multimodal learning

SonicVisionLM: Playing Sound with Vision Language Models CVPR 2024 SoundingActions: Learning How Actions Sound from Narrated Egocentric Videos CVPR 2024 Source-Free Domain Adaptation with Frozen Multimodal Foundation Model CVPR 2024 SpeechForensics: Audio-Visual Speech Representation Learning for Face Forgery Detection NeurIPS 2024 Speech ReaLLM – Real-time Speech Recognition with Multimodal Language Models by Teaching the Flow of Time Interspeech 2024 Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing? ACL 2024 Spontaneous Speech-Based Suicide Risk Detection Using Whisper and Large Language Models Interspeech 2024 SportsMetrics: Blending Text and Numerical Data to Understand Information Fusion in LLMs ACL 2024 Step Differences in Instructional Video CVPR 2024 STimage-1K4M: A histopathology image-gene expression dataset for spatial transcriptomics NeurIPS 2024 Stitching Segments and Sentences towards Generalization in Video-Text Pre-training AAAI 2024 Streaming Detection of Queried Event Start NeurIPS 2024 StreamingFlow: Streaming Occupancy Forecasting with Asynchronous Multi-modal Data Streams via Neural Ordinary Differential Equation CVPR 2024 Streaming Long Video Understanding with Large Language Models NeurIPS 2024 Structural Information Guided Multimodal Pre-training for Vehicle-Centric Perception AAAI 2024 Structure-Aware Multimodal Sequential Learning for Visual Dialog AAAI 2024 Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-Modal Structured Representations AAAI 2024 StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing ACL 2024 SURf: Teaching Large Vision-Language Models to Selectively Utilize Retrieved Information EMNLP 2024 SuteAlbastre at SemEval-2024 Task 4: Predicting Propaganda Techniques in Multilingual Memes using Joint Text and Vision Transformers SemEval 2024 Synthetic Multimodal Question Generation EMNLP 2024 T3M: Text Guided 3D Human Motion Synthesis from Speech NAACL 2024 Tables as Texts or Images: Evaluating the Table Reasoning Ability of LLMs and MLLMs ACL 2024 TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergy NeurIPS 2024 Tackling Data Bias in MUSIC-AVQA: Crafting a Balanced Dataset for Unbiased Question-Answering WACV 2024