Multimodal Learning

What If the TV Was Off? Examining Counterfactual Reasoning Abilities of Multi-modal Language Models CVPR 2024 What if...?: Thinking Counterfactual Keywords Helps to Mitigate Hallucination in Large Multi-modal Models EMNLP 2024 What Makes Good Collaborative Views? Contrastive Mutual Information Maximization for Multi-Agent Perception AAAI 2024 What Matters in Training a GPT4-Style Language Model with Multimodal Inputs? NAACL 2024 What matters when building vision-language models? NeurIPS 2024 What to Say and When to Say it: Live Fitness Coaching as a Testbed for Situated Interaction NeurIPS 2024 What When and Where? Self-Supervised Spatio-Temporal Grounding in Untrimmed Multi-Action Videos from Narrated Instructions CVPR 2024 When LLMs Meets Acoustic Landmarks: An Efficient Approach to Integrate Speech into Large Language Models for Depression Detection EMNLP 2024 When Visual Grounding Meets Gigapixel-level Large-scale Scenes: Benchmark and Approach CVPR 2024 Where Do We Go From Here? Multi-scale Allocentric Relational Inferencefrom Natural Spatial Descriptions EACL 2024 Where Elegance Meets Precision: Towards a Compact, Automatic, and Flexible Framework for Multi-modality Image Fusion and Applications IJCAI 2024 Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing EMNLP 2024 Which Modality should I use - Text, Motif, or Image? : Understanding Graphs with Large Language Models NAACL 2024 Which One? Leveraging Context Between Objects and Multiple Views for Language Grounding NAACL 2024 Whiteboard-of-Thought: Thinking Step-by-Step Across Modalities EMNLP 2024 WhodunitBench: Evaluating Large Multimodal Agents via Murder Mystery Games NeurIPS 2024 Who Evaluates the Evaluations? Objectively Scoring Text-to-Image Prompt Coherence Metrics with T2IScoreScore (TS2) NeurIPS 2024 Who Responded to Whom: The Joint Effects of Latent Topics and Discourse in Conversation Structure ACL 2024 Why are Visually-Grounded Language Models Bad at Image Classification? NeurIPS 2024 Why do LLaVA Vision-Language Models Reply to Images in English? EMNLP 2024 WikiDO: A New Benchmark Evaluating Cross-Modal Retrieval for Vision-Language Models NeurIPS 2024 WikiScenes with Descriptions: Aligning Paragraphs and Sentences with Images in Wikipedia Articles NAACL 2024 WildPPG: A Real-World PPG Dataset of Long Continuous Recordings NeurIPS 2024 WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences NeurIPS 2024 Wings: Learning Multimodal LLMs without Text-only Forgetting NeurIPS 2024