Multimodal Learning

VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Tasks NeurIPS 2024 VISTA-LLAMA: Reducing Hallucination in Video Language Models via Equal Distance to Visual Tokens CVPR 2024 VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval ACL 2024 Visual Anchors Are Strong Information Aggregators For Multimodal Large Language Model NeurIPS 2024 Visual Fact Checker: Enabling High-Fidelity Detailed Caption Generation CVPR 2024 Visual Hallucination Elevates Speech Recognition AAAI 2024 Visual Hallucinations of Multi-modal Large Language Models ACL 2024 Visually Guided Audio Source Separation With Meta Consistency Learning WACV 2024 Visual Pivoting Unsupervised Multimodal Machine Translation in Low-Resource Distant Language Pairs EMNLP 2024 Visual Prompting in LLMs for Enhancing Emotion Recognition EMNLP 2024 VIVA: A Benchmark for Vision-Grounded Decision-Making with Human Values EMNLP 2024 VIXEN: Visual Text Comparison Network for Image Difference Captioning AAAI 2024 VLFeedback: A Large-Scale AI Feedback Dataset for Large Vision-Language Models Alignment EMNLP 2024 VLG-CBM: Training Concept Bottleneck Models with Vision-Language Guidance NeurIPS 2024 Vlogger: Make Your Dream A Vlog CVPR 2024 VLP: Vision Language Planning for Autonomous Driving CVPR 2024 VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Models AAAI 2024 Web-Scale Visual Entity Recognition: An LLM-Driven Data Approach NeurIPS 2024 Well, Now We Know! Unveiling Sarcasm: Initiating and Exploring Multimodal Conversations with Reasoning AAAI 2024 What if...?: Thinking Counterfactual Keywords Helps to Mitigate Hallucination in Large Multi-modal Models EMNLP 2024 What matters when building vision-language models? NeurIPS 2024 What When and Where? Self-Supervised Spatio-Temporal Grounding in Untrimmed Multi-Action Videos from Narrated Instructions CVPR 2024 When Visual Grounding Meets Gigapixel-level Large-scale Scenes: Benchmark and Approach CVPR 2024 Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing EMNLP 2024 Whiteboard-of-Thought: Thinking Step-by-Step Across Modalities EMNLP 2024