Multimodal Learning

MTMMC: A Large-Scale Real-World Multi-Modal Camera Tracking Benchmark CVPR 2024 Muffin or Chihuahua? Challenging Multimodal Large Language Models with Multipanel VQA ACL 2024 Multi-Level Information Retrieval Augmented Generation for Knowledge-based Visual Question Answering EMNLP 2024 Multilingual Diversity Improves Vision-Language Representations NeurIPS 2024 Multimodal Event Causality Reasoning with Scene Graph Enhanced Interaction Network AAAI 2024 Multi-Modal Gaze Following in Conversational Scenarios WACV 2024 Multimodal Industrial Anomaly Detection by Crossmodal Feature Mapping CVPR 2024 Multi-Object Hallucination in Vision Language Models NeurIPS 2024 Multiple Knowledge-Enhanced Interactive Graph Network for Multimodal Conversational Emotion Recognition EMNLP 2024 Multi-view Masked Contrastive Representation Learning for Endoscopic Video Analysis NeurIPS 2024 MuseChat: A Conversational Music Recommendation System for Videos CVPR 2024 MVP-Bench: Can Large Vision-Language Models Conduct Multi-level Visual Perception Like Humans? EMNLP 2024 Naming, Describing, and Quantifying Visual Objects in Humans and LLMs ACL 2024 Nearest Neighbor Normalization Improves Multimodal Retrieval EMNLP 2024 Needle In A Multimodal Haystack NeurIPS 2024 NeuMA: Neural Material Adaptor for Visual Grounding of Intrinsic Dynamics NeurIPS 2024 NLPNCHU at SemEval-2024 Task 4: A Comparison of MDHC Strategy and In-domain Pre-training for Multilingual Detection of Persuasion Techniques in Memes SemEval 2024 No Head Left Behind – Multi-Head Alignment Distillation for Transformers AAAI 2024 No "Zero-Shot" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance NeurIPS 2024 OmAgent: A Multi-modal Agent Framework for Complex Video Understanding with Task Divide-and-Conquer EMNLP 2024 OneRef: Unified One-tower Expression Grounding and Segmentation with Mask Referring Modeling NeurIPS 2024 On the Robustness of Large Multimodal Models Against Image Adversarial Attacks CVPR 2024 Open-Vocabulary Segmentation with Semantic-Assisted Calibration CVPR 2024 Open Vocabulary Semantic Scene Sketch Understanding CVPR 2024 Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers CVPR 2024