Multimodal Learning

MetaSumPerceiver: Multimodal Multi-Document Evidence Summarization for Fact-Checking ACL 2024 Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models NeurIPS 2024 Methods of Automatic Matrix Language Determination for Code-Switched Speech EMNLP 2024 MEVTR: A Multilingual Model Enhanced with Visual Text Representations COLING 2024 MFDR: Multiple-stage Fusion and Dynamically Refined Network for Multimodal Emotion Recognition Interspeech 2024 MFF-EINV2: Multi-scale Feature Fusion across Spectral-Spatial-Temporal Domains for Sound Event Localization and Detection Interspeech 2024 MIBench: Evaluating Multimodal Large Language Models over Multiple Images EMNLP 2024 MICA: Towards Explainable Skin Lesion Diagnosis via Multi-Level Image-Concept Alignment AAAI 2024 Micro-Bench: A Microscopy Benchmark for Vision-Language Understanding NeurIPS 2024 MicroCinema: A Divide-and-Conquer Approach for Text-to-Video Generation CVPR 2024 MiKASA: Multi-Key-Anchor & Scene-Aware Transformer for 3D Visual Grounding CVPR 2024 MIKE: A New Benchmark for Fine-grained Multimodal Entity Knowledge Editing ACL 2024 MindBridge: A Cross-Subject Brain Decoding Framework CVPR 2024 MindMerger: Efficiently Boosting LLM Reasoning in non-English Languages NeurIPS 2024 MIND: Multimodal Shopping Intention Distillation from Large Vision-language Models for E-commerce Purchase Understanding EMNLP 2024 Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models NeurIPS 2024 MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models ICLR 2024 Mining Fine-Grained Image-Text Alignment for Zero-Shot Captioning via Text-Only Training AAAI 2024 MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens NeurIPS 2024 MIntRec2.0: A Large-scale Benchmark Dataset for Multimodal Intent Recognition and Out-of-scope Detection in Conversations ICLR 2024 MIPS at SemEval-2024 Task 3: Multimodal Emotion-Cause Pair Extraction in Conversations with Multimodal Language Models SemEval 2024 MiRAGeNews: Multimodal Realistic AI-Generated News Detection EMNLP 2024 Mirasol3B: A Multimodal Autoregressive Model for Time-Aligned and Contextual Modalities CVPR 2024 Missing Modality Prediction for Unpaired Multimodal Learning via Joint Embedding of Unimodal Models ECCV 2024 Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning ICLR 2024