Multimodal Learning

MM-ChatAlign: A Novel Multimodal Reasoning Framework based on Large Language Models for Entity Alignment EMNLP 2024 MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problems EMNLP 2024 MmCows: A Multimodal Dataset for Dairy Cattle Monitoring NeurIPS 2024 MMDU: A Multi-Turn Multi-Image Dialog Understanding Benchmark and Instruction-Tuning Dataset for LVLMs NeurIPS 2024 MMedAgent: Learning to Use Medical Tools with Multi-modal Agent EMNLP 2024 MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning ICLR 2024 MM-IGLU: Multi-Modal Interactive Grounded Language Understanding COLING 2024 MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting Interspeech 2024 MM-LLMs: Recent Advances in MultiModal Large Language Models ACL 2024 MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations NeurIPS 2024 MM-MATH: Advancing Multimodal Math Evaluation with Process Evaluation and Fine-grained Classification EMNLP 2024 MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI CVPR 2024 MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning CVPR 2024 MMNeuron: Discovering Neuron-Level Domain-Specific Interpretation in Multimodal Large Language Model EMNLP 2024 MM-NodeFormer: Node Transformer Multimodal Fusion for Emotion Recognition in Conversation Interspeech 2024 MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts EMNLP 2024 MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance ICML 2024 MM-Point: Multi-View Information-Enhanced Multi-Modal Self-Supervised 3D Point Cloud Understanding AAAI 2024 MM-SAP: A Comprehensive Benchmark for Assessing Self-Awareness of Multimodal Large Language Models in Perception ACL 2024 MMScan: A Multi-Modal 3D Scene Dataset with Hierarchical Grounded Language Annotations NeurIPS 2024 MM-SOC: Benchmarking Multimodal Large Language Models in Social Media Platforms ACL 2024 MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI ICML 2024 MMToM-QA: Multimodal Theory of Mind Question Answering ACL 2024 MM-TTS: Multi-Modal Prompt Based Style Transfer for Expressive Text-to-Speech Synthesis AAAI 2024 MMUTF: Multimodal Multimedia Event Argument Extraction with Unified Template Filling EMNLP 2024