Multimodal Learning

MIVC: Multiple Instance Visual Component for Visual-Language Models WACV 2024 Mixture of In-Context Experts Enhance LLMs' Long Context Awareness NeurIPS 2024 MLIP: Enhancing Medical Visual Representation with Divergence Encoder and Knowledge-guided Contrastive Learning CVPR 2024 MLLM-CompBench: A Comparative Reasoning Benchmark for Multimodal LLMs NeurIPS 2024 MLLM-Protector: Ensuring MLLM’s Safety without Hurting Performance EMNLP 2024 MMAR: Multilingual and Multimodal Anaphora Resolution in Instructional Videos EMNLP 2024 MmCows: A Multimodal Dataset for Dairy Cattle Monitoring NeurIPS 2024 MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI CVPR 2024 MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning CVPR 2024 MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts EMNLP 2024 MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance ICML 2024 MM-Point: Multi-View Information-Enhanced Multi-Modal Self-Supervised 3D Point Cloud Understanding AAAI 2024 MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI ICML 2024 MM-WLAuslan: Multi-View Multi-Modal Word-Level Australian Sign Language Recognition Dataset NeurIPS 2024 MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training CVPR 2024 MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding EMNLP 2024 MODDP: A Multi-modal Open-domain Chinese Dataset for Dialogue Discourse Parsing ACL 2024 MoExtend: Tuning New Experts for Modality and Task Extension ACL 2024 Mol2Lang-VLM: Vision- and Text-Guided Generative Pre-trained Language Models for Advancing Molecule Captioning through Multimodal Fusion ACL 2024 MolTC: Towards Molecular Relational Modeling In Language Models ACL 2024 MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models NeurIPS 2024 Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Models CVPR 2024 MOSEL: Inference Serving Using Dynamic Modality Selection EMNLP 2024 MoST: Multi-Modality Scene Tokenization for Motion Prediction CVPR 2024 Motion Deblurring via Spatial-Temporal Collaboration of Frames and Events AAAI 2024