Multimodal Learning

MARVEL: Unlocking the Multi-Modal Capability of Dense Retrieval via Visual Module Plugin ACL 2024 Mask Grounding for Referring Image Segmentation CVPR 2024 MasonTigers@LT-EDI-2024: An Ensemble Approach Towards Detecting Homophobia and Transphobia in Social Media Comments EACL 2024 Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs ICML 2024 Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models EMNLP 2024 Matrix Information Theory for Self-Supervised Learning ICML 2024 MCIL: Multimodal Counterfactual Instance Learning for Low-resource Entity-based Multimodal Information Extraction COLING 2024 MEANT: Multimodal Encoder for Antecedent Information EMNLP 2024 Medical Vision-Language Pre-Training for Brain Abnormalities COLING 2024 MedM2G: Unifying Medical Multi-Modal Generation via Cross-Guided Diffusion with Visual Invariant CVPR 2024 MeLFusion: Synthesizing Music from Image and Language Cues using Diffusion Models CVPR 2024 MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencing ACL 2024 MERLIN: Multimodal Embedding Refinement via LLM-based Iterative Navigation for Text-Video Retrieval-Rerank Pipeline EMNLP 2024 MESED: A Multi-Modal Entity Set Expansion Dataset with Fine-Grained Semantic Classes and Hard Negative Entities AAAI 2024 Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models NeurIPS 2024 MGMap: Mask-Guided Learning for Online Vectorized HD Map Construction CVPR 2024 MIBench: Evaluating Multimodal Large Language Models over Multiple Images EMNLP 2024 MIND: Multimodal Shopping Intention Distillation from Large Vision-language Models for E-commerce Purchase Understanding EMNLP 2024 MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens NeurIPS 2024 Mirasol3B: A Multimodal Autoregressive Model for Time-Aligned and Contextual Modalities CVPR 2024 Missing Modality Prediction for Unpaired Multimodal Learning via Joint Embedding of Unimodal Models ECCV 2024 Mitigating Hallucinations in Large Vision-Language Models (LVLMs) via Language-Contrastive Decoding (LCD) ACL 2024 Mitigating Idiom Inconsistency: A Multi-Semantic Contrastive Learning Method for Chinese Idiom Reading Comprehension AAAI 2024 Mitigating Noisy Correspondence by Geometrical Structure Consistency Learning CVPR 2024 MiTTenS: A Dataset for Evaluating Gender Mistranslation EMNLP 2024