Multimodal Learning

LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding Reasoning and Planning CVPR 2024 LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction CVPR 2024 LLMs are Good Sign Language Translators CVPR 2024 LLMs Can Evolve Continually on Modality for X-Modal Reasoning NeurIPS 2024 L+M-24: Building a Dataset for Language+Molecules @ ACL 2024 ACL 2024 Local-Global Multi-Modal Distillation for Weakly-Supervised Temporal Video Grounding AAAI 2024 Localize, Understand, Collaborate: Semantic-Aware Dragging via Intention Reasoner NeurIPS 2024 Locating What You Need: Towards Adapting Diffusion Models to OOD Concepts In-the-Wild NeurIPS 2024 LoCoNet: Long-Short Context Network for Active Speaker Detection CVPR 2024 Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts EMNLP 2024 LoTLIP: Improving Language-Image Pre-training for Long Text Understanding NeurIPS 2024 LQMFormer: Language-aware Query Mask Transformer for Referring Image Segmentation CVPR 2024 Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Models NeurIPS 2024 M2Doc: A Multi-Modal Fusion Approach for Document Layout Analysis AAAI 2024 M2SA: Multimodal and Multilingual Model for Sentiment Analysis of Tweets COLING 2024 M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought ACL 2024 M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation ACL 2024 m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt COLING 2024 MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions ICML 2024 Magic Tokens: Select Diverse Tokens for Multi-modal Object Re-Identification CVPR 2024 Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners ACL 2024 Make Pixels Dance: High-Dynamic Video Generation CVPR 2024 Make Prompts Adaptable: Bayesian Modeling for Vision-Language Prompt Learning with Data-Dependent Prior AAAI 2024 MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding CVPR 2024 ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation CVPR 2024