Multimodal Learning

Vision-Language Pre-training with Object Contrastive Learning for 3D Scene Understanding AAAI 2024 VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Tasks NeurIPS 2024 Vision Mamba Mender NeurIPS 2024 VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval ACL 2024 Visual Fourier Prompt Tuning NeurIPS 2024 Visual Hallucination Elevates Speech Recognition AAAI 2024 Visual Language – Let the Product Say What You Want AAAI 2024 VLG-CBM: Training Concept Bottleneck Models with Vision-Language Guidance NeurIPS 2024 VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding NeurIPS 2024 VTQA: Visual Text Question Answering via Entity Alignment and Cross-Media Reasoning CVPR 2024 WATT: Weight Average Test Time Adaptation of CLIP NeurIPS 2024 What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights NeurIPS 2024 What matters when building vision-language models? NeurIPS 2024 What to Say and When to Say it: Live Fitness Coaching as a Testbed for Situated Interaction NeurIPS 2024 Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing EMNLP 2024 WhodunitBench: Evaluating Large Multimodal Agents via Murder Mystery Games NeurIPS 2024 WikiScenes with Descriptions: Aligning Paragraphs and Sentences with Images in Wikipedia Articles NAACL 2024 Words Worth a Thousand Pictures: Measuring and Understanding Perceptual Variability in Text-to-Image Generation EMNLP 2024 World to Code: Multi-modal Data Generation via Self-Instructed Compositional Captioning and Filtering EMNLP 2024 XKD: Cross-Modal Knowledge Distillation with Domain Alignment for Video Representation Learning AAAI 2024 XMask3D: Cross-modal Mask Reasoning for Open Vocabulary 3D Semantic Segmentation NeurIPS 2024 Zero-shot Referring Expression Comprehension via Structural Similarity Between Images and Captions CVPR 2024 Actional Atomic-Concept Learning for Demystifying Vision-Language Navigation AAAI 2023 Affection: Learning Affective Explanations for Real-World Visual Data CVPR 2023 Aligning Step-by-Step Instructional Diagrams to Video Demonstrations CVPR 2023