Multimodal Learning

ViT-Lens: Towards Omni-modal Representations CVPR 2024 Vitron: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing NeurIPS 2024 VIVA: A Benchmark for Vision-Grounded Decision-Making with Human Values EMNLP 2024 VIXEN: Visual Text Comparison Network for Image Difference Captioning AAAI 2024 VLCounter: Text-Aware Visual Representation for Zero-Shot Object Counting AAAI 2024 VLFeedback: A Large-Scale AI Feedback Dataset for Large Vision-Language Models Alignment EMNLP 2024 VLG-CBM: Training Concept Bottleneck Models with Vision-Language Guidance NeurIPS 2024 VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark NeurIPS 2024 VLM4Bio: A Benchmark Dataset to Evaluate Pretrained Vision-Language Models for Trait Discovery from Biological Images NeurIPS 2024 VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought NeurIPS 2024 VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Grounding CoRL 2024 VLMimic: Vision Language Models are Visual Imitation Learner for Fine-grained Actions NeurIPS 2024 VLN-Video: Utilizing Driving Videos for Outdoor Vision-and-Language Navigation AAAI 2024 VLP: Vision Language Planning for Autonomous Driving CVPR 2024 VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models CVPR 2024 Vocal Call Locator Benchmark (VCL) for localizing rodent vocalizations from multi-channel audio NeurIPS 2024 VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wild ACL 2024 Voice Disorder Analysis: a Transformer-based Approach Interspeech 2024 Voila-A: Aligning Vision-Language Models with User's Gaze Attention NeurIPS 2024 Volcano: Mitigating Multimodal Hallucination through Self-Feedback Guided Revision NAACL 2024 VOLTA: Improving Generative Diversity by Variational Mutual Information Maximizing Autoencoder NAACL 2024 Volumetric Environment Representation for Vision-Language Navigation CVPR 2024 Voxel Proposal Network via Multi-Frame Knowledge Distillation for Semantic Scene Completion NeurIPS 2024 VPL: Visual Proxy Learning Framework for Zero-Shot Medical Image Diagnosis EMNLP 2024 VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Models AAAI 2024