Vision-Language Models

Learning Hierarchical Prompt with Structured Linguistic Knowledge for Vision-Language Models AAAI 2024 Learning Multi-Dimensional Human Preference for Text-to-Image Generation CVPR 2024 Learning to Learn Better Visual Prompts AAAI 2024 LEGENT: Open Platform for Embodied Agents ACL 2024 Leveraging Cross-Modal Neighbor Representation for Improved CLIP Classification CVPR 2024 LG-CAV: Train Any Concept Activation Vector with Language Guidance NeurIPS 2024 LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge CVPR 2024 LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding Reasoning and Planning CVPR 2024 Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Models NeurIPS 2024 M5 – A Diverse Benchmark to Assess the Performance of Large Multimodal Models Across Multilingual and Multicultural Vision-Language Tasks EMNLP 2024 MAFA: Managing False Negatives for Vision-Language Pre-training CVPR 2024 Magnet: We Never Know How Text-to-Image Diffusion Models Work, Until We Learn How Vision-Language Models Function NeurIPS 2024 Making Visual Sense of Oracle Bones for You and Me CVPR 2024 MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding CVPR 2024 MARVEL: Multidimensional Abstraction and Reasoning through Visual Evaluation and Learning NeurIPS 2024 Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset NeurIPS 2024 MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classification EMNLP 2024 Micro-Bench: A Microscopy Benchmark for Vision-Language Understanding NeurIPS 2024 MIKE: A New Benchmark for Fine-grained Multimodal Entity Knowledge Editing ACL 2024 MLeVLM: Improve Multi-level Progressive Capabilities based on Multimodal Large Language Model for Medical Visual Question Answering ACL 2024 MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understanding NeurIPS 2024 MM-ChatAlign: A Novel Multimodal Reasoning Framework based on Large Language Models for Entity Alignment EMNLP 2024 MM-SOC: Benchmarking Multimodal Large Language Models in Social Media Platforms ACL 2024 MMVQA: A Comprehensive Dataset for Investigating Multipage Multimodal Information Retrieval in PDF-based Visual Question Answering IJCAI 2024 MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding EMNLP 2024