multimodal model

Explaining CLIP's Performance Disparities on Data from Blind/Low Vision Users CVPR 2024 FigCLIP: A Generative Multimodal Model with Bidirectional Cross-attention for Understanding Figurative Language via Visual Entailment NAACL 2024 Generative Multimodal Models are In-Context Learners CVPR 2024 GeoEval: Benchmark for Evaluating LLMs and Multi-Modal Models on Geometry Problem-Solving ACL 2024 GLaMM: Pixel Grounding Large Multimodal Model CVPR 2024 GPT-4V(ision) is a Generalist Web Agent, if Grounded ICML 2024 Hallo3D: Multi-Modal Hallucination Detection and Mitigation for Consistent 3D Content Generation NeurIPS 2024 How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models EMNLP 2024 INQUIRE: A Natural World Text-to-Image Retrieval Benchmark NeurIPS 2024 Instruction-Guided Visual Masking NeurIPS 2024 Interpretable Measures of Conceptual Similarity by Complexity-Constrained Descriptive Auto-Encoding CVPR 2024 Investigating the Role of Instruction Variety and Task Difficulty in Robotic Manipulation Tasks EMNLP 2024 LLark: A Multimodal Instruction-Following Language Model for Music ICML 2024 Masking Latent Gender Knowledge for Debiasing Image Captioning NAACL 2024 Mixture-of-Subspaces in Low-Rank Adaptation EMNLP 2024 MMCert: Provable Defense against Adversarial Attacks to Multi-modal Models CVPR 2024 MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities ICML 2024 MOSEL: Inference Serving Using Dynamic Modality Selection EMNLP 2024 No "Zero-Shot" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance NeurIPS 2024 OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI NeurIPS 2024 OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLM CVPR 2024 Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts CVPR 2024 Plot Twist: Multimodal Models Don’t Comprehend Simple Chart Details EMNLP 2024 Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videos CVPR 2024 RILA: Reflective and Imaginative Language Agent for Zero-Shot Semantic Audio-Visual Navigation CVPR 2024