Applications

DeVAn: Dense Video Annotation for Video-Language Models ACL 2024 DIEM: Decomposition-Integration Enhancing Multimodal Insights CVPR 2024 EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answering AAAI 2024 ECIS-VQG: Generation of Entity-centric Information-seeking Questions from Videos EMNLP 2024 ERVQA: A Dataset to Benchmark the Readiness of Large Vision Language Models in Hospital Environments EMNLP 2024 Exploiting the Social-Like Prior in Transformer for Visual Reasoning AAAI 2024 Exploring Question Guidance and Answer Calibration for Visually Grounded Video Question Answering EMNLP 2024 FineCops-Ref: A new Dataset and Task for Fine-Grained Compositional Referring Expression Comprehension EMNLP 2024 FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culture EMNLP 2024 From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesis EMNLP 2024 GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation CVPR 2024 GRAM: Global Reasoning for Multi-Page VQA CVPR 2024 II-MMR: Identifying and Improving Multi-modal Multi-hop Reasoning in Visual Question Answering ACL 2024 Improving Automatic VQA Evaluation Using Large Language Models AAAI 2024 JDocQA: Japanese Document Question Answering Dataset for Generative Language Models COLING 2024 JourneyBench: A Challenging One-Stop Vision-Language Understanding Benchmark of Generated Images NeurIPS 2024 Large Language Models Know What is Key Visual Entity: An LLM-assisted Multimodal Retrieval for VQA EMNLP 2024 Learning Musical Representations for Music Performance Question Answering EMNLP 2024 Mask4Align: Aligned Entity Prompting with Color Masks for Multi-Entity Localization Problems CVPR 2024 MiKASA: Multi-Key-Anchor & Scene-Aware Transformer for 3D Visual Grounding CVPR 2024 MISTI: Metadata-Informed Scientific Text and Image Representation through Contrastive Learning ACL 2024 MLeVLM: Improve Multi-level Progressive Capabilities based on Multimodal Large Language Model for Medical Visual Question Answering ACL 2024 MMScan: A Multi-Modal 3D Scene Dataset with Hierarchical Grounded Language Annotations NeurIPS 2024 Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Models CVPR 2024 Multi-Level Information Retrieval Augmented Generation for Knowledge-based Visual Question Answering EMNLP 2024