Applications

Not (yet) the whole story: Evaluating Visual Storytelling Requires More than Measuring Coherence, Grounding, and Repetition EMNLP 2024 Object Attribute Matters in Visual Question Answering AAAI 2024 Object-Aware Adaptive-Positivity Learning for Audio-Visual Question Answering AAAI 2024 Plot Twist: Multimodal Models Don’t Comprehend Simple Chart Details EMNLP 2024 Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluation ACL 2024 Prompting vision-language fusion for Zero-Shot Composed Image Retrieval ACML 2024 Question-Instructed Visual Descriptions for Zero-Shot Video Answering ACL 2024 ReMI: A Dataset for Reasoning with Multiple Images NeurIPS 2024 Selectively Answering Visual Questions ACL 2024 SnapNTell: Enhancing Entity-Centric Visual Question Answering with Retrieval Augmented Multimodal LLM EMNLP 2024 Synthesize Step-by-Step: Tools Templates and LLMs as Data Generators for Reasoning-Based Chart VQA CVPR 2024 The Illusion of Competence: Evaluating the Effect of Explanations on Users’ Mental Models of Visual Question Answering Systems EMNLP 2024 Towards Artwork Explanation in Large-scale Vision Language Models ACL 2024 Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation Learning AAAI 2024 Towards More Faithful Natural Language Explanation Using Multi-Level Contrastive Learning in VQA AAAI 2024 Transformer-Based No-Reference Image Quality Assessment via Supervised Contrastive Learning AAAI 2024 TraveLER: A Modular Multi-LMM Agent Framework for Video Question-Answering EMNLP 2024 Unraveling the Truth: Do VLMs really Understand Charts? A Deep Dive into Consistency and Robustness EMNLP 2024 UOUO: Uncontextualized Uncommon Objects for Measuring Knowledge Horizons of Vision Language Models EMNLP 2024 Visual Text Matters: Improving Text-KVQA with Visual Text Entity Knowledge-aware Large Multimodal Assistant EMNLP 2024 VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Models AAAI 2024 ***YesBut***: A High-Quality Annotated Multimodal Dataset for evaluating Satire Comprehension capability of Vision-Language Models EMNLP 2024 Analyzing Modular Approaches for Visual Question Decomposition EMNLP 2023 An Empirical Study of Frame Selection for Text-to-Video Retrieval EMNLP 2023 A Suite of Generative Tasks for Multi-Level Multimodal Webpage Understanding EMNLP 2023