conftrace_

multimodal evaluation

18 papers

Explore in graph

Co-occurring keywords

multimodal learning (4645) vision-language model (2348) visual question answering (1017) vision language model (767) benchmark evaluation (1556) text-to-image generation (587) benchmark dataset (635) text-image alignment (32) large language model (13587) evaluation metric (573)

Papers

Pay More Attention to Images: Numerous Images-Oriented Multimodal Summarization NAACL 2025
Guiding Vision-Language Model Selection for Visual Question-Answering Across Tasks, Domains, and Knowledge Types COLING 2025
Can Vision Language Models Understand Mimed Actions? ACL 2025
CliME: Evaluating Multimodal Climate Discourse on Social Media and the Climate Alignment Quotient (CAQ) ACL 2025
Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis CVPR 2025
Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Content CVPR 2025
IRR: Image Review Ranking Framework for Evaluating Vision-Language Models COLING 2025
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation ACL 2025
IntelliCockpitBench: A Comprehensive Benchmark to Evaluate VLMs for Intelligent Cockpit ACL 2025
SVLTA: Benchmarking Vision-Language Temporal Alignment via Synthetic Video Situation CVPR 2025
Can’t See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs ACL 2025
GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI NIPS 2024
ColorSwap: A Color and Word Order Dataset for Multimodal Evaluation ACL 2024
What You See is What You Read? Improving Text-Image Alignment Evaluation NIPS 2023
Evaluating Object Hallucination in Large Vision-Language Models EMNLP 2023
Mutual Information Divergence: A Unified Metric for Multimodal Generative Models NIPS 2022
Understanding ME? Multimodal Evaluation for Fine-grained Visual Commonsense EMNLP 2022
VIFIDEL: Evaluating the Visual Fidelity of Image Descriptions ACL 2019