benchmark evaluation

VariantBench: A Framework for Evaluating LLMs on Justifications for Genetic Variant Interpretation IJCNLP 2025 VC4VG: Optimizing Video Captions for Text-to-Video Generation EMNLP 2025 VidCapBench: A Comprehensive Benchmark of Video Captioning for Controllable Text-to-Video Generation ACL 2025 VidComposition: Can MLLMs Analyze Compositions in Compiled Videos? CVPR 2025 VideoAutoArena: An Automated Arena for Evaluating Large Multimodal Models in Video Analysis through User Simulation CVPR 2025 Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis CVPR 2025 VideoVista-CulturalLingo: 360° Horizons-Bridging Cultures, Languages, and Domains in Video Comprehension ACL 2025 VisEscape: A Benchmark for Evaluating Exploration-driven Decision-making in Virtual Escape Rooms EMNLP 2025 VisFinEval: A Scenario-Driven Chinese Multimodal Benchmark for Holistic Financial Understanding EMNLP 2025 Vision-Language Models Struggle to Align Entities across Modalities ACL 2025 VisNumBench: Evaluating Number Sense of Multimodal Large Language Models ICCV 2025 Visual Robustness Benchmark for Visual Question Answering (VQA) WACV 2025 VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning ICLR 2025 VLind-Bench: Measuring Language Priors in Large Vision-Language Models NAACL 2025 VLM2-Bench: A Closer Look at How Well VLMs Implicitly Link Explicit Matching Visual Cues ACL 2025 VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Models CVPR 2025 VLRMBench: A Comprehensive and Challenging Benchmark for Vision-Language Reward Models ICCV 2025 VLSBench: Unveiling Visual Leakage in Multimodal Safety ACL 2025 VMLU Benchmarks: A comprehensive benchmark toolkit for Vietnamese LLMs ACL 2025 Voice of a Continent: Mapping Africa’s Speech Technology Frontier EMNLP 2025 VOILA: Evaluation of MLLMs For Perceptual Understanding and Analogical Reasoning ICLR 2025 VoxEval: Benchmarking the Knowledge Understanding Capabilities of End-to-End Spoken Language Models ACL 2025 VSCBench: Bridging the Gap in Vision-Language Model Safety Calibration ACL 2025 VSP: Diagnosing the Dual Challenges of Perception and Reasoning in Spatial Planning Tasks for MLLMs ICCV 2025 Waste-Bench: A Comprehensive Benchmark for Evaluating VLLMs in Cluttered Environments EMNLP 2025