benchmark evaluation

TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages ACL 2025 TurnBack: A Geospatial Route Cognition Benchmark for Large Language Models through Reverse Route EMNLP 2025 TurnBench-MS: A Benchmark for Evaluating Multi-Turn, Multi-Step Reasoning in Large Language Models EMNLP 2025 Turning the Tide: Repository-based Code Reflection EMNLP 2025 Two Steps from Hell: Compositionality on Chemical LMs EMNLP 2025 UBench: Benchmarking Uncertainty in Large Language Models with Multiple Choice Questions ACL 2025 UCFE: A User-Centric Financial Expertise Benchmark for Large Language Models NAACL 2025 UGMathBench: A Diverse and Dynamic Benchmark for Undergraduate-Level Mathematical Reasoning with Large Language Models ICLR 2025 ULTRABENCH: Benchmarking LLMs under Extreme Fine-grained Text Generation EMNLP 2025 U-MATH: A University-Level Benchmark for Evaluating Mathematical Skills in Large Language Models ACL 2025 UNCLE: Benchmarking Uncertainty Expressions in Long-Form Generation EMNLP 2025 Understanding LLM Development Through Longitudinal Study: Insights from the Open Ko-LLM Leaderboard NAACL 2025 Unmasking Deceptive Visuals: Benchmarking Multimodal Large Language Models on Misleading Chart Question Answering EMNLP 2025 Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models ACL 2025 Unveiling Cultural Blind Spots: Analyzing the Limitations of mLLMs in Procedural Text Comprehension ACL 2025 Unveiling the Ignorance of MLLMs: Seeing Clearly, Answering Incorrectly CVPR 2025 Unveiling the Lack of LVLM Robustness to Fundamental Visual Variations: Why and Path Forward ACL 2025 Unveiling the Mist over 3D Vision-Language Understanding: Object-centric Evaluation with Chain-of-Analysis CVPR 2025 UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spaces ACL 2025 UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarios AAAI 2025 URO-Bench: Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models EMNLP 2025 UTBoost: Rigorous Evaluation of Coding Agents on SWE-Bench ACL 2025 Validate Your Authority: Benchmarking LLMs on Multi-Label Precedent Treatment Classification EMNLP 2025 Value Portrait: Assessing Language Models’ Values through Psychometrically and Ecologically Valid Items ACL 2025 VANE-Bench: Video Anomaly Evaluation Benchmark for Conversational LMMs NAACL 2025