Evaluation

VL-RouterBench: A Benchmark for Vision-Language Model Routing CVPR 2026 Why Supervised Fine-Tuning Fails to Learn: A Systematic Study of Incomplete Learning in Large Language Models ACL 2026 WiTTA-Bench: Benchmarking Test-Time Adaptation for WiFi Sensing CVPR 2026 A Comprehensive Evaluation on Event Reasoning of Large Language Models AAAI 2025 Adaptively profiling models with task elicitation EMNLP 2025 Addressing Blind Guessing: Calibration of Selection Bias in Multiple-Choice Question Answering by Video Language Models ACL 2025 A Dual-Perspective NLG Meta-Evaluation Framework with Automatic Benchmark and Better Interpretability ACL 2025 Agent-RewardBench: Towards a Unified Benchmark for Reward Modeling across Perception, Planning, and Safety in Real-World Multimodal Agents ACL 2025 AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark ACL 2025 An Analysis of Datasets, Metrics and Models in Keyphrase Generation ACL 2025 An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4 ACL 2025 A Proactive Reliability Metric for Detecting Failures in Language Model Training EMNLP 2025 ARC ‘Challenge’ Is Not That Challenging ACL 2025 Are Bias Evaluation Methods Biased ? ACL 2025 Are LLMs Better than Reported? Detecting Label Errors and Mitigating Their Effect on Model Performance EMNLP 2025 ArGAN: Arabic Gender, Ability, and Nationality Dataset for Evaluating Biases in Large Language Models ACL 2025 ArithmAttack: Evaluating Robustness of LLMs to Noisy Context in Math Problem Solving ACL 2025 A Unified Agentic Framework for Evaluating Conditional Image Generation ACL 2025 A Unifying Information-theoretic Perspective on Evaluating Generative Models AAAI 2025 BelarusianGLUE: Towards a Natural Language Understanding Benchmark for Belarusian ACL 2025 Benchmarking LLM Faithfulness in RAG with Evolving Leaderboards EMNLP 2025 Benchmarking Long-Context Language Models on Long Code Understanding ACL 2025 Beyond Hate Speech: NLP’s Challenges and Opportunities in Uncovering Dehumanizing Language EMNLP 2025 Beyond Text Compression: Evaluating Tokenizers Across Scales ACL 2025 Beyond the Surface: Measuring Self-Preference in LLM Judgments EMNLP 2025