Evaluation

Investigating Value-Reasoning Reliability in Small Large Language Models EMNLP 2025 Is my Meeting Summary Good? Estimating Quality with a Multi-LLM Evaluator COLING 2025 Is your benchmark truly adversarial? AdvScore: Evaluating Human-Grounded Adversarialness NAACL 2025 ITALIC: An Italian Culture-Aware Natural Language Benchmark NAACL 2025 Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models ACL 2025 Judging It, Washing It: Scoring and Greenwashing Corporate Climate Disclosures using Large Language Models ACL 2025 Judging the Judges: Can Large Vision-Language Models Fairly Evaluate Chart Comprehension and Reasoning? ACL 2025 Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges ACL 2025 JuStRank: Benchmarking LLM Judges for System Ranking ACL 2025 KazBench-KK: A Cultural-Knowledge Benchmark for Kazakh ACL 2025 Keep Guessing? When Considering Inference Scaling, Mind the Baselines NAACL 2025 K-NLPers at BEA 2025 Shared Task: Evaluating the Quality of AI Tutor Responses with GPT-4.1 ACL 2025 Knockout LLM Assessment: Using Large Language Models for Evaluations through Iterative Pairwise Comparisons ACL 2025 Know Your RAG: Dataset Taxonomy and Generation Strategies for Evaluating RAG Systems COLING 2025 KRETA: A Benchmark for Korean Reading and Reasoning in Text-Rich VQA Attuned to Diverse Visual Contexts EMNLP 2025 K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferences CVPR 2025 Label Convergence: Defining an Upper Performance Bound in Object Recognition through Contradictory Annotations WACV 2025 LADDER: Language-Driven Slice Discovery and Error Rectification in Vision Classifiers ACL 2025 Language Model Probabilities are Not Calibrated in Numeric Contexts ACL 2025 Large Language Models Badly Generalize across Option Length, Problem Types, and Irrelevant Noun Replacements EMNLP 2025 LastingBench: Defend Benchmarks Against Knowledge Leakage EMNLP 2025 Lessons Learned from the URGENT 2024 Speech Enhancement Challenge Interspeech 2025 Lessons Learned in Assessing Student Reflections with LLMs ACL 2025 Let Them Down Easy! Contextual Effects of LLM Guardrails on User Perceptions and Preferences EMNLP 2025 LIFBench: Evaluating the Instruction Following Performance and Stability of Large Language Models in Long-Context Scenarios ACL 2025