Evaluation

BI-Bench : A Comprehensive Benchmark Dataset and Unsupervised Evaluation for BI Systems ACL 2025 BIG-Bench Extra Hard ACL 2025 Blind Men and the Elephant: Diverse Perspectives on Gender Stereotypes in Benchmark Datasets EMNLP 2025 BoN Appetit Team at LeWiDi-2025: Best-of-N Test-time Scaling Can Not Stomach Annotation Disagreements (Yet) EMNLP 2025 BOSE: A Systematic Evaluation Method Optimized for Base Models ACL 2025 Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM EMNLP 2025 BOUQuET : dataset, Benchmark and Open initiative for Universal Quality Evaluation in Translation EMNLP 2025 Bridging AI and Carbon Capture: A Dataset for LLMs in Ionic Liquids and CBE Research ACL 2025 Bridging the Gap Between Ideal and Real-world Evaluation: Benchmarking AI-Generated Image Detection in Challenging Scenarios ICCV 2025 Bridging the Gap with RedSQL: A Russian Text-to-SQL Benchmark for Domain-Specific Applications ACL 2025 Bringing Ladin to FLORES+ EMNLP 2025 Bringing Pedagogy into Focus: Evaluating Virtual Teaching Assistants’ Question-Answering in Asynchronous Learning Environments EMNLP 2025 Building Japanese Creativity Benchmarks and Applying them to Enhance LLM Creativity ACL 2025 Butterfly Effects in Toolchains: A Comprehensive Analysis of Failed Parameter Filling in LLM Tool-Agent Systems EMNLP 2025 C2LEVA: Toward Comprehensive and Contamination-Free Language Model Evaluation ACL 2025 C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversations EMNLP 2025 CA*: Addressing Evaluation Pitfalls in Computation-Aware Latency for Simultaneous Speech Translation NAACL 2025 CalibraEval: Calibrating Prediction Distribution to Mitigate Selection Bias in LLMs-as-Judges ACL 2025 Calibrating LLM Confidence by Probing Perturbed Representation Stability EMNLP 2025 CaLQuest.PT: Towards the Collection and Evaluation of Natural Causal Ladder Questions in Portuguese for AI Agents COLING 2025 Can AI Make Us Laugh? Comparing Jokes Generated by Witscript and a Human Expert COLING 2025 Can External Validation Tools Improve Annotation Quality for LLM-as-a-Judge? ACL 2025 Can Language Models Replace Programmers for Coding? REPOCOD Says ‘Not Yet’ ACL 2025 Can Large Language Models Outperform Non-Experts in Poetry Evaluation? A Comparative Study Using the Consensual Assessment Technique EMNLP 2025 Can Large Language Models Unlock Novel Scientific Research Ideas? EMNLP 2025