evaluation methodology

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It EACL 2026 Is This LLM Library Learning? Evaluation Must Account For Compute and Behaviour EACL 2026 Lessons from the Field: An Adaptable Lifecycle Approach to Applied Dialogue Summarization EACL 2026 Optimizing Retrieval-Augmented Generation for E-Commerce How-To Assistance ACL 2026 An Interdisciplinary Approach to Human-Centered Machine Translation EMNLP 2025 ARC ‘Challenge’ Is Not That Challenging ACL 2025 Are Your Keywords Like My Queries? A Corpus-Wide Evaluation of Keyword Extractors with Real Searches COLING 2025 Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs EMNLP 2025 Evaluating the Evaluation of Diversity in Commonsense Generation ACL 2025 Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMs EMNLP 2025 From Feedback to Checklists: Grounded Evaluation of AI-Generated Clinical Notes EMNLP 2025 Measuring Bias or Measuring the Task: Understanding the Brittle Nature of LLM Gender Biases EMNLP 2025 Practical Solutions to Practical Problems in Developing Argument Mining Systems ACL 2025 Redundancy Principles for MLLMs Benchmarks ACL 2025 ReproHum #0669-08: Reproducing Sentiment Transfer Evaluation ACL 2025 Right Answer, Wrong Score: Uncovering the Inconsistencies of LLM Evaluation in Multiple-Choice Question Answering ACL 2025 SPHERE: An Evaluation Card for Human-AI Systems ACL 2025 Stop Playing the Guessing Game! Evaluating Conversational Recommender Systems via Target-free User Simulation EMNLP 2025 T5Score: A Methodology for Automatically Assessing the Quality of LLM Generated Multi-Document Topic Sets ACL 2025 The Progress Illusion: Revisiting meta-evaluation standards of LLM evaluators EMNLP 2025 Towards a Principled Evaluation of Knowledge Editors ACL 2025 Using LLM Judgements for Sanity Checking Results and Reproducibility of Human Evaluations in NLP ACL 2025 Where is this coming from? Making groundedness count in the evaluation of Document VQA models NAACL 2025 Accurate and Nuanced Open-QA Evaluation Through Textual Entailment ACL 2024 A linguistically-motivated evaluation methodology for unraveling model’s abilities in reading comprehension tasks EMNLP 2024