conftrace_

evaluation methodology

109 papers

Explore in graph

Co-occurring keywords

benchmark evaluation (1556) large language model (13587) human evaluation (379) machine translation (2499) natural language processing (2034) model evaluation (445) evaluation metric (573) machine learning (436) benchmark dataset (635) evaluation benchmark (257)

Papers

Optimizing Retrieval-Augmented Generation for E-Commerce How-To Assistance ACL 2026
Is This LLM Library Learning? Evaluation Must Account For Compute and Behaviour EACL 2026
Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It EACL 2026
Lessons from the Field: An Adaptable Lifecycle Approach to Applied Dialogue Summarization EACL 2026
Measuring Bias or Measuring the Task: Understanding the Brittle Nature of LLM Gender Biases EMNLP 2025
SPHERE: An Evaluation Card for Human-AI Systems ACL 2025
Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs EMNLP 2025
Where is this coming from? Making groundedness count in the evaluation of Document VQA models NAACL 2025
Towards a Principled Evaluation of Knowledge Editors ACL 2025
Redundancy Principles for MLLMs Benchmarks ACL 2025
ReproHum #0669-08: Reproducing Sentiment Transfer Evaluation ACL 2025
T5Score: A Methodology for Automatically Assessing the Quality of LLM Generated Multi-Document Topic Sets ACL 2025
The Progress Illusion: Revisiting meta-evaluation standards of LLM evaluators EMNLP 2025
Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMs EMNLP 2025
Practical Solutions to Practical Problems in Developing Argument Mining Systems ACL 2025
An Interdisciplinary Approach to Human-Centered Machine Translation EMNLP 2025
Right Answer, Wrong Score: Uncovering the Inconsistencies of LLM Evaluation in Multiple-Choice Question Answering ACL 2025
From Feedback to Checklists: Grounded Evaluation of AI-Generated Clinical Notes EMNLP 2025
Task-Aware Evaluation and Error-Overlap Analysis for Large Language Models IJCNLP 2025
ARC ‘Challenge’ Is Not That Challenging ACL 2025
Evaluating the Evaluation of Diversity in Commonsense Generation ACL 2025
Are Your Keywords Like My Queries? A Corpus-Wide Evaluation of Keyword Extractors with Real Searches COLING 2025
Stop Playing the Guessing Game! Evaluating Conversational Recommender Systems via Target-free User Simulation EMNLP 2025
Using LLM Judgements for Sanity Checking Results and Reproducibility of Human Evaluations in NLP ACL 2025
Evaluation and Continual Improvement for an Enterprise AI Assistant NAACL 2024