automated evaluation

A Functionality-Grounded Benchmark for Evaluating Web Agents in E-commerce Domains ACL 2026 Assessing Automated Fact-Checking for Medical LLM Responses with Knowledge Graphs AAAI 2026 Automated Creativity Evaluation of Language Models Across Open-Ended Tasks ACL 2026 AutoTaskEval: Towards Domain-Specific and Fine-Grained Evaluation for LLMs ACL 2026 DR-Arena: an Automated Evaluation Framework for Deep Research Agents ACL 2026 HypoEval: Hypothesis-Guided Evaluation for Natural Language Generation ACL 2026 Korean Canonical Legal Benchmark: Toward Knowledge-Independent Evaluation of LLMs’ Legal Reasoning Capabilities EACL 2026 Label Effects: Shared Heuristic Reliance in Trust Assessment by Humans and LLM-as-a-Judge ACL 2026 LLM-Powered Benchmark Factory: Reliable, Generic, and Efficient ACL 2026 Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluation ACL 2026 RAFFLES: Reasoning-based Attribution of Faults for LLM Systems EACL 2026 AbGen: Evaluating Large Language Models in Ablation Study Design and Evaluation for Scientific Research ACL 2025 AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark ACL 2025 A Measure of the System Dependence of Automated Metrics ACL 2025 A Survey on Automated Distractor Evaluation in Multiple-Choice Tasks ACL 2025 AutoEval-ToD: Automated Evaluation of Task-oriented Dialog Systems NAACL 2025 BI-Bench : A Comprehensive Benchmark Dataset and Unsupervised Evaluation for BI Systems ACL 2025 Can LLMs Generate and Solve Linguistic Olympiad Puzzles? EMNLP 2025 CourtEval: A Courtroom-Based Multi-Agent Evaluation Framework ACL 2025 CSEval: Towards Automated, Multi-Dimensional, and Reference-Free Counterspeech Evaluation using Auto-Calibrated LLMs NAACL 2025 Evaluation of Generated Poetry AACL 2025 Exploring the Potential of LLMs as Personalized Assistants: Dataset, Evaluation, and Analysis ACL 2025 From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge EMNLP 2025 Graders Should Cheat: Privileged Information Enables Expert-Level Automated Evaluations EMNLP 2025 InstaJudge: Aligning Judgment Bias of LLM-as-Judge with Humans in Industry Applications EMNLP 2025