conftrace_

automated evaluation

58 papers

Explore in graph

Co-occurring keywords

large language model (13587) human evaluation (379) language model (4599) text summarization (896) automatic evaluation (225) evaluation metric (573) benchmark evaluation (1556) dialogue system (1667) multimodal learning (4645) human preference (124)

Papers

DR-Arena: an Automated Evaluation Framework for Deep Research Agents ACL 2026
AutoTaskEval: Towards Domain-Specific and Fine-Grained Evaluation for LLMs ACL 2026
LLM-Powered Benchmark Factory: Reliable, Generic, and Efficient ACL 2026
A Functionality-Grounded Benchmark for Evaluating Web Agents in E-commerce Domains ACL 2026
Assessing Automated Fact-Checking for Medical LLM Responses with Knowledge Graphs AAAI 2026
RAFFLES: Reasoning-based Attribution of Faults for LLM Systems EACL 2026
Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluation ACL 2026
Label Effects: Shared Heuristic Reliance in Trust Assessment by Humans and LLM-as-a-Judge ACL 2026
Korean Canonical Legal Benchmark: Toward Knowledge-Independent Evaluation of LLMs’ Legal Reasoning Capabilities EACL 2026
HypoEval: Hypothesis-Guided Evaluation for Natural Language Generation ACL 2026
Automated Creativity Evaluation of Language Models Across Open-Ended Tasks ACL 2026
InstaJudge: Aligning Judgment Bias of LLM-as-Judge with Humans in Industry Applications EMNLP 2025
Can LLMs Generate and Solve Linguistic Olympiad Puzzles? EMNLP 2025
TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understanding ACL 2025
LogiDebrief: A Signal-Temporal Logic Based Automated Debriefing Approach with Large Language Models Integration IJCAI 2025
ProxAnn: Use-Oriented Evaluations of Topic Models and Document Clustering ACL 2025
From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge EMNLP 2025
ProjectEval: A Benchmark for Programming Agents Automated Evaluation on Project-Level Code Generation ACL 2025
BI-Bench : A Comprehensive Benchmark Dataset and Unsupervised Evaluation for BI Systems ACL 2025
AbGen: Evaluating Large Language Models in Ablation Study Design and Evaluation for Scientific Research ACL 2025
CSEval: Towards Automated, Multi-Dimensional, and Reference-Free Counterspeech Evaluation using Auto-Calibrated LLMs NAACL 2025
AutoEval-ToD: Automated Evaluation of Task-oriented Dialog Systems NAACL 2025
Towards Scalable Human-aligned Benchmark for Text-guided Image Editing CVPR 2025
Graders Should Cheat: Privileged Information Enables Expert-Level Automated Evaluations EMNLP 2025
AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark ACL 2025