agent evaluation

Agentic CLEAR: Automating Multi-Level Evaluation of LLM Agents ACL 2026 Agent-Testing Agent: A Meta-Agent for Automated Testing and Evaluation of Conversational AI Agents EACL 2026 Efficient Agent Evaluation via Diversity-Guided User Simulation ACL 2026 Graph2Eval: Automatic Multimodal Task Generation for Agents via Knowledge Graphs CVPR 2026 HABIT: Human Action Benchmark for Interactive Traffic in CARLA WACV 2026 Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic Evaluations ACL 2026 SAGE : A Top-Down Bottom-Up Knowledge-Grounded User Simulator for Multi-turn Agent Evaluation EACL 2026 SGVEF-LOOP: Coverage-Guided Progressive Topological Exploration and Fact-Grounded Metamorphic Evaluation for MCP Agents ACL 2026 AgentDiagnose: An Open Toolkit for Diagnosing LLM Agent Trajectories EMNLP 2025 AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments ACL 2025 DMT-RoleBench: A Dynamic Multi-Turn Dialogue Based Benchmark for Role-Playing Evaluation of Large Language Model and Agent AAAI 2025 LLM Agents Can Be Choice-Supportive Biased Evaluators: An Empirical Study AAAI 2025 MCPEval: Automatic MCP-based Deep Evaluation for AI Agent Models EMNLP 2025 Tooling or Not Tooling? The Impact of Tools on Language Agents for Chemistry Problem Solving NAACL 2025 X-WebAgentBench: A Multilingual Interactive Web Benchmark for Evaluating Global Agentic System ACL 2025 AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents NeurIPS 2024 NegoLog: An Integrated Python-based Automated Negotiation Framework with Enhanced Assessment Components IJCAI 2024 WhodunitBench: Evaluating Large Multimodal Agents via Murder Mystery Games NeurIPS 2024 Gentopia.AI: A Collaborative Platform for Tool-Augmented LLMs EMNLP 2023 Benchmarking the Spectrum of Agent Capabilities ICLR 2022 Navigation Turing Test (NTT): Learning to Evaluate Human-Like Navigation ICML 2021