conftrace_

agent evaluation

19 papers

Explore in graph

Co-occurring keywords

large language model (13587) agent system (324) llm agent (162) multi-agent system (1819) multi-turn interaction (36) multi-turn agent (5) benchmark framework (17) web agent (49) multi-step reasoning (150) user simulator (33)

Papers

SAGE : A Top-Down Bottom-Up Knowledge-Grounded User Simulator for Multi-turn Agent Evaluation EACL 2026
SGVEF-LOOP: Coverage-Guided Progressive Topological Exploration and Fact-Grounded Metamorphic Evaluation for MCP Agents ACL 2026
Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic Evaluations ACL 2026
HABIT: Human Action Benchmark for Interactive Traffic in CARLA WACV 2026
Efficient Agent Evaluation via Diversity-Guided User Simulation ACL 2026
Agentic CLEAR: Automating Multi-Level Evaluation of LLM Agents ACL 2026
Agent-Testing Agent: A Meta-Agent for Automated Testing and Evaluation of Conversational AI Agents EACL 2026
Tooling or Not Tooling? The Impact of Tools on Language Agents for Chemistry Problem Solving NAACL 2025
AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments ACL 2025
X-WebAgentBench: A Multilingual Interactive Web Benchmark for Evaluating Global Agentic System ACL 2025
AgentDiagnose: An Open Toolkit for Diagnosing LLM Agent Trajectories EMNLP 2025
MCPEval: Automatic MCP-based Deep Evaluation for AI Agent Models EMNLP 2025
DMT-RoleBench: A Dynamic Multi-Turn Dialogue Based Benchmark for Role-Playing Evaluation of Large Language Model and Agent AAAI 2025
LLM Agents Can Be Choice-Supportive Biased Evaluators: An Empirical Study AAAI 2025
WhodunitBench: Evaluating Large Multimodal Agents via Murder Mystery Games NIPS 2024
AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents NIPS 2024
NegoLog: An Integrated Python-based Automated Negotiation Framework with Enhanced Assessment Components IJCAI 2024
Gentopia.AI: A Collaborative Platform for Tool-Augmented LLMs EMNLP 2023
Navigation Turing Test (NTT): Learning to Evaluate Human-Like Navigation ICML 2021