Agent-as-a-Judge: Evaluate Agents with Agents

Mingchen Zhuge; Changsheng Zhao; Dylan R. Ashley; Wenyi Wang; Dmitrii Khizbullin; Yunyang Xiong; Zechun Liu; Ernie Chang; Raghuraman Krishnamoorthi; Yuandong Tian; Yangyang Shi; Vikas Chandra; Jürgen Schmidhuber

2025 ICML ICML 2025

Agent-as-a-Judge: Evaluate Agents with Agents

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Computer Science and Natural Language Processing

Authors

Mingchen Zhuge, Changsheng Zhao, Dylan R. Ashley, Wenyi Wang, Dmitrii Khizbullin, Yunyang Xiong, Zechun Liu, Ernie Chang, Raghuraman Krishnamoorthi, Yuandong Tian, Yangyang Shi, Vikas Chandra, Jürgen Schmidhuber

Topics

Artificial Intelligence > Core AI > Agent Systems Natural Language Processing > Generation > Text Generation Computer Science > Applications > Software Engineering

Keywords

code generation agents evaluation hierarchical solution requirements human evaluation baseline implementation

Download PDF