Skip to content
conftrace_
2025 ICML ICML 2025

When Can Proxies Improve the Sample Complexity of Preference Learning?

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

❓ The Questioner
🐣 Hot Topic Early Bird - reward hacking

Authors

Yuchen Zhu, Daniel Augusto de Souza, Zhengyan Shi, Mengyue Yang, Pasquale Minervini, Matt Kusner, Alexander D’Amour

Topics

Artificial Intelligence > Core AI > AI Safety Machine Learning > Optimization & Theory > Learning Theory Artificial Intelligence > Core AI > Large Language Models

Keywords

sample complexity reward hacking proxy reward llms expert data ground truth policy
Download PDF