Skip to content
conftrace_
2024 ICML ICML 2024

Is DPO Superior to PPO for LLM Alignment? A Comprehensive Study

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

❓ The Questioner
🌉 Interdisciplinary Bridge - Artificial Intelligence and Reinforcement Learning

Authors

Shusheng Xu, Wei Fu, Jiaxuan Gao, Wenjie Ye, Weilin Liu, Zhiyu Mei, Guangju Wang, Chao Yu, Yi Wu

Topics

Machine Learning > Optimization & Theory > Optimization Reinforcement Learning > Methods > Policy Learning Artificial Intelligence > Core AI > Large Language Models

Keywords

reward model actor critic llms alignment ppo dpo
Download PDF