Skip to content
conftrace_

preference optimization

355 papers

Explore in graph

Also known as

PO

Co-occurring keywords · papers mentioning both

large language model (156) direct preference optimization (50) reinforcement learning (44) reinforcement learning from human feedback (36) language model alignment (31) model alignment (30) language model (29) supervised fine-tuning (29) reward model (23) diffusion model (18)

Papers

Weak-to-Strong Reasoning EMNLP 2024 What Makes and Breaks Safety Fine-tuning? A Mechanistic Study NeurIPS 2024 Word Alignment as Preference for Machine Translation EMNLP 2024 Would I Lie To You? Inference Time Alignment of Language Models using Direct Preference Heads NeurIPS 2024 WPO: Enhancing RLHF with Weighted Preference Optimization EMNLP 2024