Skip to content
conftrace_

direct preference optimization

427 papers

Explore in graph

Also known as

DPO

Co-occurring keywords · papers mentioning both

large language model (156) reinforcement learning from human feedback (63) preference optimization (50) preference learning (46) language model alignment (45) supervised fine-tuning (44) preference alignment (37) reward model (33) reinforcement learning (32) model alignment (32)

Papers

Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithms NeurIPS 2024 Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-Evaluation ACL 2024 Self-Refine Instruction-Tuning for Aligning Reasoning in Language Models EMNLP 2024 Self-supervised Preference Optimization: Enhance Your Language Model with Preference Degree Awareness EMNLP 2024 Self-Training Large Language and Vision Assistant for Medical Question Answering EMNLP 2024 Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning ACL 2024 SimPO: Simple Preference Optimization with a Reference-Free Reward NeurIPS 2024 Statistical Rejection Sampling Improves Preference Optimization ICLR 2024 Step-level Value Preference Optimization for Mathematical Reasoning EMNLP 2024 Stepwise Alignment for Constrained Language Model Policy Optimization NeurIPS 2024 SYNFAC-EDIT: Synthetic Imitation Edit Feedback for Factual Alignment in Clinical Summarization EMNLP 2024 The Paradox of Preference: A Study on LLM Alignment Algorithms and Data Acquisition Methods NAACL 2024 Token-level Direct Preference Optimization ICML 2024 Towards Efficient Exact Optimization of Language Model Alignment ICML 2024 Unintended Impacts of LLM Alignment on Global Representation ACL 2024 Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback NeurIPS 2024 Using Human Feedback to Fine-tune Diffusion Models without Any Reward Model CVPR 2024 V-DPO: Mitigating Hallucination in Large Vision Language Models via Vision-Guided Direct Preference Optimization EMNLP 2024 VLFeedback: A Large-Scale AI Feedback Dataset for Large Vision-Language Models Alignment EMNLP 2024 What Makes and Breaks Safety Fine-tuning? A Mechanistic Study NeurIPS 2024 Word Alignment as Preference for Machine Translation EMNLP 2024 Would I Lie To You? Inference Time Alignment of Language Models using Direct Preference Heads NeurIPS 2024 WPO: Enhancing RLHF with Weighted Preference Optimization EMNLP 2024 Deformable Mesh Transformer for 3D Human Mesh Recovery CVPR 2023 Direct Preference Optimization: Your Language Model is Secretly a Reward Model NeurIPS 2023