← Keywords

direct preference optimization

317 papers

Explore in graph

Also known as

DPO

Co-occurring keywords

large language model (12755) preference optimization (273) reinforcement learning from human feedback (261) preference learning (411) language model alignment (142) supervised fine-tuning (310) model alignment (219) preference alignment (142) reinforcement learning (4122) reward model (251)

Papers

Stepwise Alignment for Constrained Language Model Policy Optimization NIPS 2024
Advancing Tool-Augmented Large Language Models: Integrating Insights from Errors in Inference Trees NIPS 2024
Adaptive Preference Scaling for Reinforcement Learning with Human Feedback NIPS 2024
WPO: Enhancing RLHF with Weighted Preference Optimization EMNLP 2024
MAPO: Advancing Multilingual Reasoning through Multilingual-Alignment-as-Preference Optimization ACL 2024
Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignment ACL 2024
Unintended Impacts of LLM Alignment on Global Representation ACL 2024
Disentangling Length from Quality in Direct Preference Optimization ACL 2024
Direct Preference Optimization with an Offset ACL 2024
Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization ACL 2024
GDPO: Learning to Directly Align Language Models with Diversity Using GFlowNets EMNLP 2024
Knowledge Editing in Language Models via Adapted Direct Preference Optimization EMNLP 2024
V-DPO: Mitigating Hallucination in Large Vision Language Models via Vision-Guided Direct Preference Optimization EMNLP 2024
Preference Tuning For Toxicity Mitigation Generalizes Across Languages EMNLP 2024
Cal-DPO: Calibrated Direct Preference Optimization for Language Model Alignment NIPS 2024
Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithms NIPS 2024
What Makes and Breaks Safety Fine-tuning? A Mechanistic Study NIPS 2024
Geometric-Averaged Preference Optimization for Soft Preference Labels NIPS 2024
Quantifying and Optimizing Global Faithfulness in Persona-driven Role-playing NIPS 2024
Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers EMNLP 2024
A SMART Mnemonic Sounds like “Glue Tonic”: Mixing LLMs with Student Feedback to Make Mnemonic Learning Stick EMNLP 2024
Model-based Preference Optimization in Abstractive Summarization without Human Feedback EMNLP 2024
Self-Training Large Language and Vision Assistant for Medical Question Answering EMNLP 2024
SYNFAC-EDIT: Synthetic Imitation Edit Feedback for Factual Alignment in Clinical Summarization EMNLP 2024
FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data EMNLP 2024