Skip to content
conftrace_

direct preference optimization

427 papers

Explore in graph

Also known as

DPO

Co-occurring keywords · papers mentioning both

large language model (156) reinforcement learning from human feedback (63) preference optimization (50) preference learning (46) language model alignment (45) supervised fine-tuning (44) preference alignment (37) reward model (33) reinforcement learning (32) model alignment (32)

Papers

Knowledge Editing in Language Models via Adapted Direct Preference Optimization EMNLP 2024 Learning Planning-based Reasoning by Trajectories Collection and Process Reward Synthesizing EMNLP 2024 Learning to Ask Informative Questions: Enhancing LLMs with Preference Optimization and Expected Information Gain EMNLP 2024 LIONs: An Empirically Optimized Approach to Align Language Models EMNLP 2024 LLMs Beyond English: Scaling the Multilingual Capability of LLMs with Cross-Lingual Feedback ACL 2024 MAPO: Advancing Multilingual Reasoning through Multilingual-Alignment-as-Preference Optimization ACL 2024 mDPO: Conditional Preference Optimization for Multimodal Large Language Models EMNLP 2024 Mercury: A Code Efficiency Benchmark for Code Large Language Models NeurIPS 2024 Model-based Preference Optimization in Abstractive Summarization without Human Feedback EMNLP 2024 Multi-Modal Hallucination Control by Visual Information Grounding CVPR 2024 Multi-modal Preference Alignment Remedies Degradation of Visual Instruction Tuning on Language Models ACL 2024 On Softmax Direct Preference Optimization for Recommendation NeurIPS 2024 On the Limited Generalization Capability of the Implicit Reward Model Induced by Direct Preference Optimization EMNLP 2024 Preference Learning Algorithms Do Not Learn Preference Rankings NeurIPS 2024 Preference Tuning For Toxicity Mitigation Generalizes Across Languages EMNLP 2024 Provably Mitigating Overoptimization in RLHF: Your SFT Loss is Implicitly an Adversarial Regularizer NeurIPS 2024 Provably Robust DPO: Aligning Language Models with Noisy Feedback ICML 2024 PURE: Aligning LLM via Pluggable Query Reformulation for Enhanced Helpfulness EMNLP 2024 Quantifying and Optimizing Global Faithfulness in Persona-driven Role-playing NeurIPS 2024 RAG-HAT: A Hallucination-Aware Tuning Pipeline for LLM in Retrieval-Augmented Generation EMNLP 2024 Reward Model Learning vs. Direct Policy Optimization: A Comparative Analysis of Learning from Human Preferences ICML 2024 RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback CVPR 2024 RS-DPO: A Hybrid Rejection Sampling and Direct Preference Optimization Method for Alignment of Large Language Models NAACL 2024 SafeWorld: Geo-Diverse Safety Alignment NeurIPS 2024 SambaLingo: Teaching Large Language Models New Languages EMNLP 2024