direct preference optimization

317 papers

Explore in graph

Also known as

DPO

Co-occurring keywords

large language model (12755) preference optimization (273) reinforcement learning from human feedback (261) preference learning (411) language model alignment (142) supervised fine-tuning (310) model alignment (219) preference alignment (142) reinforcement learning (4122) reward model (251)

Papers

Fine-tuning Large Language Models for Improving Factuality in Legal Question Answering COLING 2025

Synthetic Paths to Integral Truth: Mitigating Hallucinations Caused by Confirmation Bias with Synthetic Data COLING 2025

AGFSync: Leveraging AI-Generated Feedback for Preference Optimization in Text-to-Image Generation AAAI 2025

HSCR: Hierarchical Self-Contrastive Rewarding for Aligning Medical Vision Language Models ACL 2025

Divide-Then-Align: Honest Alignment based on the Knowledge Boundary of RAG ACL 2025

Advancing Zero-shot Text-to-Speech Intelligibility across Diverse Domains via Preference Alignment ACL 2025

Investigating and Enhancing the Robustness of Large Multimodal Models Against Temporal Inconsistency ACL 2025

LoGU: Long-form Generation with Uncertainty Expressions ACL 2025

PatchDPO: Patch-level DPO for Finetuning-free Personalized Image Generation CVPR 2025

Enhancing Machine Translation with Self-Supervised Preference Data ACL 2025

Uncertainty-Aware Iterative Preference Optimization for Enhanced LLM Reasoning ACL 2025

Subtle Errors in Reasoning: Preference Learning via Error-injected Self-editing ACL 2025

Comparing Bad Apples to Good Oranges Aligning Large Language Models via Joint Preference Optimization ACL 2025

Focused-DPO: Enhancing Code Generation Through Focused Preference Optimization on Error-Prone Points ACL 2025

Adversary-Aware DPO: Enhancing Safety Alignment in Vision Language Models via Adversarial Training EMNLP 2025

Captioning for Text-Video Retrieval via Dual-Group Direct Preference Optimization EMNLP 2025

Beyond Task-Oriented and Chitchat Dialogues: Proactive and Transition-Aware Conversational Agents EMNLP 2025

BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Data ACL 2025

Textual Aesthetics in Large Language Models EMNLP 2025

Self-Improvement Towards Pareto Optimality: Mitigating Preference Conflicts in Multi-Objective Alignment ACL 2025

Selective Preference Optimization via Token-Level Reward Function Estimation EMNLP 2025

Ambiguity Awareness Optimization: Towards Semantic Disambiguation for Direct Preference Optimization EMNLP 2025

Playpen: An Environment for Exploring Learning From Dialogue Game Feedback EMNLP 2025

RLHF Algorithms Ranked: An Extensive Evaluation Across Diverse Tasks, Rewards, and Hyperparameters EMNLP 2025

VideoDPO: Omni-Preference Alignment for Video Diffusion Generation CVPR 2025