direct preference optimization

317 papers

Explore in graph

Also known as

DPO

Co-occurring keywords

large language model (12755) preference optimization (273) reinforcement learning from human feedback (261) preference learning (411) language model alignment (142) supervised fine-tuning (310) model alignment (219) preference alignment (142) reinforcement learning (4122) reward model (251)

Papers

CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images CVPR 2025

Boost Your Human Image Generation Model via Direct Preference Optimization CVPR 2025

BDA-UC3M @ BioLaySumm: Efficient Lay Summarization with Small-Scale SoTA LLMs ACL 2025

InspireDebate: Multi-Dimensional Subjective-Objective Evaluation-Guided Reasoning and Optimization for Debating ACL 2025

Fine-tuning Large Language Models for Improving Factuality in Legal Question Answering COLING 2025

Continual SFT Matches Multimodal RLHF with Negative Supervision CVPR 2025

It Depends: Resolving Referential Ambiguity in Minimal Contexts with Commonsense Knowledge EMNLP 2025

Command-A-Translate: Raising the Bar of Machine Translation with Difficulty Filtering EMNLP 2025

Cross-lingual Human-Preference Alignment for Neural Machine Translation with Direct Quality Optimization EMNLP 2025

V.I.P. : Iterative Online Preference Distillation for Efficient Video Diffusion Models ICCV 2025

Putting People in LLMs’ Shoes: Generating Better Answers via Question Rewriter AAAI 2025

Preference-Oriented Supervised Fine-Tuning: Favoring Target Model over Aligned Large Language Models AAAI 2025

Multi-Reference Preference Optimization for Large Language Models AAAI 2025

Detecting and Mitigating Hallucination in Large Vision Language Models via Fine-Grained AI Feedback AAAI 2025

Aligning Language Models Using Follow-up Likelihood as Reward Signal AAAI 2025

Robust Multi-Objective Preference Alignment with Online DPO AAAI 2025

Data with High and Consistent Preference Difference Are Better for Reward Model AAAI 2025

Generalizing Alignment Paradigm of Text-to-Image Generation with Preferences Through f-Divergence Minimization AAAI 2025

Aligning Large Language Models for Faithful Integrity Against Opposing Argument AAAI 2025

AlignGuard: Scalable Safety Alignment for Text-to-Image Generation ICCV 2025

Scalable Ranked Preference Optimization for Text-to-Image Generation ICCV 2025

Advancing Zero-shot Text-to-Speech Intelligibility across Diverse Domains via Preference Alignment ACL 2025

NHK Submission to WAT 2025: Leveraging Preference Optimization for Article-level Japanese–English News Translation IJCNLP 2025

MPPO: Multi Pair-wise Preference Optimization for LLMs with Arbitrary Negative Samples COLING 2025

PatchDPO: Patch-level DPO for Finetuning-free Personalized Image Generation CVPR 2025