direct preference optimization

317 papers

Explore in graph

Also known as

DPO

Co-occurring keywords

large language model (12755) preference optimization (273) reinforcement learning from human feedback (261) preference learning (411) language model alignment (142) supervised fine-tuning (310) model alignment (219) preference alignment (142) reinforcement learning (4122) reward model (251)

Papers

Full-Step-DPO: Self-Supervised Preference Optimization with Step-wise Rewards for Mathematical Reasoning ACL 2025

PatchDPO: Patch-level DPO for Finetuning-free Personalized Image Generation CVPR 2025

VideoDPO: Omni-Preference Alignment for Video Diffusion Generation CVPR 2025

LookAlike: Consistent Distractor Generation in Math MCQs ACL 2025

DesignDiffusion: High-Quality Text-to-Design Image Generation with Diffusion Models CVPR 2025

Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimization CVPR 2025

DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundness ICCV 2025

Balancing the Budget: Understanding Trade-offs Between Supervised and Preference-Based Finetuning ACL 2025

Introducing Spotlight: A Novel Approach for Generating Captivating Key Information from Documents EMNLP 2025

Enhancing Logical Reasoning in Language Models via Symbolically-Guided Monte Carlo Process Supervision EMNLP 2025

ReCoT: Reflective Self-Correction Training for Mitigating Confirmation Bias in Large Vision-Language Models ICCV 2025

2D-DPO: Scaling Direct Preference Optimization with 2-Dimensional Supervision NAACL 2025

CAPO: Confidence Aware Preference Optimization Learning for Multilingual Preferences IJCNLP 2025

Refining Text Generation for Realistic Conversational Recommendation via Direct Preference Optimization EMNLP 2025

Retrieval-Augmented Fine-Tuning With Preference Optimization For Visual Program Generation ACL 2025

Uncovering the Impact of Chain-of-Thought Reasoning for Direct Preference Optimization: Lessons from Text-to-SQL ACL 2025

Supportiveness-based Knowledge Rewriting for Retrieval-augmented Language Modeling NAACL 2025

Chinchunmei at SemEval-2025 Task 11: Boosting the Large Language Model’s Capability of Emotion Perception using Contrastive Learning SEMEVAL 2025

Beyond Online Sampling: Bridging Offline-to-Online Alignment via Dynamic Data Transformation for LLMs EMNLP 2025

How Does DPO Reduce Toxicity? A Mechanistic Neuron-Level Analysis EMNLP 2025

Towards Human Understanding of Paraphrase Types in Large Language Models COLING 2025

Low-Resource Language Expansion and Translation Capacity Enhancement for LLM: A Study on the Uyghur COLING 2025

MDPO: Customized Direct Preference Optimization with a Metric-based Sampler for Question and Answer Generation COLING 2025

Persona-Consistent Dialogue Generation via Pseudo Preference Tuning COLING 2025

A Logical Fallacy-Informed Framework for Argument Generation NAACL 2025