direct preference optimization

317 papers

Explore in graph

Also known as

DPO

Co-occurring keywords

large language model (12755) preference optimization (273) reinforcement learning from human feedback (261) preference learning (411) language model alignment (142) supervised fine-tuning (310) model alignment (219) preference alignment (142) reinforcement learning (4122) reward model (251)

Papers

When Equal Isn’t Fair: Mitigating Over-Normalization in Large Language Models (Student Abstract) AAAI 2026

RMO: Towards Better LLM Alignment via Reshaping Reward Margin Distributions AAAI 2026

SafeNLIDB: A Privacy-Preserving Safety Alignment Framework for LLM-based Natural Language Database Interfaces AAAI 2026

MPJudge: Towards Perceptual Assessment of Music-Induced Paintings AAAI 2026

Preference Robustness for DPO with Applications to Public Health AAAI 2026

Align Video Diffusion Model with Online Video-Centric Preference Optimization WACV 2026

Optimizing LVLMs with On-Policy Data for Effective Hallucination Mitigation WACV 2026

LaCoMSA: Language-Consistency Multilingual Self-Alignment with Latent Representation Rewarding EACL 2026

Full-Step-DPO: Self-Supervised Preference Optimization with Step-wise Rewards for Mathematical Reasoning ACL 2025

Self-Improvement Towards Pareto Optimality: Mitigating Preference Conflicts in Multi-Objective Alignment ACL 2025

Finding the Sweet Spot: Preference Data Construction for Scaling Preference Optimization ACL 2025

BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Data ACL 2025

DPO Kernels: A Semantically-Aware, Kernel-Enhanced, and Divergence-Rich Paradigm for Direct Preference Optimization ACL 2025

SDPO: Segment-Level Direct Preference Optimization for Social Agents ACL 2025

A Necessary Step toward Faithfulness: Measuring and Improving Consistency in Free-Text Explanations EMNLP 2025

Investigating and Enhancing the Robustness of Large Multimodal Models Against Temporal Inconsistency ACL 2025

HSCR: Hierarchical Self-Contrastive Rewarding for Aligning Medical Vision Language Models ACL 2025

Divide-Then-Align: Honest Alignment based on the Knowledge Boundary of RAG ACL 2025

Dually Self-Improved Counterfactual Data Augmentation Using Large Language Model ACL 2025

Personalized Preference Fine-tuning of Diffusion Models CVPR 2025

Learning to Summarize from LLM-generated Feedback NAACL 2025

Using LLMs and Preference Optimization for Agreement-Aware HateWiC Classification ACL 2025

Is Poisoning a Real Threat to DPO? Maybe More So Than You Think AAAI 2025

RadQA-DPO: A Radiology Question Answering System with Encoder-Decoder Models Enhanced by Direct Preference Optimization ACL 2025

MuCAL: Contrastive Alignment for Preference-Driven KG-to-Text Generation EMNLP 2025