direct preference optimization

317 papers

Explore in graph

Also known as

DPO

Co-occurring keywords

large language model (12755) preference optimization (273) reinforcement learning from human feedback (261) preference learning (411) language model alignment (142) supervised fine-tuning (310) model alignment (219) preference alignment (142) reinforcement learning (4122) reward model (251)

Papers

Chinchunmei at SemEval-2025 Task 11: Boosting the Large Language Model’s Capability of Emotion Perception using Contrastive Learning ACL 2025

Improve Vision Language Model Chain-of-thought Reasoning ACL 2025

LongReward: Improving Long-context Large Language Models with AI Feedback ACL 2025

IPO: Your Language Model is Secretly a Preference Classifier ACL 2025

AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation ACL 2025

Align-SLM: Textless Spoken Language Models with Reinforcement Learning from AI Feedback ACL 2025

Marco-o1 v2: Towards Widening The Distillation Bottleneck for Reasoning Models ACL 2025

A Dual-Mind Framework for Strategic and Expressive Negotiation Agent ACL 2025

Consistency-Aware Online Multi-Objective Alignment for Related Search Query Generation ACL 2025

AutoMixAlign: Adaptive Data Mixing for Multi-Task Preference Optimization in LLMs ACL 2025

FocalPO: Enhancing Preference Optimizing by Focusing on Correct Preference Rankings ACL 2025

Permutative Preference Alignment from Listwise Ranking of Human Judgments EMNLP 2025

We Politely Insist: Your LLM Must Learn the Persian Art of Taarof EMNLP 2025

Direct Judgement Preference Optimization EMNLP 2025

Re-Align: Aligning Vision Language Models via Retrieval-Augmented Direct Preference Optimization EMNLP 2025

ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance EMNLP 2025

VideoPASTA: 7K Preference Pairs That Matter for Video-LLM Alignment EMNLP 2025

When Inverse Data Outperforms: Exploring the Pitfalls of Mixed Data in Multi-Stage Fine-Tuning EMNLP 2025

Nine Ways to Break Copyright Law and Why Our LLM Won’t: A Fair Use Aligned Generation Framework EMNLP 2025

PersLLM: A Personified Training Approach for Large Language Models EMNLP 2025

From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignment EMNLP 2025

Token Preference Optimization with Self-Calibrated Visual-Anchored Rewards for Hallucination Mitigation EMNLP 2025

RAR2: Retrieval-Augmented Medical Reasoning via Thought-Driven Retrieval EMNLP 2025

TreeBoN: Enhancing Inference-Time Alignment with Speculative Tree-Search and Best-of-N Sampling EMNLP 2025

Towards Universal Debiasing for Language Models-based Tabular Data Generation EMNLP 2025