Skip to content
conftrace_

direct preference optimization

427 papers

Explore in graph

Also known as

DPO

Co-occurring keywords · papers mentioning both

large language model (156) reinforcement learning from human feedback (63) preference optimization (50) preference learning (46) language model alignment (45) supervised fine-tuning (44) preference alignment (37) reward model (33) reinforcement learning (32) model alignment (32)

Papers

A Modular Approach for Clinical SLMs Driven by Synthetic Data with Pre-Instruction Tuning, Model Merging, and Clinical-Tasks Alignment ACL 2025 A Necessary Step toward Faithfulness: Measuring and Improving Consistency in Free-Text Explanations EMNLP 2025 A Practical Analysis of Human Alignment with *PO NAACL 2025 ASPO: Adaptive Sentence-Level Preference Optimization for Fine-Grained Multimodal Reasoning ACL 2025 Assessing and Mitigating Medical Knowledge Drift and Conflicts in Large Language Models EMNLP 2025 As Simple as Fine-tuning: LLM Alignment via Bidirectional Negative Feedback Loss ICLR 2025 Asynchronous RLHF: Faster and More Efficient Off-Policy RL for Language Models ICLR 2025 Automated Filtering of Human Feedback Data for Aligning Text-to-Image Diffusion Models ICLR 2025 AutoMixAlign: Adaptive Data Mixing for Multi-Task Preference Optimization in LLMs ACL 2025 Balancing the Budget: Understanding Trade-offs Between Supervised and Preference-Based Finetuning ACL 2025 Bayesian WeakS-to-Strong from Text Classification to Generation ICLR 2025 BDA-UC3M @ BioLaySumm: Efficient Lay Summarization with Small-Scale SoTA LLMs ACL 2025 Better Instruction-Following Through Minimum Bayes Risk ICLR 2025 Beyond Human Data: Aligning Multimodal Large Language Models by Iterative Self-Evolution AAAI 2025 Beyond Online Sampling: Bridging Offline-to-Online Alignment via Dynamic Data Transformation for LLMs EMNLP 2025 Beyond Task-Oriented and Chitchat Dialogues: Proactive and Transition-Aware Conversational Agents EMNLP 2025 BFS-Prover: Scalable Best-First Tree Search for LLM-based Automatic Theorem Proving ACL 2025 BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Data ACL 2025 Binary Classifier Optimization for Large Language Model Alignment ACL 2025 Boost Your Human Image Generation Model via Direct Preference Optimization CVPR 2025 Bootstrapping Language Models with DPO Implicit Rewards ICLR 2025 Bridging and Modeling Correlations in Pairwise Data for Direct Preference Optimization ICLR 2025 Building Math Agents with Multi-Turn Iterative Preference Learning ICLR 2025 CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images CVPR 2025 CALM: Unleashing the Cross-Lingual Self-Aligning Ability of Language Model Question Answering NAACL 2025