conftrace_

direct preference optimization

427 papers

Explore in graph

Also known as

DPO

Co-occurring keywords · papers mentioning both

large language model (156) reinforcement learning from human feedback (63) preference optimization (50) preference learning (46) language model alignment (45) supervised fine-tuning (44) preference alignment (37) reward model (33) reinforcement learning (32) model alignment (32)

Papers

InspireDebate: Multi-Dimensional Subjective-Objective Evaluation-Guided Reasoning and Optimization for Debating ACL 2025 Instantly Learning Preference Alignment via In-context DPO NAACL 2025 Integrating Symbolic Execution into the Fine-Tuning of Code-Generating LLMs NAACL 2025 Into The Limits of Logic: Alignment Methods for Formal Logical Reasoning EMNLP 2025 Introducing Spotlight: A Novel Approach for Generating Captivating Key Information from Documents EMNLP 2025 Investigating and Enhancing the Robustness of Large Multimodal Models Against Temporal Inconsistency ACL 2025 IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimization ACL 2025 IPO: Your Language Model is Secretly a Preference Classifier ACL 2025 Is Poisoning a Real Threat to DPO? Maybe More So Than You Think AAAI 2025 ISR-DPO: Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPO AAAI 2025 It Depends: Resolving Referential Ambiguity in Minimal Contexts with Commonsense Knowledge EMNLP 2025 Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models ACL 2025 Language Imbalance Driven Rewarding for Multilingual Self-improving ICLR 2025 Learning LLM-as-a-Judge for Preference Alignment ICLR 2025 Learning Strategic Language Agents in the Werewolf Game with Iterative Latent Space Policy Optimization ICML 2025 Learning to Summarize from LLM-generated Feedback NAACL 2025 Learn Your Reference Model for Real Good Alignment ICLR 2025 Let's Verify and Reinforce Image Generation Step by Step CVPR 2025 LIVS: A Pluralistic Alignment Dataset for Inclusive Public Spaces ICML 2025 LoGU: Long-form Generation with Uncertainty Expressions ACL 2025 LongReward: Improving Long-context Large Language Models with AI Feedback ACL 2025 LookAlike: Consistent Distractor Generation in Math MCQs ACL 2025 Low-Resource Language Expansion and Translation Capacity Enhancement for LLM: A Study on the Uyghur COLING 2025 Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing ICLR 2025 MallowsPO: Fine-Tune Your LLM with Preference Dispersions ICLR 2025