direct preference optimization

VideoPASTA: 7K Preference Pairs That Matter for Video-LLM Alignment EMNLP 2025 V.I.P. : Iterative Online Preference Distillation for Efficient Video Diffusion Models ICCV 2025 Weights-Rotated Preference Optimization for Large Language Models EMNLP 2025 We Politely Insist: Your LLM Must Learn the Persian Art of Taarof EMNLP 2025 WEPO: Web Element Preference Optimization for LLM-based Web Navigation AAAI 2025 When Inverse Data Outperforms: Exploring the Pitfalls of Mixed Data in Multi-Stage Fine-Tuning EMNLP 2025 YinYang-Align: A new Benchmark for Competing Objectives and Introducing Multi-Objective Preference based Text-to-Image Alignment ACL 2025 β-DPO: Direct Preference Optimization with Dynamic β NeurIPS 2024 3D Structure Prediction of Atomic Systems with Flow-based Direct Preference Optimization NeurIPS 2024 A Critical Evaluation of AI Feedback for Aligning Large Language Models NeurIPS 2024 Active Preference Learning for Large Language Models ICML 2024 Adaptive Preference Scaling for Reinforcement Learning with Human Feedback NeurIPS 2024 Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers EMNLP 2024 A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques ACL 2024 Advancing Tool-Augmented Large Language Models: Integrating Insights from Errors in Inference Trees NeurIPS 2024 Adversarial DPO: Harnessing Harmful Data for Reducing Toxicity with Minimal Impact on Coherence and Evasiveness in Dialogue Agents NAACL 2024 A General Theoretical Paradigm to Understand Learning from Human Preferences AISTATS 2024 Are U a Joke Master? Pun Generation via Multi-Stage Curriculum Learning towards a Humor LLM ACL 2024 ARM: Alignment with Residual Energy-Based Model NAACL 2024 A SMART Mnemonic Sounds like “Glue Tonic”: Mixing LLMs with Student Feedback to Make Mnemonic Learning Stick EMNLP 2024 Automated Multi-level Preference for MLLMs NeurIPS 2024 Automatic Pair Construction for Contrastive Post-training NAACL 2024 Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization ACL 2024 Beyond Reverse KL: Generalizing Direct Preference Optimization with Diverse Divergence Constraints ICLR 2024 BiasDPO: Mitigating Bias in Language Models through Direct Preference Optimization ACL 2024