preference alignment

142 papers

Explore in graph

Also known as

DPO

Co-occurring keywords

large language model (12755) direct preference optimization (317) reinforcement learning from human feedback (261) reinforcement learning (4122) reward model (251) reward modeling (159) preference optimization (273) language model alignment (142) instruction tuning (810) language model (4573)

Papers

Governance in Motion: Co-evolution of Constitutions and AI models for Scalable Safety EMNLP 2025

Uncovering Factor-Level Preference to Improve Human-Model Alignment EMNLP 2025

Permutative Preference Alignment from Listwise Ranking of Human Judgments EMNLP 2025

Improving Preference Alignment of LLM with Inference-Free Self-Refinement EMNLP 2025

SparsePO: Controlling Preference Alignment of LLMs via Sparse Token Masks EMNLP 2025

SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Models CVPR 2025

CodeRAG: Finding Relevant and Necessary Knowledge for Retrieval-Augmented Repository-Level Code Completion EMNLP 2025

Group Preference Alignment: Customizing LLM Responses from In-Situ Conversations Only When Needed EMNLP 2025

Beyond Human Data: Aligning Multimodal Large Language Models by Iterative Self-Evolution AAAI 2025

MVReward: Better Aligning and Evaluating Multi-View Diffusion Models with Human Preferences AAAI 2025

Alleviating Shifted Distribution in Human Preference Alignment through Meta-Learning AAAI 2025

Sequential Preference Optimization: Multi-Dimensional Preference Alignment with Implicit Reward Modeling AAAI 2025

VideoDPO: Omni-Preference Alignment for Video Diffusion Generation CVPR 2025

Curiosity-Driven Reinforcement Learning from Human Feedback ACL 2025

Persona-judge: Personalized Alignment of Large Language Models via Token-level Self-judgment ACL 2025

InternLM-XComposer2.5-Reward: A Simple Yet Effective Multi-Modal Reward Model ACL 2025

Continual SFT Matches Multimodal RLHF with Negative Supervision CVPR 2025

DyMO: Training-Free Diffusion Model Alignment with Dynamic Multi-Objective Scheduling CVPR 2025

Marco Large Translation Model at WMT2025: Transforming Translation Capability in LLMs via Quality-Aware Training and Decoding EMNLP 2025

Robust Multi-Objective Preference Alignment with Online DPO AAAI 2025

Maximizing Signal in Human-Model Preference Alignment AAAI 2025

CTR-Guided Generative Query Suggestion in Conversational Search EMNLP 2025

Distributional Preference Alignment of LLMs via Optimal Transport NIPS 2024

Perplexity-aware Correction for Robust Alignment with Noisy Preferences NIPS 2024

Mission Impossible: A Statistical Perspective on Jailbreaking LLMs NIPS 2024