preference optimization

273 papers

Explore in graph

Also known as

ACPO RPO MMPO ORPO KTO DPO SPO PO

Co-occurring keywords

large language model (12755) direct preference optimization (317) reinforcement learning (4122) reinforcement learning from human feedback (261) model alignment (219) language model alignment (142) language model (4573) supervised fine-tuning (310) reward model (251) preference learning (411)

Papers

LifeAlign: Lifelong Alignment for Large Language Models with Memory-Augmented Focalized Preference Optimization AAAI 2026

SMPRO: Self-Supervised Visual Preference Alignment via Differentiable Multi-Preference Multi-Group Ranking AAAI 2026

SMART-Editor: A Multi-Agent Framework for Human-Like Design Editing with Structural Integrity EACL 2026

Bootstrapping LLMs via Preference-Based Policy Optimization AAAI 2026

MetaGDPO: Alleviating Catastrophic Forgetting with Metacognitive Knowledge Through Group Direct Preference Optimization AAAI 2026

AMaPO: Adaptive Margin-attached Preference Optimization for Language Model Alignment AAAI 2026

Rethinking the Evaluation of Alignment Methods: Insights into Diversity, Generalisation, and Safety EACL 2026

IRPO: Implicit Policy Regularized Preference Optimization EACL 2026

SPA: Achieving Consensus in LLM Alignment via Self-Priority Optimization AAAI 2026

DEPO: Dual-Efficiency Preference Optimization for LLM Agents AAAI 2026

LLMdoctor: Token-Level Flow-Guided Preference Optimization for Efficient Test-Time Alignment of Large Language Models AAAI 2026

AP2O-Coder: Adaptively Progressive Preference Optimization for Reducing Compilation and Runtime Errors in LLM-Generated Code AAAI 2026

S³-MSD: Large Vision-Language Model for Explainable and Generalizable Multi-modal Sarcasm Detection AAAI 2026

Operationalizing Pluralistic Values in Large Language Model Alignment Reveals Trade-offs in Safety, Inclusivity, and Model Behavior AAAI 2026

Do Political Opinions Transfer Between Western Languages? An Analysis of Unaligned and Aligned Multilingual LLMs EACL 2026

Offline Preference Optimization via Maximum Marginal Likelihood Estimation EACL 2026

Causal Direct Preference Optimization for Language Model Alignment EACL 2026

Attribute-Controlled Translation with Preference Optimization EACL 2026

EPO: Diverse and Realistic Protein Ensemble Generation via Energy Preference Optimization AAAI 2026

FantasyTalking2: Timestep-Layer Adaptive Preference Optimization for Audio-Driven Portrait Animation AAAI 2026

Preference Optimization via Contrastive Divergence: Your Policy Is Secretly an NLL Estimator AAAI 2026

OmniDPO: A Preference Optimization Framework to Address Omni-Modal Hallucination AAAI 2026

Textual Self-Attention Network: Test-Time Preference Optimization Through Textual Gradient-Based Attention AAAI 2026

SERL: Self-Examining Reinforcement Learning on Open-Domain AAAI 2026

Not All Tokens Are Meant to Be Forgotten AAAI 2026