preference optimization

273 papers

Explore in graph

Also known as

ACPO RPO MMPO ORPO KTO DPO SPO PO

Co-occurring keywords

large language model (12755) direct preference optimization (317) reinforcement learning (4122) reinforcement learning from human feedback (261) model alignment (219) language model alignment (142) language model (4573) supervised fine-tuning (310) reward model (251) preference learning (411)

Papers

AMaPO: Adaptive Margin-attached Preference Optimization for Language Model Alignment AAAI 2026

SERL: Self-Examining Reinforcement Learning on Open-Domain AAAI 2026

Textual Self-Attention Network: Test-Time Preference Optimization Through Textual Gradient-Based Attention AAAI 2026

Preference Optimization via Contrastive Divergence: Your Policy Is Secretly an NLL Estimator AAAI 2026

FantasyTalking2: Timestep-Layer Adaptive Preference Optimization for Audio-Driven Portrait Animation AAAI 2026

Do Political Opinions Transfer Between Western Languages? An Analysis of Unaligned and Aligned Multilingual LLMs EACL 2026

Offline Preference Optimization via Maximum Marginal Likelihood Estimation EACL 2026

FocalPO: Enhancing Preference Optimizing by Focusing on Correct Preference Rankings ACL 2025

Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences ACL 2025

Learning to Translate Ambiguous Terminology by Preference Optimization on Post-Edits EMNLP 2025

Dataground at SemEval-2025 Task 8: Small LLMs and Preference Optimization for Tabular QA ACL 2025

CARMO: Dynamic Criteria Generation for Context Aware Reward Modelling ACL 2025

Modality-Fair Preference Optimization for Trustworthy MLLM Alignment IJCAI 2025

Atyaephyra at SemEval-2025 Task 4: Low-Rank Negative Preference Optimization ACL 2025

Learning from Negative Samples in Biomedical Generative Entity Linking ACL 2025

𝒜3: Automatic Alignment Framework for Attributed Text Generation ACL 2025

Expectation Preference Optimization: Reliable Preference Estimation for Improving the Reasoning Capability of Large Language Models EMNLP 2025

Language Models as Continuous Self-Evolving Data Engineers EMNLP 2025

Enhancing Machine Translation with Self-Supervised Preference Data ACL 2025

Tuning Less, Prompting More: In-Context Preference Learning Pipeline for Natural Language Transformation EMNLP 2025

Empowering Math Problem Generation and Reasoning for Large Language Model via Synthetic Data based Continual Learning Framework EMNLP 2025

Diverse, not Short: A Length-Controlled Data Selection Strategy for Improving Response Diversity of Language Models EMNLP 2025

T-REG: Preference Optimization with Token-Level Reward Regularization ACL 2025

Uncertainty-Aware Iterative Preference Optimization for Enhanced LLM Reasoning ACL 2025

NTTSU at WMT2025 General Translation Task EMNLP 2025