preference optimization

273 papers

Explore in graph

Also known as

ACPO RPO MMPO ORPO KTO DPO SPO PO

Co-occurring keywords

large language model (12755) direct preference optimization (317) reinforcement learning (4122) reinforcement learning from human feedback (261) model alignment (219) language model alignment (142) language model (4573) supervised fine-tuning (310) reward model (251) preference learning (411)

Papers

Co-Evolving LLMs and Embedding Models via Density-Guided Preference Optimization for Text Clustering EMNLP 2025

R-TOFU: Unlearning in Large Reasoning Models EMNLP 2025

AbsVis – Benchmarking How Humans and Vision-Language Models “See” Abstract Concepts in Images EMNLP 2025

PORTS: Preference-Optimized Retrievers for Tool Selection with Large Language Models EMNLP 2025

SATER: A Self-Aware and Token-Efficient Approach to Routing and Cascading EMNLP 2025

R-PRM: Reasoning-Driven Process Reward Modeling EMNLP 2025

iTool: Reinforced Fine-Tuning with Dynamic Deficiency Calibration for Advanced Tool Use EMNLP 2025

Tuning Less, Prompting More: In-Context Preference Learning Pipeline for Natural Language Transformation EMNLP 2025

Language Models as Continuous Self-Evolving Data Engineers EMNLP 2025

Empowering Math Problem Generation and Reasoning for Large Language Model via Synthetic Data based Continual Learning Framework EMNLP 2025

Expectation Preference Optimization: Reliable Preference Estimation for Improving the Reasoning Capability of Large Language Models EMNLP 2025

Diverse, not Short: A Length-Controlled Data Selection Strategy for Improving Response Diversity of Language Models EMNLP 2025

A Comprehensive Survey on Learning from Rewards for Large Language Models: Reward Models and Learning Strategies EMNLP 2025

IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimization ACL 2025

Mitigating Hallucinated Translations in Large Language Models with Hallucination-focused Preference Optimization NAACL 2025

Efficient Long Context Language Model Retrieval with Compression ACL 2025

When2Call: When (not) to Call Tools NAACL 2025

Little Giants: Synthesizing High-Quality Embedding Data at Scale NAACL 2025

LoGU: Long-form Generation with Uncertainty Expressions ACL 2025

CodeDPO: Aligning Code Models with Self Generated and Verified Source Code ACL 2025

Forward KL Regularized Preference Optimization for Aligning Diffusion Policies AAAI 2025

Sakura at SemEval-2025 Task 2: Enhancing Named Entity Translation with Fine-Tuning and Preference Optimization ACL 2025

Mutual-Taught for Co-adapting Policy and Reward Models ACL 2025

The Fellowship of the LLMs: Multi-Model Workflows for Synthetic Preference Optimization Dataset Generation ACL 2025

Rationalize and Align: Enhancing Writing Assistance with Rationale via Self-Training for Improved Alignment ACL 2025