preference optimization

273 papers

Explore in graph

Also known as

ACPO RPO MMPO ORPO KTO DPO SPO PO

Co-occurring keywords

large language model (12755) direct preference optimization (317) reinforcement learning (4122) reinforcement learning from human feedback (261) model alignment (219) language model alignment (142) language model (4573) supervised fine-tuning (310) reward model (251) preference learning (411)

Papers

Training Language Model to Critique for Better Refinement ACL 2025

Atyaephyra at SemEval-2025 Task 4: Low-Rank Negative Preference Optimization SEMEVAL 2025

DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models EMNLP 2025

RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Services EMNLP 2025

Modality-Fair Preference Optimization for Trustworthy MLLM Alignment IJCAI 2025

Fine-grained Video Dubbing Duration Alignment with Segment Supervised Preference Optimization ACL 2025

RPO: Retrieval Preference Optimization for Robust Retrieval-Augmented Generation ACL 2025

Self-Taught Agentic Long Context Understanding ACL 2025

DavIR: Data Selection via Implicit Reward for Large Language Models ACL 2025

Mutual-Taught for Co-adapting Policy and Reward Models ACL 2025

LoGU: Long-form Generation with Uncertainty Expressions ACL 2025

IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimization ACL 2025

Enhancing Machine Translation with Self-Supervised Preference Data ACL 2025

Uncertainty-Aware Iterative Preference Optimization for Enhanced LLM Reasoning ACL 2025

𝒜3: Automatic Alignment Framework for Attributed Text Generation ACL 2025

Learning from Negative Samples in Biomedical Generative Entity Linking ACL 2025

CARMO: Dynamic Criteria Generation for Context Aware Reward Modelling ACL 2025

Dataground at SemEval-2025 Task 8: Small LLMs and Preference Optimization for Tabular QA ACL 2025

Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences ACL 2025

FocalPO: Enhancing Preference Optimizing by Focusing on Correct Preference Rankings ACL 2025

Comparing Bad Apples to Good Oranges Aligning Large Language Models via Joint Preference Optimization ACL 2025

Slamming: Training a Speech Language Model on One GPU in a Day ACL 2025

Focused-DPO: Enhancing Code Generation Through Focused Preference Optimization on Error-Prone Points ACL 2025

Learning Together to Perform Better: Teaching Small-Scale LLMs to Collaborate via Preferential Rationale Tuning ACL 2025

DCRM: A Heuristic to Measure Response Pair Quality in Preference Optimization EMNLP 2025