preference alignment

142 papers

Explore in graph

Also known as

DPO

Co-occurring keywords

large language model (12755) direct preference optimization (317) reinforcement learning from human feedback (261) reinforcement learning (4122) reward model (251) reward modeling (159) preference optimization (273) language model alignment (142) instruction tuning (810) language model (4573)

Papers

Prompt-A-Video: Prompt Your Video Diffusion Model via Preference-Aligned LLM ICCV 2025

Instruction-Oriented Preference Alignment for Enhancing Multi-Modal Comprehension Capability of MLLMs ICCV 2025

EvolvingGrasp: Evolutionary Grasp Generation via Efficient Preference Alignment ICCV 2025

Command R7B Arabic: a small, enterprise-focused, multilingual, and culturally aware Arabic LLM ACL 2025

Radiology Report Generation via Multi-objective Preference Optimization AAAI 2025

Model Extrapolation Expedites Alignment ACL 2025

ATLANTIS: Weak-to-Strong Learning via Importance Sampling ACL 2025

Bridging Relevance and Reasoning: Rationale Distillation in Retrieval-Augmented Generation ACL 2025

Align2LLaVA: Cascaded Human and Large Language Model Preference Alignment for Multi-modal Instruction Curation ACL 2025

AMoPO: Adaptive Multi-objective Preference Optimization without Reward Models and Reference Models ACL 2025

Well Begun is Half Done: Low-resource Preference Alignment by Weak-to-Strong Decoding ACL 2025

RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment ACL 2025

Implicit Cross-Lingual Rewarding for Efficient Multilingual Preference Alignment ACL 2025

A Comprehensive Graph Framework for Question Answering with Mode-Seeking Preference Alignment ACL 2025

What Are Step-Level Reward Models Rewarding? Counterintuitive Findings from MCTS-Boosted Mathematical Reasoning AAAI 2025

RoVRM: A Robust Visual Reward Model Optimized via Auxiliary Textual Preference Data AAAI 2025

Instantly Learning Preference Alignment via In-context DPO NAACL 2025

FloorPlan-LLaMa: Aligning Architects’ Feedback and Domain Knowledge in Architectural Floor Plan Generation ACL 2025

Rethinking Reward Model Evaluation Through the Lens of Reward Overoptimization ACL 2025

SudoLM: Learning Access Control of Parametric Knowledge with Authorization Alignment ACL 2025

Frictional Agent Alignment Framework: Slow Down and Don’t Break Things ACL 2025

Koel-TTS: Enhancing LLM based Speech Generation with Preference Alignment and Classifier Free Guidance EMNLP 2025

GainRAG: Preference Alignment in Retrieval-Augmented Generation through Gain Signal Synthesis ACL 2025

Alignment with Fill-In-the-Middle for Enhancing Code Generation EMNLP 2025

FaST: Feature-aware Sampling and Tuning for Personalized Preference Alignment with Limited Data EMNLP 2025