← Keywords

preference optimization

273 papers

Explore in graph

Also known as

ACPO RPO MMPO ORPO KTO DPO SPO PO

Co-occurring keywords

large language model (12755) direct preference optimization (317) reinforcement learning (4122) reinforcement learning from human feedback (261) model alignment (219) language model alignment (142) language model (4573) supervised fine-tuning (310) reward model (251) preference learning (411)

Papers

Critic-V: VLM Critics Help Catch VLM Errors in Multimodal Reasoning CVPR 2025
Creative Preference Optimization EMNLP 2025
Image Difference Captioning via Adversarial Preference Optimization EMNLP 2025
SPPD: Self-training with Process Preference Learning Using Dynamic Value Margin EMNLP 2025
Controllable Protein Sequence Generation with LLM Preference Optimization AAAI 2025
Structured Policy Optimization: Enhance Large Vision-Language Model via Self-referenced Dialogue ICCV 2025
Atomic Consistency Preference Optimization for Long-Form Question Answering AACL 2025
CAPO: Confidence Aware Preference Optimization Learning for Multilingual Preferences AACL 2025
T-REG: Preference Optimization with Token-Level Reward Regularization ACL 2025
Noise Contrastive Alignment of Language Models with Explicit Rewards NIPS 2024
UltraMedical: Building Specialized Generalists in Biomedicine NIPS 2024
Panacea: Pareto Alignment via Preference Adaptation for LLMs NIPS 2024
RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback CVPR 2024
Robust Reinforcement Learning from Corrupted Human Feedback NIPS 2024
Team NP_PROBLEM at SemEval-2024 Task 7: Numerical Reasoning in Headline Generation with Preference Optimization NAACL 2024
PediatricsGPT: Large Language Models as Chinese Medical Assistants for Pediatric Applications NIPS 2024
Team NP_PROBLEM at SemEval-2024 Task 7: Numerical Reasoning in Headline Generation with Preference Optimization SEMEVAL 2024
Post-edits Are Preferences Too EMNLP 2024
Self-Consuming Generative Models with Curated Data Provably Optimize Human Preferences NIPS 2024
More Insightful Feedback for Tutoring: Enhancing Generation Mechanisms and Automatic Evaluation EMNLP 2024
Model-based Preference Optimization in Abstractive Summarization without Human Feedback EMNLP 2024
Step-level Value Preference Optimization for Mathematical Reasoning EMNLP 2024
Calibrating LLMs with Preference Optimization on Thought Trees for Generating Rationale in Science Question Scoring EMNLP 2024
BAPO: Base-Anchored Preference Optimization for Overcoming Forgetting in Large Language Models Personalization EMNLP 2024
Weak-to-Strong Reasoning EMNLP 2024