preference optimization

273 papers

Explore in graph

Also known as

ACPO RPO MMPO ORPO KTO DPO SPO PO

Co-occurring keywords

large language model (12755) direct preference optimization (317) reinforcement learning (4122) reinforcement learning from human feedback (261) model alignment (219) language model alignment (142) language model (4573) supervised fine-tuning (310) reward model (251) preference learning (411)

Papers

TRANS-ZERO: Self-Play Incentivizes Large Language Models for Multilingual Translation Without Parallel Data ACL 2025

Antidote: A Unified Framework for Mitigating LVLM Hallucinations in Counterfactual Presupposition and Object Perception CVPR 2025

Co-Evolving LLMs and Embedding Models via Density-Guided Preference Optimization for Text Clustering EMNLP 2025

𝒜3: Automatic Alignment Framework for Attributed Text Generation ACL 2025

Sakura at SemEval-2025 Task 2: Enhancing Named Entity Translation with Fine-Tuning and Preference Optimization SEMEVAL 2025

Atomic Consistency Preference Optimization for Long-Form Question Answering IJCNLP 2025

PERSONA: A Reproducible Testbed for Pluralistic Alignment COLING 2025

Teaching Models to Balance Resisting and Accepting Persuasion NAACL 2025

ComPO: Community Preferences for Language Model Personalization NAACL 2025

BPO: Towards Balanced Preference Optimization between Knowledge Breadth and Depth in Alignment NAACL 2025

PORT: Preference Optimization on Reasoning Traces NAACL 2025

PromptOptMe: Error-Aware Prompt Compression for LLM-based MT Evaluation Metrics NAACL 2025

Sentimatic: Sentiment-guided Automatic Generation of Preference Datasets for Customer Support Dialogue System NAACL 2025

LogRules: Enhancing Log Analysis Capability of Large Language Models through Rules NAACL 2025

RewardBench: Evaluating Reward Models for Language Modeling NAACL 2025

LiPO: Listwise Preference Optimization through Learning-to-Rank NAACL 2025

Style Transfer with Multi-iteration Preference Optimization NAACL 2025

Sequence-level Large Language Model Training with Contrastive Preference Optimization NAACL 2025

Aligning to What? Limits to RLHF Based Alignment NAACL 2025

A Practical Analysis of Human Alignment with *PO NAACL 2025

Evaluating Design Choices in Verifiable Generation with Open-source Models NAACL 2025

AIGI-Holmes: Towards Explainable and Generalizable AI-Generated Image Detection via Multimodal Large Language Models ICCV 2025

Factorized Learning for Temporally Grounded Video-Language Models ICCV 2025

Cycle Consistency as Reward: Learning Image-Text Alignment without Human Preferences ICCV 2025

Efficient Long Context Language Model Retrieval with Compression ACL 2025