preference optimization

273 papers

Explore in graph

Also known as

ACPO RPO MMPO ORPO KTO DPO SPO PO

Co-occurring keywords

large language model (12755) direct preference optimization (317) reinforcement learning (4122) reinforcement learning from human feedback (261) model alignment (219) language model alignment (142) language model (4573) supervised fine-tuning (310) reward model (251) preference learning (411)

Papers

Self-training Language Models for Arithmetic Reasoning EMNLP 2024

V-DPO: Mitigating Hallucination in Large Vision Language Models via Vision-Guided Direct Preference Optimization EMNLP 2024

Preference Tuning For Toxicity Mitigation Generalizes Across Languages EMNLP 2024

Margin Matching Preference Optimization: Enhanced Model Alignment with Granular Feedback EMNLP 2024

ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique Pipeline EMNLP 2024

Improving Factual Consistency of News Summarization by Contrastive Preference Optimization EMNLP 2024

Subject-driven Text-to-Image Generation via Preference-based Reinforcement Learning NIPS 2024

Iterative Reasoning Preference Optimization NIPS 2024

Automated Multi-level Preference for MLLMs NIPS 2024

What Makes and Breaks Safety Fine-tuning? A Mechanistic Study NIPS 2024

Negating Negatives: Alignment with Human Negative Samples via Distributional Dispreference Optimization EMNLP 2024

Can Machine Unlearning Reduce Social Bias in Language Models? EMNLP 2024

Rethinking Pragmatics in Large Language Models: Towards Open-Ended Evaluation and Preference Tuning EMNLP 2024

RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMs EMNLP 2024

A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques ACL 2024

Persuading across Diverse Domains: a Dataset and Persuasion Large Language Model ACL 2024

Are U a Joke Master? Pun Generation via Multi-Stage Curriculum Learning towards a Humor LLM ACL 2024

Detecting and Preventing Hallucinations in Large Vision Language Models AAAI 2024

WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language Models NIPS 2024

SpeechAlign: Aligning Speech Generation to Human Preferences NIPS 2024

HIVE: Harnessing Human Feedback for Instructional Visual Editing CVPR 2024

Advancing Large Language Model Attribution through Self-Improving EMNLP 2024

Contrastive Policy Gradient: Aligning LLMs on sequence-level scores in a supervised-friendly fashion EMNLP 2024

Inverse-Q*: Token Level Reinforcement Learning for Aligning Large Language Models Without Preference Data EMNLP 2024

Word Alignment as Preference for Machine Translation EMNLP 2024