direct preference optimization

317 papers

Explore in graph

Also known as

DPO

Co-occurring keywords

large language model (12755) preference optimization (273) reinforcement learning from human feedback (261) preference learning (411) language model alignment (142) supervised fine-tuning (310) model alignment (219) preference alignment (142) reinforcement learning (4122) reward model (251)

Papers

RAG-HAT: A Hallucination-Aware Tuning Pipeline for LLM in Retrieval-Augmented Generation EMNLP 2024

Evolutionary Contrastive Distillation for Language Model Alignment EMNLP 2024

Step-level Value Preference Optimization for Mathematical Reasoning EMNLP 2024

PURE: Aligning LLM via Pluggable Query Reformulation for Enhanced Helpfulness EMNLP 2024

ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique Pipeline EMNLP 2024

Self-supervised Preference Optimization: Enhance Your Language Model with Preference Degree Awareness EMNLP 2024

Diffusion Model Alignment Using Direct Preference Optimization CVPR 2024

mDPO: Conditional Preference Optimization for Multimodal Large Language Models EMNLP 2024

Evaluating Psychological Safety of Large Language Models EMNLP 2024

On the Limited Generalization Capability of the Implicit Reward Model Induced by Direct Preference Optimization EMNLP 2024

Enhancing Alignment using Curriculum Learning & Ranked Preferences EMNLP 2024

Inverse-Q*: Token Level Reinforcement Learning for Aligning Large Language Models Without Preference Data EMNLP 2024

Filtered Direct Preference Optimization EMNLP 2024

Direct Preference Optimization: Your Language Model is Secretly a Reward Model NIPS 2023

Improving Contextual Query Rewrite for Conversational AI Agents through User-preference Feedback Learning EMNLP 2023

Deformable Mesh Transformer for 3D Human Mesh Recovery CVPR 2023

Improving Summarization with Human Edits EMNLP 2023