← Keywords

preference alignment

142 papers

Explore in graph

Also known as

DPO

Co-occurring keywords

large language model (12755) direct preference optimization (317) reinforcement learning from human feedback (261) reinforcement learning (4122) reward model (251) reward modeling (159) preference optimization (273) language model alignment (142) instruction tuning (810) language model (4573)

Papers

What Makes and Breaks Safety Fine-tuning? A Mechanistic Study NIPS 2024
Aligning to Thousands of Preferences via System Message Generalization NIPS 2024
A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques ACL 2024
CoTKR: Chain-of-Thought Enhanced Knowledge Rewriting for Complex Knowledge Graph Question Answering EMNLP 2024
Let Me Teach You: Pedagogical Foundations of Feedback for Language Models EMNLP 2024
Encourage or Inhibit Monosemanticity? Revisit Monosemanticity from a Feature Decorrelation Perspective EMNLP 2024
LLMs Beyond English: Scaling the Multilingual Capability of LLMs with Cross-Lingual Feedback ACL 2024
InstructGraph: Boosting Large Language Models via Graph-centric Instruction Tuning and Preference Alignment ACL 2024
Improving Discriminative Capability of Reward Models in RLHF Using Contrastive Learning EMNLP 2024
GDPO: Learning to Directly Align Language Models with Diversity Using GFlowNets EMNLP 2024
Evidence-Focused Fact Summarization for Knowledge-Augmented Zero-Shot Question Answering EMNLP 2024
BPO: Staying Close to the Behavior LLM Creates Better Online LLM Alignment EMNLP 2024
Panacea: Pareto Alignment via Preference Adaptation for LLMs NIPS 2024
One-Shot Safety Alignment for Large Language Models via Optimal Dualization NIPS 2024
DINGO: Towards Diverse and Fine-Grained Instruction-Following Evaluation AAAI 2024
Multi-modal Preference Alignment Remedies Degradation of Visual Instruction Tuning on Language Models ACL 2024
Knowledgeable Preference Alignment for LLMs in Domain-specific Question Answering ACL 2024
Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignment ACL 2024
BIDER: Bridging Knowledge Inconsistency for Efficient Retrieval-Augmented LLMs via Key Supporting Evidence ACL 2024
LIRE: listwise reward enhancement for preference alignment ACL 2024
ALaRM: Align Language Models via Hierarchical Rewards Modeling ACL 2024
Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability EMNLP 2024
Towards Aligning Language Models with Textual Feedback EMNLP 2024
Preference-Guided Reflective Sampling for Aligning Language Models EMNLP 2024
ProConSuL: Project Context for Code Summarization with LLMs EMNLP 2024