conftrace_

language model alignment

142 papers

Explore in graph

Co-occurring keywords

large language model (13587) reinforcement learning from human feedback (278) direct preference optimization (332) reinforcement learning (4352) preference learning (418) reward model (276) preference optimization (302) model alignment (226) reward modeling (164) language model (4599)

Papers

Preference Learning Algorithms Do Not Learn Preference Rankings NIPS 2024
Adaptive Preference Scaling for Reinforcement Learning with Human Feedback NIPS 2024
Cal-DPO: Calibrated Direct Preference Optimization for Language Model Alignment NIPS 2024
Noise Contrastive Alignment of Language Models with Explicit Rewards NIPS 2024
Multi-turn Reinforcement Learning with Preference Human Feedback NIPS 2024
Provably Mitigating Overoptimization in RLHF: Your SFT Loss is Implicitly an Adversarial Regularizer NIPS 2024
The Wisdom of Hindsight Makes Language Models Better Instruction Followers ICML 2023
SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF EMNLP 2023
Aligning Language Models to User Opinions EMNLP 2023
Aligning Language Models with Preferences through $f$-divergence Minimization ICML 2023
Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision NIPS 2023
Tuna: Instruction Tuning using Feedback from Large Language Models EMNLP 2023
Direct Preference Optimization: Your Language Model is Secretly a Reward Model NIPS 2023
Aligning Language Models with Human Preferences via a Bayesian Approach NIPS 2023
RRHF: Rank Responses to Align Language Models with Human Feedback NIPS 2023
Training language models to follow instructions with human feedback NIPS 2022
QUARK: Controllable Text Generation with Reinforced Unlearning NIPS 2022