conftrace_

reinforcement learning from human feedback

278 papers

Explore in graph

Co-occurring keywords

large language model (13587) reward model (276) reinforcement learning (4352) direct preference optimization (332) language model alignment (142) reward modeling (164) human feedback (161) preference learning (418) model alignment (226) language model (4599)

Papers

OpenAssistant Conversations - Democratizing Large Language Model Alignment NIPS 2023
Sequential Preference Ranking for Efficient Reinforcement Learning from Human Feedback NIPS 2023
Direct Preference Optimization: Your Language Model is Secretly a Reward Model NIPS 2023
Fine-Grained Human Feedback Gives Better Rewards for Language Model Training NIPS 2023
Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewards NIPS 2023
Is RLHF More Difficult than Standard RL? A Theoretical Perspective NIPS 2023
SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF EMNLP 2023
Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluation EMNLP 2023
Principled Reinforcement Learning with Human Feedback from Pairwise or K-wise Comparisons ICML 2023
Pretraining Language Models with Human Preferences ICML 2023
Aligning Language Models with Preferences through $f$-divergence Minimization ICML 2023
trlX: A Framework for Large Scale Open Source RLHF EMNLP 2023
trlX: A Framework for Large Scale Reinforcement Learning from Human Feedback EMNLP 2023
The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values EMNLP 2023
Language Models can Solve Computer Tasks NIPS 2023
ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generation NIPS 2023
BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Dataset NIPS 2023
A Study on Annotation Interfaces for Summary Comparison ACL 2023
Can we trust the evaluation on ChatGPT? ACL 2023
Discovering Language Model Behaviors with Model-Written Evaluations ACL 2023
Reliability Check: An Analysis of GPT-3’s Response to Sensitive Topics and Prompt Wording ACL 2023
Scaling Laws for Reward Model Overoptimization ICML 2023
HuatuoGPT, Towards Taming Language Model to Be a Doctor EMNLP 2023
AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback NIPS 2023
Towards Boosting the Open-Domain Chatbot with Human Feedback ACL 2023