conftrace_

reward hacking

34 papers

Explore in graph

Co-occurring keywords

reinforcement learning (4352) reinforcement learning from human feedback (278) reward model (276) direct preference optimization (332) reward modeling (164) reward function (291) language model (4599) safe reinforcement learning (120) language model alignment (142) kl divergence (196)

Papers

Language Model Alignment with Elastic Reset NIPS 2023
Reward Gaming in Conditional Text Generation ACL 2023
Path-Specific Objectives for Safer Agent Incentives AAAI 2022
Defining and Characterizing Reward Gaming NIPS 2022
Direct Behavior Specification via Constrained Reinforcement Learning ICML 2022
Learning Human Objectives by Evaluating Hypothetical Behavior ICML 2020
Safe Imitation Learning via Fast Bayesian Reward Inference from Preferences ICML 2020
Meta Learning for Image Captioning AAAI 2019
Inverse Reward Design NIPS 2017