offline rlhf

contrastive kl regularization (1) policy-labeled preference learning (1) regret-based modeling (1) sequential contrastive learning (1) reward difference prediction (1) sample reweighting (1) ranking loss (1) language model alignment (1) direct preference optimization (1) preference learning (1)