conftrace_

mode-seeking objectives

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

negative gradient (1) likelihood (1) categorical distribution (1) preference fine-tuning (1) on-policy sampling (1)

Papers

Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Data ICML 2024