conftrace_

kl divergence budget

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

overoptimization (1) policy confidence (1) large language model (1) alignment quality (1) direct preference optimization (1)

Papers

ConfPO: Exploiting Policy Model Confidence for Critical Token Selection in Preference Optimization ICML 2025