SAGE: Answer-Conditioned Uncertainty Targets for Verbal Confidence Alignment
Abstract
AbstractLarge language models increasingly express uncertainty through verbalized confidence, yet these expressions often fail to reflect the model’s sampled behavior. We study verbal confidence alignment as a distributional calibration problem, where the confidence target for a prompt is estimated from repeated model outputs rather than from a single response. However, group rollouts alone are insufficient, since the resulting target must provide a useful training signal. We propose Semantic-Answer Guided Entropy (SAGE), a group-level uncertainty target that constructs an answer-conditioned uncertainty geometry over sampled responses. SAGE preserves categorical, numeric, and symbolic answer distinctions while maintaining a smooth and scale-preserving calibration signal. We further introduce Group-Uncertainty Preference Optimization (GUPO), an uncertainty-channel training framework that supervises verbal confidence expressions rather than the full response. Experiments across factual, mathematical, and multiple-choice reasoning tasks show improved confidence ranking, lower calibration error, and reduced overconfidence.