Trajectory-Triggered Sparse Collaborative Decoding
Abstract
AbstractUncertainty estimates in language models are typically computed locally, from the predictive distribution at an individual decoding step. In multi-step reasoning, however, the outcome of interest is often trajectory-level: whether the final answer produced after many intermediate steps will be correct. We show that these two notions of uncertainty can diverge sharply, and study what an uncertainty signal should look like when the prediction target is failure of the complete reasoning trajectory. We first quantify the limitation of local uncertainty for predicting final-answer failure. On GSM8K with a Qwen-1.5B draft model, token-level entropy predicts final incorrectness at AUC 0.531, negative log-likelihood at 0.528, and logit margin at 0.474. Short-window changes in these quantities remain between 0.498 and 0.503. A model can therefore remain locally confident while following an incorrect derivation, or become locally uncertain at a step from which it subsequently recovers. Next-token uncertainty does not directly measure the risk accumulated over a reasoning trajectory. The shape of the confidence trajectory is substantially more informative. We represent each observed prefix using approximately 85 statistics describing the evolution of entropy, likelihood, logit margin, and probability concentration, including means, extrema, percentiles, slopes, variances, temporal changes, and position-dependent behavior. A lightweight logistic predictor trained only on draft trajectories labeled by final correctness reaches AUC 0.864, while the strongest individual trajectory feature reaches 0.803. Its learned weights associate failure with declining logit-margin separation, increasing temporal volatility, and weaker top-k probability concentration. A complementary wavelet analysis finds elevated mid-frequency oscillation in incorrect trajectories, suggesting that persistent instability and unresolved competition between reasoning paths carry more information than iso