ThinkLeap: Reasoning Optimization Through Confidence-Guided Cognitive Leap Extraction
Abstract
AbstractLarge Reasoning Models (LRMs) show remarkable capabilities in complex reasoning tasks through Chain-of-Thought (CoT) mechanisms. However, their reasoning processes frequently suffer from overthinking, generating inefficient patterns and substantial overhead without improving quality. Existing pruning approaches typically rely on computationally expensive external teacher models or aggregated sequence-level metrics, failing to capture the fine-grained, intrinsic cognitive state of individual reasoning steps. In this paper, we propose ThinkLeap, a novel confidence-guided optimization framework that identifies and retains only critical cognitive leaps within reasoning chains. Our approach is grounded in the observation that a model’s internal confidence dynamics serve as a fine-grained structural signal: rising confidence often reflects evidence accumulation, while declining confidence signals doubt or redundancy. By leveraging these dynamics, ThinkLeap autonomously replaces inefficient steps with ellipsis markers, preserving the logical flow while signaling omitted deliberation. Extensive experiments across three challenging reasoning benchmarks demonstrate that ThinkLeap establishes a new paradigm for efficient reasoning, achieving an average 19.4% reduction in reasoning length while maintaining comparable accuracy.