Foundation First: Stabilizing SLM Agents via Pre-execution Logical Scaffolding
Abstract
AbstractIn on-device agentic systems, Small Language Models (SLMs) are essential for ensuring privacy-preserving personalization and low-latency execution. However, despite their capacity to handle isolated atomic tasks, during complex multi-step orchestration SLMs frequently suffer from stochastic drift—a phenomenon where minor logical deviations cascade into irrecoverable trajectory failures. In this work, we demonstrate the primacy of pre-execution planning, revealing that mitigating initial logical drift is vastly more effective than mid-trajectory interventions. Building on this insight, we propose FORST(FOundation fiRST) framework that implements sequential logical scaffolding in pre-execution planning, where predefined expert anchors are injected as fixed pre-computed KV-cache states. While the scaffolding ensures logical stability, KV-cache reuse efficiently realizes the structured anchor prefix without repeatedly prefilling static anchors. Then, we can maintain a monolithic reasoning chain within predefined logical planning boundaries and effectively eliminate the redundant computational overhead of structured anchors. Extensive evaluations on the MCPEval benchmark demonstrate that establishing this rigid logical foundation via achieves competitive or numerically higher performance than frontier models, while achieving an latency reduction on edge-device platforms.