Edit4Agency: Efficiently Enhancing Agent Sub-Capabilities of Small Language Models via Model Editing
Abstract
AbstractCurrently, most agentic systems are driven by mainstream closed-source large language models (LLMs), such as GPT-5 and Gemini 3, resulting in high operational costs. As a result, deploying customized small language models (SLMs) to replace LLMs in agent components has attracted increasing attention. However, the limited capabilities of SLMs often render them inadequate for agent tasks. To address this, we propose Edit4Agency, a novel framework that utilizes model editing to efficiently and effectively enhance agent sub-capabilities of SLMs. By formalizing tasks as a sequence generation problem triggered by specific conditions, the framework embeds task triggers into system prompts and performs model editing through localized parameter updates, eliminating the need for large-scale retraining. Extensive experiments across multiple datasets and case studies in agent systems demonstrate that model editing, with only 50 data samples, enables a base model without instruction tuning to acquire new skills such as tool calling while maintaining its general capabilities. The results show that Edit4Agency outperforms instruction-tuned SLMs, constrained decoding, and SLMs trained with large-scale supervised fine-tuning or reinforcement learning methods.