SkillSmith: Co-Evolving Skills and Tools for Self-Improving Agent Systems

Yangbo Wei Zhen Huang Shaoqiang Lu Junhong Qian Qifan Wang Chen Wu Lei He Shanghai Jiao Tong University, Shanghai, China Eastern Institute of Technology, Ningbo, China University of Science and Technology of China, Hefei, China Southeast University, Nanjing, China Ningbo Institute of Digital Twin, Ningbo, China · 2026

Read SkillSmith: Co-Evolving Skills and Tools for Self-Improving Agent Systems by Yangbo Wei Zhen Huang Shaoqiang Lu Junhong Qian Qifan Wang Chen Wu Lei He Shanghai Jiao Tong University, Shanghai, China Eastern Institute of Technology, Ningbo, China University of Science and Technology of China, Hefei, China Southeast University, Nanjing, China Ningbo Institute of Digital Twin, Ningbo, China (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01314.txt.

Introduction

Wei and co-authors let agent skills and tools evolve together. Agents store skills in external libraries for reuse. Libraries can grow, but context windows stay finite. Each improvement round also costs a finite budget. SkillSmith treats this as evolution under two budgets. Replicator dynamics allocate context across the skill pool. Randomized masking and Bayesian tools learn skill effects.

Four typed operations repair tools and shift logic across the boundary. Failed proposals become version-scoped nogoods for later rounds. These records guide repairs and veto repeat failures. Theory shows utility ascent for fixed-model dynamics. Tests span five Qwen3 point 5 scales. SkillSmith beats EvoSkill by up to 10 point 2 points on OfficeQA.

Catalog record

CREATORYangbo Wei Zhen Huang Shaoqiang Lu Junhong Qian Qifan Wang Chen Wu Lei He Shanghai Jiao Tong University, Shanghai, China Eastern Institute of Technology, Ningbo, China University of Science and Technology of China, Hefei, China Southeast University, Nanjing, China Ningbo Institute of Digital Twin, Ningbo, China
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.01314

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SkillSmith: Co-Evolving Skills and Tools for Self-Improving Agent Systems Yangbo Wei Zhen Huang Shaoqiang Lu Junhong Qian Qifan Wang Chen Wu Lei He Shanghai Jiao Tong University, Shanghai, China Eastern Institute of Technology, Ningbo, China University of Science and Technology of China, Hefei, China Southeast University, Nanjing, China Ningbo Institute of Digital Twin, Ningbo, China Abstract Recent self-evolving agents have shown that skills can be discovered, refined, and accumulated through execution. However, existing skill evolution frameworks typically assume a fixed tool layer and evaluate each skill independently, limiting their ability to repair tool-level failures or reason about interactions among skills. We propose SkillSmith , a synergy-aware skill–tool co-evolution framework. SkillSmith introduces a unified proposal space where reflection produces atomic bundles that jointly modify skills and tools—allowing tools to be wrapped, edited, composed, split, or retired when skill evolution identifies a reusable capability gap. To guide this joint search, SkillSmith maintains an ecological utility model inspired by Lotka–Volterra dynamics, where an interaction matrix estimated from execution traces captures pairwise complementarity and conflict among skills and provides pressure signals for retrieval, mutation prioritization, and retirement. Furthermore, SkillSmith records anti-patterns—failure signatures, attributions, and remedies—to accelerate diagnosis and veto proposals that repeat known mistakes. Experiments on three benchmarks (e.g., WildClawBench) and five Qwen3.5 scales show that SkillSmith consistently outperforms strong baselines, with gains that amplify as task complexity and multi-skill co-activation increase. 1 Introduction Tool use is now a foundational principle in large language model (LLM)-driven agents. Early systems, such as WebGPT 10 , MRKL 6 , ReAct 22 , and Toolformer 14 , pioneered the use of external APIs and environmental interactions to extend LLMs beyond pure text generation. This paradigm persists in modern agent architectures 18 ; 19 ; 4 . Instead of relying on isolated tool calls, recent systems increasingly organize reusable capabilities into Skills : structured capability packages comprising workflow instructions, executable scripts, domain reference materials, and metadata 23 . Consequently, at time t , the Skill library \mathcal{S}_{t} serves as an external, non-parametric state object maintained outside the model weights, functioning much like externally accessible memory in retrieval-augmented generation 7 . Despite the growing adoption of Skills, mechanisms for generating, repairing, and continuously improving them remain underexplored. Existing prompt-optimization methods, such as automatic prompt engineering 25 , ProTeGi 13 , and optimization-by-LLM approaches 21 , primarily search over natural-language instructions and other individual components. In contrast, optimizing a Skill library requires searching over a discrete, structured, and multi-component external policy space. Recent work has begun to automate Skill generation and improvement. Trace2Skill 11 and SkillX 17 extract transferable skill knowledge bases offline from execution traces. Online methods, including CoEvoSkills 24 explores adversarial co-evolution between a Skill generator and a verifier. SkillClaw 9 extends Skill evolution from private agent memory to a shared multi-user asset layer. EvoSkill 2 discovers and optimizes Skills through failure-driven analysis and Pareto-front selection, while D2Skill 16 models Skill utility using an explicitly computable credit signal. Concurrently, GEPA 1 shows that reflective textual evolution can be substantially more sample-efficient than scalar-reward reinforcement learning. Together, these studies 20 ; 8 ; 5 suggest that Skills are becoming a non-parametric, versionable, and governable external policy layer for LLM agents. Figure 1: Motivation of SkillSmith. Prior skill-evolution methods fix tools, ignore skill interactions, and forget failure diagnostics; SkillSmith addresses these limitations via skill–tool co-evolution , ecosystem dynamics , and anti-pattern memory , enabling robust agent self-improvement. However, improvements are often ambiguous: failures may arise from tool deficiencies, conflicting Skills, or unrecorded errors, rather than from the Skills themselves. For instance, a question-answering agent may fail to retrieve a document not due to an incorrect workflow, but because a search tool is outdated or multiple Skills interfere. Addressing such failures solely by rewriting Skill risks producing illusory gains while leaving the true causes unresolved. These considerations highlight three core limitations in current Skill-evolution systems, as illustrated in Fig. 1 . First, the tool layer is typically treated as fixed. Failures caused by missing, brittle, or mis-specified tools force systems to overcompensate at the Skill layer, leading to bloated and error-prone Skills. Second, Skill utility is often evaluated in isolation. Existing systems mutate only one Skill at a time, implicitly assuming that each Skill’s value is independent of the others. Yet, in realistic agent execution, multiple Skills are retrieved, composed, and applied simultaneously. Third, failure experience is rarely retained. Failed trajectories are typically consumed once during reflection, preserving only successful artifacts, which can result in repeated error diagnosis and inadvertent regeneration of retired Skills, wasting computation and slowing evolution. To address these challenges, we propose SkillSmith , a synergy-aware Skill–Tool co-evolution framework that jointly evolves Skills, Tools, and failure memory through three key extensions. (1) Bundle-based Skill–Tool co-evolution. Given failed execution traces, SkillSmith generates an atomic proposal bundle that jointly updates Skills and Tools. The bundle may revise Skills and apply typed Tool lifecycle operations— wrap , edit , compose , split , and retire —to repair, refactor, or retire existing Tools while ensuring safe and controlled tool evolution. Atomicity ensures that interdependent Skill and Tool changes take effect simultaneously, avoiding invalid intermediate states and allowing SkillSmith to address tool-level bottlenecks without bloating Skill descriptions. (2) Synergy-aware Skill ecosystem dynamics. Inspired by Lotka–Volterra competition–mutualism equations, SkillSmith estimates a Skill interaction matrix from execution logs. Positive values indicate complementarity, negative values indicate interference, while global capacity captures competition under limited retrieval, context, and maintenance budgets. The resulting utility dynamics prioritize Skills for mutation not only by isolated performance, but also by whether they suppress useful neighbors, duplicate capabilities, or lack necessary complements. (3) Anti-pattern memory. The anti-pattern memory records verified failure modes and their attributions. During reflection, it accelerates diagnosis by retrieving similar past failures and vetoes mutation proposals that resemble known patterns, preventing previously failed Skill–Tool configurations from recurring. Thus, the agent accumulates both what works and what should be avoided. We evaluate SkillSmith on OfficeQA, SealQA, and WildClawBench across five Qwen3.5 scales (9B–397B). At 397B, SkillSmith achieves 80.1% on OfficeQA (+18.3%) and 49.5% on SealQA (+18.9%), with gains growing monotonically with model size. On WildClawBench, SkillSmith sustains improvement through Day 6 where skill-only baselines plateau by Day 2–3, with the largest advantage on tool-intensive categories. Ablations confirm that locking the tool layer causes the single largest drop ( - 6.8% on WCB), removing ecological governance inflates the library to 21+7 components, and removing anti-pattern memory triples the regression rate. 2 Preliminaries and Problem Formulation Agent System as External State. We consider an LLM-driven agent whose capabilities are determined jointly by model weights and a collection of external, non-parametric assets maintained outside the model. At time t , the external state is a triple \Sigma_{t}=(\mathcal{S}_{t},\;\mathcal{T}_{t},\;\mathcal{F}_{t}), (1) comprising three components defined below. All three components are non-parametric. The resulting assets can be inspected, versioned, and transferred across models. Skills. A skill s=(m,w,r,u) packages a task-facing strategy: metadata m (name, trigger condition, version), a workflow body w (orchestration logic and step-level instructions), reference resources r (templates, domain knowledge), and a scalar utility estimate u . The skill library \mathcal{S}_{t}=\{s_{1},\dots,s_{n}\} tells the agent how to approach a class of tasks . Tools. A tool \tau=(d,f,\sigma) exposes an atomic operation: an interface description d ,

Read the complete text