SkillGrad: Optimizing Agent Skills Like Gradient Descent

Hanyu Wang, Yifan Lan, Bochuan Cao · 2026

Read SkillGrad: Optimizing Agent Skills Like Gradient Descent by Hanyu Wang, Yifan Lan, Bochuan Cao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27760.txt.

Introduction

Wang and colleagues borrow the step-by-step logic of gradient descent to tune reusable agent skills instead of rewriting them by guesswork. SkillGrad runs a skill on tasks, turns failures into written correction signals, and carries repeated diagnoses forward in a memory layer so later fixes build on earlier ones. On spreadsheet and table-question tests it beat training-based rivals on two base models.

Catalog record

CREATORHanyu Wang, Yifan Lan, Bochuan Cao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58933
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.27760

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SkillGrad: Optimizing Agent Skills Like Gradient Descent Hanyu Wang, Yifan Lan, Bochuan Cao Abstract Agent skills provide a lightweight way to adapt LLM agents to specialized domains by storing reusable procedural knowledge in structured files. However, whether downloaded from third parties or self-generated, these skills are often unreliable, incomplete, or outdated. Existing skill-evolution methods often address these deficiencies through heuristic reflections without an explicit optimization formulation. In this paper, we propose SkillGrad , a gradient-descent-inspired framework for optimizing agent skills. SkillGrad treats the skill package as a structured parameter to optimize in a gradient descent fashion: task executions provide trajectory-level loss evidence, automatic diagnoses then provide text-based gradients that indicate the correction directions. To stabilize optimization across iterations, a momentum agent accumulates recurring diagnostic patterns into a persistent memory overlay. Finally, an LLM-based patcher executes the parameter update by applying layer-aware edits to the skill package. Evaluated on SpreadsheetBench Verified and WikiTableQuestions, SkillGrad consistently outperforms training-based skill evolution baselines across two backbone LLMs, improving over the strongest training-based baseline by 6.7 6.7 percentage points on average. Ablations further show that momentum and contrastive diagnosis both contribute to the final skill quality. Code will be updated at https://github.com/wwwhy725/SkillGrad 1 Introduction Large Language Model agents ( 26 ; 21 ) have evolved rapidly, achieving impressive proficiency in long-horizon decision-making tasks such as reasoning ( 4 ; 24 ; 9 ) , planning ( 7 ; 22 ) , and web navigation ( 8 ; 6 ; 23 ) . However, many practical agent applications require more than general problem-solving ability. In specialized, procedure-heavy domains, such as spreadsheet manipulation ( 5 ) , document editing ( 10 ) , and codebase maintenance ( 11 ) , agents must repeatedly follow domain-specific workflows, use specialized tools correctly, and handle recurring edge cases. Adapting agents to various domains through fine-tuning ( 13 ; 3 ) , retrieval pipelines ( 29 ) , or repeated web searches ( 19 ) can be costly or cumbersome, especially when the needed knowledge is procedural rather than purely factual. To bridge this gap, Agent Skills offer a lightweight alternative. They are persistent file packages that an agent can load progressively when solving tasks. Unlike a flat prompt, a skill is a structured artifact. Its metadata determines when it is activated, its SKILL.md body is always loaded after activation, and additional resources are consulted only when relevant. However, the usefulness of this adaptation depends critically on skill quality. SkillsBench ( 12 ) shows that automatically generated skills can remain well below expert-written ones, and in some cases even degrade agent performance relative to using no skill. This problem is broader than automatic skill generation, because any fixed skill package can omit task-specific edge cases, become misaligned with the target task distribution, or encode brittle assumptions about tools and workflows. Such problems motivate a natural question: can we treat a skill as an optimizable artifact and systematically improve it after initialization? To answer this question, we introduce SkillGrad , a gradient-descent-inspired framework for optimizing agent skills. The correspondence is conceptual rather than numeric. Agent skills are discrete text artifacts, so there is no literal derivative. Instead, the analogy provides a principled design lens, summarized in Table 1 . The parameter is the structured skill package S_{t} . At each iteration, the current skill is executed on a mini-batch of tasks, producing outcomes r_{t,i} and trajectories \tau_{t,i} as loss evidence. A diagnoser converts this evidence into textual update signals d_{t,i} , analogous to per-example gradients. Failed trajectories expose corrective changes, while contrastive successful trajectories, where the initial skill failed but the current skill succeeds, identify behaviors worth preserving. A momentum agent accumulates recurring patterns into a persistent memory M_{t} and a current overlay O_{t} , and a patcher applies a layer-aware edit to obtain the next skill package S_{t+1} . We evaluate SkillGrad on SpreadsheetBench Verified ( 14 ) and WikiTableQuestions ( 17 ) using two backbone LLMs and two sources of initial xlsx skills, one generated by an LLM and one downloaded from a third party. Both cases share the same goal of optimizing the given skill package under a fixed configuration. SkillGrad outperforms training-free settings and training-based skill improvement baselines, showing that the framework is effective and not tied to a particular skill source. Ablations show that removing momentum or contrastive diagnosis lowers held-out accuracy, and analysis of batch size, iteration budget, and token cost clarify the behavior and budget of the framework. In summary, our contributions are three-fold: • We formulate agent skill improvement as optimization over a structured skill artifact, with explicit analogues of parameter, loss evidence, gradient, momentum, and update. • Based on the formulation, we propose SkillGrad, a multi-agent framework that diagnoses executions, accumulates recurring patterns, and applies layer-aware skill patches. • Empirical experiments demonstrate that SkillGrad improves agents on spreadsheet tasks from both LLM-generated and third-party initial skills, with gains under in-domain and out-of-domain evaluations. Gradient descent SkillGrad optimization Parameter Structured skill package S_{t} Loss evidence Task outcome and trajectory evidence \mathcal{E}_{t}(\mathcal{T}_{i}) Gradient signal Task diagnosis d_{t,i} Momentum Pattern memory M_{t} and overlay O_{t} Parameter Update Layer-aware patch S_{t+1}=\mathrm{Patch}(S_{t},\{d_{t,i}\}_{i=1}^{B},M_{t},O_{t}) Table 1: Conceptual correspondence between gradient descent and SkillGrad. 2 Related Work Recent work has explored agent skills as reusable artifacts that can be generated, updated, and reused by LLM agents. The training-based baselines in our experiments are EvoSkill and Trace2Skill because both consume task executions and produce standalone skill artifacts, which allows all methods to be evaluated under the same initialization, training tasks, backbone model, and held-out split. EvoSkill ( 2 ) follows an iterative skill evolution formulation. It analyzes failed executions, turns the resulting diagnoses into new or revised skills, and selects candidates using held-out validation performance. This corresponds to a failure-driven update strategy with validation-based selection, while SkillGrad optimizes one current skill artifact using both failed executions and contrastive successful executions as loss evidence. Trace2Skill ( 16 ) follows a trajectory-to-skill distillation formulation. It analyzes a pool of execution trajectories, extracts local lessons, and hierarchically consolidates them into a unified skill directory. This gives an offline trace-distillation strategy, while in comparison, SkillGrad repeatedly executes the current skill so that each update changes the evidence observed in later iterations. Other skill-oriented systems study broader forms of skill acquisition, memory, and reuse. SkillX ( 20 ) constructs a plug-and-play skill knowledge base by organizing experience into multi-level skills, refining them with execution feedback, and expanding the library with newly generated skills. SkillClaw ( 15 ) studies collective skill evolution in multi-user agent ecosystems, where trajectories accumulated across users are aggregated to refine existing skills or extend a shared skill repository. Memento-Skills ( 30 ) treats structured markdown skills as persistent memory, enabling agents to retrieve, update, and expand task-specific skills through a read–write learning loop. CoEvoSkills ( 28 ) constructs complex multi-file skill packages through a skill generator and a separate verifier that critiques executions and provides feedback for later revisions. AutoSkill ( 25 ) focuses on lifelong personalized agents by deriving, maintaining, and reusing skills from user dialogue and interaction traces. Together, these works broaden agent skill learning toward skill libraries, shared repositories, verifier-guided construction, and lifelong personalization. Figure 1: Overview of SkillGrad. Given

Read the complete text