CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verification
Hanrong Zhang, Shicheng Fan, Henry Peng Zou, Yankai Chen, Zhenting Wang, Jiayu Zhou, Chengze Li, Wei-Chieh Huang, Yifei Yao, Kening Zheng, Xue (Steve) Liu, Xiaoxiao Li, Philip S. Yu, [6pt] University of Illinois Chicago · 2026
Read CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verification by Hanrong Zhang, Shicheng Fan, Henry Peng Zou, Yankai Chen, Zhenting Wang, Jiayu Zhou, Chengze Li, Wei-Chieh Huang, Yifei Yao, Kening Zheng, Xue (Steve) Liu, Xiaoxiao Li, Philip S. Yu, [6pt] University of Illinois Chicago (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-01687.txt.
Introduction
Zhang and colleagues propose CoEvoSkills, a framework letting agents build their own skill packs without hand-writing. A skill bundles linked files for multi-step work, unlike a tool, one self-contained function. Hand authoring is slow and can clash with how machines reason. Their design pairs a Skill Generator that keeps refining skills with a Surrogate Verifier evolving beside it, giving feedback without hidden test answers. On SkillsBench the system beat five baselines on Claude Code and Codex and carried over to six more models.
Catalog record
| CREATOR | Hanrong Zhang, Shicheng Fan, Henry Peng Zou, Yankai Chen, Zhenting Wang, Jiayu Zhou, Chengze Li, Wei-Chieh Huang, Yifei Yao, Kening Zheng, Xue (Steve) Liu, Xiaoxiao Li, Philip S. Yu, [6pt] University of Illinois Chicago |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68052 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.01687
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verification Hanrong Zhang, Shicheng Fan, Henry Peng Zou, Yankai Chen, Zhenting Wang, Jiayu Zhou, Chengze Li, Wei-Chieh Huang, Yifei Yao, Kening Zheng, Xue (Steve) Liu, Xiaoxiao Li, Philip S. Yu, [6pt] University of Illinois Chicago Abstract Anthropic proposes the concept of skills for LLM agents to tackle multi-step professional tasks that simple tool invocations cannot address. A tool is a single, self-contained function, whereas a skill is a structured bundle of interdependent multi-file artifacts. Currently, skill generation is not only label-intensive due to manual authoring, but also may suffer from human--machine cognitive misalignment, which can lead to degraded agent performance, as evidenced by evaluations on SkillsBench. Therefore, we aim to enable agents to autonomously generate skills. However, existing self-evolving methods designed for tools cannot be directly applied to skills due to their increased complexity. To address these issues, we propose CoEvoSkills 1 1 1 Project page: https://zhang-henry.github.io/CoEvoSkills/ , a self-evolving skills framework that enables agents to autonomously construct complex, multi-file skill packages. Specifically, CoEvoSkills couples a Skill Generator that iteratively refines skills with a Surrogate Verifier that co-evolves to provide informative and actionable feedback without access to ground-truth test content. On SkillsBench, CoEvoSkills achieves the highest pass rate among five baselines on both Claude Code and Codex, and also exhibits strong generalization capabilities to six additional LLMs. 1 Introduction LLM agents have advanced rapidly in reasoning, planning, and interaction with their environments ( 33 ; 34 ; 8 ; 35 ; 9 ; 17 ; 16 ) . Among the key drivers of this progress is the ability to invoke external tools and APIs ( 23 ; 21 ; 20 ) . However, professional open-ended tasks, such as complex software repair, multi-step scientific analysis, and enterprise data pipeline orchestration, require far more than isolated tool invocations. Agents must orchestrate a coherent procedure across multiple steps and artifacts: decomposing goals, coordinating tools, recovering from failures, and validating intermediate outputs. This is profoundly challenging because decisions are long-horizon, instructions and scripts are tightly coupled, and reliable environmental feedback is often sparse or delayed. To bridge the gap, Anthropic proposed the concept of agent skills ( 2 ) . Fig. 1 illustrates the difference between a tool and a skill: a tool is usually a simple function, whereas a skill is a structured package of workflow instructions, executable scripts, and domain references ( 30 ) . According to the systematic evaluation presented in SkillsBench ( 12 ) , equipping agents with well-crafted skills yields consistent performance gains across a broad spectrum of professional domains, including software engineering and scientific analysis etc., confirming that structured procedural guidance substantially augments task-solving capability beyond what bare tool access affords. Despite the demonstrated utility of skills, the prevailing paradigm relies almost entirely on human authoring, a process that is both labor-intensive and difficult to scale, with no systematic guarantee of output quality. As demonstrated in Fig. 6 , the SkillsBench evaluation ( 12 ) reveals that human-curated skills yield highly uneven gains: while certain domains benefit substantially, others, such as Natural Science, even exhibit degraded performance after skill integration. We hypothesize that a key driver of this inconsistency is human–machine cognitive misalignment : workflows and abstractions designed to be intuitive for human experts do not naturally match how LLM agents process context, reason, and act under execution constraints. Figure 1: Tool–skill difference illustration. To reduce manual effort, recent approaches have shifted from pre-defining static tools or APIs to self-evolve tools or tools libraries by the LLM agent itself ( 6 ; 11 ; 14 ; 26 ; 28 ) . However, these methods suffer from a fundamental tool–skill gap : they are inherently designed for one-shot generation of simple, self-contained functions, and are inadequate for the creation of structured, multi-file skill packages that coordinate workflow instructions, executable scripts, and domain references across multiple artifacts. Moreover, the work 1 relies heavily on ground-truth supervision for failure diagnosis , limiting applicability in real-world settings where such signals are unavailable. Figure 2: Skill quality improvement across 5 evolution rounds. CoEvoSkills surpasses human-curated skills within 5 evolution iterations. To address these challenges, we propose a self-evolving skills framework CoEvoSkills . To overcome the inherent unreliability of one-shot multi-file skill generation, we design a main component, the Skill Generator , to iteratively generate and refine skill bundles, with skill quality steadily improving across evolution rounds, as shown in Fig. 2 . It also maintains a persistent conversation context that accumulates high-fidelity feedback from another main component, the Surrogate Verifier , across iterations. The Surrogate Verifier , a separate LLM session without inheriting the generator’s biases, is designed to address the lack of ground-truth feedback in the real world. It synthesizes test cases and scripts according to the task instructions and environment, and provides high-fidelity feedback to the Skill Generator to co-evolutionarily improve skill generation quality. In summary, our key contributions are as follows: ❶ We introduce CoEvoSkills , a co-evolutionary framework for LLM agents to self-evolve robust multi-file skill packages. ❷ We demonstrate key insights on autonomous skill generation: (i) agents create better skills than human-curated ones by capturing the reasoning patterns and tool-use strategies that agents actually need; (ii) self-evolved skills are portable across different model families , as the evolved packages encode reusable task structure rather than model-specific artifacts. ❸ We conduct extensive experiments on SkillsBench, CoEvoSkills achieves the highest pass rate of 71.1% (+40.5pp over the no-skill baseline), substantially surpassing all five baselines. Furthermore, skills evolved by a single frontier LLM transfer effectively to six additional LLMs from five companies, yielding 35–45pp gains over their respective no-skill baselines. 2 Related Work LLM Agent Skills. Anthropic introduced Agent Skills ( 2 ) as shown in Fig. 1 . A recent systematization ( 10 ) further distinguishes skills from atomic tools and one-off plans, defining them as reusable modules with explicit applicability and termination conditions. SkillsBench ( 12 ) provides the first systematic benchmark for evaluating agent skills, comprising 87 tasks across 11 domains with deterministic verifiers. Several learning-based approaches attempt to close this gap. SAGE ( 27 ) trains agents on chains of related tasks with a skill-integrated reward, yet the resulting skills remain single-file programmatic functions rather than structured multi-file packages. SkillRL ( 29 ) distills trajectories into a hierarchical skill bank via reinforcement learning, but relies on teacher-guided distillation and produces prompt-level heuristics rather than executable artifacts. CoEvoSkills instead generates structured, multi-file skill packages and evolves them through iterative verification. Self-evolving LLM Agents. A growing body of work automates the self-improvement of agent capabilities, yet existing methods exhibit two recurring shortcomings. First, most self-evolving pipelines produce only single tools or function APIs or just prompt heuristics ( 26 ; 11 ; 28 ; 14 ; 6 ; 7 ) , and none can construct the multi-file structure a full skill package demands. Moreover, AutoSkill ( 32 ) and AutoRefine ( 22 ) extract reusable knowledge as prompt templates rather than executable packages, while SEAgent ( 25 ) internalizes capabilities into model weights, making them non-inspectable and non-transferable ( 10 ) . Second, some methods heavily rely on ground-truth signals for failure diagnosis, limiting applicability when such supervision is unavailable ( 1 ;