SkillPyramid : A Hierarchical Skill Consolidation Framework for Self-Evolving Agents
Yuan Xiong, Miao Ziqi, Chen Qian, Lijun Li, Yequan Wang, Shizhu He, Jun Zhao, Kang Liu, [0.6em] The Key Laboratory of Cognition, Decision Intelligence for Complex SystemsInstitute of Automation, Chinese Academy of Sciences, Beijing, China · 2026
Read SkillPyramid : A Hierarchical Skill Consolidation Framework for Self-Evolving Agents by Yuan Xiong, Miao Ziqi, Chen Qian, Lijun Li, Yequan Wang, Shizhu He, Jun Zhao, Kang Liu, [0.6em] The Key Laboratory of Cognition, Decision Intelligence for Complex SystemsInstitute of Automation, Chinese Academy of Sciences, Beijing, China (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03692.txt.
Introduction
Xiong and co-authors give self-evolving agents a way to consolidate skills over time. Agents can call skills to solve complex tasks. Long-term gains stall when skills are built in a scattered way. Similar abilities get rebuilt across tasks, and task-specific skills fail to transfer. SkillPyramid answers with a hierarchical skill topology.
A self-evolution mechanism lets agents compose, validate, and adopt new skills while they work. Past skill experience is reused for broader generalization. Tests run on ALFWorld, WebShop, and ScienceWorld, across four backbone models. Average reward rises by 38 percent. Execution steps fall by about 28 percent. The skill pool stops being a static shelf of tools. It becomes a dynamic system that grows with use. Agent builders get a frame for turning experience into reusable assets.
Catalog record
| CREATOR | Yuan Xiong, Miao Ziqi, Chen Qian, Lijun Li, Yequan Wang, Shizhu He, Jun Zhao, Kang Liu, [0.6em] The Key Laboratory of Cognition, Decision Intelligence for Complex SystemsInstitute of Automation, Chinese Academy of Sciences, Beijing, China |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.03692
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SkillPyramid : A Hierarchical Skill Consolidation Framework for Self-Evolving Agents Yuan Xiong, Miao Ziqi, Chen Qian, Lijun Li, Yequan Wang, Shizhu He, Jun Zhao, Kang Liu, [0.6em] The Key Laboratory of Cognition, Decision Intelligence for Complex SystemsInstitute of Automation, Chinese Academy of Sciences, Beijing, China Abstract Recent AI agents can flexibly invoke skills to solve complex tasks, but their long-term improvement is fundamentally constrained by a lack of systematic skill construction, accumulation, and transfer. In particular, without a unified framework for skill consolidation, agents tend to redundantly construct similar capabilities across different tasks, are unable to effectively transform experience into reusable assets, and struggle to generalize task-specific skills to novel scenarios. To address this limitation, we propose SkillPyramid , a skill consolidation framework that reuses existing skill experience for broader task generalization. Operating on a hierarchical skill topology, SkillPyramid further introduces a self-evolution mechanism that enables agents to compose, validate, and incorporate new skills during task execution. Experiments on ALFWorld, WebShop, and ScienceWorld across four backbone models show that SkillPyramid substantially increases the average reward by 38.0% and reduces execution steps by 27.7%. Overall, our method transforms a skill collection from a static resource pool into a dynamic evolution system. 1 Introduction Figure 1: Flat skill library vs. SkillPyramid . (a) With isolated skills, no match is found for an unseen task and the agent must explore from scratch, often failing. (b) SkillPyramid composes new skills by recombining components of existing ones. Recent advances in large language models (LLMs) have shifted agent systems from passive response generation to autonomous task completion ( 23 ; 14 ; 17 ) . Within this shift, skills —callable units of capability—have become a key substrate for agents’ problem solving, substantially improving performance on complex, long-horizon, and open-ended tasks ( 17 ; 5 ; 16 ; 8 ) . In open-ended environments, however, manually curated skill sets quickly grow stale, and continual skill evolution becomes essential for sustained competence. Yet a central question remains open: how can skills evolve from isolated, task-specific solutions into reusable, compositional knowledge? Existing approaches tackle parts of this question from different angles. Tool-augmented agents extend LLMs with external APIs to fill capability gaps ( 12 ; 11 ) , and modular frameworks coordinate specialized components through task decomposition ( 3 ; 13 ; 7 ) . A related line learns reusable skills via program synthesis or experiential accumulation ( 4 ; 24 ; 2 ) . More recently, dedicated skill-management frameworks have emerged ( 5 ; 16 ; 8 ) , demonstrating the value of creating, organizing, retrieving, and refining reusable skill units. Yet two limitations remain: (i) existing skills are typically reused as stored units, leaving their internal transferable experience underexploited; and (ii) new skills are often retrieved, refined, or appended rather than composed from prior skill experience. This motivates a different perspective: a growing, structured skill library in which the experience captured by existing skills generalizes effectively to tasks beyond their original scope. As illustrated in Figure 1 , related skills often share underlying capabilities, and treating these as atomic components lets agents recombine them to address unseen tasks, turning a flat collection into a structure that supports both reuse and generalization. Building on this view, we propose SkillPyramid , an evolving skill framework for LLM agents. SkillPyramid organizes skills into a multi-level hierarchy in which lower levels hold fine-grained, reusable atomic capabilities and upper levels abstract recurring problem-solving patterns. A Relation Analyzer and a Relation Builder identify reusable relations and construct this hierarchy through Downward Atomic Extraction , which captures minimal reusable capabilities, and Upward Abstract Induction , which summarizes common problem-solving patterns. A task-driven self-evolution mechanism then folds each validated new skill back into the hierarchy by linking it to related skills, yielding a dynamic capability system that expands over time, reduces redundancy, and accumulates reusable knowledge. Our contributions are as follows: • We propose SkillPyramid , a framework that organizes agent skills into a growing hierarchy and improves transferability through explicit reuse and dependency modeling. • We design a pyramid organization mechanism with a Relation Analyzer and a Relation Builder, constructing atomic skills via downward extraction and abstract skills via upward induction. • We introduce a task-driven self-evolution mechanism that retrieves, composes, and generates skills while incrementally updating SkillPyramid . Experiments on ALFWorld, WebShop, and ScienceWorld show 38.0% higher average reward and 27.7% fewer interaction steps across multiple backbone LLMs. 2 Method Figure 2: Overview of the proposed SkillPyramid framework. The system analyzes an existing skill library, constructs downward atomic and upward abstract reuse relations, organizes skills into a hierarchical pyramid, creates skills from the pyramid, and incrementally evolves the pyramid as new skills are added. Our method improves the generalization of a fixed skill collection by leveraging reusable patterns from existing high-quality skills. To this end, we construct a pyramidal, reusable, and continuously evolving skill system, where successful skills serve as reusable building blocks for related tasks rather than isolated modules. As illustrated in Figure 2 , the system is managed by a multi-agent framework, following prior agent and tool-orchestration paradigms ( 3 ; 13 ; 7 ; 11 ; 20 ) , that analyzes the existing skill library (§2.2.1), constructs reuse relations among skills (§2.2.2), synthesizes new skills grounded in the resulting hierarchy (§2.3), and incrementally evolves as new skills are added (§2.4). 2.1 Problem Formalization We consider an interactive agent setting where an agent receives a natural language task instruction x , interacts with an environment through actions, and receives task feedback after execution. At each step t , the agent observes the environment state o_{t} , takes an action a_{t} , and obtains a final reward r\in[0,1] or a task completion signal after the episode ends. A complete task trajectory is denoted as \tau=(x,o_{0},a_{0},o_{1},\ldots,a_{T},o_{T+1},r) . A skill s is defined as a structured natural language program s=(n,d,c) , where n is the skill name, d is a short description, and c is the skill content specifying its applicable conditions, execution procedure, and inputs/outputs. Unlike methods that directly treat trajectories as training data for parameter updates, SkillPyramid converts task experience and existing skill descriptions into explicit, reusable skills. Given a skill collection \mathcal{S}=\{s_{1},s_{2},\ldots,s_{N}\} , our goal is to construct and maintain a hierarchical SkillPyramid \mathcal{P}=\{L_{0},L_{1},\ldots,L_{K}\} (illustrated in Figure 2 ), where skills become increasingly abstract and compositional from the bottom layer L_{0} to the top layer L_{K} . For a stream of tasks, SkillPyramid aims to improve task performance by reusing, composing, and evolving skills. 2.2 SkillPyramid Construction To construct the pyramid, we employ two agents: a Relation Analyzer and a Relation Builder. The Analyzer identifies related skill groups, specifies the relation type for each, and dispatches the relation-construction tasks to the Builder. The Builder then extracts atomic skills, induces abstract skills, and rewrites the original skills. The Analyzer–Builder pipeline iterates until no new skill is produced or a maximum of T rounds is reached, with each round’s outputs feeding the next. 2.2.1 Relation Analyzer Given the current skill collection \mathcal{S}=\{s_{i}\}_{i=1}^{N} , directly analyzing all skills jointly may introduce substantial noise and lead to an excessive analysis workload. We therefore adopt a progressive analysis strategy that proceeds from coarse to fine granularity.