SkillMAS: Skill Co-Evolution with LLM-based Multi-Agent System

Shuai Pan, Yixiang Liu, Jiaye Gao, Te Gao, Weiwen Liu, Jianghao Lin, Zhihui Fu, Jun Wang, Weinan Zhang, Yong Yu · 2026

Read SkillMAS: Skill Co-Evolution with LLM-based Multi-Agent System by Shuai Pan, Yixiang Liu, Jiaye Gao, Te Gao, Weiwen Liu, Jianghao Lin, Zhihui Fu, Jun Wang, Weinan Zhang, Yong Yu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09341.txt.

Introduction

Pan and nine colleagues address post-deployment growth of LLM agent systems, where skill evolution and multi-agent restructuring are usually kept apart. That split can create organisation bottlenecks, context pressure, and mis-specialisation, so the team offers SkillMAS, a non-parametric framework joining skill evolution with MAS restructuring.

SkillMAS assigns credit with Utility Learning from checked execution traces and refines reusable procedures through bounded skill evolution without unchecked library growth. It restructures the MAS only when past failures and Executor Utility signal a structural mismatch. In embodied manipulation, command-line execution, and retail work, SkillMAS matches rivals under the reported harnesses while showing how post-deployment specialisation is attributed, updated, and applied. The work shows which parts to keep, which to revise, and when a fixed team setup has itself become the bottleneck.

Catalog record

CREATORShuai Pan, Yixiang Liu, Jiaye Gao, Te Gao, Weiwen Liu, Jianghao Lin, Zhihui Fu, Jun Wang, Weinan Zhang, Yong Yu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.09341

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SkillMAS: Skill Co-Evolution with LLM-based Multi-Agent System Shuai Pan, Yixiang Liu, Jiaye Gao, Te Gao, Weiwen Liu, Jianghao Lin, Zhihui Fu, Jun Wang, Weinan Zhang, Yong Yu Abstract Large language model (LLM) agent systems are increasingly expected to improve after deployment, but existing work often decouples two adaptation targets: skill evolution and multi-agent system (MAS) restructuring. This separation can create organization bottlenecks, context pressure, and mis-specialization. We present SkillMAS , a non-parametric framework for adaptive specialization in multi-agent systems that couples skill evolution with MAS restructuring. SkillMAS uses Utility Learning to assign credit from verified execution traces, bounded skill evolution to refine reusable procedures without unfiltered library growth, and evidence-gated MAS restructuring when retained failures and Executor Utility indicate a structural mismatch. Across embodied manipulation, command-line execution, and retail workflows, SkillMAS is competitive under the reported harnesses while clarifying how post-deployment specialization is attributed, updated, and applied. † † footnotetext: Correspondence: {wwliu, linjianghao, wnzhang}@sjtu.edu.cn , [email protected] . 1 Introduction LLM agents are increasingly expected not only to complete long-horizon tasks, but also to improve after deployment as they accumulate verified execution traces, reusable procedures, and coordination experience. This creates a system-level problem: a deployed agent stack must decide what to retain, what to revise, and when a fixed collaboration structure has itself become the bottleneck. Prior work on multi-agent orchestration, externalized agent infrastructure, post-deployment memories or skills, and Agentic ROI suggests that practical agent systems should keep improving after deployment rather than remain fixed pipelines ( 7 ; 23 ; 37 ; 16 ; 24 ; 22 ; 9 ) . Existing work still treats two tightly coupled adaptation targets as largely separate problems: skill evolution and MAS restructuring. One line adapts MAS organization through spawning, orchestration, role/profile updates, interaction rewards, or topology selection ( 2 ; 30 ; 12 ; 26 ; 11 ; 15 ) . A separate line evolves reusable skills or distills trajectory-local lessons into transferable procedures, typically without simultaneously editing executor boundaries ( 33 ; 24 ; 13 ; 32 ; 1 ) . In practice, however, these targets interact directly: skill evolution changes what MAS organization must route and maintain, while MAS organization determines whether evolved skills can be reused without excessive context load or responsibility ambiguity. We call this system-level mismatch adaptation decoupling : skill evolution and MAS restructuring are optimized separately even though each changes the operating conditions of the other. Adaptation decoupling creates three recurring failure modes. Verified execution trace reuse can introduce redundant or low-value evidence for skill evolution; skill evolution can make MAS organization harder to route and maintain; and fixed MAS organization can lag behind changing task structure or runtime complexity. We therefore make three design requirements explicit: credit should be assigned from verified execution traces rather than retrieval alone; skill evolution should avoid overwhelming MAS organization; and skill evolution should be comparable with MAS restructuring under the same empirical evidence. Without a shared evidence surface, the system cannot tell whether the next useful intervention is skill evolution, MAS restructuring, or no change at all. Figure 1 illustrates this failure mode. To this end, we introduce SkillMAS , a non-parametric framework that treats skill evolution and MAS restructuring as one empirical loop. Utility Learning updates Skill Utility and Executor Utility only from verified execution traces, bounded skill evolution changes the skill library without accepting every local patch, and MAS restructuring changes MAS organization only when retained failures and Executor Utility indicate an organizational bottleneck. The contribution is not that either update target is new in isolation, but that both are constrained by one verified-trace evidence surface. The empirical section evaluates this scaffold through benchmark performance, an ALFWorld stress test, and round-by-round adaptation trajectories. Figure 1: Coupled adaptation is the paper’s central motivation: decoupled skill evolution can increase interference under fixed MAS organization, whereas SkillMAS coordinates skill evolution and MAS restructuring from shared verified traces. We make three contributions: • We formulate adaptation decoupling as a system-level problem in post-deployment specialization of self-evolving MAS. • We introduce SkillMAS, a non-parametric scaffold that places Utility Learning, bounded skill evolution, and evidence-gated MAS restructuring under shared verified-trace evidence. • We evaluate this scaffold across embodied manipulation, command-line OS workflows, and retail-service interaction. 2 Method SkillMAS addresses adaptation decoupling without retraining the underlying language models. One adaptation round executes a batch of episodes, learns utility from verified execution traces, constructs a retained evidence set, and then applies skill evolution together with evidence-gated MAS restructuring. Figure 2 gives an ALFWorld example of how the same retained evidence coordinates skill evolution and MAS restructuring. Figure 2: SkillMAS uses one retained evidence set to update utilities, repair skills, and justify MAS restructuring only when Executor Utility exposes overloaded MAS organization. 2.1 Round State and Adaptation Loop SkillMAS maintains the following round state: X_{r}=\bigl(\mathcal{L}_{r},\mathcal{A}_{r},Q^{s}_{r},Q^{a}_{r},\mathcal{P}_{r},\mathcal{K}_{r}\bigr), (1) where \mathcal{L}_{r} is the skill library, \mathcal{A}_{r} the executor set, Q^{s}_{r} and Q^{a}_{r} the Skill Utility and Executor Utility tables, \mathcal{P}_{r} a validation pool for new or heavily revised skills, and \mathcal{K}_{r} a policy-derived expert policy index. With X_{r} fixed, one adaptation round begins by executing the current system: \mathcal{T}_{r}=\mathrm{Exec}(X_{r}). (2) Here n_{r} is the number of episodes executed in round r , and we write \xi\in\mathcal{T}_{r} for an episode-level verified trace from that round. Each \xi records the attempted task, selected skills, routed executors, produced trajectory, and verified terminal outcome. When we need the executor-local portion associated with a routed executor a , we write \xi(a) for the corresponding executor trace slice inside the same episode trace. The trace set is then converted into post-execution utility estimates: \bigl(Q^{s,+}_{r},Q^{a,+}_{r}\bigr)=\mathrm{Learn}\!\left(Q^{s}_{r},Q^{a}_{r},\mathcal{T}_{r}\right). (3) The superscript + denotes utilities after Utility Learning but before the coupled adaptation update. SkillMAS does not pass the entire trace set to the update modules. It first constructs a retained evidence set: \widetilde{\mathcal{T}}_{r}=\mathrm{Retain}\!\left(\mathcal{T}_{r},Q^{s,+}_{r},Q^{a,+}_{r}\right)\subseteq\mathcal{T}_{r}. (4) This lightweight filtering step is not a learned controller and is not the main contribution. It retains verified traces that are most useful for adaptation, such as repeated failures, near misses, reusable successes, and retrieval/execution mismatches. The retained evidence set \widetilde{\mathcal{T}}_{r} then drives one coupled adaptation update: skill evolution proposes bounded changes to \mathcal{L}_{r} and \mathcal{P}_{r} , while MAS restructuring keeps, adds, merges/removes, or modifies executors when the evidence supports a structural mismatch. The accepted skill evolution and MAS restructuring changes jointly produce X_{r+1} . Appendix Algorithm 1 summarizes the concrete round-level contract used in the experiments, and Appendix Table 4 lists the benchmark-local heuristics that instantiate retained-evidence construction, diagnosability, and restructuring predicates. 2.2 Utility Learning SkillMAS learns Skill Utility and Executor Utility from task execution outcomes grounded in verified execution traces, rather than from retrieval alone. Equation 3 is instantiated over \mathcal{T}_{r} , where each element \xi is an episode-level verified trace and each \xi(a) denotes the executor-local slice created during a delegated step. Utility updates are grounded in what was actually executed and validated. Let \tau denote the episode-level task type. SkillMAS maintains two utility estimates for two decision layers: skill selection and executor selection: \displaystyle Q^{s}_{r}(s,\tau) \displaystyle:\text{Skill Utility for skill }s\text{ on task type }\tau, (5) \displaystyle Q^{a}_{r}(a,\tau) \displaystyle:\text{Executor Utility for executor }a\text{ under task type }\tau. (6) Q^{s}_{r} is used for task-conditioned skill selection from the skill library, while Q^{a}_{r} ranks candidate

Read the complete text