SkillFoundry : Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resources

Shuaike Shen, Wenduo Cheng, Mingqian Ma, Alistair Turcan, Martin Jinye Zhang, Jian Ma · 2026

Read SkillFoundry : Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resources by Shuaike Shen, Wenduo Cheng, Mingqian Ma, Alistair Turcan, Martin Jinye Zhang, Jian Ma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03964.txt.

Introduction

Shuaike Shen and colleagues built SkillFoundry, a system that turns scattered scientific know-how into validated agent skills. It maps a domain as a knowledge tree, mines high-value branches, extracts operational contracts, and compiles executable skill packages. A closed validation loop then expands, repairs, merges, or prunes the library over time. Mined skills were 71.1 percent novel versus existing libraries and lifted coding agents on five of six MoSciBench sets.

Catalog record

CREATORShuaike Shen, Wenduo Cheng, Mingqian Ma, Alistair Turcan, Martin Jinye Zhang, Jian Ma
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51550
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.03964

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SkillFoundry : Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resources Shuaike Shen, Wenduo Cheng, Mingqian Ma, Alistair Turcan, Martin Jinye Zhang, Jian Ma Abstract Modern scientific ecosystems are rich in procedural knowledge across repositories, APIs, scripts, notebooks, documentation, databases, and papers, yet much of this knowledge remains fragmented across heterogeneous artifacts that agents cannot readily operationalize. This gap between abundant scientific know-how and usable agent capabilities is a key bottleneck for building effective scientific agents. We present SkillFoundry , a self-evolving framework that converts such resources into validated agent skills, reusable packages that encode task scope, inputs and outputs, execution steps, environment assumptions, provenance, and tests. SkillFoundry organizes a target domain as a domain knowledge tree, mines resources from high-value branches, extracts operational contracts, compiles them into executable skill packages, and then iteratively expands, repairs, merges, or prunes the resulting library through a closed-loop validation process. SkillFoundry produces a substantially novel and internally valid skill library, with 71.1% of mined skills differing from existing skill libraries such as SkillHub and SkillSMP. We demonstrate that these mined skills improve coding agent performance on five of the six MoSciBench datasets. We further show that SkillFoundry can design new task-specific skills on demand for concrete scientific objectives, and that the resulting skills substantially improve performance on two challenging genomics tasks: cell type annotation and the scDRS workflow. Together, these results show that automatically mined skills improve agent performance on benchmarks and domain-specific tasks, expand coverage beyond hand-crafted skill libraries, and provide a practical foundation for more capable scientific agents. Code and an interactive website dashboard for exploring the skill library, domain knowledge tree, and mined resources are available at https://github.com/ma-compbio-lab/SkillFoundry and https://ma-compbio-lab.github.io/SkillFoundry/ . 1 Introduction LLM agents have demonstrated strong capabilities in reasoning, planning, tool use, and interacting with external environments across a wide range of applications ( Wang et al. 2024 ) . However, they often lack the contextual knowledge and domain expertise needed to perform real-world tasks reliably ( Xu & Yan 2026 ) , especially in scientific settings where reliable execution depends not only on access to tools, but also on procedural know-how: specialized software conventions, environment-specific constraints, implicit assumptions, and complex multi-step workflows that are rarely available in a form agents can directly use. Agent skills provide a natural abstraction for bridging this gap. A skill packages reusable procedural knowledge into a structured, executable unit that specifies what a capability does, how it should be invoked, what inputs and outputs it expects, and what dependencies or constraints it requires. In modern agent frameworks, skills are represented as self-contained packages that agents can discover, load, and invoke when relevant ( Anthropic 2026 ) . Unlike raw tools, which mainly expose callable interfaces, skills capture richer procedural guidance for coordinating multi-step decisions and actions, making them a more reliable foundation for workflow execution ( Xu & Yan 2026 ) . However, most agent skills today are still hand-crafted, narrowly scoped, and evaluated only in limited settings ( Alzubi et al. 2026 ) , making them difficult to scale across diverse scientific domains. Recent work has demonstrated the potential of LLM agents to accelerate scientific discovery and automate complex workflows ( Huang et al. 2025 ; Wang et al. 2025c ; Swanson et al. 2025 ; Qu et al. 2025 ; Wang et al. 2025a ) . Yet most existing systems are still built on custom wrappers and predefined tools, making them difficult to scale, adapt, and extend across domains ( Gao et al. 2025 ) . At the same time, modern scientific ecosystems already contain a wealth of procedural knowledge in repositories, software packages, APIs, databases, scripts, notebooks, documentation, papers, and web services. The challenge is therefore not a lack of scientific know-how, but that much of this knowledge is buried in heterogeneous, fragmented, and unstructured resources that agents cannot directly retrieve, execute, validate, or compose into reliable workflows. In this work, we ask whether scientific procedural knowledge hidden in heterogeneous domain resources can be automatically converted into agent skills that support reliable and scalable scientific agents. To this end, we propose SkillFoundry , a self-evolving framework that transforms heterogeneous scientific resources into structured, executable skills. The framework mines domain resources, extracts operational contracts, validates executability, and iteratively refines the resulting skill library. Beyond building a reusable library, SkillFoundry can also synthesize and test task-specific skills on demand for a concrete scientific objective. We evaluate SkillFoundry from two complementary perspectives: the quality of the skill library it builds, and the downstream utility of those skills on scientific tasks. At the library level, we study whether the mined skills are internally valid, executable, and novel relative to existing skill libraries. At the task level, we test whether these skills improve agent performance both when drawn from the existing library and when newly constructed for concrete user-specified workflows. Concretely, we evaluate the utility of the mined skills on the scientific discovery benchmark MoSciBench, and study task-specific skill design on two challenging genomics workflows: cell type annotation for spatial transcriptomics data and identification of disease-relevant cells using the statistical genetics tool scDRS ( Zhang et al. 2022 ) . Across these settings, SkillFoundry produces a substantially novel and internally valid skill library, improves benchmark performance on five of six MoSciBench datasets, and substantially boosts agent performance on both cell type annotation and the scDRS workflow. This paper makes the following contributions: • We introduce SkillFoundry , a self-evolving framework that converts heterogeneous domain resources into a library of structured, executable, and validated agent skills. • We establish an evaluation protocol that combines library-level validation, including executability and novelty, with task-level utility on benchmarks and realistic scientific workflows. • We demonstrate that the skills produced by SkillFoundry extend beyond existing skill libraries and improve agent performance on scientific benchmarks. • We show that SkillFoundry can also design task-specific skills for real-world scientific workflows. 2 Related Work Agent Tools and MCPs. Prior work has improved LLM agents’ ability to access external capabilities through tool-use learning, API calling, and benchmarked tool-augmented agent systems ( Schick et al. 2023 ; Patil et al. 2024 ; Li et al. 2023 ; Qin et al. 2023 ) . However, these lines of work mostly assume the needed capabilities are already available in usable form. Meanwhile, MCP provides a standard way to expose tools, resources, and prompts to agents ( Anthropic 2024 ) . More broadly, tools, MCPs, and skills are related but distinct components of the agent ecosystem: tools provide executable interfaces, MCP standardizes access to external capabilities, and skills package reusable procedural knowledge for using such capabilities effectively. Our focus is on this skill layer, rather than on tool-use policy or protocol design alone. Agent Skills. Prior work has shown that agents benefit from reusable skill libraries. Voyager ( Wang et al. 2023 ) introduced an ever-growing library of executable skills for lifelong embodied learning, while Anthropic’s Claude framework formalized agent skills as modular packages that combine instructions, metadata, and optional scripts or resources ( Anthropic 2026 ) . More recent work has explored different ways of building and improving such skills, including reinforcement-learning-based skill reuse ( Wang et al. 2025b ) , large engineered skill bases for

Read the complete text