Automating Skill Acquisition through Large-Scale Mining of Open-Source Agentic Repositories: A Framework for Multi-Agent Procedural Knowledge Extraction

Shuzhen Bi, Mengsong Wu, Hao Hao, Keqian Li, Wentao Liu, Siyu Song, Hongbo Zhao, Aimin Zhou · 2026

Read Automating Skill Acquisition through Large-Scale Mining of Open-Source Agentic Repositories: A Framework for Multi-Agent Procedural Knowledge Extraction by Shuzhen Bi, Mengsong Wu, Hao Hao, Keqian Li, Wentao Liu, Siyu Song, Hongbo Zhao, Aimin Zhou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11808.txt.

Introduction

Bi and co-authors present a framework that mines open-source agent repositories to harvest skills for LLM agents. General models know much but often lack the step-by-step craft real workflows need. The pipeline scans repository structure, finds skills by dense retrieval, and rewrites them into the standard SKILL.md format. It draws visualization and teaching skills from systems like TheoremExplainAgent and Code2Video, both built on Manim. With security checks and scoring, the authors report 40% gains in knowledge transfer for agent-made teaching content.

Catalog record

CREATORShuzhen Bi, Mengsong Wu, Hao Hao, Keqian Li, Wentao Liu, Siyu Song, Hongbo Zhao, Aimin Zhou
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30197
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.11808

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Automating Skill Acquisition through Large-Scale Mining of Open-Source Agentic Repositories: A Framework for Multi-Agent Procedural Knowledge Extraction Shuzhen Bi, Mengsong Wu, Hao Hao, Keqian Li, Wentao Liu, Siyu Song, Hongbo Zhao, Aimin Zhou Abstract The transition from monolithic large language models (LLMs) to modular, skill-equipped agents represents a fundamental architectural shift in artificial intelligence deployment. While general-purpose models demonstrate remarkable breadth in declarative knowledge, their utility in autonomous workflows is frequently constrained by insufficient specialized procedural expertise. This report investigates a systematic framework for automated acquisition of high-quality agent skills through mining of open-source repositories on platforms such as GitHub. We focus on the extraction of visualization and educational capabilities from state-of-the-art systems including TheoremExplainAgent and Code2Video, both utilizing the Manim mathematical animation engine. The framework encompasses repository structural analysis, semantic skill identification through dense retrieval, and translation to the standardized SKILL.md format. We demonstrate that systematic extraction from agentic repositories, combined with rigorous security governance and multi-dimensional evaluation metrics, enables scalable acquisition of procedural knowledge that augments LLM capabilities without requiring model retraining. Our analysis reveals that agent-generated educational content can achieve 40% gains in knowledge transfer efficiency while maintaining pedagogical quality comparable to human-crafted tutorials. ∗ Corresponding author: [email protected] 1 East China Normal University 2 Shanghai Innovation Institute 3 University of Science and Technology of China Email addresses: [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected] 1 Introduction The deployment of artificial intelligence has undergone a paradigm shift from monolithic transformer-based large language models toward modular, skill-equipped agent architectures [ 1 , 2 ] . While contemporary LLMs possess extensive declarative knowledge spanning diverse domains, their effectiveness in autonomous task execution remains limited by insufficient specialized procedural expertise required for real-world applications [ 2 , 3 ] . This fundamental limitation has catalyzed the emergence of the “agent skill” paradigm—a modular abstraction framework wherein procedural knowledge is encapsulated into discrete, filesystem-based units that agents can dynamically discover, load, and execute on demand [ 1 , 2 ] . By architecturally decoupling specific capabilities from underlying model parameters, this paradigm enables dynamic capability extension without incurring the prohibitive computational and temporal costs associated with model retraining or fine-tuning [ 2 , 3 ] . The skill-based architecture transforms the fundamental question from “how do we train a model to perform task X?” to “how do we provide a model with executable procedural knowledge for task X?” Central to advancing this architectural vision is the challenge of skill acquisition at scale. Traditionally, high-quality skills are manually authored by domain experts, providing reliability guarantees but suffering from severe scalability constraints [ 1 , 2 ] . Autonomous discovery methods, while promising, frequently struggle to maintain semantic coherence and pedagogical value in open-world environments [ 1 , 4 ] . A third acquisition pathway involves systematic extraction of procedural knowledge from existing open-source software, particularly specialized agentic repositories hosted on platforms such as GitHub [ 1 , 5 ] . These repositories often contain sophisticated, domain-specific logic for complex tasks—including mathematical theorem visualization, educational content synthesis, and multimodal explanation generation—that can be systematically refactored into standardized, reusable agentic skills [ 6 , 7 ] . This report presents a comprehensive framework for automated skill acquisition through large-scale mining of GitHub-based agent repositories. We focus specifically on extraction of visualization and educational capabilities from two state-of-the-art systems: TheoremExplainAgent (TEA), which generates long-form visual explanations of STEM theorems [ 6 ] , and Code2Video, which implements a code-centric paradigm for educational video generation [ 7 ] . Our framework encompasses three primary components: (1) repository structural analysis and contextualization, (2) semantic skill identification through dense retrieval mechanisms, and (3) systematic translation to the SKILL.md standardized format. 2 The Formal Paradigm of Agentic Skills 2.1 Mathematical Formulation To establish rigorous foundations for skill extraction, we first define the mathematical structure of an agentic skill. Formally, an agentic skill S is represented as a four-tuple: S=(\mathcal{C},\pi,\mathcal{T},\mathcal{R}) (1) where each component serves a distinct functional role in the skill’s operational semantics [ 8 ] . The applicability conditions \mathcal{C} define the initiation set—the contextual prerequisites that determine when a skill becomes relevant for activation [ 8 ] . This component enables efficient skill selection by allowing agents to maintain awareness of skill availability without loading complete procedural content into working memory. The policy \pi encapsulates the core procedural knowledge, representing the sequence of actions or reasoning steps the agent must execute. This policy may manifest in multiple forms: natural language prompt templates, executable Python scripts, reinforcement learning policies, or hybrid symbolic-neural workflows [ 8 ] . The policy component distinguishes skills from simple tool wrappers by embedding domain-specific reasoning and decision-making logic. Termination criteria \mathcal{T} provide the logical conditions for determining successful skill completion, enabling both the executing agent and external orchestrators to verify goal achievement [ 8 ] . These criteria may include output validation rules, state verification conditions, or success metrics specific to the task domain. The interface \mathcal{R} establishes a standardized callable boundary, defining input parameters, output formats, and composition protocols that enable runtime integration with agent architectures [ 8 ] . This standardization is critical for enabling skill reuse across heterogeneous agent implementations and facilitating hierarchical skill composition. This formal structure ensures that skills remain simultaneously executable, reusable, and governable, distinguishing them from atomic tools (which lack complex procedural logic) and episodic memories (which lack standardized callable interfaces) [ 8 ] . 2.2 The SKILL.md Specification The architectural implementation of the agent skill paradigm has converged on the SKILL.md specification, originally developed by Anthropic and subsequently released as an open standard [ 9 , 10 ] . This specification implements a progressive disclosure architecture designed to minimize context window consumption while maintaining access to deep procedural knowledge [ 1 , 2 ] . The progressive disclosure architecture organizes skill information into three hierarchical levels, each activated under different context-loading conditions. Table 1 details this organizational structure. Table 1: Progressive Disclosure Architecture for Agentic Skills Level Component Content and Metadata Context Load Token Usage Level 1 Metadata YAML frontmatter: Name, Description, Version, Trigger Conditions Pre-loaded at startup 30–100 Level 2 Instructions Procedural knowledge: Workflows, best practices, guidance, step-by-step logic Loaded upon activation 200–5,000 Level 3 Resources Auxiliary assets: Executable scripts, reference documents, templates, schemas Loaded on-demand by scripts Unbounded Level 1 metadata serves as an efficient “table of contents,” enabling agents to maintain awareness of thousands of available skills without context window degradation [ 1 , 2 ] . When user requests match a skill’s descriptive metadata, the agent activates Level 2, injecting procedural instructions into the conversation context as hidden meta-messages [ 1 , 2 ] . This injection modifies the agent’s internal reasoning process rather than its direct output, allowing skills to reshape problem-solving approaches [ 1 , 3 ] . Level 3 resources remain dormant until explicitly invoked by Level 2 instructions or executable scripts, enabling skills to leverage arbitrarily large reference materials without impacting baseline context consumption [ 9 , 13 ] . 3 Methodological Framework for Skill Extraction The systematic acquisition of skills from GitHub repositories requires a multi-stage pipeline that transforms monolithic codebases into modular SKILL.md artifacts. This section details the three primary stages: repository structural analysis, semantic

Read the complete text