Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skills
Jingwei Ni § \lx@sectionsign ,*, Yihao Liu § \lx@sectionsign ,*, Xinpeng Liu § \lx@sectionsign ,*, Yutao Sun § \lx@sectionsign ,*, Mengyu Zhou † {\dagger}, Pengyu Cheng, Dexin Wang, Erchao Zhao, Xiaoxi Jiang, Guanjun Jiang · 2026
Read Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skills by Jingwei Ni § \lx@sectionsign ,*, Yihao Liu § \lx@sectionsign ,*, Xinpeng Liu § \lx@sectionsign ,*, Yutao Sun § \lx@sectionsign ,*, Mengyu Zhou † {\dagger}, Pengyu Cheng, Dexin Wang, Erchao Zhao, Xiaoxi Jiang, Guanjun Jiang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25158.txt.
Introduction
Ni and co-authors turn agent work logs into reusable skills with Trace2Skill. Hand-written skills do not scale, and skills dreamed up by a model miss real pitfalls. This system reads many run traces side by side and reasons over them as a group. It can deepen skills a person wrote or grow new ones from weak drafts. The distilled skills compress repeat failures into standard steps. They travel well: skills from one model's traces lift a bigger model by up to 58 points on table questions.
Catalog record
| CREATOR | Jingwei Ni § \lx@sectionsign ,*, Yihao Liu § \lx@sectionsign ,*, Xinpeng Liu § \lx@sectionsign ,*, Yutao Sun § \lx@sectionsign ,*, Mengyu Zhou † {\dagger}, Pengyu Cheng, Dexin Wang, Erchao Zhao, Xiaoxi Jiang, Guanjun Jiang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62230 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.25158
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skills Jingwei Ni § \lx@sectionsign ,*, Yihao Liu § \lx@sectionsign ,*, Xinpeng Liu § \lx@sectionsign ,*, Yutao Sun § \lx@sectionsign ,*, Mengyu Zhou † {\dagger}, Pengyu Cheng, Dexin Wang, Erchao Zhao, Xiaoxi Jiang, Guanjun Jiang Abstract Equipping Large Language Model (LLM) agents with domain-specific skills is critical for tackling complex tasks. Yet, manual authoring creates a severe scalability bottleneck. Conversely, automated skill generation often yields fragile or fragmented results because it either relies on shallow parametric knowledge or sequentially overfits to non-generalizable trajectory-local lessons. To overcome this, we introduce Trace2Skill, a framework that mirrors how human experts author skills: by holistically analyzing broad execution experience before distilling it into a single, comprehensive guide. Instead of reacting sequentially to individual trajectories, Trace2Skill dispatches a parallel fleet of sub-agents to analyze a diverse pool of executions. It extracts trajectory-specific lessons and hierarchically consolidates them into a unified, conflict-free skill directory via inductive reasoning. Trace2Skill supports both deepening existing human-written skills and creating new ones from scratch. Experiments in challenging domains, such as spreadsheet, VisionQA and math reasoning, show that Trace2Skill significantly improves upon strong baselines, including Anthropic’s official xlsx skills. Crucially, this trajectory-grounded evolution does not merely memorize task instances or model-specific quirks: evolved skills transfer across LLM scales and generalize to OOD settings. For example, skills evolved by Qwen3.5-35B on its own trajectories improved a Qwen3.5-122B agent by up to 57.65 absolute percentage points on WikiTableQuestions. Further analysis confirms that our holistic, parallel consolidation outperforms both online sequential editing and retrieval-based experience banks. Ultimately, our results demonstrate that complex agent experience can be packaged into highly transferable, declarative skills---requiring no parameter updates, no external retrieval modules, and utilizing open-source models as small as 35B parameters. 1 1 1 Work in progress. 0 0 footnotetext: \lx@sectionsign Core Contributors. 1 Introduction Figure 1 : Left: Concurrent work’s online setting where lessons from in-coming traces evolve a skill bank sequentially. Right: Trace2Skill’s analyze a pool of traces in parallel, and hierarchically consolidating lessons to induce generalizable SOPs. LLM-based agents are increasingly rely on skills — structured, reusable documents that encode task-solving procedures, domain knowledge, and operational guidelines — to navigate complex environments ( 3 ) . As these agents are deployed across increasingly broad and nuanced domain-specific use cases, demand for highly specialized skills grows accordingly, creating a scalability bottleneck for manual skill creation and maintenance ( 5 ; 9 ; 2 ; 14 ) . Even when a human-written skill exists, it is not guaranteed to improve performance for a given agent, model, or task distribution (e.g., Table 1 shows that a human-expert-written skill that lifts a 122B agent by + 20 pp on SpreadsheetBench-Verified ( 17 ) actively harms a 35B agent). These pressures motivate automatic creation and adaptation of skills for specific use cases ( 5 ) . However, synthesizing skills relying solely on an LLM’s parametric knowledge yields limited benefits, even with leading proprietary models, primarily because parametric knowledge lacks information about the specifics and common pitfalls of the target domain ( 11 ; 6 ) . To address this, concurrent work proposes improving skills using agent execution experience in an online setting, where an agent continuously interacts with the environment and evolves its skill collection based on incoming trajectories ( 30 ; 27 ; 1 ; 33 ; 6 ) . While this continuous, online paradigm has shown promise, we approach the problem of skill evolution from a different angle—one that more closely mirrors how human experts author skills. Specifically, we observe that existing online paradigms often diverge from human methodology in two key ways: • Skill Fragmentation vs. Consolidation: Existing works often create new, narrowly tailored skills to host trajectory-local lessons, resulting in massive skill collections that can lead to retrieval difficulties ( 12 ) . In contrast, human experts typically craft a single, comprehensive skill per domain, complete with broad procedural guidance and error prevention checklists. • Sequential vs. Holistic Updates: In an online setting, skills are updated sequentially using lessons from isolated incoming trajectories ( 6 ; 27 ) . This mimics a scenario where an author continuously edits a skill while sequentially learning about a domain, reacting prematurely before acquiring adequate domain-specific knowledge. Human experts, conversely, build a comprehensive, high-level understanding of the domain before instantiating it into a skill. Figure 1 illustrates these comparisons. Motivated by these observations, we introduce Trace2Skill, a framework designed to simulate this human, holistic approach. Rather than reacting to trajectories sequentially, Trace2Skill analyzes a wide range of trajectory-local lessons in parallel, and distills common patterns into a single, comprehensive agent skill. Trace2Skill operates in three stages: (1) Trajectory Generation: An agent runs in parallel on an evolving set of tasks, producing a pool of execution trajectories. (2) Parallel Multi-Agent Patch Proposal: A fleet of success and error-analyst sub-agents independently processes batches of trajectories, proposing targeted patches to the skill. (3) Conflict-Free Consolidation: Sub-agent-proposed patches are hierarchically merged into a coherent update to the skill directory, utilizing programmatic conflict detection and format validation at each step. We process all patches simultaneously during consolidation for two reasons. First, this acts as an inductive reasoning process ( 29 ; 10 ; 15 ) that mines generalizable patterns from experience-specific patches, building a high-level understanding of the domain analogous to a human expert’s prior knowledge. Second, analyzing a massive number of trajectories in parallel brings substantial efficiency benefits and ensures a holistic view of the domain. This reflects the core design wisdom of agent swarms ( 7 ) , which process multiple information sources efficiently using parallelized sub-agents. The framework supports two modes: deepening an existing human-written skill, and creating an effective skill from scratch starting from an ineffective LLM-generated draft. The most surprising finding of this work is not just that trajectory analysis improves skill quality, but that it does so without sacrificing generalizability. Despite the deep analysis over a specific task distribution and trajectories of a specific LLM, evolved skills transfer across model scales (e.g., a skill evolved by Qwen3.5-35B ( 24 ) improves Qwen3.5-122B) and generalize to out-of-distribution task domains (e.g. from spreadsheet editing to Wikipedia table QA). Analyses attribute this transferability to the successful mining of prevalent, highly useful patterns induced from broad trajectories. This challenges the common assumption that experience is inherently model- and task-specific and must be managed through the retrieval of episodic memories ( 20 ; 26 ; 22 ; 19 ; 16 ) . Instead, we show that experience can be distilled into transferable, declarative skills. We further confirm the effectiveness of Trace2Skill on creating useful skills for math and vision reasoning. Further analysis shows that Trace2Skill outperforms other popular paradigms of experience-learning: (1) Reasoning Bank ( 20 ) that first saves generalizable lessons from each trajectory, and retrieve useful experiences at inference time based on task similarity. (2) An online setting where new trajectories sequentially come in, and the skill evolves based on new lessons learned. Crucially, because the skills created or deepened by Trace2Skill operate entirely without an external retrieval module, they are seamlessly portable across the broader agent-skill ecosystem. • Trace2Skill, a framework for automatic skill creation and adaptation that supports both deepening existing human-written