EvoDS: Self-Evolving Autonomous Data Science Agent with Skill Learning and Context Management Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770855.3818002 ISBN: 979-8-4007-2259-2/2026/08 CCS: Computing methodologies Intelligent agents CCS: Computing methodologies Multi-agent systems CCS: Computing methodologies Reinforcement learning

Zherui Yang, Fan Liu, Yansong Ning, Hao Liu · 2026

Read EvoDS: Self-Evolving Autonomous Data Science Agent with Skill Learning and Context Management Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770855.3818002 ISBN: 979-8-4007-2259-2/2026/08 CCS: Computing methodologies Intelligent agents CCS: Computing methodologies Multi-agent systems CCS: Computing methodologies Reinforcement learning by Zherui Yang, Fan Liu, Yansong Ning, Hao Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03841.txt.

Introduction

Yang and co-authors build EvoDS, a data science agent that improves itself over time. Language model agents now automate parts of data science. Static action sets limit what they can learn to do. Weak long-horizon context handling blocks steady work on multi-stage pipelines. Reusable experience fails to accumulate under those limits.

EvoDS attacks both limits at once. An Autonomous Skill Acquisition mechanism synthesizes, validates, and reuses executable skills. An Adaptive Context Compression strategy treats context as a learned control problem. Passive truncation is left behind. A two-stage multi-agent training scheme orchestrates the two strategies. Theory links the design to lower tool-selection error and an information bottleneck goal. Across four benchmarks, EvoDS beats top open-source rivals by about 29 percent on average. Out-of-token failures disappear entirely. Data science teams get an agent that grows with use.

Catalog record

CREATORZherui Yang, Fan Liu, Yansong Ning, Hao Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE83 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03841

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EvoDS: Self-Evolving Autonomous Data Science Agent with Skill Learning and Context Management Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770855.3818002 ISBN: 979-8-4007-2259-2/2026/08 CCS: Computing methodologies Intelligent agents CCS: Computing methodologies Multi-agent systems CCS: Computing methodologies Reinforcement learning Zherui Yang, Fan Liu, Yansong Ning, Hao Liu Abstract . Recent progress in Large Language Model (LLM) agents has enabled promising advances in automated data science. However, existing approaches remain fundamentally limited by their static action sets and lack of principled long-horizon context management, hindering their ability to accumulate reusable experience across tasks and operate reliably in multi-stage, iterative data science pipelines. To address these challenges, we introduce EvoDS, a self-evolving autonomous data science agent that learns to expand its skills and adaptively managing long-term context through agentic reinforcement learning. Specifically, EvoDS introduces two key strategies: (1) Autonomous Skill Acquisition (ASA) mechanism, which enables agents to synthesize, validate, and reuse executable skills; and (2) Adaptive Context Compression (ACC) strategy, which treats context management as a learned control problem rather than passive truncation. These strategies are orchestrated within a two-stage multi-agent training scheme, enabling EvoDS to autonomously improve over time. Theoretically, we prove that EvoDS’s hierarchical design reduces tool-selection error, and its optimization objective aligns with an information bottleneck principle, ensuring efficient context use. Empirically, EvoDS outperforms state-of-the-art open-source data science agents by an average of 28.9% across four diverse benchmarks while eliminating out-of-token failures. Our code and data are available at https://github.com/usail-hkust/EvoDS . † † cc-license: by 1. Introduction Automating data science workflows, from data preprocessing and feature engineering to model selection, evaluation, and visualization, has long been a central goal of machine learning research, driven by the growing demand for scalable, accessible, and efficient analytics across scientific and industrial domains ( 3 ; 38 ; 76 ) . Traditional AutoML systems have made important progress in automating isolated stages of this pipeline, yet they typically rely on rigid search spaces and predefined operators, limiting flexibility in open-ended analytical tasks ( 76 ; 20 ) . Recent advances in large language models (LLMs) have renewed interest in autonomous data science agents capable of reasoning over natural language instructions, writing executable code, invoking tools, and coordinating multi-step workflows ( 57 ; 19 ; 47 ) . By integrating language reasoning with perception, memory, and action, LLM-based agents offer a promising pathway toward end-to-end automation of realistic data science pipelines with minimal human intervention ( 52 ; 58 ; 55 ; 74 ; 48 ) . Despite this promise, existing autonomous data science agents remain largely constrained by predefined workflows and fixed action spaces ( 18 ; 56 ; 30 ; 70 ) . Recent systems such as DS-Agent ( 18 ) , AutoKaggle ( 30 ) , and DeepAnalyze ( 70 ) demonstrate encouraging results by orchestrating LLMs with code execution and tool calling for tasks including feature engineering, model training, and evaluation. However, these approaches primarily rely on scripted pipelines or hand-designed control logic, treating tools as static primitives rather than learnable capabilities. Consequently, agents repeatedly rediscover similar solutions through trial-and-error, instead of abstracting successful behaviors into reusable skills. Moreover, prior experience is typically discarded after task completion, preventing systematic improvement over time. This stands in contrast to the problem-solving process of human data scientists, which is inherently exploratory, iterative, and experience-driven. These observations raise a fundamental research question: can we design autonomous data science agents that not only execute tasks, but also support open-ended exploratory analysis and systematically accumulate experience across iterations and tasks? However, achieving this goal introduces two tightly coupled challenges. (1) Automatic Skill Acquisition : How can data science agents acquire reusable skills from experience, abstracting successful problem-solving procedures into persistent actions or operators that enable self-improvement across tasks? Without such skill acquisition, agents remain confined to one-off reasoning and cannot systematically benefit from prior exploration. (2) Explosive Context Management : How can agents effectively manage rapidly growing context arising from iterative experimentation, intermediate artifacts, and evolving skills? Data science workflows naturally require long-horizon iterative reasoning, while continual skill evolution further enlarges the action space and execution context, aggravating long-context challenges. Such context explosion not only induces the well-known lost-in-the-middle phenomenon ( 32 ) , degrading long-horizon reasoning performance, but also hampers effective experience accumulation by obscuring which actions and decisions were truly responsible for success ( 58 ; 74 ) . Consequently, autonomous data science demands principled mechanisms for jointly learning skills and regulating memory, allowing agents to preserve task-critical information while suppressing irrelevant details under bounded context constraints. To address the above challenges, we propose EvoDS , a self-evolving autonomous data science agent that integrates skill acquisition and context regulation within a hierarchical multi-agent architecture. EvoDS employs a Manager Agent to coordinate specialized agents for subtasks such as data handling, modeling, visualization, and debugging, where each agent maintains scope-specific data science skills. This design decomposes complex workflows into atomic executable subtasks for fine-grained skill evolution, while localizing long execution contexts for more effective context management. To maintain consistency, agents share a global memory for overall task objectives and maintain local memories for subtask-specific context. To enable experience-driven self-improvement, EvoDS introduces an Autonomous Skill Acquisition (ASA) mechanism that abstracts successful problem-solving behaviors into reusable executable skills, allowing the action space to progressively expand over time. EvoDS further incorporates an Adaptive Context Compression (ACC) strategy to selectively retain task-critical information while suppressing irrelevant details under bounded context windows. The above components are jointly optimized through a two-stage agentic reinforcement learning (RL) framework. We first collect trajectories from a teacher model for supervised fine-tuning (SFT), and then perform online RL to jointly optimize task performance, skill acquisition, and context management. This design enables EvoDS to simultaneously learn autonomous task execution, progressive skill acquisition, and long-horizon context management within a unified multi-agent framework. Our main contributions are summarized as follows: • We propose EvoDS, a self-evolving autonomous data science agent that integrates Autonomous Skill Acquisition mechanism and Adaptive Context Compression Strategy within a unified hierarchical multi-agent framework, enabling agents to progressively acquire reusable operational skills while actively controlling long-term context. • We design a two-stage multi-agent training scheme that jointly optimizes task execution, skill acquisition, and context regulation, allowing EvoDS to improve with experience while remaining robust under context constraints. • We theoretically show that the hierarchical architecture reduces tool-selection errors and that the reinforcement learning objective aligns with an information bottleneck, encouraging retention of task-critical information while filtering irrelevant signals. • Extensive experiments on four benchmarks demonstrate that EvoDS significantly outperforms state-of-the-art open-source agents, achieves robust long-horizon performance without out-of-token failures, and exhibits consistent improvement from accumulated experience. 2. Related Works 2.1. Data Science Agents Recent advances in LLMs have driven the development of autonomous data science agents, which aim to automate a wide range of data-centric tasks, including exploratory data analysis, feature construction, predictive modeling, and result interpretation ( 71 ; 6 ; 73 ; 33 ; 11 ; 39 ; 12 ) . Early approaches mainly rely

Read the complete text