DataMaster: Data-Centric Autonomous AI Research
Yaxin Du 1,* , Xiyuan Yang 1,* , Zhifan Zhou 2 , Wanxu Liu 1 , Zixing Lei 1 , Zimeng Chen 1 , Fenyi Liu 1 , Haotian Wu 1 , Yuzhu Cai 4 , Zexi Liu 1 , Xinyu Zhu 1 , Wenhao Wang 3 , Linfeng Zhang 1 , Chen Qian 1 , Siheng Chen 1, † \dagger 1 Shanghai Jiao Tong University 2 Carnegie Mellon University 3 Zhejiang University 4 Beijing University of Aeronautics and Astronautics * Equal contribution. † \dagger Corresponding author: [email protected] · 2026
Read DataMaster: Data-Centric Autonomous AI Research by Yaxin Du 1,* , Xiyuan Yang 1,* , Zhifan Zhou 2 , Wanxu Liu 1 , Zixing Lei 1 , Zimeng Chen 1 , Fenyi Liu 1 , Haotian Wu 1 , Yuzhu Cai 4 , Zexi Liu 1 , Xinyu Zhu 1 , Wenhao Wang 3 , Linfeng Zhang 1 , Chen Qian 1 , Siheng Chen 1, † \dagger 1 Shanghai Jiao Tong University 2 Carnegie Mellon University 3 Zhejiang University 4 Beijing University of Aeronautics and Astronautics * Equal contribution. † \dagger Corresponding author: [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10906.txt.
Introduction
Yaxin Du and fourteen colleagues present DataMaster, an agent framework for autonomous data engineering that improves a learning system by fixing its data, never its algorithm. As models and training recipes standardize, data quality drives further gains, yet finding, cleaning, and composing datasets still runs by hand.
DataMaster searches a tree of candidate data moves, shares lessons across branches, and validates choices through downstream training, handling the open-ended search and delayed feedback that make the job hard. The agent discovers outside data, selects and composes it, and transforms it, all while the learner stays fixed. Machine-learning teams get a data-side worker that turns ad-hoc wrangling into systematic search.
Catalog record
| CREATOR | Yaxin Du 1,* , Xiyuan Yang 1,* , Zhifan Zhou 2 , Wanxu Liu 1 , Zixing Lei 1 , Zimeng Chen 1 , Fenyi Liu 1 , Haotian Wu 1 , Yuzhu Cai 4 , Zexi Liu 1 , Xinyu Zhu 1 , Wenhao Wang 3 , Linfeng Zhang 1 , Chen Qian 1 , Siheng Chen 1, † \dagger 1 Shanghai Jiao Tong University 2 Carnegie Mellon University 3 Zhejiang University 4 Beijing University of Aeronautics and Astronautics * Equal contribution. † \dagger Corresponding author: [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68770 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10906
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DataMaster: Data-Centric Autonomous AI Research Yaxin Du 1,* , Xiyuan Yang 1,* , Zhifan Zhou 2 , Wanxu Liu 1 , Zixing Lei 1 , Zimeng Chen 1 , Fenyi Liu 1 , Haotian Wu 1 , Yuzhu Cai 4 , Zexi Liu 1 , Xinyu Zhu 1 , Wenhao Wang 3 , Linfeng Zhang 1 , Chen Qian 1 , Siheng Chen 1, † \dagger 1 Shanghai Jiao Tong University 2 Carnegie Mellon University 3 Zhejiang University 4 Beijing University of Aeronautics and Astronautics * Equal contribution. † \dagger Corresponding author: [email protected] Abstract As model families, training recipes, and compute budgets become increasingly standardized, further gains in machine learning systems depend increasingly on data. Yet data engineering remains largely manual and ad hoc: practitioners repeatedly search for external datasets, adapt them to existing pipelines, validate candidate data through downstream training, and carry forward lessons from prior attempts. We study task-conditioned autonomous data engineering , where an autonomous agent improves a fixed learning algorithm by optimizing only the data side, including external data discovery, data selection and composition, cleaning and transformation. The goal is to obtain a stronger downstream solution while leaving the learning algorithm unchanged. To address the open-ended search space, branch-dependent refinement, and delayed validation inherent in autonomous data engineering, we propose DataMaster , a data-agent framework that integrates tree-structured search, shared candidate data, and cumulative memory. DataMaster consists of three key components: a DataTree that organizes alternative data-engineering branches, a shared Data Pool that stores discovered external data sources for reuse, and a Global Memory that records node outcomes, artifacts, and reusable findings. Together, these components allow the agent to discover candidate data, construct executable training inputs, evaluate them through downstream feedback, and carry useful evidence across branches. We evaluate DataMaster on two types of benchmarks, MLE-Bench Lite and PostTrainBench. On MLE-Bench Lite, it improves medal rate by 32.27% over the initial score; on PostTrainBench, it surpasses the instruct model on GPQA (31.02% vs 30.35%). Code https://github.com/sjtu-sai-agents/DataMaster 1 Introduction Progress in Machine Learning (ML) has historically been driven by better models, better algorithms, and more computation. Yet in an increasing number of settings, model development itself is becoming more standardized: pretrained backbones are widely available, training recipes are easier to reuse, open-source stacks make fine-tuning increasingly turnkey, and evaluation pipelines are more reproducible than before. As a result, performance differences are increasingly shaped by data: what data is used, how it is selected and cleaned, how it is mixed, and how well it matches the downstream objective. This points to a more strongly data-centric phase of ML development [ 36 , 23 ] . It also changes what autonomous systems should optimize: if data is becoming the main remaining lever for improving downstream performance, then agentic ML systems should move beyond model-centric optimization alone. In practice, current autonomous ML systems remain largely model-centric. Recent ML engineering agents have become increasingly capable at writing code, debugging training pipelines, tuning hyperparameters, and iterating from validation feedback, achieving strong results in benchmarked environments such as MLE-Bench [ 8 , 16 , 37 ] . More recent benchmarks such as PostTrainBench have begun to expand the action space by allowing agents to go online, run experiments, and curate data during training [ 29 ] . However, even in these settings, data is still treated primarily as an auxiliary action dimension rather than the central object of optimization. What remains missing is a framework that allows an agent to systematically improve downstream performance by operating on the data side itself. To address this gap, we study task-conditioned autonomous data engineering for ML systems. Given a downstream objective and an initial solution, the agent treats the data state , rather than the model code, as the primary object of optimization and iteratively searches, cleans, adapts, integrates, and reuses data under training-closed-loop feedback. The objective is not to perform an isolated data operation, but to improve the full data pipeline, including discovering candidate sources, cleaning and adapting them, integrating them into training, and validating whether they improve the downstream model. Existing data-centric work addresses important parts of this pipeline, either through autonomous systems for tasks such as dataset discovery [ 20 ] and data cleaning [ 13 ] , or through benchmarks that evaluate these stages in isolation [ 6 , 19 ] . However, these stages remain fragmented and are rarely linked by downstream training feedback. This problem is harder than simply retrieving a few extra datasets and appending them to the training set. ❶ Data search is open-ended : potentially useful sources are scattered across repositories and the open web, with uneven quality, unclear licensing, and highly variable relevance to the task. ❷ Discovered data is rarely plug-and-play : schema alignment, label mapping, format conversion, filtering, and deduplication often have to be synthesized before the data can even enter training. ❸ Data iteration is inherently cumulative . To avoid repeating failed directions and to build on past successes, the agent must remember where it searched, what transformations were attempted, which adapters worked, and what kinds of data improved performance. To instantiate this idea, we introduce DataMaster , the first data-agent framework that treats the data state as the primary optimization target and unifies external data discovery, executable data refinement, and cumulative memory under downstream training feedback. Its core search structure, DataTree , organizes data engineering as tree-structured search over self-contained data states, each of which includes the current training data and its associated transformations, paired with a shared Data Pool that stores discovered external datasets for reuse and a Global Memory that stores reusable source histories, useful cleaning methods, and training outcomes across nodes. This tree-plus-memory design is natural for data engineering because data iteration is branchable, path-dependent, cumulative, and only verifiable through downstream training. Concretely, DataTree decomposes data engineering into two complementary node types: red nodes , which search for and introduce external data, and black nodes , which clean, adapt, and enhance the current training data. Together, DataTree with Global Memory turn autonomous data engineering from a sequence of isolated data operations into a structured search process over executable data states, enabling the agent to systematically improve downstream performance through data-side decisions. We evaluate DataMaster in two complementary settings: MLE-Bench Lite for controlled classical ML engineering and PostTrainBench for autonomous LLM post-training. On MLE-Bench Lite, DataMaster improves the strongest initial solution by +32.27% in medal rate. On PostTrainBench, DataMaster improves the average score by +19.79 points over the strongest non-human baseline and surpasses official instruct model on GPQA (31.02 vs. 30.35). These results show that autonomous data engineering can deliver substantial gains across both traditional ML engineering and LLM post-training. The main contributions of this paper are as follows: • We formulate task-conditioned autonomous data engineering as a first-class research problem, in which the data state rather than model code is the primary object of optimization. • We introduce DataMaster , a memory-augmented data-agent framework whose DataTree organizes autonomous data engineering as tree-structured search over data states, paired with a Global Memory for cumulative reuse across nodes. • We evaluate DataMaster on two complementary benchmarks, PostTrainBench and MLE-Bench Lite , showing that structured data-side iteration can improve strong initial solutions