Dataforge: A Data Agent Platform for Autonomous Data Engineering

Xinyuan Wang, Yanjie Fu · 2025

Read Dataforge: A Data Agent Platform for Autonomous Data Engineering by Xinyuan Wang, Yanjie Fu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06185.txt.

Introduction

Xinyuan Wang, Hongyu Cao, Kunpeng Liu, and Yanjie Fu built Dataforge, a platform that prepares raw tables for artificial intelligence with little human labor. Fields like materials discovery and climate science stall because cleaning and reshaping data takes so long. Dataforge uses a large language model agent to do that preparation on its own.

The platform cleans data and repeatedly improves feature operations inside a budgeted feedback loop that stops by itself. It is designed to be automatic, safe, and usable by non-experts. Across tabular benchmarks it earned the best overall downstream results, and ablation tests confirmed that its routing, repeated refinement, and grounding steps each support accuracy and reliability.

Catalog record

CREATORXinyuan Wang, Yanjie Fu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-06185

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Dataforge: A Data Agent Platform for Autonomous Data Engineering Xinyuan Wang, Yanjie Fu Abstract The growing demand for AI applications in fields such as materials discovery, molecular modeling, and climate science has made data preparation an important but labor-intensive step. Raw data from diverse sources must be cleaned, normalized, and transformed to become AI-ready, while effective feature transformation and selection are essential for efficient training and inference. To address the challenges of scalability and expertise dependence, we present Data Agent , a fully autonomous system specialized for tabular data. Leveraging large language model (LLM) reasoning and grounded validation, Data Agent automatically performs data cleaning, hierarchical routing, and feature-level optimization through dual feedback loops. It embodies three core principles: automatic , safe , and non-expert friendly , which ensure end-to-end reliability without human supervision. This demo showcases the first practical realization of an autonomous Data Agent, illustrating how raw data can be transformed “From Data to Better Data.” I Introduction Modern AI applications increasingly rely on AI-ready data—data that are clean, consistent, and semantically aligned with model objectives. In fields such as materials discovery, molecular design, and climate modeling, AI-ready data determine whether models can achieve reliable prediction, efficient training, and meaningful scientific insight [ 8 ] . Yet, transforming raw data into such AI-ready form remains a persistent challenge. Raw datasets are often heterogeneous, incomplete, and noisy, collected from instruments or repositories with inconsistent formats and semantics. Converting them into usable inputs requires extensive cleaning, normalization, and feature transformation, which are still largely manual, error-prone, and dependent on domain expertise. This growing mismatch between the rapid progress of AI models and the slow, fragmented process of data preparation exposes a fundamental data engineering gap that increasingly limits the scalability and reliability of AI applications. The rapid progress of large language models (LLMs) has opened a new path toward autonomous data engineering. LLMs not only capture extensive domain knowledge from large-scale text corpora but also exhibit emerging abilities to interpret data schemas, infer transformation logic, and generate executable operations—tasks traditionally reserved for human experts. Although many recent works have explored using LLMs for data-centric tasks such as LLM-based feature engineering and transformation [ 3 , 4 , 5 , 9 , 2 ] , they remain limited in several aspects: (1) Lack of full automation: Most approaches still require user intervention, manual code review, or step-by-step prompting to complete a data pipeline. (2) Limited reliability: LLMs may generate invalid or unsafe operations without schema verification or grounding checks, leading to broken workflows. (3) Expert dependency: Many systems assume the user understands LLM prompts, data schemas, or tool APIs, which prevents non-expert adoption. Newer LLMs now demonstrate emergent agentic behaviors—the ability to reason, plan, and act through iterative interaction with tools and environments. This shift marks an agentic evolution in how intelligence is deployed: systems no longer just generate outputs for a descriptive query, but autonomously understand tasks, reason, plan, ground, execute actions, and adapt through feedback. Extending this paradigm to the data domain gives rise to the concept of Data Agents: autonomous systems that can understand datasets, reason about transformations, and execute data-centric operations to improve quality, consistency, and utility. Fig. 1 : Conceptual comparison between a traditional manual workflow and the agentic workflow. Fig. 2 : The framework of the Dataforge system. To this end, we develop the Dataforge , an autonomous data agent specialized for tabular data that embodies three core design goals: 1) Automatic: performs end-to-end data transformation without manual intervention; 2) Safe: ensures workflow reliability via routing, grounding, and execution validation; 3) Non-expert Friendly: allows users with minimal technical background to improve their data by simply specifying task and data types. The dataagent is implemented based on the perception–planning–grounding–execution principles [ 1 ] as a deployable system for tabular data. The data agent includes a sequential stages of data cleaning, hierarchical routing, grounding validation, and dual-loop optimization. In particular, the hierarchical routing mechanism determines both the high-level task family and the low-level feature actions; each action is checked before execution to ensure safety, and results are evaluated to guide iterative improvement; the dual feedback loops ensure that each decision is validated before execution and that performance improvements are optimized through experience replay. Our Contribution: present the first functional data agent demo that leverages LLMs to automatically reason over tabular data and iteratively orchestrate next grounded actions with autostop to fabric AI-ready data. II Dataforge: Agentic Data Engineering II-A Overview of the Dataforge Fig. 2 shows that Dataforge aims to automate the end-to-end data preparation process—from raw input to adaptive refinement—through a structured six-stage pipeline. (1) Input and Cleaning: Raw data is standardized via schema alignment, missing-value handling, and type correction under preset modes ( light , aggressive , or time-series ). (2) Task-Level Routing: A rule-based router identifies the task type (e.g., classification, clustering, regression) and dispatches data to corresponding action-level LLM router. (3) Action-Level Routing: Within each branch, an LLM-based planner selects, transforms, or generates features based on metadata and experience. (4) Grounding and Execution: Actions are validated for schema and logic safety, then executed through modular Python or SQL engines. (5) Evaluation and Feedback: An evaluator computes task-specific metrics (e.g., F1, AUC, RMSE) and maintains two feedback loops to regulate the process, in which the inner loop validates actions to prevent workflow failure, and the outer loop optimizes performance across iterations. (6) Experience Replay and Summary: The system logs all operations as experiences to replay for continual learning and automatically generate reports for traceable provenance. II-B Hierarchical Routing After data cleaning, to enable efficient and reliable decision-making, we adopt a hierarchical routing architecture, including task-level and action-level reasoning. At the task-level routing , a rule-based router quickly identifies the task type: classification , regression , or unsupervised learning , based on table schema metadata, such as, data types, label structures, and feature distribution. Such lightweight router relies on deterministic heuristics, instead of large language models, thus, enable fast and reliable responses across diverse datasets. At the action-level routing , a compact LLM-based planner refines the decision by selects and plans the most suitable feature-level actions such as, different ordered combinations of feature selection, transformation, or generation, under the identified task (e.g., a classification dataset). Since each router operates within a smaller, well-defined action space, this hierarchical routing approach not only accelerates processing but also avoid invalid or high-risk operations. II-C Dual Feedback Loops We develop two collaborative feedback loops to transform the static workflow into an adaptive, self-correcting process, in order to achieve autonomy and continual refinement. 1) Action Validation Loop for Safety: This feddback loop is to ground actions to ensure operational safety before execution. Each planned action is first grounded through schema alignment, type checking, and logical consistency tests, such as, detecting divisions by zero or invalid type conversions. Only actions that pass validation proceed to execution so as to prevent runtime errors and maintaining workflow integrity. 2) Performance Optimization Loop for Adaptiveness: This feedback loop focuses on post-execution improvement and enabling the Dataforge to converge toward optimal behavior without human supervision. In particular, after each valid action runs, an evaluator measures task-specific metrics (e.g., F1, AUC, RMSE). If performance improves, the system

Read the complete text