AgenticData : An Agentic Data Analytics System for Heterogeneous Data Conference: Make sure to enter the correct conference title from your rights confirmation email; Aug 06, 2025; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06
Ji Sun, Guoliang Li, Peiyao Zhou, Yihui Ma, Jingzhe Xu, Yuan Li · 2025
Read AgenticData : An Agentic Data Analytics System for Heterogeneous Data Conference: Make sure to enter the correct conference title from your rights confirmation email; Aug 06, 2025; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 by Ji Sun, Guoliang Li, Peiyao Zhou, Yihui Ma, Jingzhe Xu, Yuan Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-05002.txt.
Introduction
Ji Sun and co-authors present a data analysis system that answers plain-language questions by sending AI agents to do the legwork. Analyzing mixed data, part neat tables and part messy text, usually takes experts writing code across many steps. Their system, AgenticData, takes a natural question and builds a plan from relational and meaning-based operators. Three agents divide the labor.
One agent profiles the data to find what is relevant. A second cross-checks the plan and refines it from feedback. A third tends memory, short-term for the task and long-term for accumulated knowledge. An optimizer then polishes and runs the plan. Across three benchmarks, the system beat the best existing methods on both easy and hard questions. The authors pitch it as analysis for people who know their question but not the machinery.
Catalog record
| CREATOR | Ji Sun, Guoliang Li, Peiyao Zhou, Yihui Ma, Jingzhe Xu, Yuan Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-05002
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AgenticData : An Agentic Data Analytics System for Heterogeneous Data Conference: Make sure to enter the correct conference title from your rights confirmation email; Aug 06, 2025; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 Ji Sun, Guoliang Li, Peiyao Zhou, Yihui Ma, Jingzhe Xu, Yuan Li Abstract . Existing unstructured data analytics systems rely on experts to write code and manage complex analysis workflows, making them both expensive and time-consuming. To address these challenges, we introduce AgenticData , an innovative agentic data analytics system that allows users to simply pose natural language (NL) questions while autonomously analyzing data sources across multiple domains, including both unstructured and structured data. First, AgenticData employs a feedback-driven planning technique that automatically converts an NL query into a semantic plan composed of relational and semantic operators. We propose a multi-agent collaboration strategy by utilizing a data profiling agent for discovering relevant data, a semantic cross-validation agent for iterative optimization based on feedback, and a smart memory agent for maintaining short-term context and long-term knowledge. Second, we propose a semantic optimization model to refine and execute semantic plans effectively. Our system, AgenticData , has been tested using three benchmarks. Experimental results showed that AgenticData achieved superior accuracy on both easy and difficult tasks, significantly outperforming state-of-the-art methods. 1. Introduction While large language models (LLMs) have made significant strides in understanding and generating for unstructured data, substantial gaps remain in their ability to perform data analysis on unstructured and structured data . Harnessing the capabilities of LLMs, such as understanding, reasoning, planning, and generation, holds great promise for transforming data analytics systems that handle both structured and unstructured data. To enhance analytics on unstructured data (or text columns within structured data), semantic operators are utilized to boost system capabilities ( AOP ; Lotus ; palimpzestCIDR ; TAG ) . For example, we can use the semantic filter to identify movies with positive sentiments, and employ the semantic group to classify movies based on the emotions they evoke, like "uplifting," "melancholic," "thought-provoking," etc. While there have been some efforts to support semantic data analytics on unstructured data, these approaches face several limitations. First, certain methods propose coding-based solutions that require humans to write code using semantic operators for analyzing both unstructured and structured data ( Luna ; UQE ; palimpzestCIDR ; Lotus ) . However, relying on humans to manage declarative pipelines is costly, highlighting the need for natural language (NL) interfaces to facilitate data analysis across both unstructured and structured datasets. Second, some methods extend SQL to include semantic operators ( UQE ) , allowing for semantic analysis of structured data. Unfortunately, these methods cannot handle unstructured data due to the challenges in obtaining schemas. It’s worth mentioning that while there are NL2SQL works ( liu2025surveytexttosqlerallms ; 10.14778/3685800.3685905 ) , they are limited to SQL-based databases and lack the capability for cross-data-source analysis. Third, some methods utilize NL queries to perform semantic analysis on unstructured data ( ZenDB ; DocETL ) . However, they require extracting structured data from the unstructured content before analysis, making them unsuitable for scenarios where a structured schema cannot be derived. To overcome these limitations, we explore semantic data analytics for both unstructured and structured data using NL queries. Recent advancements in AI agents ( shen2025mindmachinerisemanus ; xagent2023 ; huang-chang-2023-towards ; smolagents ) have enabled these agents to write code, search for relevant information online, and handle complex tasks. However, general AI agents are not tailored for collaborative multi-agent systems in data analysis tasks, which leads to lower quality results in these scenarios. The challenges in developing an agentic data analytics system include: Challenge 1: How can we efficiently discover task-specific datasets from vast data repositories in production environments? For example, bank production systems contain thousands of datasets, but many lack detailed metadata and schema documentation, making it difficult to pinpoint relevant datasets for analytical tasks. Challenge 2: How can we develop logically correct and valid semantic plans for an NL query? Given ten primitive relational and semantic operators, the number of possible plans expands to trillions of variations, turning the task of finding one correct solution into a search for a needle in a haystack. Challenge 3: How can we optimize and execute a semantic plan to minimize LLM costs while maintaining high accuracy? To tackle these challenges, we introduce AgenticData , a feedback-based multi-agent data analytics system. AgenticData begins with the development of a collaborative multi-agent planning framework that converts an NL query into a semantic plan composed of a data profiling agent, a data planning agent, and a data manipulation agent. The data profiling agent is designed to thoroughly comprehend the data analysis task description, select and analyze pertinent datasets, extract catalogs from unstructured datasets, and proactively learn domain knowledge from the datasets. The planning agent formulates an initial sketch of the semantic plan. Given the propensity for LLMs to produce errors, especially in complex plans, we design semantic and grammar validation techniques as well as smart memory management, providing essential feedback for plan correction. The data manipulation agent enhances the semantic plan by incorporating data access tools, such as calling functions or generating codes. Furthermore, we propose effective optimization strategies to reduce LLM costs without compromising plan accuracy. In summary, we make the following contributions. (1) We propose AgenticData , a feedback-based agentic data system featuring multi-agent collaboration, which facilitates data analysis on multi-source heterogeneous datasets with humans writing NL queries. To the best of our knowledge, this is the first agentic data analytics system designed for heterogeneous data. (See Section 2 ) (2) We introduce a groundbreaking planning framework that translates NL queries into semantic plans, utilizing semantic data discovery , semantic cross-validation , and smart memory management techniques. These techniques ensure accurate plan generation and automatic plan correction. (See Section 3 ) (3) We propose an optimization method at both the operator and plan levels to minimize LLM costs without compromising plan accuracy. (See Section 4 ) (4) We evaluated our system on three benchmarks, and the results showed that AgenticData achieved the highest accuracy and the least cost comparing to SOTA baselines. (See Section 5 ) 2. System Overview 2.1. Problem Formulation In this paper, we present AgenticData , a data agent system designed for analyzing multi-source heterogeneous data. Users employ NL to specify their requirements for extracting insights from underlying datasets, and AgenticData delivers high-quality results that accurately capture the intended data insights. The system should demonstrate three key characteristics: (1) High Accuracy: The results must be highly accurate with minimal hallucination, (2) Low Cost: The expenses of using LLMs should be minimized, and (3) Low Latency: The overall response time should be low. To fulfill these requirements, AgenticData supports a comprehensive set of relational operators (e.g., Scan, Filter, Project, Join, Aggregate, Union, Merge, Sort, Limit, etc.) as well as semantic operators (e.g., Extract, Sentiment Analysis, Semantic Filter, Semantic Group, Semantic Join, etc.). The semantic operators are specifically designed for analyzing unstructured data or textual columns ( unify ; palimpzestCIDR ) . Additionally, AgenticData can leverage LLMs to generate code for supporting non-predefined operators. AgenticData is designed to translate an NL query into a tree-structured semantic plan that incorporates various operators, optimizing and executing the semantic plan