Can LLMs Clean Up Your Mess? A Survey of Application-Ready Data Preparation with LLMs
Wei Zhou, Jun Zhou, Haoyu Wang, Zhenghao Li, Qikang He, Shaokun Han, Guoliang Li · 2026
Read Can LLMs Clean Up Your Mess? A Survey of Application-Ready Data Preparation with LLMs by Wei Zhou, Jun Zhou, Haoyu Wang, Zhenghao Li, Qikang He, Shaokun Han, Guoliang Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17058.txt.
Introduction
Wei Zhou and a team of seven co-authors survey how chatbots prep raw data for use. Raw data oft comes dirty, split, and hard to join. Prep cleans it, links it, and mines it for worth. Need for app-ready data keeps on the rise. Chatbot tools and agent kits now make prep more flex. Their 2026 preprint maps that fast field in full.
The survey sorts prep tasks and the tools for each. It weighs where chatbots shine and where they slip. Dirty data wastes much pro time in all fields. Sound maps help teams pick prep tools with proof. They also mark gaps for the next wave of work.
Catalog record
| CREATOR | Wei Zhou, Jun Zhou, Haoyu Wang, Zhenghao Li, Qikang He, Shaokun Han, Guoliang Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 100 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-17058
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Can LLMs Clean Up Your Mess? A Survey of Application-Ready Data Preparation with LLMs Thanks: Wei Zhou, Jun Zhou, Haoyu Wang, Zhenghao Li, Qikang He, Shaokun Han, Xuanhe Zhou, Zhenzhe Zheng, and Fan Wu are with Shanghai Jiao Tong University, Shanghai, China. Guoliang Li is with Tsinghua University, Beijing, China. Yeye He is with Microsoft Research. Chunwei Liu is with MIT CSAIL, USA. Bin Wang and Conghui He are with Shanghai AI Laboratory. Shen Tang and Kai Zuo are with Xiaohongshu Inc. Yuyu Luo is with the Hong Kong University of Science and Technology (Guangzhou), China. Jingren Zhou is with Alibaba Group. Thanks: Corresponding author: Xuanhe Zhou ([email protected]). Wei Zhou, Jun Zhou, Haoyu Wang, Zhenghao Li, Qikang He, Shaokun Han, Guoliang Li Abstract Data preparation aims to denoise raw datasets, uncover cross-dataset relationships, and extract valuable insights from them, which is essential for a wide range of data-centric applications. Driven by (i) rising demands for application-ready data (e.g., for analytics, visualization, decision-making), (ii) increasingly powerful LLM techniques, and (iii) the emergence of infrastructures that facilitate flexible agent construction (e.g., using Databricks Unity Catalog), LLM-enhanced methods are rapidly becoming a transformative and potentially dominant paradigm for data preparation. By investigating hundreds of recent literature works, this paper presents a systematic review of this evolving landscape, focusing on the use of LLM techniques to prepare data for diverse downstream tasks. First, we characterize the fundamental paradigm shift, from rule-based, model-specific pipelines to prompt-driven, context-aware, and agentic preparation workflows. Next, we introduce a task-centric taxonomy that organizes the field into three major tasks: data cleaning (e.g., standardization, error processing, imputation), data integration (e.g., entity matching, schema matching), and data enrichment (e.g., data annotation, profiling). For each task, we survey representative techniques, and highlight their respective strengths (e.g., improved generalization, semantic understanding) and limitations (e.g., the prohibitive cost of scaling LLMs, persistent hallucinations even in advanced agents, the mismatch between advanced methods and weak evaluation). Moreover, we analyze commonly used datasets and evaluation metrics (the empirical part). Finally, we discuss open research challenges and outline a forward-looking roadmap that emphasizes scalable LLM-data systems, principled designs for reliable agentic workflows, and robust evaluation protocols. I Introduction Data preparation refers to the process of transforming raw datasets into high-quality ones (e.g., trustworthy and comprehensive) by denoising corrupted inputs, identifying cross-dataset relationships, and extracting meaningful insights. Despite its foundational role in downstream applications such as business intelligence (BI) analytics [ 98 , 3 ] , machine learning (ML) model training [ 109 , 47 ] , and data sharing [ 43 , 23 ] , data preparation remains a critical bottleneck in real scenarios. For instance, an estimated 20% - 30% of enterprise revenue is lost due to data inefficiencies [ 15 ] . As illustrated in Figure 1 , real-world data inefficiencies primarily arise from three sources: (1) Consistency & Quality Issues (e.g., non-standard formats, noise, and incompleteness); (2) Isolation & Integration Barriers (e.g., disparate systems, entity ambiguity, and schema conflicts); and (3) Semantic & Context Limitations (e.g., missing metadata and unlabeled data). To these challenges, data preparation [ 165 , 166 ] involves three main tasks: Data Cleaning , Data Integration , and Data Enrichment , which transform raw inputs into unified, reliable, and enriched datasets. As the volume and heterogeneity of data continue to surge (e.g., global data volume is forecast to triple from 2025 to 2029 [ 129 ] ), the imperative for effective data preparation has never been greater. However, traditional data preparation methods rely heavily on static rules [ 86 , 104 ] , manual interventions, or narrowly scoped models [ 76 , 24 ] , motivating the need for more intelligent, adaptive solutions. Fig. 1: Application-Ready Data Preparation – Three core tasks (i.e., Data Cleaning, Integration, and Enrichment) address key sources of data inefficiency: quality issues, integration barriers, and semantic gaps. Fig. 2: Overview of Application-Ready Data Preparation through LLM -Enhanced Methods. I-A Limitations of Traditional Data Preparation As discussed above, traditional preparation techniques, ranging from heuristic rule-based systems [ 11 , 21 , 104 ] to domain-specific machine-learning models [ 31 , 134 , 76 , 24 ] , face several fundamental limitations. \bullet (Limitation ❶) High Manual Effort and Expertise Dependence. Traditional data preparation methods largely depend on fixed rules and domain-specific configurations, such as regular expressions and validation constraints [ 73 , 153 ] . This reliance demands substantial manual effort and specialized expert knowledge, introducing significant development and maintenance barriers. For instance, data standardization typically requires complex, handcrafted scripts (e.g., user-defined functions) or manual constraints (e.g., date formatting rules) [ 86 , 6 ] . Similarly, data error processing pipelines often rely on fixed detect-then-correct workflows defined by manually crafted rules, which are not only labor-intensive to maintain but also prone to introducing new errors (e.g., incorrectly repaired values) during correction [ 100 ] . \bullet (Limitation ❷) Limited Semantic Awareness in Preparation Enforcement. Conventional rule-based approaches predominantly rely on statistical patterns (e.g., computing missing value percentages) or syntactic matching, which fundamentally limit their ability to accurately identify complex inconsistencies that require semantic reasoning. For example, in data integration, traditional similarity-based matching techniques struggle to resolve semantic ambiguities (such as abbreviations, synonyms, or domain-specific terminology) due to the lack of commonsense or domain-specific knowledge [ 85 ] . Moreover, keyword-based search mechanisms in data enrichment frequently fail to capture user intent, creating a semantic gap that leaves relevant datasets undiscovered [ 44 , 7 ] . \bullet (Limitation ❸) Poor Generalization across Diverse Preparation Tasks and Data Modalities. Traditional deep learning models typically require specialized feature engineering [ 24 ] or domain-specific training [ 76 ] , which severely restricts their generalizability across diverse domains and data modalities. For example, fine-tuned entity-matching models exhibit significant performance degradation when applied to out-of-distribution entities [ 108 ] . Similarly, supervised data annotation models struggle to perform well on data from underrepresented subgroups or domains with limited labeled examples [ 39 , 68 ] . Furthermore, methods designed for structured tabular data often fail to effectively process semi-structured text or other modalities [ 94 ] , limiting their applicability in heterogeneous data environments. \bullet (Limitation ❹) Preparation Reliance on Labeled Data and Limited Knowledge Integration. Small-model-based approaches typically require large volumes of high-quality and accurately labeled examples, which can be expensive to obtain at scale [ 137 ] . For instance, in data annotation, the prohibitively high cost of expert labeling limits the scale of reliable datasets, whereas crowdsourced alternatives often exhibit unstable quality [ 53 ] . Moreover, existing methods often lack the flexibility to integrate diverse contexts. For example, general retrieval-based systems [ 44 ] face challenges in effectively integrating structured table data with unstructured free-text context. I-B LLM-Enhanced Data Preparation : Driving Forces And Opportunities To overcome these limitations, recent advances in large language models (LLMs) have catalyzed a paradigm shift in data preparation [ 146 , 14 ] . This transformation is fueled by three converging forces. First, the increasing demand for application-ready data, which is essential for scenarios such as personalizing customer experiences [ 127 ] and enabling real-time analytics. Second, the methodological shift from static, rule-based pipelines to LLM agent frameworks that can