A Survey of LLM × \times DATA

Xuanhe Zhou 1 5 , Junxuan He 1 5 , Wei Zhou 1 5 , Haodong Chen 1 5 , Zirui Tang 1 5 , Haoyu Zhao 1 5 , Xin Tong 1 , Guoliang Li 2 , Youmin Chen 1 , Jun Zhou 1 , Zhaojun Sun 1 , Binyuan Hui 3 , Shuo Wang 2 , Conghui He 4 , Zhiyuan Liu 2 , Jingren Zhou 3 , Fan Wu 1 · 2025

Read A Survey of LLM × \times DATA by Xuanhe Zhou 1 5 , Junxuan He 1 5 , Wei Zhou 1 5 , Haodong Chen 1 5 , Zirui Tang 1 5 , Haoyu Zhao 1 5 , Xin Tong 1 , Guoliang Li 2 , Youmin Chen 1 , Jun Zhou 1 , Zhaojun Sun 1 , Binyuan Hui 3 , Shuo Wang 2 , Conghui He 4 , Zhiyuan Liu 2 , Jingren Zhou 3 , Fan Wu 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18458.txt.

Introduction

Xuanhe Zhou and co-authors survey in a 2025 review the two-way street between large language models and data management. Data work feeds the models: gathering, cleaning, deduplicating, storing, and serving the text they train and retrieve on. In return, the models are becoming engines inside data systems themselves.

The survey maps both directions in detail, from KV-cache handling and checkpointing to model-driven data cleaning, discovery, and query rewriting. Multi-agent setups and retrieval-grounded prompting recur as themes. For builders of either field, the message is that the two now design each other.

Catalog record

CREATORXuanhe Zhou 1 5 , Junxuan He 1 5 , Wei Zhou 1 5 , Haodong Chen 1 5 , Zirui Tang 1 5 , Haoyu Zhao 1 5 , Xin Tong 1 , Guoliang Li 2 , Youmin Chen 1 , Jun Zhou 1 , Zhaojun Sun 1 , Binyuan Hui 3 , Shuo Wang 2 , Conghui He 4 , Zhiyuan Liu 2 , Jingren Zhou 3 , Fan Wu 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE286 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-18458

Browse the full library · About the Tower of Babel