Position: Let’s Develop Data Probes to Fundamentally Understand How Data Affects LLM Performance
Shiqiang Wang, Herbert Woisetschläger, Hans Arno Jacobsen, Mingyue Ji · 2026
Read Position: Let’s Develop Data Probes to Fundamentally Understand How Data Affects LLM Performance by Shiqiang Wang, Herbert Woisetschläger, Hans Arno Jacobsen, Mingyue Ji (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18801.txt.
Introduction
Shiqiang Wang and three colleagues argue for data probes as a principled way to learn how data shapes language model skill. Current work leans on costly trials over large public sets to find filtering rules, with little theory for why traits matter. The authors call for synthetic sequences drawn from defined random processes, run through training, tuning, alignment, and prompting stages. Watching model behaviour on such probes, they say, can reveal which data traits drive skill, transfer, and robustness.
Catalog record
| CREATOR | Shiqiang Wang, Herbert Woisetschläger, Hans Arno Jacobsen, Mingyue Ji |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62427 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.18801
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Position: Let’s Develop Data Probes to Fundamentally Understand How Data Affects LLM Performance Shiqiang Wang, Herbert Woisetschläger, Hans Arno Jacobsen, Mingyue Ji Abstract Data is fundamental to large language models (LLMs). However, understanding of what makes certain data useful for different stages of an LLM workflow, including training, tuning, alignment, in-context learning, etc., and why, remains an open question. Current approaches rely heavily on extensive experimentation with large public datasets to obtain empirical heuristics for data filtering and dataset construction. These approaches are compute intensive and lack a principled way of understanding the essence of how specific data characteristics drive LLM behavior. In this position paper, we advocate for the need of developing systematic methodologies for generating synthetic sequences from appropriately defined random processes, with the goal that these sequences can reveal useful characteristics when they are used in one or multiple stages of the LLM workflow . We refer to such sequences as data probes . By observing LLM behavior on data probes, researchers can systematically conduct studies on how data characteristics influence model performance, generalization, and robustness. The probing sequences exhibit statistical properties that can be viewed using theoretical concepts, such as typical sets, which are generalized to describe the behaviors of LLMs. This data-probe approach provides a pathway for uncovering foundational insights into the role of data in LLM training and inference, beyond empirical heuristics. 1 Introduction The success of large language models (LLMs) stems not only from advances in model architecture and training algorithms but also from access to vast amounts of diverse data ( Grattafiori et al. 2024 ; Mishra et al. 2024 ; Brown et al. 2020 ; DeepSeek-AI 2025 ) . Raw data typically cannot be used directly. It must be processed or filtered to ensure quality. Such data processing is resource-intensive ( Penedo et al. 2024 ) , so, as of today, data-related research has been primarily conducted by large organizations with the necessary computational and financial resources ( Grattafiori et al. 2024 ; Gemma Team et al. 2024 ; Su et al. 2025 ; Gohari et al. 2026 ) . While such research has been practically useful, there is limited study on the fundamental reasons behind how data affects LLM performance . Beyond the need for extensive resources, another obstacle preventing the understanding of data for LLMs is the lack of a systematic and principled way of controlling the data input for LLM training and inference. Real-world data is often not directly controllable, as its ground-truth distribution is largely unknown ( Cvejoski et al. 2024 ; Shu & Yu 2024 ) . Thus, current data processing methods rely on empirical heuristics, which are developed through extensive experimentation involving LLM training with data processed in different ways and evaluation on benchmark datasets ( Wettig et al. 2024 ; Penedo et al. 2024 ) . Such empirical findings usually hold only on a case-by-case basis. Moreover, the training data may be contaminated with benchmark data, and the benchmark datasets themselves may not fit the target domain where the LLM will be applied ( Sainz et al. 2023 ) . Therefore, an important open problem is the fundamental relationship between data properties and LLM behavior. Addressing this problem is crucial, as a better understanding of how data affects LLM performance could lead to more efficient and targeted dataset construction, reducing costs and risks (e.g., hallucination) while improving the overall LLM performance. Recently, some theoretical studies have attempted to use simplified sequences to analyze specific properties of transformer-based architectures ( Makkuva et al. 2025 ; Rajaraman et al. 2024 ) . Although these studies provide valuable insights, their evaluations usually consider oversimplified models and have limited relevance to practical LLM workflows. What is missing is a systematic yet accessible approach that can connect theoretical findings with real-world applications , offering both explanatory power and actionable guidance for practitioners. In this paper, we argue that the research community should develop systematic methodologies for generating synthetic sequences from fully defined (known) random processes, with the goal that these sequences will be useful tools for understanding the relationship between data and LLM performance. We refer to such sequences as data probes . The data probes are designed to have a clear meaning (usually in theory) while being able to trigger specific behaviors in practical LLMs. Different data probes can be used depending on the LLM behavior, e.g., hallucination, bias, memorization, mode collapse, we would like to study. Compared to actual datasets, the uniqueness of data probes is that they are generated from a random process with a known probability distribution. Although it may be high-dimensional and difficult to fully comprehend from a human perspective, the fact that this distribution is known and can be expressed numerically has the following advantages: 1. A virtually unlimited amount of data can be generated from the same distribution, so both training and test data can be generated and used in experiments driven by data probes. Such data can be generated on the fly, removing the need to manage massive datasets. 2. The likelihood of any given sequence can be computed against the distribution, which is impossible for experiments with real datasets where the underlying stochastic process for generating such real data is unknown. This unlocks new opportunities, such as examining the difference in the likelihood between the training data and LLM-generated data, which subsequently help advance the research in LLMs and generative AI. In essence, by systematically varying key characteristics of the probability distribution for generating data probes, researchers can observe how these properties influence LLM performance, where the results can be obtained by evaluating LLM-generated data back on the known distribution. Compared to standard empirical studies driven by massive datasets, this approach is more controllable and requires significantly fewer resources. It can reveal the core principles underlying the influence of data on LLMs. The results of such data probe-based studies will be a valuable starting point for more sophisticated theoretical analysis and practical design of data processing algorithms . Data probes also allow for deeper integration of theoretical concepts, such as typical sets from information theory ( Cover & Thomas 2006 ) , thus offering a principled framework. However, the difference between this data-probe approach and most existing theoretical analyses is that data probes are designed to have both theoretical and practical values . The results provide actionable insights into how datasets can be better constructed and curated. In this way, data probes will be an important “interface” for connecting theory and practice , as illustrated in Figure 1 . Figure 1 : Data probes connect theory and practice. This position paper highlights the importance of developing and adopting data probes to advance both research and practice. They offer a powerful way to bridge the gap between theory and real-world application, helping the community develop more efficient, transparent, and effective strategies for leveraging data in developing next-generation LLMs. This approach can also inspire a closer collaboration and integration of data-related research between academic institutions and large industrial organizations. 2 Current Status of Understanding LLMs The understanding of LLMs has evolved through various complementary approaches, each offering unique insights into these complex systems. While these approaches have advanced our knowledge significantly, they