Synthetic Data and the Shifting Ground of Truth

Dietmar Offenhuber · 2025

Read Synthetic Data and the Shifting Ground of Truth by Dietmar Offenhuber (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-13355.txt.

Introduction

Dietmar Offenhuber examines man-made data and the concept of ground truth in a 2025 paper. Man-made data are used for privacy protection, training data making, or convenient access to quasi-real-life data in any shape or volume. They mimic real-world readings but do not refer to external features of the world.

That lack of a representational relationship does not prevent researchers from using man-made data as training data and as ground truth repositories. It is claimed that unrealistic data can even lead to better model results than real-life data, by compensating for known biases, preventing overfitting, supporting generalization, and improving robustness to outliers. Injecting noisy or implausible data can be beneficial. Ground truth thus becomes a self-referential affair, complicating the usual assumption that representational quality determines data fidelity.

Catalog record

CREATORDietmar Offenhuber
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-13355

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Synthetic Data and the Shifting Ground of Truth Dietmar Offenhuber Abstract \KOMAoption captionstableheading Talk presented at the Society for the Social Studies of Science (4S) 2025 meeting in Seattle. Abstract The emergence of synthetic data for privacy protection, training data generation, or simply convenient access to quasi-realistic data in any shape or volume complicates the concept of ground truth. Synthetic data mimic real-world observations, but do not refer to external features. This lack of a representational relationship, however, not prevent researchers from using synthetic data as training data for AI models and ground truth repositories. It is claimed that the lack of data realism is not merely an acceptable tradeoff, but often leads to better model performance than realistic data: compensate for known biases, prevent overfitting and support generalization, and make the models more robust in dealing with unexpected outliers. Indeed, injecting noisy and outright implausible data into training sets can be beneficial for the model. This greatly complicates usual assumptions based on which representational accuracy determines data fidelity (garbage in - garbage out). Furthermore, ground truth becomes a self-referential affair, in which the labels used as a ground truth repository are themselves synthetic products of a generative model and as such not connected to real-world observations. My paper examines how ML researchers and practitioners bootstrap ground truth under such paradoxical circumstances without relying on the stable ground of representation and real-world reference. It will also reflect on the broader implications of a shift from a representational to what could be described as a mimetic or iconic concept of data. Figure 1 : Simone Niquille, Still from “Sorting Song” 2021 Introduction The concept of ground truth, traditionally serving as a stable reference point for evaluating model predictions, undergoes significant transformation when applied to synthetic data. This paper examines the epistemic and ontological foundations of the concept of ground truth, used differently in different contexts. Gil Fournier and Jussi Parikka, describe ground truth broadly as a “grounding figure of knowledge,” both a guarantee of knowledge and a metaphorical figure (Gil-Fournier and Parikka 2020). In the case of synthetic data, however, this grounding figure undergoes several figure-ground inversions: what was once considered the static background, turns into a site of uncertainty and controversy. These shifts turn the common representational understanding of data on its head. To begin, consider the following set of conflicting assumptions: Garbage in - garbage out : A common stance of critical data studies is that every machine learning model is only as good as its training data. Good in this context means how well and complete it represents its population or phenomenon. It has been closely studied how biased training data automates and perpetuates historical inequalities and exclusion (Benjamin 2019; D’Ignazio and Klein 2020) Counter-intuitive findings in AI research : Seemingly in conflict with this stance, AI resarch has shown that including fake, improbable, even impossible observations into training data can improve learning and generalization; make models more robust. As Tobin et al. note, “With enough variability in the simulator, the real world may appear to the model as just another variation” (Tobin et al. 2017). Increasing variability in this context means precisely not to make synthetic data as realistic as possible, but to explore the full parameter space to force a machine learning model to generalize and focus on the big picture rather than smaller, often spurious correlations. My paper will discuss the consequences of this paradoxon for the concept of ground truth. A brief typology of synthetic data It is important to avoid overly-general statements about synthetic data, as this concept is an umbrella term for data generated for very different purposes with very different functions and properties. Broadly, it means any data that is artificially generated for a particular purpose. What follows are the four most important, as discussed in Offenhuber (2024). 1. Algorithmic - this includes the algorithmically generated data sets and simulations that are used as benchmarks in disciplines such as physics or network science. synthetic data here is a idealized case that real-world data can be compared to. 2. Obfuscated - real observations, obfuscated for the purpose of privacy protection (i.e. of micro-census data, which uses noise injection for differential privacy). mathematical theory around differential privacy that allows to calculate how much obfuscation is needed. 3. Mimikry, hybridized - data generated based on one or several data sets, for a variety of reasons (analytic purposes with issues of privacy, de-biasing, test data). Involves combining different datasets to increase resolution, or enlarge a data set preserving known statistical properties (not necessarily the unknown ones). also possible to Photoshop data that way, reduce known biases etc… but the important thing is that here we no longer talk about real observations, but data that look like real observations. 4. Generated training data - entirely artificial data sets for training purposes that are not generated based on real data, completely invented. here we are very far away from any representational relationship or fidelity. the only objective is that these data improve learning when injected into other observations. The following discussion is not equally relevant for all four categories; it mostly applies to the last two, although some arguments also apply to second category focusing on differential privacy obfuscation. The rationales for synthetic data There is common ground between the garbage-in, garbage-out stance and the case for increasing variability through generalization. In both cases, the core problem is well understood: all observational training data are biased and contain stereotypes. They also don’t cover enough outliers. Inclusion of outliers is considered important in both cases, although for slightly different reasons. In the first case, the goal is proportionally accurate representation. The second case aims to cover all possible variations, regardless of proportionality. Another goal is to increase the contrast between features to put smaller variations into perspective. Microsoft’s Face Synthetics dataset is designed to train facial recognition models without using photos of real people. Instead, the dataset contains rendered 3D characters with randomized features, facial expressions, and lighting conditions (Castellanos 2021). While this randomization may not accurately reflect demographic variations, it attempts to maximize diversity. After all, a model should have as much training data relating to underrepresented cases as to those that are more common. AI research on underrepresented cases is limited by a lack of real-world training data, which puts models at risk of underperforming for these populations. In the medical field, rare brain tumors are outliers. Researchers have replaced real MRI images with synthetically generated images of brain tumors and subsequently used them to train a model to recognize real tumors (Rouzrokh et al., n.d.). As in the facial recognition example, the goal is a simulation-to-reality transfer. In this case, however, it is complicated by the scarcity of real-world medical data on rare conditions. An even more extreme case are data about phenomena that have never been observed or events that are not known to have ever occurred. In this context, Jacobsen addresses the political dimension of synthetic data, driven from the desire to model “black swan events” to manage risks in technocratic regimes of governance (Jacobsen 2023). Steinhoff also considers synthetic data to follow but eventually supersede the paradigm of surveillance capitalism, While surveillance

Read the complete text