Using Imperfect Synthetic Data in Downstream Inference Tasks

Yewon Byun, Shantanu Gupta, Zachary C. Lipton, Rachel Leah Childers, Bryan Wilder, Machine Learning Department, Carnegie Mellon University University of Zurich {yewonb, shantang, zlipton, bwilder}@cs.cmu.edu · 2025

Read Using Imperfect Synthetic Data in Downstream Inference Tasks by Yewon Byun, Shantanu Gupta, Zachary C. Lipton, Rachel Leah Childers, Bryan Wilder, Machine Learning Department, Carnegie Mellon University University of Zurich {yewonb, shantang, zlipton, bwilder}@cs.cmu.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06635.txt.

Introduction

Yewon Byun led a team that wrote, in two thousand twenty-five, on safe sums from fake data. When real data are thin, teams now ask big word codes to make fake rows, such as fake survey forms. Mix fake rows with real ones, and the sums can go wrong with no sign. Past work dealt most with code tags put on real rows. Wholly fake rows are a harder case.

The team built a new estimator, a sum tool based on the generalized method of moments. It needs no knobs set by hand, and strong proof backs its sums. One find was a surprise: when the gaps in the fake rows and the gaps in the real rows track each, the pair can sharpen the sums a great deal. Tests on code tasks from group and crowd study bore that out, with large gains.

Catalog record

CREATORYewon Byun, Shantanu Gupta, Zachary C. Lipton, Rachel Leah Childers, Bryan Wilder, Machine Learning Department, Carnegie Mellon University University of Zurich {yewonb, shantang, zlipton, bwilder}@cs.cmu.edu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-06635

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Using Imperfect Synthetic Data in Downstream Inference Tasks Yewon Byun, Shantanu Gupta, Zachary C. Lipton, Rachel Leah Childers, Bryan Wilder, Machine Learning Department, Carnegie Mellon University University of Zurich {yewonb, shantang, zlipton, bwilder}@cs.cmu.edu Abstract Predictions and generations from large language models are increasingly being explored as an aid to computational social science and human subject research in limited data regimes. While previous technical work has explored the potential to use model-predicted labels for unlabeled data in a principled manner, there is increasing interest in using large language models to generate entirely new synthetic samples (also termed as synthetic simulations), such as in responses to surveys. However, it is not immediately clear by what means practitioners can combine such data with real data and yet produce statistically valid conclusions upon them. In this work, we introduce a new estimator based on generalized method of moments, providing a hyperparameter-free solution with strong theoretical guarantees to address the challenge at hand. Surprisingly, we find that interactions between the moment residuals of synthetic data and those of real data can improve estimates of the target parameter. We empirically validate the finite-sample performance of our estimator across different regression tasks in computational social science applications, demonstrating large empirical gains. 1 Introduction Diverse forms of synthetic data have entered downstream pipelines, such as in computational social science and human subject research. In settings where labeled data is scarce, practitioners increasingly leverage large language models (LLMs) as cheap but noisy labelers for automating tasks traditionally reliant on manual human annotations ( Egami et al. 2023 ; Gligorić et al. 2024 ) . For example, in computational social science, practitioners often use large corpora of text documents to explain some outcome of interest (e.g., political stance) with respect to certain explanatory variables (e.g., linguistic markers) ( Ziems et al. 2024 ; Bail 2024 ; Veselovsky et al. 2023 ) . In such settings where manually labeling large, unstructured text corpora can be prohibitively expensive, it is increasingly common to leverage LLMs for label annotation ( Ziems et al. 2024 ) . Beyond annotation, recently, practitioners have started to explore the possibility of leveraging LLMs for more diverse and open-ended forms of model-generated data. For instance, practitioners have started to explore the possibility of leveraging LLMs to output entirely new synthetic samples, e.g., simulating human responses to surveys or human participants in early pilot studies ( Argyle et al. 2023 ; Brand et al. 2023 ; Dominguez-Olmedo et al. 2024 ; Anthis et al. 2025 ; Hwang et al. 2025b ) . Such synthetic simulations aim to overcome the financial limitations and time costs of relying solely on human participants, to improve both efficiency and accessibility ( Alemayehu et al. 2018 ) . Ideally, we would like to realize the benefits of incorporating information from these additional data sources, while retaining good statistical properties—consistency and proper asymptotic coverage— to allow practitioners to report conclusions reliably. A persistent challenge, however, is that naively combining these imperfect surrogates with human-annotated samples for tasks such as downstream analyses can often lead to biased estimates, compromising their statistical validity. While such pipelines leveraging fully synthetic simulations have yet to be fully realized, developing reliable mechanisms for aggregating these data sources is indeed what will inform how such pipelines should be designed and implemented in practice. Yet, existing methods have not made clear by what means we can incorporate such data, while producing statistically valid estimates. First of all, it is not immediately obvious how to even produce synthetic samples such that they can be used in a principled manner. Naively drawing samples from a generative model and treating them as additional samples alongside real data makes it impossible to provide statistical guarantees for the resulting estimate if the generative model does not perfectly match the real distribution—which is expected in practice. To address this, we propose a specific sampling strategy in which each synthetic sample is generated conditional on an individual real text as an example (see Section 3 for details). What makes this formulation statistically powerful is that it introduces a correlation structure between each real text and synthetic sample. This correlation structure will prove critical for principled methods for integrating synthetic data, as it enables us to more effectively share information across them. We focus on the following setup, which is one instantiation of the illustrated sampling strategy. We assume the practitioner has access to a corpus of unlabeled text and only a small set of human annotations of covariates and outcomes. Here, the practitioner can leverage LLMs to (1) predict covariates and outcomes for the unlabeled text samples; and (2) generate new text samples conditioned on available text samples and extract covariates and outcomes from them similarly to (1). Under this setting, we study how to effectively combine these different sources of information for downstream statistical estimation tasks. Our primary methodological contribution is to propose a new estimator based on generalized method of moments (GMM) that naturally incorporates this synthetic data. We also explore ways to adapt existing debiasing methods ( Angelopoulos et al. 2023a ; Angelopoulos et al. 2023b ; Egami et al. 2023 ) from the literature to apply to our problem setup. The construction of our GMM estimator defines separate parameters and moments for each data source. While it is not necessarily obvious that the incorporation of moments based exclusively on synthetic data should yield any benefits (or even affect) the estimation of the target parameter, we surprisingly find that the interactions between the moment residuals of the different sources of information can improve estimates of the target parameter (see Sections 4.6 and 6 ) — the key intuition being that synthetic data will improve performance when the synthetic data residuals are predictive of the real data residuals . This GMM-based strategy for incorporating auxiliary data may be of broader interest as an alternative to the predominant debiasing-based methods used so far in the literature ( Angelopoulos et al. 2023a ) . 2 Related Work LLMs for Data Annotation and Synthetic Simulation Tasks. Our work is motivated by the increasingly growing use and future promise of LLMs for annotations and simulations, particularly as a means to reduce human labeling costs ( Hwang et al. 2025a ) . Recently, LLMs have been tested in fully synthetic simulation studies ( Dillion et al. 2023 ; Anthis et al. 2025 ) , with primary applications in exploratory research or early pilot studies. For instance, recent work has studied simulating individuals in society and their interactions ( Park et al. 2022 ; Chen et al. ) , analyzing whether the resulting LLM agents produced accurate responses on surveys and accurately predicted behavioral outcomes ( Park et al. 2023 ) . Other works have applied LLMs to simulate survey responses ( Geng et al. 2024 ; Rothschild et al. 2024 ) , while others have cautioned about specific flaws in LLM responses ( Dominguez-Olmedo et al. 2024 ) , such as not accurately reflecting the influence of demographic groups ( Dominguez-Olmedo et al. 2024 ; Wang et al. 2025 ) . Whether such simulations should be used by itself or in some combination with "real" data remains an open and task-dependent question.

Read the complete text