Using Zero-Shot LLM-Generated Survey Data for Geographically Explicit Population Synthesis
Taylor Anderson, Sara Von Hoene, Orhan Yagizer Cinar, Emma Von Hoene, Amira Roess, Andrew Crooks, Hamdi Kavak, [1em] Dept. of Geography, Geoinformation Science, George Mason University, Fairfax, VA, USA · 2026
Read Using Zero-Shot LLM-Generated Survey Data for Geographically Explicit Population Synthesis by Taylor Anderson, Sara Von Hoene, Orhan Yagizer Cinar, Emma Von Hoene, Amira Roess, Andrew Crooks, Hamdi Kavak, [1em] Dept. of Geography, Geoinformation Science, George Mason University, Fairfax, VA, USA (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27401.txt.
Introduction
Taylor Anderson and colleagues test whether zero-shot language model survey data can feed population synthesis. Using GPT-4-1 records and Gemini-2-5-Pro records for Colorado and Mississippi, they run a standard iterative proportional fitting pipeline. Both models show major state contrasts, but results vary by variable, so synthetic data supplements rather than replaces real surveys.
Catalog record
| CREATOR | Taylor Anderson, Sara Von Hoene, Orhan Yagizer Cinar, Emma Von Hoene, Amira Roess, Andrew Crooks, Hamdi Kavak, [1em] Dept. of Geography, Geoinformation Science, George Mason University, Fairfax, VA, USA |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36122 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27401
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Using Zero-Shot LLM-Generated Survey Data for Geographically Explicit Population Synthesis Taylor Anderson, Sara Von Hoene, Orhan Yagizer Cinar, Emma Von Hoene, Amira Roess, Andrew Crooks, Hamdi Kavak, [1em] Dept. of Geography, Geoinformation Science, George Mason University, Fairfax, VA, USA Abstract Abstract There is a growing interest in utilizing synthetic populations for a diverse range of applications. At the same time, we are witnessing a tremendous growth in artificial intelligence in all walks of life. This paper evaluates whether zero-shot large language model (LLM)-generated health survey data can serve as inputs to a conventional iterative proportional fitting (IPF) workflow for geographically explicit population synthesis. Using the 2023 Behavioral Risk Factor Surveillance System (BRFSS), we generate synthetic survey records for the U.S. states of Colorado and Mississippi with GPT-4.1 and Gemini-2.5-Pro. We use the generated data in an IPF-based synthesis pipeline and evaluate the resulting census tract-level synthetic populations against external benchmarks. Results show both LLMs capture several major state-level contrasts, indicating zero-shot generation produces geographically differentiated survey data. However, performance is strongly variable-dependent. Downstream effects in population synthesis are mixed, as IPF sometimes amplifies or reduces errors in the generated data. Spatial validation shows that LLM-based populations reproduce census tract-level patterns reasonably well, especially for variables that were more aligned with the ground truth data. Overall, the LLM-generated survey data shows promise as supplementary input, but not yet as a replacement for real survey data. 1 Introduction Geographically explicit population synthesis is a technique for generating synthetic populations of individuals by integrating survey data with spatially aggregated marginal population constraints. These synthetic populations are widely used as inputs to agent-based and microsimulation models in public health, including models of infectious disease transmission ( 6 ; 10 ) , chronic disease dynamics ( 8 ; 16 ) , and the spread of health risk behaviors ( 12 ; 28 ) . A common method for constructing them is iterative proportional fitting (IPF), which reweights or allocates survey-based records so they match marginal population totals for each geographic unit. The quality of a synthetic population depends not only on the fitting procedure itself, but also on the quality and availability of the input survey data. Bias, error, or sampling noise can propagate through the synthesis process and affect downstream spatial estimates and simulation outcomes. At the same time, many population synthesis applications are constrained by the limited availability of survey data that include the variables needed for a given simulation and/or are representative of the specific population being modeled. One way to potentially overcome the gap in data is to utilize artificial intelligence. Recent work suggests that, with caution, large language models (LLMs) may be able to generate synthetic human data that resembles real survey respondents. For example, computational social science, studies have shown that LLMs can reproduce opinions and behaviors when prompted with background attributes or persona-like descriptions ( 1 ; 15 ; 27 ; 2 ; 19 ) . However, applications exploring LLM-generated survey data in the health domain remain more limited, although emerging research suggests that LLMs may be useful for generating synthetic health survey records ( 25 ) . Such work suggests that LLM-generated survey data could serve as inputs to geographically explicit population synthesis pipelines, addressing persistent data limitations. Other work is emerging that moves beyond individual record generation and attempts to scale LLM-produced individuals into larger synthetic populations. In some cases, this has involved specifying constraints in the prompt to align LLM-generated populations with known spatial distributions ( 23 ) . While Olmez et al. ( 17 ) used LLMs to supplement or complete limited survey data before those data are used in population synthesis. Finally, some studies have also attempted to generate location itself as one of the individual attributes ( 20 ) . This growing body of research points towards a possible role for LLMs in synthetic population construction, but none of which fully address a different and more practical question for population synthesis: to what extent can LLM-generated survey data serve as suitable input data for established geographically explicit synthesis methods? This distinction is important, as in geographically explicit population synthesis, the survey data are not the final product; they are the joint distributional template. As a result, the challenge is not only about the plausibility of LLM-generated responses in isolation, but about whether they preserve the multivariate relationships needed for downstream synthesis procedures such as IPF. To our knowledge, no work has directly examined the consequences of using LLM-generated survey data in this way. As such, in this paper, we take a first step toward evaluating the potential of zero-shot LLM-generated survey data for geographically explicit population synthesis using IPF. IPF makes for an interesting case study because it seeks to preserve the joint distributions present in the input records; thus, any incorrect relationships, bias, misclassification, or underrepresented subgroup patterns in the original data can be carried into the final synthetic population ( 7 ) . To demonstrate our work, we focus on two substantively different U.S. states, Colorado (CO) and Mississippi (MS), and use fourteen categorical questions from the 2023 Behavioral Risk Factor Surveillance System or BRFSS health survey ( 3 ) . These states provide a useful contrast because they differ across a range of demographic and health-related characteristics, including education , income , exercise , body mass index , and self-reported health . We use the LLMs GPT-4.1 and Gemini-2.5-Pro to generate synthetic individual-level survey records and compare them with weighted BRFSS survey data to assess how well the models reproduce marginal distributions and broader state-level contrasts. We then use the generated records as inputs to an IPF-based population synthesis pipeline and evaluate the resulting census tract-level synthetic populations against external benchmarks. Our contribution is twofold. First, whereas prior work has largely evaluated LLM-generated data at the national level, we assess the extent to which LLM-generated survey data can approximate state-specific health survey data and capture meaningful geographic differences. Second, we examine the downstream usefulness of these data within a geographically explicit population synthesis workflow by comparing the errors they propagate to those arising from a synthetic population generated from real survey data. Although our analysis considers all modeled variables, we use health insurance and general health as especially detailed case studies because they illustrate two different types of downstream behavior and can be validated against census tract-level external benchmarks. In what follows, we provide our overview of our methods (Section 2 before presenting the results in Section 3 . Finally, we conclude our paper in Section 4 with a discussion and highlight areas of further work. 2 METHODS Population synthesis fits survey data to spatially aggregated demographic data containing marginal population totals. Here, survey data refers to anonymized individual responses to a set of questions, including demographic information. In this study, for each state CO and MS, we generated populations using LLM-generated survey data from GPT-4.1, Gemini-2.5-Pro, and real BRFSS survey data, for a total of six populations. The following sections outline the methods for survey data generation using LLMs (Section 2.1 ), the population synthesis (Section 2.2 ), and our evaluation approach (Section 2.3 ). 2.1 Survey data generation using LLMs We generated synthetic individual-level survey records using