Distribution Shift Alignment Helps LLMs Simulate Survey Response Distributions

Ji Huang, Mengfei Li, Shuai Shao · 2025

Read Distribution Shift Alignment Helps LLMs Simulate Survey Response Distributions by Ji Huang, Mengfei Li, Shuai Shao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-21977.txt.

Introduction

Ji Huang, Mengfei Li, and Shuai Shao use language models to imitate how groups of people answer surveys, a cheaper stand-in for polling real respondents. Off-the-shelf models prompted cold are jittery and inaccurate, while ordinary fine-tuning just memorizes the training surveys and cannot beat the data it learned from.

Their method, Distribution Shift Alignment, fine-tunes in two stages with a different target. Not the response distributions themselves, but how those distributions shift when the background of the surveyed group changes. Learning the shifts lets the model land closer to the true distribution than its own training data sits. Across five public survey datasets the approach beat rival methods on accuracy and held up on robustness checks, while cutting the real survey data needed by more than half.

Catalog record

CREATORJi Huang, Mengfei Li, Shuai Shao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-21977

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Distribution Shift Alignment Helps LLMs Simulate Survey Response Distributions Ji Huang, Mengfei Li, Shuai Shao Abstract Large language models (LLMs) offer a promising way to simulate human survey responses, potentially reducing the cost of large-scale data collection. However, existing zero-shot methods suffer from prompt sensitivity and low accuracy, while conventional fine-tuning approaches mostly fit the training set distributions and struggle to produce results more accurate than the training set itself, which deviates from the original goal of using LLMs to simulate survey responses. Building on this observation, we introduce Distribution Shift Alignment (DSA), a two-stage fine-tuning method that aligns both the output distributions and the distribution shifts across different backgrounds. By learning how these distributions change rather than fitting training data, DSA can provide results substantially closer to the true distribution than the training data. Empirically, DSA consistently outperforms other methods on five public survey datasets. We further conduct a comprehensive comparison covering accuracy, robustness, and data savings. DSA reduces the required real data by 53.48–69.12%, demonstrating its effectiveness and efficiency in survey simulation. 1 Introduction Figure 1: Overview of different approaches for simulating survey responses. Surveys are essential tools in social sciences, market research, and political science, providing valuable data for decision-making. However, large-scale surveys are costly and resource-intensive. Large language models (LLMs), trained on vast amounts of human text, offer a promising alternative by simulating human responses in surveys. This has led to growing research on whether LLMs can accurately replicate human preferences, potentially reducing the costs of data collection. One primary approach is zero-shot methods, where LLMs generate survey responses without fine-tuning on real data Kaiser et al. 2025 , as shown in Figure 1 . Further research includes using prompt engineering to better simulate Yang et al. 2024 ; Meister et al. 2025 . While zero-shot methods are data-efficient, their performance is limited because results often deviate from real-world distributions. Additionally, these methods are sensitive to prompt changes, leading to varying results Wang et al. 2025a . Another approach is fine-tuning methods. AAE Wang et al. 2025c proposed fine-tuning a conditional probability model to align the LLM’s output distribution with the training set. Two recent studies Suh et al. 2025 ; Cao et al. 2025 directly fine-tuned the LLM’s token probabilities to match the training set’s distribution. While fine-tuning produces more accurate results than zero-shot methods, its improvement mainly comes from aligning the LLM with the training set distribution, and is limited to reproducing the patterns of the training data without achieving higher accuracy, as shown in Figure 1 . This raises the question of why not directly use the training set distribution as result, as these methods underutilize the LLM’s potential. Considering these limitations, we explore how to leverage LLMs’ capabilities to yield results closer to the true distribution than training data. We find that, although LLMs may not be able to predict the exact distribution of human preferences, they are effective at identifying the differences in preferences across different backgrounds. For example, LLMs can’t accurately predict how many people like sports cars, but it can capture the trend that younger people prefer sports cars more than middle-aged people. This ability to predict preference shifts can align the distribution from different backgrounds, and integrate information from diverse backgrounds. Building on this idea, we propose using the Distribution Shift Alignment (DSA) fine-tuning to help LLMs simulate human choice distributions. Our approach starts by collecting a small amount of training data and using it to fine-tune the LLM at the token level, which means adjusting the model’s token probabilities corresponding to survey options. The fine-tuning process is divided into two stages. In the first stage, we fine-tune the LLM directly using the training data, aligning its output distribution with that of the training data. This stage helps the LLM’s output better match the distribution of the training data and corrects biases. In the second stage, we train the LLM to align the distribution shifts between different backgrounds using a designed distribution shift loss. By fine-tuning the LLM to maintain the same differences between the distributions of different backgrounds, and using these differences to estimate the distribution of certain background from all other backgrounds, we can obtain a distribution closer to the real one than the training data, as shown in Figure 1 . In the Appendix A , we prove that under stronger assumptions, this estimation is consistent with the true distribution. In experiments, we evaluated DSA on five publicly available survey datasets in different areas, and compare DSA with both zero-shot and fine-tuning methods. DSA consistently outperformed all others in accurately simulating the real distribution. Using DSA, we were able to reduce the amount of data required by 53.48%-69.12% to achieve similar accuracy, significantly cutting down the costs. In general, this paper makes the following contributions: • We propose Distribution Shift Alignment fine-tuning for simulating human survey responses with LLMs, which can generate results closer to the real distribution than the training data. • We incorporate the training set results as a baseline to compare with both zero-shot and fine-tuning methods, enabling evaluations of multiple characteristics—such as data savings—that were often ignored in previous studies. • We conducted experiments on five datasets and show that DSA provided the most accurate predictions and reduced the cost of conducting surveys by up to 53.48%-69.12%. 2 Methodology Figure 2: Framework of our proposed distribution shift alignment fine-tuning method. 2.1 Task Definition In a survey, respondents’ choices on core question C are defined as a probability distribution over the options P(C)=[p_{1},p_{2},\dots,p_{n}] . In practice, surveys often focus on how people with different backgrounds (e.g., region, education level) make their choices. To capture such heterogeneity, a set of background information questions B=(B_{1},B_{2},\dots,B_{m}) is included, where each background question B_{i} contains multiple options B_{i}=(b_{i1},b_{i2},\dots,b_{iN_{i}}) , and each option b_{ij} represents a specific subgroup (e.g., people living in urban areas). Given a combination of background attributes \mathbf{b}\in B_{1}\times\dots\times B_{m} , LLM is expected to predict the probability distribution of choices on the core survey question P(C\mid\mathbf{b})\ \text{for all}\ \mathbf{b}\in B_{1}\times\dots\times B_{m} . 2.2 Phase 1: Aligning with Training Set Distributions Given a small amount of real survey data, we can compute the choice distribution of different backgrounds P^{\text{Train}}(C\mid\mathbf{b}) , which is a sample of the true distribution. In the first stage of fine-tuning, we focus on aligning the model’s token-level outputs with these observed distributions from the training data. To achieve more precise fine-tuning, we adopt the same approach as the token-level fine-tuning Suh et al. 2025 , directly fine-tuning the LLM at the token level. Specifically, we treat the background information as prompt, and then assign a label to each option c_{i} of the core question (e.g., score from 1 to 5), asking the LLM to output the corresponding label directly, as shown in Figure 2 . Then, the probability of the token t_{i} corresponding to the option label is regarded as the predicted probability: P_{i}^{\text{LLM}}=\frac{e^{t_{i}}}{\sum_{j=1}^{n}e^{t_{j}}}, We train the LLM to align its output distribution with the observed distribution in the training data using the KL divergence loss: \mathcal{L}=\sum_{\mathbf{b}\in B_{1}\times\dots\times B_{m}}P^{\text{LLM}}(C\mid\mathbf{b})\log\left(\frac{P^{\text{LLM}}(C\mid\mathbf{b})}{P^{\text{Train}}(C\mid\mathbf{b})}\right) This phase of fine-tuning aligns the LLM’s output distribution with the training data distribution, preventing the model’s predictions from deviating too

Read the complete text