Fairness in LLM-Generated Surveys

Andrés Abeliuk, Vanessa Gaete, Naim Bro · 2025

Read Fairness in LLM-Generated Surveys by Andrés Abeliuk, Vanessa Gaete, Naim Bro (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15351.txt.

Introduction

Andres Abeliuk and co-authors test whether language models can stand in for human surveys without bending the results. Models can mimic social and political reply patterns cheaply, which tempts research teams. Yet training data leans toward rich Western sources, so fairness across lands is in doubt.

The team checks model replies against real public surveys in Chile and the United States. Models scored better on the United States data across the board. The gap survived checks for demographic mix, which points to training roots. Within the United States, party identity and race swayed accuracy most. In Chile, gender, schooling, and faith weighed more. The authors offer a fresh framework for gauging such bias, so survey users can audit a model before trusting its crowds.

Catalog record

CREATORAndrés Abeliuk, Vanessa Gaete, Naim Bro
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-15351

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fairness in LLM-Generated Surveys Andrés Abeliuk, Vanessa Gaete, Naim Bro Abstract Large Language Models (LLMs) excel in text generation and understanding, especially in simulating socio-political and economic patterns, serving as an alternative to traditional surveys. However, their global applicability remains questionable due to unexplored biases across socio-demographic and geographic contexts. This study examines how LLMs perform across diverse populations by analyzing public surveys from Chile and the United States, focusing on predictive accuracy and fairness metrics. The results show performance disparities, with LLM consistently outperforming on U.S. datasets. This bias originates from the U.S.-centric training data, remaining evident after accounting for socio-demographic differences. In the U.S., political identity and race significantly influence prediction accuracy, while in Chile, gender, education, and religious affiliation play more pronounced roles. Our study presents a novel framework for measuring socio-demographic biases in LLMs, offering a path toward ensuring fairer and more equitable model performance across diverse socio-cultural contexts. 1 Introduction Large Language Models (LLMs) have launched a disruptive era in natural language processing, with applications ranging from conversational agents to predictive analytics. Models such as OpenAI’s GPT series have demonstrated remarkable text generation and understanding capabilities, excelling at tasks beyond their initial training goals [ OpenAI([n. d.]) ] . These breakthroughs have catalyzed research into the boundaries of LLMs, envisioning diverse applications in fields such as education, healthcare, and social sciences [ Tamkin and Ganguli(2021) , Bail(2024) , Ziems et al.(2024) ] . A particularly compelling application of LLMs is their ability to simulate socio-political and economic patterns, providing an alternative to traditional surveys and predictive models. Research has demonstrated that LLMs can generate human-like responses based on socio-demographic characteristics, enabling the creation of synthetic datasets whose distributions closely mirror those of human responses to real survey questions [ Argyle et al.(2023) , Kim and Lee(2024) ] . These capabilities have been used to predict voting preferences, assess public opinion, and analyze political group perceptions [ Lippert et al.(2024) ] , as well as to replicate individual and collective behaviors to study social dynamics [ Park et al.(2024) ] . LLMs have been further explored as simulated economic agents, effectively replicating key findings from behavioral economics and social science experiments with an accuracy comparable to human forecasters [ Horton(2023) , Dillion et al.(2023) , Aher et al.(2023) , Ashokkumar et al.(2024) ] . Despite these advancements, limitations and challenges persist. While studies have highlighted the ability of LLMs to serve as proxies for specific human subgroups [ Argyle et al.(2023) ] , they also reveal disparities in model performance across populations, ethical concerns, and the risks of over-reliance on synthetic data [ Wang et al.(2024) , Santurkar et al.(2023) ] . Furthermore, most LLM research remains concentrated on the U.S. context, raising critical questions about the generalizability of these models [ Myung et al.(2024) , Navigli et al.(2023) ] . The opaque nature of LLM training data, which spans languages, regions, and socio-demographic groups, makes it difficult to determine whether their exceptional performance in well-represented areas such as the U.S. can be replicated in underrepresented countries or groups. Ensuring that machine learning models are fair and unbiased is essential for their ethical application in social science research. Most studies that utilize LLM agents simulate human-like responses by choosing from a limited set of predefined options, effectively framing these tasks as classification problems [ Kim and Lee(2024) ] . Therefore, employing established fairness metrics from machine learning to analyze outcomes offers a systematic approach to identifying and addressing inequalities in the context of LLMs [ Verma and Rubin(2018) , Barocas et al.(2023) ] . These metrics typically focus on group fairness, which ensures equitable treatment across different socio-demographic groups [ Mehrabi et al.(2021) , Caton and Haas(2024) ] . Group fairness can be further divided into between-group fairness, which evaluates differences between distinct subgroups. By applying these metrics, it becomes possible to assess how LLMs reflect soci-demographic groups, ensuring that the models do not perpetuate existing societal biases or inadequately represent specific populations. Building on these considerations, this study measures Fairness and adequate representation of diverse socio-demographic and geographic groups in LLMs, with a specific focus on Chile. Chile serves as a compelling case study for examining inequalities in LLM representation and performance across geographic contexts. Although anecdotical evidence indicates that LLMs include data relevant to Chile, their capacity to fairly and accurately model Chilean socio-political behavior remains underexplored. Public surveys from Chile and the U.S. that feature comparable political and moral questions are utilized to evaluate and directly compare the models’ predictive capabilities across these distinct contexts. Through this investigation, we aim to assess the extent to which LLMs can accurately capture and replicate socio-political trends in Chile and compare their performance to that in the U.S. context. We examine the role of prompting techniques and the potential for fine-tuning to mitigate performance disparities. Fairness metrics are incorporated to evaluate and compare model performance across various socio-demographic groups to expand this analysis, identifying disparities and their implications. This work not only evaluates the utility of LLMs in underrepresented regions but also addresses broader concerns about fairness, representation, and the ethical use of AI, advancing the discourse on the responsible deployment of LLMs. The main contributions of this paper are as follows: • A novel framework to measure socio-demographic biases in large language models (LLMs). • A comparative evaluation of LLM predictive capabilities using public surveys from Chile and the U.S. • An analysis of prompting techniques and fine-tuning to mitigate performance disparities. The remainder of this paper is organized as follows: Section 2 details the methodology, including prediction experiments and prompting techniques. Section 3 presents the results, comparing model performance across contexts and socio-demographic groups. Section 4 discusses the findings, highlighting cultural biases and limitations. Section 5 concludes with a summary and future research directions. 2 Methodology Three prediction experiments based on public surveys have been designed: two concerning political events and one focused on opinion. In the first scenario, the model is tasked with predicting vote choices in presidential elections and referendums. In the second scenario, the model predicts an individual’s stance on abortion based on their socio-demographic characteristics. The objective is to evaluate whether LLMs can accurately predict political opinions or voting behavior based on socio-demographic characteristics. The details of the public surveys are as follows: • Presidential Election Experiment : includes both the 2020 U.S. presidential election and the second round of the 2021 Chilean presidential election. • Abortion Opinion Experiment : includes data from both the CEP survey in Chile and the U.S. ANES survey to predict individuals’ opinions on abortion based on socio-demographic characteristics. • Constitutional Plebiscite 2022 Experiment : corresponding to the plebiscite held in Chile to decide on a new constitution. The experiments include different parameters, models, and prompts to optimize the results. The models tested include GPT-3.5 (GPT-3.5-turbo), GPT-4 (GPT-4-turbo), Llama-13b, and Mistral (version 0.2). For cost reasons, GPT-4 is not used for all prompt variants. 2.1 Datasets This research utilizes two public survey datasets, one from Chile and one from the United States. The Chilean dataset comes from the Centro de Estudios Públicos (CEP) 1 1 1 https://www.cepchile.cl/opinion-publica/encuesta-cep/ , which conducts surveys on various socio-political topics.

Read the complete text