Arti-“fickle” Intelligence: Using LLMs as a Tool for Inference in the Political and Social Sciences

Lisa P. Argyle, Ethan C. Busby, Joshua R. Gubler, Bryce Hepner, Alex Lyman, David Wingate · 2025

Read Arti-“fickle” Intelligence: Using LLMs as a Tool for Inference in the Political and Social Sciences by Lisa P. Argyle, Ethan C. Busby, Joshua R. Gubler, Bryce Hepner, Alex Lyman, David Wingate (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03822.txt.

Introduction

Lisa Argyle and co-authors urged care in using language models as inference tools in social science in 2025. Generative models are versatile and powerful. They serve science best, the authors argue, when they deepen knowledge of real human behavior rather than replace it.

The paper centers inference: judging what model output really shows about people. Checking model output against real data illustrates the risks and the rewards. Guidelines follow for stating when a model has failed or succeeded at a set task, and for what may then be inferred. The authors close on how shared habits of validation would let knowledge about these tools accumulate across the field.

Catalog record

CREATORLisa P. Argyle, Ethan C. Busby, Joshua R. Gubler, Bryce Hepner, Alex Lyman, David Wingate
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-03822

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Arti-“fickle” Intelligence: Using LLMs as a Tool for Inference in the Political and Social Sciences Lisa P. Argyle, Ethan C. Busby, Joshua R. Gubler, Bryce Hepner, Alex Lyman, David Wingate Abstract Generative large language models (LLMs) are incredibly useful, versatile, and promising tools. However, they will be of most use to political and social science researchers when they are used in a way that advances understanding about real human behaviors and concerns. To promote the scientific use of LLMs, we suggest that researchers in the political and social sciences need to remain focused on the scientific goal of inference. To this end, we discuss the challenges and opportunities related to scientific inference with LLMs, using validation of model output as an illustrative case for discussion. We propose a set of guidelines related to establishing the failure and success of LLMs when completing particular tasks, and discuss how we can make inferences from these observations. We conclude with a discussion of how this refocus will improve the accumulation of shared scientific knowledge about these tools and their uses in the social sciences. 1 Introduction The political and social sciences have quickly adopted generative AI into virtually every aspect of the research process. Large language models (LLMs) are used for idea and theory generation [ 1 , 2 ] , as automated research assistants [ 3 , 4 ] , for writing code [ 5 ] , for annotating and classifying text and image data [ 6 , 7 , 8 , 9 , 10 ] , for producing and administering experimental manipulations [ 11 , 12 , 13 , 14 ] , as the object of study [ 15 , 16 , 17 ] , for simulation of subject data [ 18 , 19 , 20 , 21 , 22 ] , and even as direct partners in writing up results [ 23 , 24 ] . A broad search through published work in the social sciences suggests that the number of published articles using generative AI tools increased by a factor of 500 percent from 2023 to 2024, with no signs of slowing. 1 1 1 Calculated from a citation search of published articles in the social sciences on the Web of Science for the key terms “large language model,” “generative AI,” and “artificial intelligence.” In political science, the 2023 annual meeting of the American Political Science Association included 10 research papers using generative AI and one ‘‘breaking news” panel on large language models (LLMs) in political science; the same conference in 2024 included a full-day pre-conference on LLMs and over 100 papers making some use of generative AI and LLMs. 2 2 2 These counts come from names and brief descriptions of panels and papers in the conference program. Like others, we are enthusiastic about the potential contributions of LLMs across the social sciences [ 25 , 26 , 27 ] ; LLMs have enabled our team to explore a range of interesting and complex questions in ways that would not have been otherwise possible [ 18 , 12 , 28 , 29 ] . LLMs are unlike other scientific tools: they are neither a statistical model with carefully bounded properties, nor a machine learning algorithm with well-defined inputs, outputs and optimization objectives [ 30 ] . They are “programmed” with prompts that are remarkably fragile [ 31 , 32 , 33 ] , often trained on an opaque mix of data and aligned to secret standards [ 34 , 35 ] , and their human-like outputs are presented so naturally and confidently that it’s all too easy to forget they need to be validated [ 36 ] . The rise of LLMs is more like the advent of the internet, which transformed virtually all aspects of social science research, than it is like other social scientific tools. As journal repositories moved online, the internet opened new possibilities for efficiently accumulating and summarizing existing scholarly research. Access to digitized administrative data sources and diverse survey subject pools became faster, easier, and less costly than ever before. Internet searches changed the way students learn. Social media altered they way people interacted with and related to each other, opening new avenues for observation of and data collection about human behavior. LLMs are again reshaping each of these domains, including summarization and synthesis of scholarly research [ 37 ] , simulation of human survey or experimental data [ 38 , 18 , 21 , 22 ] , and interactions with survey research subjects [ 12 , 39 , 13 ] . LLMs facilitate administrative record linkages [ 40 , 41 ] , change the way students learn [ 42 , 43 , 44 ] , and change the way individuals interact [ 45 , 46 ] . We therefore consider it important to discuss how these tools can be best used to not simply generate knowledge, but to generate the type of cumulative scientific inference that is the goal of social scientific research. In the sections that follow, we begin with a brief discussion of what we mean by scientific knowledge, with a focus on the goal of scientific inference. We then discuss the implications of this goal for the use of LLMs in the social sciences, focusing on the importance of clearly mapping LLM outputs to targets of inference, and on the importance of systematic validation of LLM uses, including reporting and interpreting LLM success and failure modes for the range of potential social science tasks. While we feel that clearly establishing guidelines for inference and validation in LLM use will greatly facilitate the cumulation of community-wide scientific knowledge, we also note that these are not the only facets of the LLM research process that need further discussing in the pursuit of science: similar conversations should happen around other aspects of LLMs in the research process, including but not limited to ethics, replication and transparency, and governance and regulation. Our contribution here, then, is an illustrative case of the kinds of complex considerations at play regarding the scientific use of LLMs and how social scientists can be more thoughtful about integrating LLMs into their scientific pursuits. 2 Social Scientific Inference Using LLMs Although conceptions of what exactly constitutes science vary, “positive” social scientists generally agree that the fundamental goal of science is to infer descriptive or causal conclusions that go beyond a specific set of observed data [ 47 ] . In this view, scientific knowledge is not just knowing “X caused Y in this particular instance,” but instead identifying the conditions under which, and the confidence by which we can expect X to cause Y generally . Thus, theory is scientific knowledge, but facts (while helpful in the pursuit of scientific knowledge) are not. As Lakatos notes, “A given fact is explained scientifically only if a new fact is also explained with it” [ 48 , emphasis added, p. 119] – in other words, only if there is a theory about an underlying, consistent pattern that explains more than one instance. From this premise, we argue that LLM research that notes that a particular model can or cannot do something – meaning it establishes a “fact” – without careful thought

Read the complete text