When Do LLMs Generate Realistic Social Networks? A Multi-Dimensional Study of Culture, Language, Scale, and Method

Sai Hemanth Kilaru, Sriram Theerdh Manikyala, Raghav Upadhyay, Srivika Nunavathu, Dalal Alharthi · 2026

Read When Do LLMs Generate Realistic Social Networks? A Multi-Dimensional Study of Culture, Language, Scale, and Method by Sai Hemanth Kilaru, Sriram Theerdh Manikyala, Raghav Upadhyay, Srivika Nunavathu, Dalal Alharthi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12898.txt.

Introduction

Kilaru and five colleagues ask when language models build social networks that look real. Using 50 made-up personas, they make 192 networks across cultures, prompt languages, model sizes and prompt styles. They find culture shifts homophily, the pull toward similar people, political leaning rules most link formation, and prompt language alone sharply shifts religion-based grouping. Made networks match real graphs on clustering better than standard baselines, yet carry stronger demographic biases.

Catalog record

CREATORSai Hemanth Kilaru, Sriram Theerdh Manikyala, Raghav Upadhyay, Srivika Nunavathu, Dalal Alharthi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38055
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12898

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

When Do LLMs Generate Realistic Social Networks? A Multi-Dimensional Study of Culture, Language, Scale, and Method Sai Hemanth Kilaru, Sriram Theerdh Manikyala, Raghav Upadhyay, Srivika Nunavathu, Dalal Alharthi Abstract Large language models (LLMs) are increasingly used as substitutes for human subjects in behavioral simulations, including the generation of synthetic social networks. While prior work has shown that LLMs produce structurally realistic graphs, the extent to which their relational outputs depend on prompt design, cultural framing, prompt language, and model scale remains poorly characterized. Building on classical homophily theory and structural balance theory from network sociology, we formalize four LLM-based tie-formation mechanisms (sequential, global, local, iterative) as distinct conditional distributions over edge sets and quantify how each interacts with culture, language, and model scale. Holding a fixed roster of 50 demographically grounded personas constant, we generate 192 verified directed networks across four cultural contexts (United States, India, Japan, Brazil), four prompt languages (English, Spanish, Hindi, Japanese), three GPT-4.1 model variants, and four prompting architectures, with two seeds per condition. We find that cultural framing produces measurable, non-uniform shifts in inbreeding homophily and largest-component connectivity; that political affiliation dominates tie formation under three of four methods while the global method substitutes age, revealing prompt architecture as a substantive sociological variable; that model scale produces a stable divergence ranking that reproduces across all three studies, with the smallest variant behaving qualitatively rather than merely noisily differently; and that prompt language alone, with culture and personas held fixed, shifts religion homophily sharply (especially under Hindi prompting) while leaving political homophily nearly invariant. LLM-generated networks match real social graphs on clustering and modularity better than Erdős / Rényi, Barabási / Albert, or Watts / Strogatz baselines, yet encode demographic biases that exceed empirically observed levels. The apparent neutrality of LLM-based social simulation is illusory: prompt design choices that are often treated as implementation details encode substantive sociological assumptions. 1 Introduction The study of social networks, that is, how individuals form relationships, cluster into communities, and propagate information, has long been a central concern across sociology, political science, and computational social science. Generating realistic synthetic networks has traditionally required either costly large-scale empirical surveys or mathematical generative models such as preferential attachment ( 5 ) , stochastic blockmodels ( 24 ) , or exponential random graph models ( 18 ) . The former are expensive and privacy-sensitive; the latter sacrifice the demographic and behavioral nuance that characterizes real human social systems. LLMs offer a third path. By encoding socio-cultural knowledge from human-generated text, they can be prompted to simulate the fundamentally social act of choosing friends. The use of LLMs as substitutes for human survey respondents and behavioral subjects has expanded rapidly in the past two years ( 3 ; 2 ; 37 ; 25 ) , but the relational dimension, namely what kinds of social structures emerge when LLM agents are tasked with forming ties, has received much less systematic study. 11 have shown that GPT-class models produce networks with realistic structural signatures while simultaneously overestimating political homophily relative to empirical baselines. We extend this line of inquiry along four orthogonal dimensions, each connected to a separate concern in the literature on LLM behavior. We ask, first, whether cultural context embedded in the prompt alters network structure and homophily, with persona roster and prompt language held fixed; second, which demographic dimension (gender, age, race or ethnicity, religion, political affiliation, or shared interests) most strongly drives tie formation, and whether this is stable across generation methods; third, whether different LLM model sizes produce interchangeable networks or diverge in structured ways; and fourth, whether prompt language alone , with culture and personas fixed, shifts homophily and topology. Contributions. First, we recast LLM-based network generation as a family of formally distinct conditional distributions over edge sets, indexed by a prompt architecture that conditions on different amounts of relational context. Second, we ground the resulting empirical patterns in two established sociological frameworks: the baseline / inbreeding decomposition of homophily ( 32 ) and structural balance theory ( 20 ; 10 ) . Third, we contribute 192 verified directed networks over a fixed 50-persona roster, spanning four cultures, four languages, three model scales, and four prompting strategies. Fourth, we document a stable model-divergence ranking that reproduces across three independent experiments, indicating that small-tier models are qualitatively rather than quantitatively different. Finally, we show that homophily dimensions respond asymmetrically to language and culture: religion is highly language-sensitive (especially under Hindi prompting), while political homophily is remarkably language-invariant. 2 Related Work Four threads of prior work converge on the present study: the graph-theoretic toolkit for measuring network structure, the sociological theory of homophily and structural balance, the use of LLMs as proxies for human respondents, and the documentation of cultural and linguistic variation in LLM outputs. Network structure and graph generators. Classical generative models, including Erdős / Rényi random graphs ( 17 ) , Watts / Strogatz small worlds ( 42 ) , and Barabási / Albert preferential attachment ( 5 ) , capture stylized facts of degree distributions and path lengths but ignore demographic structure. Stochastic blockmodels ( 24 ) introduced demographic-aware mixing matrices, and modularity-based community detection ( 36 ) provides a complementary lens on community structure. Comprehensive treatments of social and economic networks integrate these tools with sociological theory ( 27 ; 16 ) , providing the disciplinary foundation against which any new generative process, including LLM-based generation, should be evaluated. Sociology of homophily and structural balance. 32 systematized homophily and crucially distinguished baseline homophily (the share of same-group ties induced merely by group sizes) from inbreeding homophily (the residual preference beyond what composition predicts), building on 30 . 19 established the structural importance of weak ties for information diffusion across group boundaries; 29 provided one of the first large-scale longitudinal analyses of an evolving network; 34 documented persistent racial homophily in U.S. schools; and 13 formalized homophily as the equilibrium of a friendship-formation game, distinguishing preference-driven from opportunity-driven sorting. 18 used exponential random graph models to disentangle homophily from triadic closure in adolescent networks. Structural balance theory ( 20 ; 10 ) provides the complementary mechanism for the triadic closure observed in real networks. Empirically, platform studies report elevated but bounded political homophily online ( 4 ; 12 ) , in keeping with the broader phenomenon of affective polarization ( 26 ) , against which our findings can be calibrated. LLMs as proxies for human respondents. 3 coined algorithmic fidelity to describe GPT-3’s reproduction of demographic survey distributions; 38 and 15 showed that LLM opinion distributions align unevenly with demographic and national subgroups; 2 demonstrated through “Turing Experiments” that LLMs can replicate classic human-subject studies in psychology, linguistics, and behavioral economics; 25 treated LLMs as simulated economic agents; 37 showed that LLM agents can drive believable interactive social simulations; 40 simulated social-media feeds with LLM-driven users; and 22 demonstrated predictive validity of LLM simulations for social-science experimental treatment effects. The validity of these substitutions is contested: 7 and 14 document systematic biases that limit LLMs’ usefulness as drop-in replacements for human participants. We take a relational rather than individual view, asking whether the aggregate relational structure produced by LLM agents matches real-network statistics. Cultural and linguistic variation in

Read the complete text