The Silicon Society Cookbook: Design Space of LLM-based Social Simulations
Aurélien Bück-Kaeffer 1,2,4 Sneheel Sarangi 1,2 Maximilian Puelma Touzel 1,3 Reihaneh Rabbany 1,2 Zachary Yang 1,2,4 Jean-François Godbout 2,3 1 McGill University, 2 Mila - Quebec Artificial Intelligence Institute, 3 Université de Montréal, 4 Ubisoft La Forge · 2026
Read The Silicon Society Cookbook: Design Space of LLM-based Social Simulations by Aurélien Bück-Kaeffer 1,2,4 Sneheel Sarangi 1,2 Maximilian Puelma Touzel 1,3 Reihaneh Rabbany 1,2 Zachary Yang 1,2,4 Jean-François Godbout 2,3 1 McGill University, 2 Mila - Quebec Artificial Intelligence Institute, 3 Université de Montréal, 4 Ubisoft La Forge (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-00197.txt.
Introduction
Aurélien Bück-Kaeffer and 5 co-authors map the design choices behind social networks simulated entirely by language model agents. Such silicon societies are growing in number, and some now run outside controlled studies. Yet builders have little guidance on how each design choice changes the outcome, or how to check realism.
The team varies key choices, including which base model plays the agents and how the agents connect to each other. Surveys stand in for agent opinions. Some choices add up in simple ways, while others interact in tangled ways. The single biggest factor is the choice of base model. The study gives future builders a clearer sense of which decisions matter most.
Catalog record
| CREATOR | Aurélien Bück-Kaeffer 1,2,4 Sneheel Sarangi 1,2 Maximilian Puelma Touzel 1,3 Reihaneh Rabbany 1,2 Zachary Yang 1,2,4 Jean-François Godbout 2,3 1 McGill University, 2 Mila - Quebec Artificial Intelligence Institute, 3 Université de Montréal, 4 Ubisoft La Forge |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.00197
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Silicon Society Cookbook: Design Space of LLM-based Social Simulations Aurélien Bück-Kaeffer 1,2,4 Sneheel Sarangi 1,2 Maximilian Puelma Touzel 1,3 Reihaneh Rabbany 1,2 Zachary Yang 1,2,4 Jean-François Godbout 2,3 1 McGill University, 2 Mila - Quebec Artificial Intelligence Institute, 3 Université de Montréal, 4 Ubisoft La Forge Abstract Studies attempting to simulate human behavior with Silicon Societies grow in numbers while LLM-only social networks have started appearing outside of controlled settings. However, the design space of these networks remains under-studied, which contributes to a gap in validating model realism. To enable future works to make more informed design decisions, we perform a systematic analysis of the consequences and interactions of key design choices in simulated social networks, including the choice of base model used to model individual agents, and how they are connected to each other. Using surveys as a proxy for agent opinions, our findings suggest that the geometry of the design space is non-trivial, with some parameters behaving in additive ways while others display more complex interactions. In particular, the choice of the base LLM is the most important variable impacting the simulation outcomes. 1 Introduction Agent-Based Models (ABMs) and social simulations have a long history in social sciences ( De Marchi & Page 2014 ) , but recent years have seen the emergence of a new paradigm using Large Language Models to simulate human interactions. The promise of models encompassing both micro- (individual users, messages, or even activations for a given token) and macro-level phenomena (echo chambers, herd effects, information propagation) at arbitrary levels of precision and scale has proven alluring to many (See Section 2 for a survey). However, while new increasingly more complex simulators are continuously being published, a chronic lack of validation characterizing many recent works limits their ability to build upon each other and address the limitations of classical ABMs ( Li et al. 2025 ; Larooij & Törnberg 2025 ) . In this paper, we are specifically interested in Silicon Societies , to which we limit the scope of our work. We define a Silicon Society as a simulation of human interactions using Large Language Models. This definition includes controlled studies seeking to reproduce some traits of human social interaction networks (e.g. OASIS, Yang et al. 2025 ), but to a lesser extent also covers naturally emerging social networks populated by LLMs (e.g. Moltbook). We explicitly exclude multi-agent frameworks seeking to achieve a particular goal (e.g. coding agents) other than human-likeness, even though we do note that some of the validation techniques they developed may be transferable to this setting. Validating Silicon Societies is a non-trivial task. How does one go about defining and then measuring human-likeness on the scale of a social network? Numerous attempts have been made, with “varying levels of persuasiveness and rigor” ( Larooij & Törnberg 2025 ) . As of now, a standard has yet to emerge. Human baselines, which are often application-specific, are challenging to obtain. Instead of attempting to build the ”most realistic” simulator according to arbitrary metrics, in this paper we seek to understand how the parameters we pick when designing a Silicon Society impacts the simulation and its outcome. Mapping the design space of these social simulations enables future work to make more informed design decisions. To this end, we perform a systematic analysis of simulation trajectories over 595 roll-outs with some parameters randomized to identify the nature and intensity of their respective impacts, and their complex interactions. We hypothesize that the design space will not behave additively (given that parameter A and parameter B both independently increase metric X, the space behaves additively if a simulation with both parameters A and B has a larger metric X than either of them separately). Instead, we expect to find that parameters will display complex interactions, making it difficult to predict how a simulation will behave based solely on its initial settings. We further hypothesize that fine-tuning LLMs on social media data will make them stylistically closer to humans and change their behavior in simulations. We conduct a systematic study of 595 simulation roll-outs across a Silicon Society design space spanning seven parameters. We use surveyed opinions as an operational proxy for agent beliefs. Our findings reveal that the design space is neither uniformly additive nor uniformly complex. The choice of base model is the single most influential factor, dominating both stylistic indistinguishability ( \eta^{2} =0.266 on BERT AI-detectability) and opinion dynamics ( \eta^{2} =0.090 on net consensus change). Fine-tuning on social media data substantially correlates with stronger social dynamics and reduces AI detectability, while a biased news agent has no measurable effect on any metric. Several interactions prove model-dependent and scale-dependent, underscoring that simulation behavior cannot be reliably predicted from marginal effects alone. Our main contributions are 1) measuring the relative importance of several Silicon Society design decisions (allowing us to identify the most important ones) and the nature of their respective impacts on simulation roll-outs, 2) characterizing the partially-additive nature of the design space, and 3) providing evidence that fine-tuning models on social media data leads to simulations stylistically closer to human social media text and intensified opinion dynamics during simulations. 2 Related works LLM-based social simulators have gained a significant amount of traction, and works in this field are numerous. Larooij & Törnberg 2025 survey at least 35 such simulators with human imitation objectives. Notable works include OASIS ( Yang et al. 2025 ) which achieves 1M agents, performs ablation studies over some of the simulation components, and observes convincing macro-scale effects (echo chambers, herding effect). Google Deepmind’s Concordia ( Vezhnevets et al. 2023 ) introduced modular cognitive agent components. Other notable recent works include Zheng et al. 2026 ; Lu et al. 2026 and Yuzhe et al. 2026 , each following different simulation setting and validation. The social simulation field is growing too fast for validation and methodological standards to be met by wide adoption (on March 31, 2026, searching ”LLM social simulation” in Google Scholar returned 4200 results for 2026 alone). In parallel, and while not strictly speaking ”simulators”, LLM-populated social networks have started appearing outside of controlled settings. Most notably, Moltbook has already been the subject of many articles ( Sodano et al. 2026 ; Jiang et al. 2026 ; Holtz 2026 ) . The validation gap surrounding the aforementioned social simulators has been mentioned on occasion, yet remains heavily under-addressed in relation to the amount of articles being published. The recent survey by Larooij & Törnberg 2025 discusses how poor standards prevent LLM-based social simulation from addressing long-standing classical Agent-Based models weaknesses. Li et al. 2025 outline the necessity of a science of persona creations. More recently, Li & Tao 2026 shared their position regarding the mismatch between the way models are validated and what simulation-as-a-science requires. Seshadri et al. 2026 claim that ”current evaluation practices risk misrepresenting agent capabilities across diverse user populations and may obscure real-world deployment challenges”. Our study attempts to begin addressing the validation gap in LLM-based Social Simulators by building towards a better understanding of the design space of Silicon Societies . The goal is to better understand how the decisions we make when building these complex systems affect the dynamics that occur