Mechanism Plausibility in Generative Agent-Based Modeling \conffull ( \confshort ), \confdate , \confloc DOI: 10.1145/3805689.3812388 Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montreal, QC, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montreal, QC, Canada ISBN: 979-8-4007-2596-8/2026/06 CCS: Computing methodologies Simulation evaluation CCS: Computing methodologies Model development and analysis CCS: Computing methodologies Modeling and simulation CCS: Computing methodologies Natural language processing CCS: Human-centered computing Collaborative and social computing design and evaluation methods

Patrick Zhao, David Huu Pham, Nicholas Vincent · 2026

Read Mechanism Plausibility in Generative Agent-Based Modeling \conffull ( \confshort ), \confdate , \confloc DOI: 10.1145/3805689.3812388 Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montreal, QC, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montreal, QC, Canada ISBN: 979-8-4007-2596-8/2026/06 CCS: Computing methodologies Simulation evaluation CCS: Computing methodologies Model development and analysis CCS: Computing methodologies Modeling and simulation CCS: Computing methodologies Natural language processing CCS: Human-centered computing Collaborative and social computing design and evaluation methods by Patrick Zhao, David Huu Pham, Nicholas Vincent (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12824.txt.

Introduction

Zhao, Pham and Vincent ask what makes an agent-based model explanatory. Language models make diverse patterns without coded rules, and appear in agent-based models and social simulations. But power, forecast and accounts differ: an account shows how a pattern is produced by parts. The team joins agent-based models with philosophy, setting plausibility as a scale. Their Mechanism Plausibility Scale separates sufficiency, copying a pattern, from how it is produced, and marks roles.

Catalog record

CREATORPatrick Zhao, David Huu Pham, Nicholas Vincent
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78512
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12824

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Mechanism Plausibility in Generative Agent-Based Modeling \conffull ( \confshort ), \confdate , \confloc DOI: 10.1145/3805689.3812388 Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montreal, QC, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montreal, QC, Canada ISBN: 979-8-4007-2596-8/2026/06 CCS: Computing methodologies Simulation evaluation CCS: Computing methodologies Model development and analysis CCS: Computing methodologies Modeling and simulation CCS: Computing methodologies Natural language processing CCS: Human-centered computing Collaborative and social computing design and evaluation methods Patrick Zhao, David Huu Pham, Nicholas Vincent Abstract . Large language models (LLMs) can generate high-level diverse phenomena without explicitly programmed rules. This capability has led to their adoption within different agent-based models (ABMs) and social simulations. Recent research aim to test whether they are capable of generating different phenomena of interest, for example, human behavior on social media platforms or performance in game-theoretic scenarios. However, capability, prediction, and explanation are different – drawing from the philosophy of science and mechanisms literature, explanation requires showing, to some degree, how a phenomenon is produced by related organized entities and activities. For modelers, describing the characteristics of an experiment or whether a simulation provides progress in capability (or explanation), can be difficult without being grounded in potentially distant research areas. We integrate recent work on LLM-ABMs with contemporary philosophy of science literature and make two main contributions. First, we gather insights from modeling and mechanisms literature and use them to operationalize a definition of ‘plausibility’ in a four-level scale. Our scale separates the evaluation of a model’s generative sufficiency (ability to reproduce a phenomenon) from its mechanistic plausibility (how the phenomenon could be produced), and clarifies the distinct roles of different models, such as predictive and explanatory ones. We introduce this as the Mechanism Plausibility Scale. Second, we discuss the early wave of LLM-ABM research and find that papers often conflate evidence of Agent-level functionality with claims about emergent ABM-level phenomenon, relying on ‘believability’ metrics that focus on generative sufficiency. Our discussion section speaks on how these findings echo long-standing problems in classical ABM, historical harms caused by these issues, and broader ethical and epistemic concerns about using LLMs in modeling. Using the findings from our review, we offer the scale as a practical heuristic in the form of a checklist which can clarify how simulations at different levels of plausibility may be useful. We hope the activity of filling out the scale will help new modelers ground the epistemic contribution of their simulations. † † cc-license: by 1. Introduction Developments in natural language processing have spurred interest in using large language models (LLMs) in social simulations ( 36 ; 61 ; 4 ) , for example, extending the action space of agents in agent-based models (ABMs). It seems increasingly possible that product decisions, policymaking, and even research itself may be influenced by the outcome of such simulations ( 4 ; 49 ) . Today, a modeler ( 83 ) creating simulations with LLMs is capable of reproducing higher-level phenomena without explicitly programming the mechanisms that produce them. In a canonical agent-based model (ABM), the mechanisms underlying a phenomenon are operationalized and programmed by the modeler (e.g., for an economic agent, “if the price of resource A is X and my internal requirement B is at a threshold Y , then buy some amount of resource A ”). These rules are typically based on some combination of assumptions, scientific theory, and empirical data. For instance, a programmer might read several social science papers to determine a particular distribution from which their agents will draw values that represent their preferences and attributes. Using LLMs in simulations offers the tantalizing promise that weights and biases obtained by training on social data may contain relevant distributional information about human behavior, allowing for richer representations of human subjects ( 77 ; 4 ; 61 ) . On the other hand, critiques have also formed around models failing to capture the complete experiences of the human subjects they substitute ( 1 ) , which leaves us with questions about if this is tied to the nature of LLMs, and if so, the question of if LLMs should be used at all. When using LLMs in modeling social phenomena, we are left with a few puzzles: For a given simulation, did the results emerge from some correctly retrieved social knowledge encoded in the LLM’s weights? Do our agents model the human behavior we are interested in? This could be the case, given that LLMs are trained on data describing real, human decision-making. Without improvements in the field of machine learning (ML) interpretability and data attribution, it could be the case that simulations incorporating LLMs are drawing on information that is irrelevant to the modeler’s intent (sometimes referred to in the machine learning space as ‘faithfulness’ ( 87 ; 64 ) ). In other words, we might produce a simulation that looks like it is explaining a social science phenomenon, but is just generating it through some other means, regardless of the ‘how’. One can imagine that there are many ways in which a phenomenon can occur, and we are only interested in a particular one. A recent review by Larooij et al. from April 2025 ( 45 ) surveyed and found that a number of studies involving ABMs with LLMs (LLM-ABM) fail to acknowledge established work in the traditional simulation literature, or even have proper operational validity. One particular summary is that recent evaluations rest on some variant of believability, where human annotators are tasked with labeling whether or not they think the outputs of agent dialogues are produced by a human. On top of this, much work focuses on whether or not a simulation or its LLM agents are capable of producing a specific phenomenon. These problems leave us with further questions: Is it necessary to completely understand the inner workings of LLMs to produce useful simulations? What does ‘useful’ mean anyways, in the context of simulations? To facilitate the discussion we connect work from the philosophy of science about what can be learned from idealized computer models, such as ABMs. Let us consider a target phenomenon T a modeler is attempting to produce using a simulation S . In traditional agent-based modeling it is mostly accepted that by generating T using S , they realize a possible candidate for how T is created, sometimes called generative sufficiency ( 24 ) . By ‘growing’ T through their simulation, the modeler has created an input-output mapping and demonstrated a sufficient, but not necessary condition for how T might arise ( 24 ) . Now suppose the modeler wants to explain, to some level, how T arises in actuality–they need to describe the relationship between the simulation’s mechanisms and the “real” mechanisms that produce the target. Mechanisms are the theoretical organization of entities and activities behind a phenomenon ( 53 ; 19 ) . In the mechanisms and neuroscience literature a simulation that produces T without a connection to the “how-actually” is called a phenomenal model ( 42 ; 56 ) . Connecting this to ABMs, a modeler might use a simulation to deduce or intuit parts of the mechanisms behind T ; however,

Read the complete text