Attributing Emergence in Million-Agent Systems

Ling Tang, Jilin Mei, Qian Chen, Qihan Ren, Linfeng Zhang, Quanshi Zhang, Jing Shao, Xia Hu, Dongrui Liu · 2026

Read Attributing Emergence in Million-Agent Systems by Ling Tang, Jilin Mei, Qian Chen, Qihan Ren, Linfeng Zhang, Quanshi Zhang, Jing Shao, Xia Hu, Dongrui Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11404.txt.

Introduction

Tang and eight colleagues tackle attributing large-scale emergence to single agents in language-model multi-agent systems. Existing axiomatic methods scale combinatorially and stop near one thousand agents, while the phenomena they explain occur at one million or more. Adapting Aumann-Shapley path-integral attribution to million-agent scale, they run three to five orders of magnitude quicker than sampled Shapley. On fourteen days of Bluesky data, full-scale attribution disagrees structurally with a biased hundred-agent sample, shifting about twice the share onto top follower tiers.

Catalog record

CREATORLing Tang, Jilin Mei, Qian Chen, Qihan Ren, Linfeng Zhang, Quanshi Zhang, Jing Shao, Xia Hu, Dongrui Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE99149
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.11404

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Attributing Emergence in Million-Agent Systems Ling Tang, Jilin Mei, Qian Chen, Qihan Ren, Linfeng Zhang, Quanshi Zhang, Jing Shao, Xia Hu, Dongrui Liu Abstract Large language models (LLMs) can simulate human-like reasoning and decision-making in individual agents. LLM-powered multi-agent systems (MAS) combine such agents to simulate population-scale social phenomena such as polarization, information cascades, and market panics. Such studies require attributing macro emergence to individual agents, but existing axiomatic methods scale combinatorially in N N and have been confined to N ≲ 10 3 N\lesssim 10^{3} , while the phenomena they explain occur at N ≥ 10 6 N\geq 10^{6} . We address this gap by adapting Aumann–Shapley path-integral attribution to LLM-powered MAS at million-agent scale; the resulting method satisfies all four axioms, runs four to five orders of magnitude faster than sampled Shapley on the same hardware. We use this method to test the scale gap empirically: across 14 days of public Bluesky data ( 1,671,587 1{,}671{,}587 active users), we compute the attribution at both full scale and the visibility-biased N = 10 2 N=10^{2} convenience sample used by small-scale studies, and the two disagree structurally. At full scale the long tail and middle tier jointly carry the majority; the biased small panel attributes almost everything to a few high-follower accounts. We then prove that under any nonlinear macro indicator the disagreement cannot be reduced by post-hoc rescaling: an Attribution Scaling Bias theorem shows that no global rescaling factor can reconcile small-scale and full-scale attribution. Full-scale attribution is therefore not a methodological choice but a theoretical requirement for any nonlinear macro indicator. 1 Introduction Figure 1: Cross-scale attribution on five Bluesky topics (April 8–21, 2026), f=f^{\rm heat} . (a) Per-day attribution at full scale ( N=1.67\times 10^{6} ): rows are agents sorted by follower percentile (high at top, low at bottom), columns are days; cell colour is \log_{10} within-bin attribution mass. Large language models (LLMs) can simulate human-like reasoning and decision-making in individual agents ( 1 ; 17 ) . Multi-agent systems (MAS) have long been used to study how interactions among autonomous agents produce macro-level emergent phenomena ( 40 ) . LLM-powered MAS combine the two, retaining the social realism of LLM agents at the population scale of classical MAS, and have become a common platform for simulating large-scale social phenomena. Recent applications span generative agent societies ( 26 ) , macroeconomic activity ( 23 ) , financial markets ( 42 ) , and million-agent social platforms ( 43 ; 27 ; 2 ) . These systems reproduce macro emergent phenomena observed in human society, including polarization ( 4 ) , information cascades ( 36 ; 14 ) , and market panics ( 6 ) . Scientific use of these reproductions raises two questions about each phenomenon: which agents drove it? and when did it turn? The macro curve answers neither; both require decomposing the macro indicator into per-agent, per-step contributions. This paper studies emergence attribution in LLM-powered MAS at realistic scale. Existing attribution methods require re-running the simulation over many agent subsets, at cost combinatorial in the number of agents N . Recent adaptations of axiomatic Shapley attribution to LLM-powered MAS ( 35 ; 24 ) remain confined to N\lesssim 10^{3} , while the social phenomena they target, such as online cascades ( 36 ) and election-period opinion turns ( 5 ) , occur at N\geq 10^{6} . Whether agent-level conclusions drawn at small scale survive at realistic scale is an open question. We give the first systematic answer. We develop an attribution framework that satisfies the four Aumann–Shapley axioms and scales to millions of agents (Section 4 ). The framework rests on the Aumann–Shapley path integral ( 3 ) , reaches N=10^{6} in under ten milliseconds, and is four to five orders of magnitude faster than sampled Shapley on the same hardware, over three orders of magnitude (a 1670\times jump) beyond the largest agent count reported in prior axiomatic work. Equipped with this framework, we run a controlled cross-scale study on the complete public Bluesky dataset ( 9 ; 31 ) of 1{,}671{,}587 active users over April 8–21, 2026 (Section 3 ). For each topic we attribute the macro indicator both on the full panel and on the visibility-biased convenience sample of N=10^{2} that an LLM-powered MAS case study would in practice use. The two answers disagree structurally: at full scale the long tail and middle tier jointly carry the majority of the attribution; under the biased small panel the same axiomatic method places almost all of the mass on a few high-follower accounts (Figure 1 , Table 2 ). A uniform random sample of the same size does not produce the disagreement, so the failure is specific to the biased convenience samples that small- N studies in fact rely on. Nor can the disagreement be removed by post-processing. Our Attribution Scaling Bias theorem (Theorem 1 , Section 4 ) shows that whenever the macro value function is nonlinear, no global rescaling factor can map small-scale attribution onto full-scale attribution; under linearity, exactly one such factor always works. The macro indicators of practical interest, including variance, the Gini coefficient, cascade depth ( 14 ) , and learnable nonlinear value networks, are all nonlinear, so post-hoc correction is generally impossible. We do not claim that every LLM-powered MAS study must be conducted at million-agent scale. We claim only that any conclusion of the form “ this kind of agent drives this kind of phenomenon ” should rest either on analysis at the phenomenon’s realistic scale or on cross-scale consistency evidence. 2 Related Work Prior research on LLM-powered MAS has not engaged directly with the scale dependence we report in Section 3 . We discuss the three lines of work that bear most directly on agent-level attribution below. Qualitative reproduction of macro emergence in LLM-powered MAS. A first line of work has demonstrated that LLM-powered MAS can reproduce a wide range of social phenomena. Generative agent societies ( 26 ) , macroeconomic activity ( 23 ) , financial markets ( 42 ) , and large-scale social platforms ( 43 ; 27 ; 10 ; 2 ; 34 ) have replicated polarization, information cascades, market crashes, and convention formation. Parallel work on collaborative agent pipelines such as AutoGen ( 41 ) , MetaGPT ( 16 ) , ChatDev ( 28 ) , and CAMEL ( 22 ) has reported emergent coordination in task-solving settings, and recent surveys ( 25 ) have consolidated these directions. We do not add a new emergent phenomenon; we ask who drove a known one, and when. Axiomatic Shapley-type attribution. A second line has applied cooperative-game attribution to multi-agent settings, building on the 32 value and its non-atomic extension by 3 . The Shapley value has been adapted to multi-agent reinforcement learning for credit assignment ( 39 ; 38 ) , to data valuation in machine learning ( 12 ; 18 ; 37 ) , and most recently to LLM-powered MAS itself ( 35 ; 24 ) . These methods inherit strong axiomatic guarantees but require evaluating the system on many agent subsets, with cost combinatorial in N ; published experiments accordingly remain at N\lesssim 10^{3} . Leave-one-out and Banzhaf semi-values ( 20 ; 37

Read the complete text