Hidden Coalitions in Multi-Agent AI: A Spectral Diagnostic from Internal Representations
Cameron Berg, Susan L. Schneider, Mark M. Bailey · 2026
Read Hidden Coalitions in Multi-Agent AI: A Spectral Diagnostic from Internal Representations by Cameron Berg, Susan L. Schneider, Mark M. Bailey (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06696.txt.
Introduction
Cameron Berg, Susan L. Schneider, and Mark M. Bailey detect hidden coalitions inside multi-agent AI systems by reading their internal representations. Groups of agents can organize at a group level before any behavior changes, and behavior alone cannot separate real information sharing from mere similarity. Their method builds a mutual-information graph from agents' hidden states and partitions it spectrally to find the strongest coalition boundary.
In reinforcement learning environments the method recovers programmed coalition structures and rejects false positives from coordinated but uncoupled behavior. In a language model it tracks prompt-implied teams and shows explicit labels outweigh conflicting interaction patterns. A single cross-agent information number cannot reveal this subgroup structure.
Catalog record
| CREATOR | Cameron Berg, Susan L. Schneider, Mark M. Bailey |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.06696
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Hidden Coalitions in Multi-Agent AI: A Spectral Diagnostic from Internal Representations Cameron Berg, Susan L. Schneider, Mark M. Bailey Abstract Collections of interacting AI agents can form coalitions, creating emergent group-level organization that is critical for AI safety and alignment. However, observing agent behavior alone is often insufficient to distinguish genuine informational coupling from spurious similarity, as consequential coalitions may form at the level of internal representations before any overt behavioral change is apparent. Here, we introduce a practical method for detecting coalition structure from the internal neural representations of multi-agent systems. The approach constructs a pairwise mutual-information graph from the hidden states of agents and applies spectral partitioning to identify the most salient coalition boundary. We validate this method in two domains. First, in multi-agent reinforcement learning environments, the method successfully recovers programmed hierarchical and dynamic coalition structures and correctly rejects false positives arising from behavioral coordination without informational coupling. Second, using a large language model, the method identifies coalition structures implied by descriptive prompts, tracks dynamic team reassignments, and reveals a representational hierarchy where explicit labels dominate over conflicting interaction patterns. Across both settings, the recovered partition reveals subgroup organization that a scalar cross-agent mutual-information measure cannot distinguish. The results demonstrate that analyzing hidden-state mutual information through spectral partitioning provides a scalable diagnostic for identifying representational coalitions, offering a valuable tool for monitoring emergent structure in distributed AI systems. Keywords Multi-agent systems \cdot Coalition detection \cdot Spectral graph theory \cdot Mutual information \cdot AI safety 1 Introduction Artificial intelligence systems have utility not only when deployed as isolated models but also as collections of interacting agents. Autonomous swarms, multi-robot teams, hybrid human–machine systems, and emerging AI ecosystems all exhibit forms of coordination that can appear to exceed the behavior of any single component alone [ 16 , 5 , 6 , 7 ] . Classical work in multi-agent systems has long recognized that coalition formation and coalition structure are central to collective action, task allocation, and strategic coordination [ 18 , 17 ] . More recently, populations of language agents have been shown to develop emergent conventions and collective biases, suggesting that group-level organization is becoming an increasingly important object of study in contemporary AI [ 2 ] . This raises a fundamental scientific and safety question: when do multiple agents merely behave in similar ways, and when do they form a genuinely coupled coalition? The distinction is critical for understanding alignment and oversight needs. Coalitions can support beneficial forms of specialization and cooperation, but they can also create distributed behavior that is difficult to interpret, predict, or control. In increasingly capable multi-agent systems, some of the most consequential organization may occur not at the level of overt action alone, but in the internal representational structure that coordinates those actions. Behavioral monitoring by itself is often insufficient for this purpose. Similar outputs can arise from common training data, shared prompts, shared environments, or similar reward pressures, even when agents are not informationally coupled in any meaningful sense. Conversely, internal reorganization can occur before any obvious change appears in aggregate behavior. For coalition detection, what is needed is not only a way of identifying who behaves alike, but a way of asking whether agents are internally organized into relatively cohesive informational groupings. A useful conceptual backdrop for this problem comes from work on integrated information and irreducibility. Integrated Information Theory (IIT) offers one influential framework for asking when a system resists decomposition into independent parts [ 20 , 13 , 1 ] . At the same time, exact causal \Phi is difficult to compute and carries stronger theoretical commitments than many empirical applications require. This has motivated a broader literature on practical, observer-relative measures of integration that can be estimated from time-series data or statistical dependencies without claiming to reconstruct a system’s full intrinsic causal structure [ 3 , 12 , 11 ] . For the present manuscript, that observer-relative perspective is especially useful: the goal is not to determine whether a system forms an intrinsically unified whole, but to ask whether its internal states exhibit a pattern of coupling that makes decomposition into independent subgroups empirically misleading. Once the question is posed at that observer-relative level, internal neural representations become the natural target of analysis. Behavior is downstream and can converge for many reasons even when agents are not internally coupled, whereas hidden states are where agents encode one another, local contingencies, and shared subroutines. If coalition structure becomes legible anywhere before it is behaviorally obvious, it should appear there first. In this paper, we therefore apply that observer-relative perspective to hidden coalition detection in multi-agent AI. Our focus is on whether internal neural representations reveal subgroup structure that is invisible, ambiguous, or actively misleading at the behavioral level. Framed this way, coalition detection becomes a problem of representational organization rather than only one of overt coordination. This framing is particularly relevant for safety and alignment, where one may wish to identify emergent coalitions, track coalition reorganization over time, and distinguish genuine informational dependence from spurious similarity induced by shared labels, shared prompts, or common inputs. We investigate this problem across two complementary settings. First, we study learned coalition structure in controlled multi-agent reinforcement-learning environments, where hierarchical grouping and reassignment can be manipulated directly. Second, we examine whether analogous structure can be recovered from the hidden states of a pretrained language model when prompts describe modular, integrated, or conflicting patterns of social interaction. Taken together, these settings bridge a tightly controlled multi-agent domain and a contemporary foundation-model setting in which coalition-like structure is implicit in representation rather than explicitly engineered. Our central claim is modest. We do not argue that coalition structure can be read off from behavior alone, nor do we claim that an observer-relative measure of integration is equivalent to exact causal \Phi . Instead, we argue that internal representational coupling provides a practically useful signal for detecting coalitions that matter for understanding and monitoring distributed AI systems. Importantly, the recovered partition is itself the primary result: previous work using \Phi_{\mathrm{spectral}} has treated it as a scalar index of whole-system integration evaluated on uncoupled, transitional, or fully synchronized oscillator ensembles [ 3 ] , whereas the present work uses the Fiedler bipartition as a structural readout of which agents form coalitions, and shows that this readout reveals organization that a scalar cross-agent mutual-information measure cannot distinguish. The next section develops this idea formally by introducing \Phi_{\mathrm{spectral}} and situating it within the broader literature on integration, information, and decomposability [ 3 ] . 2 Technical Background 2.1 From irreducibility to coalition structure A central question in the study of complex systems is when a collection of interacting parts should be treated as a decomposable aggregate and when it should be treated as a more integrated whole. In Integrated Information Theory (IIT), this question is formalized in terms of irreducibility of a system’s cause–effect structure under partition [ 20 , 13 , 1 ] . However, exact causal \Phi is both computationally demanding and conceptually tied to interventional structure. This has motivated a broader family of observer-relative approaches that estimate integration from statistical dependencies in observed data rather than from full intrinsic causal repertoires [ 4 , 12