sachi : S tructured A gent C oordination via H olistic I nformation Integration in Multi-Agent Reinforcement Learning
Nikunj Gupta 1 , James Zachary Hare 2 , Jesse Milzman 2 , Rajgopal Kannan 3 , Viktor Prasanna 1 · 2026
Read sachi : S tructured A gent C oordination via H olistic I nformation Integration in Multi-Agent Reinforcement Learning by Nikunj Gupta 1 , James Zachary Hare 2 , Jesse Milzman 2 , Rajgopal Kannan 3 , Viktor Prasanna 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08391.txt.
Introduction
Nikunj Gupta, James Zachary Hare, Jesse Milzman, Rajgopal Kannan, and coauthors coordinate teams of reinforcement learning agents that each see only part of the world. Jointly good actions need knowledge scattered across teammates, yet every agent must commit without seeing the others' observations or plans. Earlier designs ignored the bottleneck, squeezed it into one mixing number, or added learned chatter channels.
SACHI treats coordination as structured information integration. Graph transformer convolutions over a coordination graph enrich each agent's state with receiver-sensitive signals from teammates before it acts. The method is evaluated on five cooperative tasks spanning spatial and other domains, testing whether richer pre-decision integration beats scalar mixing.
Catalog record
| CREATOR | Nikunj Gupta 1 , James Zachary Hare 2 , Jesse Milzman 2 , Rajgopal Kannan 3 , Viktor Prasanna 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.08391
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
sachi : S tructured A gent C oordination via H olistic I nformation Integration in Multi-Agent Reinforcement Learning Nikunj Gupta 1 , James Zachary Hare 2 , Jesse Milzman 2 , Rajgopal Kannan 3 , Viktor Prasanna 1 Abstract Cooperative multi-agent reinforcement learning agents that act on partial local observations face a fundamental information bottleneck: the knowledge needed to select jointly optimal actions is scattered across the team, yet each agent must commit to a decision without access to its teammates’ observations, intentions, or chosen actions. Existing methods either ignore this bottleneck, compress it into a scalar mixing signal, or route around it with learned communication channels. Framing action coordination as a problem of structured information integration among agents, we propose structured agent coordination via holistic information integration , or sachi , in which graph transformer convolutions over an inter-agent coordination graph enrich each agent’s representation with receiver-sensitive, content-dependent signals from teammates prior to action selection. We evaluate sachi across five cooperative tasks spanning spatial, communicative, and adversarial coordination challenges against twelve baselines. sachi consistently matches or outperforms the best baseline on every task, and rigorous aggregate statistical analyses, including normalized metrics with bootstrap confidence intervals, Friedman ranking, and performance profiling, confirm that this advantage is statistically significant, robust across environments, and not attributable to increased model capacity. Parameter-matched ablations further trace the source of the gains to a single architectural property: the degree of content-dependence in the message-passing operator. † † impactstatement: This paper advances the scientific understanding of coordination in multi-agent systems by framing action coordination as a problem of structured information integration. The methods developed here are intended to improve the performance of cooperative autonomous systems in settings where effective teamwork is essential, including robotics, logistics, and resource allocation. We foresee no immediate ethical concerns arising from this work. As with any advance in autonomous decision-making, the broader societal implications depend largely on the contexts in which these methods are deployed, and we encourage responsible application. I Introduction Coordination, the alignment of individual decisions toward a shared objective, is among the oldest and most consequential problems in the study of organized systems [ 33 ] . From assembly lines to air-traffic control, success depends not on any single actor in isolation but on the degree to which many actors select mutually compatible actions under uncertainty. Multi-agent reinforcement learning (MARL) inherits this challenge in full generality: a team of agents must learn a joint policy under which each agent’s action is individually executable yet collectively coherent, often from partial and local observations of a shared environment [ 36 , 3 ] . The past decade has seen a remarkable influx of cooperative MARL algorithms, spanning value decomposition [ 45 , 39 ] , communication learning, and policy-gradient methods [ 29 , 54 ] , motivated by applications in autonomous driving, warehouse logistics, robotic manipulation, and network routing [ 28 , 37 , 52 ] . Yet across this landscape, a persistent difficulty remains: how should a joint policy be structured so that each agent’s locally-computed action is compatible with the actions of teammates it cannot observe? To appreciate why action coordination is difficult, it helps to first consider a setting where it is not. Imagine a team of delivery drones operating in non-overlapping zones of a city: each drone plans its own route independently, and the fleet’s total throughput is simply the sum of individual deliveries. A policy that maximizes each agent’s individual return also maximizes the team’s, so no coordination of actions is required. Now extend the scenario. Suppose zones overlap and two drones approaching the same rooftop must yield to avoid collision; the action each drone should take now depends on the action the other is taking, and a policy that ignores this coupling will produce collisions no matter how well each agent optimizes locally [ 31 ] . Add heterogeneity: heavy packages demand larger drones and narrow alleys require smaller ones, so the optimal action for one agent is contingent on the assignments of others. Introduce time coupling: a drone occupying a rooftop landing pad blocks a second drone carrying a perishable item, so even the order in which agents act must be jointly determined. At each extension, individual action optimality becomes insufficient. What matters is whether the joint action profile, the vector of all agents’ simultaneous choices, is coherent as a whole. This joint coherence under decentralized execution is the defining challenge of action coordination in cooperative MARL. One of the most subtle impediments to action coordination arises in settings where agents are fully aligned: every member of the team shares the same preference ranking over group outcomes, and any joint action profile that raises one agent’s payoff raises everyone’s. In such cooperative teams, the difficulty is not conflicting incentives but the structural problem of producing a coherent joint action from decentralized decisions [ 36 ] . Each agent controls only its own action and observes only a local view of the environment, yet the value of that action depends on the actions simultaneously chosen by its teammates. A search-and-rescue squad may unanimously want to cover a disaster site as quickly as possible, yet if each rescuer independently selects the nearest uncovered sector, the resulting joint action profile leaves critical zones unvisited regardless of how rational each individual choice appears in isolation. Producing a jointly optimal action profile, therefore, requires each agent’s policy to be conditioned not only on its own observations but also on information that makes teammates’ actions predictable and mutually consistent. The central challenge, then, is how to act when the information needed to select a compatible action is distributed across agents with no mechanism to assemble it. Fig. 1 : Solving the MARL Information Bottleneck. (a) Each agent holds only a fragment of the information needed to determine the globally optimal joint action; (b) Since agents cannot see their teammates’ observations or intentions, their independent “rational” choices often lead to group failure; (c) sachi resolves this by allowing agents to intelligently filter and “borrow” relevant context from teammates through graph transformer layers; and (d) Enriched internal representations allow agents to act independently at runtime while maintaining perfect joint alignment. In this paper, we address this action-coordination challenge directly by targeting the information bottleneck that prevents decentralized policies from producing coherent joint actions. We propose S tructured A gent C oordination via H olistic I nformation I ntegration ( sachi ), where holistic reflects the principle that effective coordination does not require an agent to collect all available information from all teammates indiscriminately, but rather to intelligently accumulate precisely the coordination-relevant signals it needs from its neighbors. It must filter, weight, and integrate incoming information in a manner that is sensitive to the agent’s own state and role. sachi achieves this by enriching each agent’s policy input through graph transformer convolutions [ 55 ] over an inter-agent coordination graph, in which content-dependent attention determines not only which neighboring agents contribute to a given representation but how much and in what form their information is incorporated. The coordination graph encodes which agents’ actions are coupled; the graph transformer determines what information flows between them and how each agent integrates incoming signals given