PC3D: Zero-Shot Cooperation Across Variable Rosters via Personalized Context Distillation
Ahmet Onur Akman, Rafał Kucharski · 2026
Read PC3D: Zero-Shot Cooperation Across Variable Rosters via Personalized Context Distillation by Ahmet Onur Akman, Rafał Kucharski (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10377.txt.
Introduction
Ahmet Onur Akman and Rafał Kucharski study teamwork that changes size. Cooperative multi-agent learning usually assumes a fixed team, yet deployed systems often run with varying numbers of active agents. Their 2026 paper studies episodic roster variation: each episode runs with a set of homogeneous agents, with team size varying across episodes, no run-time communication, and no online retraining.
Good teamwork then needs each agent to recover context about the active team from local history alone. The authors propose PC3D, Personalized Central Coordination Context Distillation. In training, a set-structured central teacher packs the active team into coordination tokens and tailors them into agent-specific contexts, distilled into decentralized policies. At run time, each agent infers its own context from local history and uses it to steer choices. Across three cooperative tests PC3D beat baselines at both seen and unseen roster sizes.
Catalog record
| CREATOR | Ahmet Onur Akman, Rafał Kucharski |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10377
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PC3D: Zero-Shot Cooperation Across Variable Rosters via Personalized Context Distillation Ahmet Onur Akman, Rafał Kucharski Abstract Cooperative multi-agent reinforcement learning often assumes a fixed execution team, yet many decentralized systems must operate with varying numbers of active agents during deployment. We study this setting under episodic roster variation: each episode is executed by a set of homogeneous agents, with the team size varying across episodes. Agents act only from local histories, without execution-time communication, privileged coordinators, or online retraining. Therefore, effective cooperation requires each agent to recover relevant context about the active team and adapt its behavior accordingly. To this end, we propose PC3D (Personalized Central Coordination Context Distillation), a method for training decentralized policies to recover and use personalized coordination context from local interaction histories. During training, a set-structured centralized teacher compresses the active team into coordination tokens and personalizes them into agent-specific contexts, which are distilled into decentralized policies. At execution, each agent predicts its own context from local history and adaptively uses it to condition decision-making. Across three cooperative MARL benchmarks, PC3D achieves higher returns than the evaluated baselines with both seen and unseen roster sizes, and ablations attribute these gains to both context distillation and adaptive context use. 1 Introduction Multi-agent reinforcement learning (MARL) studies how multiple decision-makers learn to act in shared environments, making it a natural framework for cooperative control problems that require coordinated behavior 50 ; 28 ; 16 . As the application domains expand, cooperative multi-agent systems are increasingly expected to operate in settings where agents cannot rely on execution-time coordination mechanisms 49 . Centralized training with decentralized execution (CTDE) has become the dominant framework for addressing this tension in cooperative MARL (CMARL) 5 . Classical value-factorization methods such as VDN and QMIX improve decentralized control by constraining how a centralized training objective decomposes into per-agent utilities 41 ; 34 . Centralized-critic methods such as MADDPG, COMA, and MAPPO instead use training-time information to stabilize policy learning while preserving decentralized execution 26 ; 15 ; 46 . Although CTDE methods have substantially advanced the field, they typically assume a fixed execution team. This leaves a structural gap for open-team cooperation (OTC), where the team size may vary during deployment. We refer to the set of agents active in a given episode as a roster , and study episodic roster variation : each episode is executed by a fixed roster, but the roster size may change across episodes. Our setting involves homogeneous agents and assumes fully decentralized execution under partial observability, without execution-time communication, global observations, or online retraining. OTC naturally arises in many decentralized control problems, including robot teams, which can be restructured to meet operational requirements 36 ; 31 ; warehouse systems, where the infrastructure can be rescaled depending on corporate objectives 35 ; and autonomous vehicle routing, where the fleet size may evolve with changing demand and adoption rates 8 ; 32 ; 4 . Several lines of work address variation in team composition in CMARL 47 with different constraints on the execution model or the task structure. Agent–entity graph methods 2 learn policies over agents and entities by relying on graph message passing. SOG 39 organizes agents into temporary conductor-follower groups, exchanging summarized messages during execution. COPA 23 uses a privileged coach with an “omniscient” view to distribute strategies during both training and execution. MIPI 45 , building on REFIL 19 , regularizes reliance on team-related information by assuming that the designer could decompose agent states into team-related ( s^{-} ) and -unrelated ( s^{+} ) components. In contrast, we explore whether a method can address the OTC problem natively within the CTDE setting without changes to the execution model, with centralized information available only during training and execution relying solely on each agent’s local history. By keeping the execution contract fixed and treating the method as the variable of interest, we ask whether methodological changes alone can improve zero-shot cooperation across roster sizes. In this setting, the core challenge is not merely learning effective coordination for a given task, but maintaining it across different, possibly unseen roster sizes at execution time. This aspect resembles Ad Hoc Teamwork (AHT), which is an adjacent problem concerned with adapting learners to unfamiliar teammates 40 ; 33 ; 44 . Although the two settings share structural challenges, AHT primarily focuses on mitigating coordination failures caused by unfamiliar teammate policies, whereas OTC requires leveraging additional teammates when new cooperative opportunities arise. This makes CTDE methods a viable option to train such policies, although their standard form does not account for changing cooperation regimes across roster sizes. To that end, this study explores whether CTDE methods can improve cooperation across varying team sizes and zero-shot generalization to unseen ones by leveraging a centralized team representation, which can provide personalized and locally recoverable coordination signals while preserving fully decentralized execution . Existing methods provide ingredients for this goal. Teacher-student methods such as CTDS and PTDE show that centralized guidance can be distilled into decentralized agents 51 and that this guidance should be agent-personalized 11 ; however, they leave open how this signal should be formed, personalized, and used under the OTC setting. On scalability and architectural compatibility with changing roster sizes, attention-based and permutation-invariant critics have shown that centralized representations can handle unordered agent collections ( 20 ; 24 ) , with Deep Sets and Set Transformers providing the underlying design principles 48 ; 22 . However, these pieces do not, by themselves, solve OTC: a set-compatible critic improves the centralized training signal but does not automatically provide the decentralized policy with a reusable notion of coordination across roster sizes. Figure 1 : PC3D at a glance. PC3D trains with centralized information over a distribution of roster sizes for a given cooperative task ( a ). During training, the centralized teacher provides personalized coordination contexts, which decentralized agents learn to recover from local interaction histories ( b ). At execution, agents act only from local histories, without communication or retraining, and coordinate across both seen and held-out roster sizes ( c ). Building on these ideas, this paper introduces PC3D ( P ersonalized C entral C oordination C ontext D istillation): a method for improving CTDE learners under episodic roster variation by (i) extracting a compact team-level coordination summary using a set-structured central module, (ii) personalizing that summary into locally recoverable contexts, and (iii) distilling it into decentralized policies that learn how and when to rely on it. We instantiate it on top of a MAPPO backbone, although the idea can be extended to other CTDE learners. During training, a centralized set critic embeds the active team as an unordered set, compresses it into a small number of coordination tokens via token-based cross-attention, and produces personalized per-agent teacher contexts . These teacher contexts are used for training agents to infer team context estimates from local interactions, while the coordination tokens support centralized value estimation. At execution, each agent still acts only on its local observation history while also predicting a student coordination context to adaptively condition policy features. As illustrated in Figure 1 , training PC3D over a distribution of roster sizes within the same cooperative task enables decentralized policies to recover relevant team context