Contextual Counterfactual Credit Assignment for Multi-Agent Reinforcement Learning in LLM Collaboration
Yanjun Chen, Yirong Sun, Hanlin Wang, Xinming Zhang, Xiaoyu Shen, Wenjie Li, Wei Zhang · 2026
Read Contextual Counterfactual Credit Assignment for Multi-Agent Reinforcement Learning in LLM Collaboration by Yanjun Chen, Yirong Sun, Hanlin Wang, Xinming Zhang, Xiaoyu Shen, Wenjie Li, Wei Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-06859.txt.
Description
Chen and colleagues present C3, counterfactual credit assignment for LLM agent teams that share context. Credit for a message is guessed by a learned critic, a run score, or an agent ablation standing in for a rarely run counterfactual. When all agents read is written into the trace, trace is state, and the counterfactual can be run. C3 swaps a message at a choice point and continues the run to reward, giving credit unbiased and right up to sampling error. Its variance follows a law with no agent term.
Catalog record
| CREATOR | Yanjun Chen, Yirong Sun, Hanlin Wang, Xinming Zhang, Xiaoyu Shen, Wenjie Li, Wei Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68508 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.06859