Contextual Counterfactual Credit Assignment for Multi-Agent Reinforcement Learning in LLM Collaboration

Yanjun Chen, Yirong Sun, Hanlin Wang, Xinming Zhang, Xiaoyu Shen, Wenjie Li, Wei Zhang · 2026

Read Contextual Counterfactual Credit Assignment for Multi-Agent Reinforcement Learning in LLM Collaboration by Yanjun Chen, Yirong Sun, Hanlin Wang, Xinming Zhang, Xiaoyu Shen, Wenjie Li, Wei Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-06859.txt.

Description

Chen and colleagues present C3, counterfactual credit assignment for LLM agent teams that share context. Credit for a message is guessed by a learned critic, a run score, or an agent ablation standing in for a rarely run counterfactual. When all agents read is written into the trace, trace is state, and the counterfactual can be run. C3 swaps a message at a choice point and continues the run to reward, giving credit unbiased and right up to sampling error. Its variance follows a law with no agent term.

Catalog record

CREATORYanjun Chen, Yirong Sun, Hanlin Wang, Xinming Zhang, Xiaoyu Shen, Wenjie Li, Wei Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68508
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.06859

Browse the full library · About the Tower of Babel