Retaining Suboptimal Actions to Follow Shifting Optima in Multi-Agent Reinforcement Learning
Yonghyeon Jo, Sunwoo Lee, Seungyul Han · 2026
Read Retaining Suboptimal Actions to Follow Shifting Optima in Multi-Agent Reinforcement Learning by Yonghyeon Jo, Sunwoo Lee, Seungyul Han (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-17062.txt.
Description
Yonghyeon Jo led a three-author team fixing a rigidity in cooperative multi-agent reinforcement learning. Value decomposition methods usually commit to a single best action, which leaves them stranded when the value landscape shifts during training and they settle on poor policies. The paper proposes Successive Sub-value Q-learning, or S2Q, which learns several sub-value functions so that strong alternative actions stay alive.
Fed into a Softmax-based behavior policy, those sub-values keep exploration going and let the total value adjust fast when the best action changes. Tests on demanding multi-agent benchmarks showed S2Q beating a range of rival algorithms, with better adaptability and overall scores. The approach offers teams of learning agents a way to stay flexible instead of locking in early.
Catalog record
| CREATOR | Yonghyeon Jo, Sunwoo Lee, Seungyul Han |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 89 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-17062