n n -Musketeers: Reinforcement Learning Shapes Collaboration Among Language Models

Ryozo Masukawa, Sanggeon Yun, Hyunwoo Oh, SungHeon Jeong, Raheeb Hassan, Hanning Chen, Wenjun Huang, Mahdi Imani, Pietro Mercati, Nathaniel D. Bastian, Mohsen Imani · 2026

Read n n -Musketeers: Reinforcement Learning Shapes Collaboration Among Language Models by Ryozo Masukawa, Sanggeon Yun, Hyunwoo Oh, SungHeon Jeong, Raheeb Hassan, Hanning Chen, Wenjun Huang, Mahdi Imani, Pietro Mercati, Nathaniel D. Bastian, Mohsen Imani (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-09173.txt.

Description

Small, specialized language models can reason surprisingly well when trained with verifiable rewards, and Ryozo Masukawa and ten co-authors ask whether teams of them can do better together. Their n-Musketeers design links several frozen, heterogeneous expert models through their internal hidden states, joined by a trainable attention interface, a scheme called soft hidden-state collaboration.

On Reasoning Gym and GSM8K, the latent team competes with strong single-model baselines. Ablations reveal two regimes: on simpler arithmetic, gains mostly reflect static expert preferences, while harder settings drive increasingly concentrated, structured attention, a sign of emergent specialization. The design offers both a compact way to reuse frozen experts and a window into how collaboration evolves under training.

Catalog record

CREATORRyozo Masukawa, Sanggeon Yun, Hyunwoo Oh, SungHeon Jeong, Raheeb Hassan, Hanning Chen, Wenjun Huang, Mahdi Imani, Pietro Mercati, Nathaniel D. Bastian, Mohsen Imani
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-09173

Browse the full library · About the Tower of Babel