The Single-Multi Evolution Loop for Self-Improving Model Collaboration Systems
Shangbin Feng, Kishan Panaganti, Yulia Tsvetkov, Wenhao Yu · 2026
Read The Single-Multi Evolution Loop for Self-Improving Model Collaboration Systems by Shangbin Feng, Kishan Panaganti, Yulia Tsvetkov, Wenhao Yu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05182.txt.
Description
Teams of language models outperform single models, but running several at once costs several times more. Shangbin Feng and 3 co-authors propose a loop that keeps the gains while shedding the cost in this 2026 paper. The recipe is distillation: let models collaborate, train a single model on the collaboration's outputs, and at run time deploy only that one model, which has absorbed the team's habits.
The loop then closes. The improved single models collaborate again, distill again, and the system evolves collectively. Across seven collaboration strategies and fifteen tasks spanning question answering, reasoning, and factuality, individual models improved by about eight percent on average after distillation. The second-generation collaboration beat the original system by about fifteen percent. The authors report the loop outperforms other evolutionary AI schemes and works across many model and distillation choices.
Catalog record
| CREATOR | Shangbin Feng, Kishan Panaganti, Yulia Tsvetkov, Wenhao Yu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-05182