When and How Human Curation Backfires: Preference Alignment under Multi-Model Self-Consuming Loop
Yang Zhang, Xiukun Wei, Xueru Zhang · 2026
Read When and How Human Curation Backfires: Preference Alignment under Multi-Model Self-Consuming Loop by Yang Zhang, Xiukun Wei, Xueru Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29267.txt.
Introduction
When several models train on each other's synthetic output instead of fresh real data, Yang Zhang, Xiukun Wei, and Xueru Zhang ask whether human curation still helps. They build a formal model of interacting self-consuming models. It shows when the shared system settles at a stable point. Curation of one model reliably helps a lone model, yet spillover to other models can weaken or even reverse the benefit. Curation judged on one model may therefore degrade alignment across the whole group.
Catalog record
| CREATOR | Yang Zhang, Xiukun Wei, Xueru Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 217430 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29267