When and How Human Curation Backfires: Preference Alignment under Multi-Model Self-Consuming Loop

Yang Zhang, Xiukun Wei, Xueru Zhang · 2026

Read When and How Human Curation Backfires: Preference Alignment under Multi-Model Self-Consuming Loop by Yang Zhang, Xiukun Wei, Xueru Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29267.txt.

Introduction

When several models train on each other's synthetic output instead of fresh real data, Yang Zhang, Xiukun Wei, and Xueru Zhang ask whether human curation still helps. They build a formal model of interacting self-consuming models. It shows when the shared system settles at a stable point. Curation of one model reliably helps a lone model, yet spillover to other models can weaken or even reverse the benefit. Curation judged on one model may therefore degrade alignment across the whole group.

Catalog record

CREATORYang Zhang, Xiukun Wei, Xueru Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE217430
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.29267

Browse the full library · About the Tower of Babel