Semantic Flow Regularization: Teaching LLMs to Generate Diverse Yet Coherent Responses
Kerui Peng, Feifei Li, Xingyu Fan, Wenhui Que · 2026
Read Semantic Flow Regularization: Teaching LLMs to Generate Diverse Yet Coherent Responses by Kerui Peng, Feifei Li, Xingyu Fan, Wenhui Que (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27971.txt.
Description
Peng and colleagues fight the loss of variety when language models are tuned for a set role or tone. Their Semantic Flow Regularization trains the model on coded hints of text yet to come, keeping many possible next lines alive instead of one. The extra training head is dropped at run time, yet range, style match, and quality all rose.
Catalog record
| CREATOR | Kerui Peng, Feifei Li, Xingyu Fan, Wenhui Que |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70902 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27971