Semantic Flow Regularization: Teaching LLMs to Generate Diverse Yet Coherent Responses

Kerui Peng, Feifei Li, Xingyu Fan, Wenhui Que · 2026

Read Semantic Flow Regularization: Teaching LLMs to Generate Diverse Yet Coherent Responses by Kerui Peng, Feifei Li, Xingyu Fan, Wenhui Que (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27971.txt.

Description

Peng and colleagues fight the loss of variety when language models are tuned for a set role or tone. Their Semantic Flow Regularization trains the model on coded hints of text yet to come, keeping many possible next lines alive instead of one. The extra training head is dropped at run time, yet range, style match, and quality all rose.

Catalog record

CREATORKerui Peng, Feifei Li, Xingyu Fan, Wenhui Que
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70902
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.27971

Browse the full library · About the Tower of Babel