On Stable Long-Form Generation: Benchmarking and Mitigating Length Volatility

Zhitao He, Haolin Yang, Rui Min, Zeyu Qin, Yi R. (May) Fung · 2026

Read On Stable Long-Form Generation: Benchmarking and Mitigating Length Volatility by Zhitao He, Haolin Yang, Rui Min, Zeyu Qin, Yi R. (May) Fung (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01357.txt.

Description

Zhitao He and four co-authors show that large language models are unsteady when they write long pieces: repeat runs of the same prompt can vary wildly in length. That spread wastes computing power and makes the models hard to trust in production.

The team first builds VOLTBench, a mixed-task benchmark that measures length swing in long-form output. Probing attention patterns then points to shared internal causes of the swing. Their fix, GLoBo, adjusts token scores at decode time only, with no retraining. On the benchmark it lifts mean output length by about half again and cuts length swing by roughly two thirds, while keeping output quality high. The work is the first broad check of this instability across mainstream models.

Catalog record

CREATORZhitao He, Haolin Yang, Rui Min, Zeyu Qin, Yi R. (May) Fung
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE156 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.01357

Browse the full library · About the Tower of Babel