On Stable Long-Form Generation: Benchmarking and Mitigating Length Volatility
Zhitao He, Haolin Yang, Rui Min, Zeyu Qin, Yi R. (May) Fung · 2026
Read On Stable Long-Form Generation: Benchmarking and Mitigating Length Volatility by Zhitao He, Haolin Yang, Rui Min, Zeyu Qin, Yi R. (May) Fung (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01357.txt.
Description
Zhitao He and four co-authors show that large language models are unsteady when they write long pieces: repeat runs of the same prompt can vary wildly in length. That spread wastes computing power and makes the models hard to trust in production.
The team first builds VOLTBench, a mixed-task benchmark that measures length swing in long-form output. Probing attention patterns then points to shared internal causes of the swing. Their fix, GLoBo, adjusts token scores at decode time only, with no retraining. On the benchmark it lifts mean output length by about half again and cuts length swing by roughly two thirds, while keeping output quality high. The work is the first broad check of this instability across mainstream models.
Catalog record
| CREATOR | Zhitao He, Haolin Yang, Rui Min, Zeyu Qin, Yi R. (May) Fung |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 156 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.01357