Steering LLM Thinking with Budget Guidance
Junyan Li, Wenshuo Zhao, Yang Zhang, Chuang Gan · 2025
Read Steering LLM Thinking with Budget Guidance by Junyan Li, Wenshuo Zhao, Yang Zhang, Chuang Gan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13752.txt.
Description
Junyan Li, Wenshuo Zhao, Yang Zhang, and Chuang Gan cap how long a reasoning model may think, without retraining it. Their paper appeared in two thousand twenty-five. Deep-thinking models often ramble past the point of usefulness. Extra tokens cost money and time for little gain. Tight budgets break most length controls. Their budget guidance works at generation time.
A light predictor estimates the remaining thinking length as text unfolds. It models that length with a Gamma distribution. The estimate softly steers each next token. Traces land near the requested budget naturally. Token efficiency improves strongly over baselines. Users gain a dial for thought, not just an on-off switch.
Catalog record
| CREATOR | Junyan Li, Wenshuo Zhao, Yang Zhang, Chuang Gan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-13752