Steering LLM Thinking with Budget Guidance

Junyan Li, Wenshuo Zhao, Yang Zhang, Chuang Gan · 2025

Read Steering LLM Thinking with Budget Guidance by Junyan Li, Wenshuo Zhao, Yang Zhang, Chuang Gan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13752.txt.

Description

Junyan Li, Wenshuo Zhao, Yang Zhang, and Chuang Gan cap how long a reasoning model may think, without retraining it. Their paper appeared in two thousand twenty-five. Deep-thinking models often ramble past the point of usefulness. Extra tokens cost money and time for little gain. Tight budgets break most length controls. Their budget guidance works at generation time.

A light predictor estimates the remaining thinking length as text unfolds. It models that length with a Gamma distribution. The estimate softly steers each next token. Traces land near the requested budget naturally. Token efficiency improves strongly over baselines. Users gain a dial for thought, not just an on-off switch.

Catalog record

CREATORJunyan Li, Wenshuo Zhao, Yang Zhang, Chuang Gan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-13752

Browse the full library · About the Tower of Babel