SelfBudgeter: Adaptive Token Allocation for Efficient LLM Reasoning
Zheng Li, Qingxiu Dong, Jingyuan Ma, Di Zhang, Kai Jia, Zhifang Sui · 2025
Read SelfBudgeter: Adaptive Token Allocation for Efficient LLM Reasoning by Zheng Li, Qingxiu Dong, Jingyuan Ma, Di Zhang, Kai Jia, Zhifang Sui (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11274.txt.
Description
Zheng Li and five co-authors teach language models to budget their own thinking in a 2025 paper. Reasoning models often spend huge numbers of tokens even on easy questions. That waste slows answers and burns compute that harder problems could use.
Their method, SelfBudgeter, first trains a model to guess how much reasoning a question needs. A reinforcement step then rewards answers that stay near that budget while keeping accuracy. On math tasks, average reply length fell by about three fifths with accuracy held steady. Users can preview the planned length or set a token cap in advance. The approach gives both systems and users direct control over reasoning cost.
Catalog record
| CREATOR | Zheng Li, Qingxiu Dong, Jingyuan Ma, Di Zhang, Kai Jia, Zhifang Sui |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-11274