SelfBudgeter: Adaptive Token Allocation for Efficient LLM Reasoning

Zheng Li, Qingxiu Dong, Jingyuan Ma, Di Zhang, Kai Jia, Zhifang Sui · 2025

Read SelfBudgeter: Adaptive Token Allocation for Efficient LLM Reasoning by Zheng Li, Qingxiu Dong, Jingyuan Ma, Di Zhang, Kai Jia, Zhifang Sui (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11274.txt.

Description

Zheng Li and five co-authors teach language models to budget their own thinking in a 2025 paper. Reasoning models often spend huge numbers of tokens even on easy questions. That waste slows answers and burns compute that harder problems could use.

Their method, SelfBudgeter, first trains a model to guess how much reasoning a question needs. A reinforcement step then rewards answers that stay near that budget while keeping accuracy. On math tasks, average reply length fell by about three fifths with accuracy held steady. Users can preview the planned length or set a token cap in advance. The approach gives both systems and users direct control over reasoning cost.

Catalog record

CREATORZheng Li, Qingxiu Dong, Jingyuan Ma, Di Zhang, Kai Jia, Zhifang Sui
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-11274

Browse the full library · About the Tower of Babel