Self-Training Elicits Concise Reasoning in Large Language Models

Tergel Munkhbat Namgyu Ho ∗ {}{*} Seo Hyun Kim ∗ {}{*} Yongjin Yang, Yujin Kim Se-Young Yun KAIST AI {tergelmunkhbat, itsnamgyu, shkimsally, yunseyoung}@kaist.ac.kr https://github.com/TergelMunkhbat/concise-reasoning · 2025

Read Self-Training Elicits Concise Reasoning in Large Language Models by Tergel Munkhbat Namgyu Ho ∗ {}{*} Seo Hyun Kim ∗ {}{*} Yongjin Yang, Yujin Kim Se-Young Yun KAIST AI {tergelmunkhbat, itsnamgyu, shkimsally, yunseyoung}@kaist.ac.kr https://github.com/TergelMunkhbat/concise-reasoning (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-20122.txt.

Description

Tergel Munkhbat and co-authors teach language models to think shorter. Their 2025 paper starts from a cost: chain-of-thought reasoning buys accuracy with tokens, and many tokens in a typical trace are redundant. Poking at the models' output habits, they find a latent ability to reason concisely that default settings leave unused.

Their fine-tuning feeds the model its own best, briefest solutions, gathered by repeated sampling and a few worked examples. Output tokens fell by about thirty percent on average across five model families on two math benchmarks, with accuracy held. Cheaper reasoning compounds across every deployment, which is the real prize.

Catalog record

CREATORTergel Munkhbat Namgyu Ho ∗ {}{*} Seo Hyun Kim ∗ {}{*} Yongjin Yang, Yujin Kim Se-Young Yun KAIST AI {tergelmunkhbat, itsnamgyu, shkimsally, yunseyoung}@kaist.ac.kr https://github.com/TergelMunkhbat/concise-reasoning
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-20122

Browse the full library · About the Tower of Babel