Self-Training Elicits Concise Reasoning in Large Language Models
Tergel Munkhbat Namgyu Ho ∗ {}{*} Seo Hyun Kim ∗ {}{*} Yongjin Yang, Yujin Kim Se-Young Yun KAIST AI {tergelmunkhbat, itsnamgyu, shkimsally, yunseyoung}@kaist.ac.kr https://github.com/TergelMunkhbat/concise-reasoning · 2025
Read Self-Training Elicits Concise Reasoning in Large Language Models by Tergel Munkhbat Namgyu Ho ∗ {}{*} Seo Hyun Kim ∗ {}{*} Yongjin Yang, Yujin Kim Se-Young Yun KAIST AI {tergelmunkhbat, itsnamgyu, shkimsally, yunseyoung}@kaist.ac.kr https://github.com/TergelMunkhbat/concise-reasoning (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-20122.txt.
Description
Tergel Munkhbat and co-authors teach language models to think shorter. Their 2025 paper starts from a cost: chain-of-thought reasoning buys accuracy with tokens, and many tokens in a typical trace are redundant. Poking at the models' output habits, they find a latent ability to reason concisely that default settings leave unused.
Their fine-tuning feeds the model its own best, briefest solutions, gathered by repeated sampling and a few worked examples. Output tokens fell by about thirty percent on average across five model families on two math benchmarks, with accuracy held. Cheaper reasoning compounds across every deployment, which is the real prize.
Catalog record
| CREATOR | Tergel Munkhbat Namgyu Ho ∗ {}{*} Seo Hyun Kim ∗ {}{*} Yongjin Yang, Yujin Kim Se-Young Yun KAIST AI {tergelmunkhbat, itsnamgyu, shkimsally, yunseyoung}@kaist.ac.kr https://github.com/TergelMunkhbat/concise-reasoning |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 79 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-20122