Towards Efficient Large Language Reasoning Models via Extreme-Ratio Chain-of-Thought Compression
Yuntian Tang, Bohan Jia, Wenxuan Huang, Lianyue Zhang, Jiao Xie, Wenxi Li, Rongrong Ji, Shaohui Lin · 2026
Read Towards Efficient Large Language Reasoning Models via Extreme-Ratio Chain-of-Thought Compression by Yuntian Tang, Bohan Jia, Wenxuan Huang, Lianyue Zhang, Jiao Xie, Wenxi Li, Rongrong Ji, Shaohui Lin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08324.txt.
Description
Long step-by-step reasoning makes language models smart but slow, and squeezing those steps usually costs accuracy. Yuntian Tang and ten co-authors propose Extra-CoT, a method that cuts reasoning tokens sharply while keeping answers right. Their 2026 arXiv paper starts by training a compressor that shortens math reasoning without losing its meaning.
A model is then tuned on compressed examples at many budgets, so it learns to reason under tight token limits, and a new training rule rewards solving problems with fewer tokens. On one math test with a small model, the method trims over 73 percent of tokens while slightly raising accuracy. Readers get a practical route to cheaper, faster reasoning that does not trade away correctness.
Catalog record
| CREATOR | Yuntian Tang, Bohan Jia, Wenxuan Huang, Lianyue Zhang, Jiao Xie, Wenxi Li, Rongrong Ji, Shaohui Lin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-08324