Towards Efficient Large Language Reasoning Models via Extreme-Ratio Chain-of-Thought Compression

Yuntian Tang, Bohan Jia, Wenxuan Huang, Lianyue Zhang, Jiao Xie, Wenxi Li, Rongrong Ji, Shaohui Lin · 2026

Read Towards Efficient Large Language Reasoning Models via Extreme-Ratio Chain-of-Thought Compression by Yuntian Tang, Bohan Jia, Wenxuan Huang, Lianyue Zhang, Jiao Xie, Wenxi Li, Rongrong Ji, Shaohui Lin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08324.txt.

Description

Long step-by-step reasoning makes language models smart but slow, and squeezing those steps usually costs accuracy. Yuntian Tang and ten co-authors propose Extra-CoT, a method that cuts reasoning tokens sharply while keeping answers right. Their 2026 arXiv paper starts by training a compressor that shortens math reasoning without losing its meaning.

A model is then tuned on compressed examples at many budgets, so it learns to reason under tight token limits, and a new training rule rewards solving problems with fewer tokens. On one math test with a small model, the method trims over 73 percent of tokens while slightly raising accuracy. Readers get a practical route to cheaper, faster reasoning that does not trade away correctness.

Catalog record

CREATORYuntian Tang, Bohan Jia, Wenxuan Huang, Lianyue Zhang, Jiao Xie, Wenxi Li, Rongrong Ji, Shaohui Lin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-08324

Browse the full library · About the Tower of Babel