Accordion-Thinking: Self-Regulated Step Summaries for Efficient and Readable LLM Reasoning
Zhicheng Yang, Zhijiang Guo, Yinya Huang, Yongxin Wang, Wenlei Shi, Yiwei Wang, Xiaodan Liang, Jing Tang · 2026
Read Accordion-Thinking: Self-Regulated Step Summaries for Efficient and Readable LLM Reasoning by Zhicheng Yang, Zhijiang Guo, Yinya Huang, Yongxin Wang, Wenlei Shi, Yiwei Wang, Xiaodan Liang, Jing Tang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03249.txt.
Description
Long chains of thought that periodically summarize themselves are new by Zhicheng Yang, leading 7 other authors, in a system called Accordion-Thinking. Scaling test-time compute through long thinking unlocks gains, but cache growth and focus cost impose practical limits. Their model learns to regulate the granularity of its own thinking steps through dynamic summarization during output, compressing context as it goes.
In fold mode, the model periodically summarizes its thoughts and discards the earlier detail, cutting dependence on historical tokens. Reinforcement learning strengthens that capability. Over training, the score gap between efficient fold mode and exhaustive unfold mode narrowed and eventually vanished. The model had learned to encode essentials into compact summaries. Throughput tripled at maintained score, and summaries stay human-readable.
Catalog record
| CREATOR | Zhicheng Yang, Zhijiang Guo, Yinya Huang, Yongxin Wang, Wenlei Shi, Yiwei Wang, Xiaodan Liang, Jing Tang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-03249