S 3 -CoT: Self-Sampled Succinct Reasoning Enables Efficient Chain-of-Thought LLMs

Yanrui Du, Sendong Zhao, Yibo Gao, Danyang Zhao, Qika Lin, Ming Ma, Jiayun Li, Yi Jiang, Kai He, Qianyi Xu, Bing Qin, Mengling Feng · 2026

Read S 3 -CoT: Self-Sampled Succinct Reasoning Enables Efficient Chain-of-Thought LLMs by Yanrui Du, Sendong Zhao, Yibo Gao, Danyang Zhao, Qika Lin, Ming Ma, Jiayun Li, Yi Jiang, Kai He, Qianyi Xu, Bing Qin, Mengling Feng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01982.txt.

Description

Yanrui Du and colleagues give chain of thought models a fast thinking mode like human System 1 reasoning, cutting redundancy. Their self sampling framework uses activation steering to induce variable length style aligned traces from target models, without teacher guidance, easing supervision scarcity for SFT methods. Filtered gold answer data trains efficient chain of thought learning through dual cognitive systems and a compression curriculum. A self evolution regime trains SFT solely on prediction consistent data, removing gold answers. Math benchmarks plus medicine tests show stable improvements for general and R1 models.

Catalog record

CREATORYanrui Du, Sendong Zhao, Yibo Gao, Danyang Zhao, Qika Lin, Ming Ma, Jiayun Li, Yi Jiang, Kai He, Qianyi Xu, Bing Qin, Mengling Feng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41363
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01982

Browse the full library · About the Tower of Babel