Reasoning Models Can Be Accurately Pruned via Chain-of-Thought Reconstruction

Ryan Lucas, Kayhan Behdin, Zhipeng Wang, Shao Tang, Qingquan Song, Rahul Mazumder · 2025

Read Reasoning Models Can Be Accurately Pruned via Chain-of-Thought Reconstruction by Ryan Lucas, Kayhan Behdin, Zhipeng Wang, Shao Tang, Qingquan Song, Rahul Mazumder (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-12464.txt.

Description

Reasoning models write long chains of thought, which makes them expensive, and pruning them the usual way backfires: the shrunken model thinks longer and worse. Ryan Lucas and five co-authors diagnose that failure in 2025 and offer a drop-in repair called Reasoning-Aware Compression.

Standard pruning rebuilds only the input-side activations, but reasoning is dominated by decoding, the model's own generated text. Their fix also rebuilds activations from the model's own chain-of-thought traces during pruning. Plugged into an existing pruning workflow, the change restores much of the lost performance on reasoning tasks without extra machinery.

Catalog record

CREATORRyan Lucas, Kayhan Behdin, Zhipeng Wang, Shao Tang, Qingquan Song, Rahul Mazumder
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-12464

Browse the full library · About the Tower of Babel