Learning from Partial Chain-of-Thought via Truncated-Reasoning Self-Distillation

Gianluigi Silvestri *, Edoardo Cetin · 2026

Read Learning from Partial Chain-of-Thought via Truncated-Reasoning Self-Distillation by Gianluigi Silvestri *, Edoardo Cetin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13274.txt.

Introduction

Gianluigi Silvestri and Edoardo Cetin introduce Truncated-Reasoning Self-Distillation, or TRSD, for reasoning language models. Long chain-of-thought traces give strong results but cost a great deal of compute. TRSD trains a student to answer well from only a truncated prefix of a reasoning trace. A frozen teacher first builds a full trace and an answer distribution as the target. Across benchmarks and token budgets, TRSD kept accuracy high under truncated inference. Trained models also wrote shorter traces on their own, cutting inference costs further.

Catalog record

CREATORGianluigi Silvestri *, Edoardo Cetin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67582
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.13274

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning from Partial Chain-of-Thought via Truncated-Reasoning Self-Distillation Gianluigi Silvestri *, Edoardo Cetin Abstract Reasoning-oriented language models achieve strong performance by generating long chain-of-thought traces at inference time. However, this capability comes with substantial and often excessive computational cost, which can materialize in redundant or inefficient reasoning. We study this setting and introduce Truncated-Reasoning Self-Distillation (TRSD), a lightweight post-training procedure that encourages models to produce correct predictions from partial reasoning traces. In TRSD, a frozen teacher model first generates a full reasoning trace and evaluates the corresponding answer distribution conditioned on the prompt and the complete reasoning to construct a synthetic training target. A student model with the same architecture is then trained to match the teacher’s answer distribution while being conditioned only on a truncated prefix of its reasoning trace. Across multiple reasoning benchmarks and token budgets, we demonstrate that TRSD improves robustness to truncated inference, with far reduced accuracy tradeoffs when applied to a diverse set of reasoning models. Moreover, although never explicitly regularized for shorter generation during training, we also find that TRSD-trained models inherently output shorter reasoning traces without truncation, significantly reducing inference-time costs even without artificial interventions. 1 Introduction Figure 1 : Accuracy as a function of the available reasoning budget for a Qwen3-4B model on GSM8K. Truncated-Reasoning Self-Distillation (TRSD) substantially improves performance in low-budget regimes, enabling accurate predictions with limited reasoning. Recent progress in large language models (LLMs) has increasingly focused on solving complex reasoning tasks, moving beyond fluent text generation toward multi-step problem solving in domains such as mathematics and coding ( 15 ; 5 ) . A central ingredient behind these gains is the explicit generation of chain-of-thought reasoning, in which models produce long intermediate reasoning traces before emitting a final answer. In modern reasoning models, performance improvements are often achieved by allowing longer such traces at inference time, effectively treating test-time compute as an additional scaling axis alongside model size and training data ( 11 ; 20 ) . However, this reliance on extended inference comes with significant costs. Reasoning models frequently generate thousands of chain-of-thought tokens per query, resulting in high inference latency and substantial computational overhead. More importantly, this additional computation is often inefficient: models tend to overthink, producing verbose or repetitive reasoning that provides little benefit to the final answer. Prior work shows that such behavior can arise even on simple problems, where extended reasoning is unnecessary and does not reliably improve accuracy ( 2 ) . In more extreme cases, reasoning traces may degenerate into repetitive or looping patterns, consuming large amounts of inference-time compute without meaningful progress ( 13 ) . In response to the growing cost of long chain-of-thought reasoning, a range of strategies have been proposed to reduce test-time compute. A first class of approaches acts directly at inference time, guiding the model to produce shorter reasoning traces. This includes prompt-based heuristics, explicit suppression of reflection tokens, and decoding strategies designed to reach a final answer with fewer intermediate reasoning steps ( 23 ; 7 ; 14 ; 18 ) . A second line of work focuses on explicitly compressing or shortening chain-of-thought traces, for instance by skipping, pruning, or selectively retaining reasoning tokens while attempting to preserve final answer accuracy ( 19 ; 16 ; 24 ; 25 ; 10 ; 22 ) . Finally, some methods incorporate length control directly into training, encouraging models to produce shorter reasoning traces by design rather than artificial inference interventions ( 9 ; 1 ) . Figure 2 : Truncated-Reasoning Self-Distillation (TRSD). Given an input prompt x , a frozen teacher model first generates a full chain-of-thought reasoning trace r and an answer y , and then evaluates the answer-token distribution p_{\text{teacher}}(y\mid x,r) conditioned on the prompt and the complete reasoning trace. The trainable student model, initialized as a copy of the teacher, is conditioned only on a truncated prefix \bar{r} of the teacher-generated reasoning trace, and evaluates the corresponding answer distribution p_{\text{student}}(y\mid x,\bar{r}) . Training minimizes the KL divergence between the teacher and student answer distributions, encouraging the student to recover the same predictions from partial reasoning and to remain accurate when inference-time reasoning is truncated. In this work, we take a different perspective on reducing the cost of reasoning. Rather than modifying decoding procedures or explicitly shortening chain-of-thought traces, we focus on training reasoning models to remain effective when inference-time reasoning is truncated, a setting that naturally arises under latency constraints, compute budgets, or user-facing APIs that allow early stopping. We propose Truncated-Reasoning Self-Distillation (TRSD), a post-training self-distillation approach in which a model is trained to match its answer predictions from a truncated prefix of its own reasoning trace to those obtained when conditioned on the full reasoning (see Figure 2 ). By encouraging robustness to truncated reasoning rather than enforcing shorter traces, TRSD directly targets wasteful inference without constraining how models reason, shifting the optimization objective away from producing shorter reasoning and toward producing answers that rely less on extended or redundant computation. We evaluate TRSD across multiple reasoning-oriented language model architectures and datasets. Across most settings, TRSD-trained models outperform their corresponding baselines under truncated inference (Figure 1 ), and in several cases these gains persist even when larger reasoning budgets are available. When reasoning is unconstrained, TRSD-trained models also tend to generate shorter reasoning traces while maintaining or improving accuracy. Importantly, this reduction in reasoning length is not enforced during training, but emerges naturally as a consequence of optimizing robustness to truncated reasoning. Overall, TRSD is a simple and lightweight post-training procedure that improves accuracy under low reasoning budgets and reduces unnecessary inference-time computation in existing reasoning models. 2 Background Reasoning models are language models trained to explicitly generate chain-of-thought reasoning traces during inference, rather than relying solely on implicit internal computation. This paradigm, exemplified by models such as DeepSeek-R1 ( 5 ) , induces language models to decompose complex problems into intermediate steps by generating long thinking traces before producing a final answer. Training reasoning models typically proceeds in two stages. First, the model undergoes a supervised fine-tuning stage, leveraging masked prompts paired with explicit reasoning traces and correct answers to establish a structured reasoning format in its generation patterns ( 15 ; 5 ) . Second, the model is directly optimized with reinforcement learning to maximize the correctness of its generated responses on downstream tasks using verifiable rewards ( 5 ) . In this second stage, the thinking trace generated by the language model inherently grows, increasingly trading test-time computation for improved accuracy. To leverage the properties of reasoning while mitigating its inference cost, large reasoning models are often distilled into smaller “students”. In standard distillation pipelines, a “teacher” generates synthetic data consisting of prompts, reasoning traces, and answers, which are used to supervise a smaller model via fine-tuning or distribution matching ( 5 ; 4 ) . While distillation enables compact models to acquire strong reasoning performance ( 21 ; 11 ) , it can also encourage students to reproduce long and unnecessary reasoning traces, partially inheriting the teacher’s inefficiencies ( 2 ; 13 ; 22 ) . 3 Method 3.1 Truncated-Reasoning Self-Distillation We propose Truncated-Reasoning Self-Distillation (TRSD), a lightweight post-training procedure applied as an additional fine-tuning step on top

Read the complete text