EPiC: Towards Lossless Speedup for Reasoning Training through Edge-Preserving CoT Condensation

Jinghan Jia Hadi Reisizadeh Chongyu Fan Nathalie Baracaldo Mingyi Hong Sijia Liu · 2025

Read EPiC: Towards Lossless Speedup for Reasoning Training through Edge-Preserving CoT Condensation by Jinghan Jia Hadi Reisizadeh Chongyu Fan Nathalie Baracaldo Mingyi Hong Sijia Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-04205.txt.

Introduction

Jia and co-authors cut the cost of teaching language models to reason by trimming the middle from expert reasoning traces. Long chain-of-thought examples, distilled from big reasoning models, are expensive training food. The team noticed traces tend to follow three acts: framing the problem, exploring, and converging on the answer. Their method, EPiC, keeps the first and last acts and discards the exploratory middle, betting the edges carry the supervision that matters.

Across two model families and several math benchmarks, the trimmed traces matched full-trace training's accuracy while cutting training time by more than a third. The framing stage, rich in reflective cues, and the synthesis stage proved sufficient to keep reasoning coherent. The authors present EPiC as the first thought-level trimming method for reasoning distillation. For labs training reasoners on a budget, it offers speed without the accuracy tax.

Catalog record

CREATORJinghan Jia Hadi Reisizadeh Chongyu Fan Nathalie Baracaldo Mingyi Hong Sijia Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-04205

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EPiC: Towards Lossless Speedup for Reasoning Training through Edge-Preserving CoT Condensation Jinghan Jia Hadi Reisizadeh Chongyu Fan Nathalie Baracaldo Mingyi Hong Sijia Liu Abstract Large language models (LLMs) have shown remarkable reasoning capabilities when trained with chain-of-thought (CoT) supervision. However, the long and verbose CoT traces, especially those distilled from large reasoning models (LRMs) such as DeepSeek-R1, significantly increase training costs during the distillation process, where a non-reasoning base model is taught to replicate the reasoning behavior of an LRM. In this work, we study the problem of CoT condensation for resource-efficient reasoning training, aimed at pruning intermediate reasoning steps ( i.e. , thoughts) in CoT traces, enabling supervised model training on length-reduced CoT data while preserving both answer accuracy and the model’s ability to generate coherent reasoning. Our rationale is that CoT traces typically follow a three-stage structure: problem understanding, exploration, and solution convergence. Through empirical analysis, we find that retaining the structure of the reasoning trace, especially the early stage of problem understanding (rich in reflective cues) and the final stage of solution convergence (which closely relates to the final answer), is sufficient to achieve lossless reasoning supervision. To this end, we propose an E dge- P reserv i ng C ondensation method, EPiC , which selectively retains only the initial and final segments of each CoT trace while discarding the middle portion. This design draws an analogy to preserving the “edge” of a reasoning trajectory, capturing both the initial problem framing and the final answer synthesis, to maintain logical continuity. Experiments across multiple model families (Qwen and LLaMA) and benchmarks show that EPiC reduces training time by over 34% while achieving lossless reasoning accuracy on Math500 , comparable to full CoT supervision. To the best of our knowledge, this is the first study to explore thought-level CoT condensation for efficient reasoning model distillation. Codes are available at https://github.com/OPTML-Group/EPiC . 1 Introduction Large language models (LLMs) have demonstrated strong performance on complex reasoning tasks, especially when trained with chain-of-thought (CoT) supervision [ 1 , 2 , 3 ] . CoT training encourages models to generate step-by-step intermediate reasoning before producing a final answer, enhancing both interpretability and task performance in domains such as mathematics [ 4 ] and science [ 5 ] . More recently, large reasoning models (LRMs) such as DeepSeek-R1 [ 3 ] , OpenAI-O1 [ 4 ] , and Kimi [ 6 ] have pushed this paradigm further by generating rich CoT traces infused with self-reflection, verification, and backtracking, e.g. , acquired via reinforcement learning. These LRMs have enabled a new training pipeline: Their reasoning ability can be distilled into smaller LLMs via supervised fine-tuning (SFT) on LRM-generated CoT data [ 3 , 7 , 8 , 9 , 10 ] . Throughout this paper, we refer to training (non-reasoning) LLMs with CoT supervision (for reasoning enhancement) as reasoning training . However, despite their quality, LRM-generated CoT traces are often excessively verbose and suffer from overthinking , a tendency to include repetitive or speculative reasoning steps that inflate sequence length without improving final answer accuracy [ 11 , 12 ] . This verbosity leads to two key issues: (1) high computational cost during SFT, and (2) reduced supervision quality due to noise, particularly in the middle of the trace where speculative exploration dominates. These observations raise a central question: Are all reasoning steps equally important for reasoning training? Figure 1: Overview of EPiC. Left: EPiC removes the middle portion of CoT while preserving the head (problem understanding) and tail (solution convergence). EPiC applies to training data in OpenR1Math. Right: Performance and training time comparison between EPiC and full CoT training based on Qwen2.5-Math-7B-Instruct . At 50% condensation ratio, EPiC achieves competitive accuracy with 1.5× faster training. In this work, we propose E dge- P reserv i ng C ondensation (EPiC), a simple yet effective thought-level pruning method that retains the head and tail segments of each CoT trace, corresponding to problem understanding and solution convergence, while removing only the middle portion of the reasoning trajectory. As illustrated in Figure 1 (left) , EPiC targets the overgenerated middle stage, preserving the structural and semantic integrity of the reasoning process. As shown in Figure 1 (right) , EPiC enables models to achieve competitive reasoning accuracy while reducing training time by 1.5× compared to full-trace fine-tuning. To better understand which segments of a CoT trace are most critical for reasoning supervision, we conduct a mutual information (MI) analysis between individual segments and the full reasoning trace. We find that the portions selected by EPiC consistently exhibit the highest MI with the complete trace, supporting our empirical finding that the middle segment is the least informative (and often the noisiest) part of the reasoning trajectory. These findings motivate EPiC as a principled and efficient strategy for CoT data-based reasoning training. Our contributions are summarized as follows: \bullet We introduce the first framework EPiC to perform thought-level condensation during training , enabling efficient reasoning distillation by pruning uninformative steps within CoT traces. \bullet We provide a series of analyses, including thought landscape visualization, mutual information analysis, and CoT perturbation studies, to quantify informativeness across CoT segments and validate the effectiveness of EPiC. \bullet We conduct extensive experiments across two CoT training datasets (OpenR1Math and GeneralThought), three reasoning benchmarks (MATH500, AIME24, and GPQA-Diamond), and multiple non-reasoning model initializations ( Qwen2.5-Math-7B-Instruct , Qwen2.5-7B-Instruct , and LLaMA3.1-8B-Instruct ). Our results show that EPiC consistently achieves final answer accuracy comparable or better than full CoT supervision, while significantly reducing training time. 2 Related Work Model distillation for LRMs. CoT prompting has been shown to significantly improve the reasoning capabilities of large language models (LLMs) [ 1 ] , motivating a line of work that seeks to build LRMs through CoT-style data construction [ 13 , 14 , 15 ] . With the emergence of strong LRMs such as OpenAI-O1 [ 4 ] , DeepSeek-R1 [ 3 ] , and Kimi-1.5 [ 6 ] , which can autonomously generate long and structured CoT traces, including self-reflection, verification, and backtracking, researchers have increasingly focused on distilling such behaviors into smaller models. Guo et al. 2025 was among the first to demonstrate that the reasoning capabilities of LRMs can be effectively transferred to smaller models through SFT. Building on this insight, numerous works have explored distillation from LRM-generated CoT data to improve reasoning performance in smaller LLMs [ 8 , 9 , 10 , 7 , 16 , 17 , 18 , 19 , 20 , 21 , 22 ] . These works can be broadly grouped into two categories: (1) distillation via high-quality, long-form CoT traces generated from LRMs [ 8 , 9 , 10 , 7 , 16 , 17 , 18 , 20 , 21 ] ; and (2) alignment-based approaches that directly supervise logits [ 19 ] . A complementary direction, explored by Ji et al. 2025 , proposes a hybrid strategy that uses truncated CoT prefixes with a small portion of full traces for efficient distillation. While prior work has successfully leveraged LRM-generated traces for performance improvement, only a few efforts [ 9 , 10 ] have addressed the efficiency bottlenecks in CoT distillation. These works focus on reducing the number of

Read the complete text