SynAdapt : Learning Adaptive Reasoning in Large Language Models via Synthetic Continuous Chain-of-Thought

Jianwei Wang, Ziming Wu, Fuming Lai, ShaobingLian, Ziqian Zeng · 2025

Read SynAdapt : Learning Adaptive Reasoning in Large Language Models via Synthetic Continuous Chain-of-Thought by Jianwei Wang, Ziming Wu, Fuming Lai, ShaobingLian, Ziqian Zeng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00574.txt.

Introduction

Chain-of-thought reasoning helps large language models solve hard problems, but writing out each step as text costs time. Continuous chain-of-thought reasons in a hidden form instead, yet earlier versions were trained in indirect ways that gave weak or shifting targets. Wang and co-authors propose SynAdapt, a framework that builds synthetic continuous reasoning traces. The model then learns from those traces as a clear, direct target.

Training on the synthetic traces teaches the model to reach exact answers through hidden reasoning alone. For questions too hard for that route, SynAdapt adds a difficulty classifier. The classifier reads the question and the hidden trace, flags the hard cases, and prompts the model to think again in the normal written way. Tests across benchmarks of varied difficulty showed the best balance of accuracy and speed among the methods compared.

Catalog record

CREATORJianwei Wang, Ziming Wu, Fuming Lai, ShaobingLian, Ziqian Zeng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-00574

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SynAdapt : Learning Adaptive Reasoning in Large Language Models via Synthetic Continuous Chain-of-Thought Jianwei Wang, Ziming Wu, Fuming Lai, ShaobingLian, Ziqian Zeng Abstract While Chain-of-Thought (CoT) reasoning improves model performance, it incurs significant time costs due to the generation of discrete CoT tokens (DCoT). Continuous CoT (CCoT) offers a more efficient alternative, but existing CCoT methods are hampered by indirect fine-tuning, limited alignment, or inconsistent targets. To overcome these limitations, we propose SynAdapt , an innovative efficient reasoning framework. Specifically, SynAdapt generates the synthetic CCoT to serve as a precise and effective alignment target for LLMs. This synthetic CCoT explicitly guides the LLM to learn CCoT and derive accurate answers directly. Furthermore, relying solely on CCoT is insufficient for solving hard questions. To address this, SynAdapt integrates a difficulty classifier that leverages both question context and CCoT to identify hard questions. CCoT can effectively help identify hard questions after some brief reasoning. We then adaptively prompt the LLM to re-think these hard questions for improved performance. Extensive experimental results across various benchmarks from different difficulty levels strongly demonstrate the effectiveness of our method, achieving the best accuracy-efficiency trade-off. 1 Introduction Chain-of-Thought (CoT) reasoning ( Kojima et al. 2022 ; Wei et al. 2022 ; Zhou et al. 2022 ) has shown remarkable potential in enhancing the problem-solving capabilities of Large Language Models (LLMs) for complex tasks ( Guo et al. 2025 ; Yang et al. 2025 ; OpenAI 2025 ) . By decomposing problems into sequential steps, CoT allows LLMs to derive correct answers step-by-step. However, a major drawback of CoT is its high computational cost due to the generation of numerous tokens, leading to substantial time consumption ( Yu et al. 2024 ; Yeo et al. 2025 ) . While this cost is often acceptable in accuracy-sensitive scenarios , such as AI for Science (AI4S) ( Lu et al. 2024 ) where accuracy is paramount, it becomes problematic in efficiency-sensitive scenarios . For instance, in embodied intelligence, real-time human-computer interaction necessitates highly efficient reasoning to ensure a satisfactory user experience ( Li et al. 2024a ) . Consequently, a critical challenge emerges: how to reduce the length of generated CoT while preserving its effective reasoning capabilities Figure 1: Comparisons between our SynAdapt and the other CCoT-based baselines. These baselines either train CCoT indirectly, provide only single-position alignment, or apply full alignment with incoherent targets. Existing efficient reasoning approaches mainly involve fine-tuning or direct prompting LLMs to reduce the number of COT steps ( Arora and Zanette 2025 ; Munkhbat et al. 2025 ; Xu et al. 2025a ) . However, the remaining CoT steps still involve numerous discrete natural language tokens, which we refer to as DCoT . As noted by Li et al. 2024b and Lin et al. 2024 , most of these verbalized tokens are mainly for communication and carry unnecessary linguistic details that do not contribute to the core reasoning process. One promising approach is fine-tuning LLM to replace DCoT with a more compact and continuous CoT representation, known as CCoT . ( Pfau, Merrill, and Bowman 2024 ; Goyal et al. 2023 ) . During reasoning, CCoT retains the hidden state of the LLM and skips generating one-hot token ID, allowing it to store more information than just a single token ( Zhu et al. 2025 ) . Nonetheless, fine-tuning LLM to learn CCoT reasoning effectively remains challenging. Coconut ( Hao et al. 2024 ) gradually fine-tunes the LLM to replace DCoT with CCoT using a curriculum learning strategy ( Deng, Choi, and Shieber 2024 ) . However, as shown in Figure 1 , it lacks explicit alignment between DCoT and CCoT, which limits its ability to effectively learn from the original DCoT. CODI ( Shen et al. 2025b ) introduces explicit alignment between the last token hidden state of DCoT and the final hidden state of CCoT but ignores alignment for other intermediate tokens. CompressCoT ( Cheng and Van Durme 2024 ) attempts to identify a subset of important tokens from DCoT, whose length matches CCoT, and aligns the full CCoT with the hidden states of these tokens. However, selecting only several isolated DCoT tokens leads to incoherence in the reasoning process. This leads to significant performance degradation in CCoT learning. To overcome these limitations, we propose a novel efficient reasoning framework called SynAdapt , which helps LLM learn Adapt ive reasoning through Syn thetic CCoT. Our approach begins by generating a synthetic CCoT to serve as a comprehensive alignment target. Specifically, we initialize a random CCoT, fix the LLM, and iteratively optimize the random CCoT into a synthetic CCoT to guide LLM towards correct answers. The synthetic CCoT thereby serves as a better alignment target than only using several isolated and incoherent tokens from the original DCoT. During fine-tuning, we apply the full alignment using the synthetic CCoT, as shown by Figure 1 . This strategy helps LLM learn the full CCoT rather than only the last one. Notably, we fine-tune the LLM to iteratively refine a meaningless draft to obtain the CCoT, rather than generating CCoT autoregressively. This approach is more efficient ( Jiang et al. 2025 ) and can boosts the reasoning ability of LLM by iterative refinement ( Saunshi et al. 2025 ; Yu et al. 2025 ) . Moreover, according to the information theory ( Nalewajski 2011 ) , compressing DCoT into the dense CCoT inevitably leads to information loss and increases the complexity of solving hard questions ( Koehn and Knowles 2017 ) . We provide an example in Figure 5 of Appendix. To address this, we train a difficulty classifier that assesses question difficulty based on both the question itself and the CCoT. And then prompt the LLM to re-think hard questions using discrete CoT tokens for improved accuracy. While CCoT may not be sufficient to solve these hard questions, it can help the classifier effectively identify them. Some hard questions resemble simpler ones and can only be distinguished through the brief reasoning captured by CCoT. We also present an illustrative example in Figure 6 of Appendix. We evaluate our method across various benchmarks with different difficulty levels, including GSM8K, MATH500, AMC23, AIME24, and AIME25. By dynamically adjusting the ratio of re-think hard questions, our method demonstrates adaptability in both accuracy-sensitive and efficiency-sensitive scenarios. Comprehensive experimental results demonstrate that our method outperforms other baselines in both scenarios, achieving an optimal accuracy-efficiency trade-off. We also evaluate the identification performance of our difficulty classifier, showing its superior performance compared to other baselines. The main contributions of this paper are as follows: • We propose a novel efficient reasoning framework that generates synthetic CCoT, providing a better full alignment target to help LLMs learn CCoT more effectively. • We introduce a difficulty classifier that more effectively distinguishes hard questions by considering both the question and the CCoT, enabling adaptive re-thinking for improved accuracy. • The experimental results strongly demonstrate the effectiveness of our framework, achieving the best accuracy-efficiency trade-off. 2 Related Work In this section, we introduce the mainstream related work on efficient reasoning in the LLMs, which can be mainly categorized into three types: SFT-based methods, RL-based methods, Prompt-based methods, and CCoT-based methods. SFT-based methods either discard the CoT

Read the complete text