Learning to Stop Overthinking at Test Time
Hieu Tran Bao, Nguyen Cong Dat, Nguyen Duc Anh, Hoang Thanh-Tung · 2025
Read Learning to Stop Overthinking at Test Time by Hieu Tran Bao, Nguyen Cong Dat, Nguyen Duc Anh, Hoang Thanh-Tung (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-10954.txt.
Introduction
Hieu Tran Bao and co-authors tackle a waste in deep thinking models: they spend the same large effort on easy and hard test items alike. Their 2025 paper notes that extra test time work can even hurt results, a problem the authors call overthinking. The root cause is that the models cannot judge how hard a given item is.
The team offers a test time training method that finds the right amount of work for each item. They also build Conv-LiGRU, a new recurrent design for visual reasoning tasks. In their tests the design proved more stable than deep thinking models, cut the overthinking effect, and reached higher accuracy at the same time.
Catalog record
| CREATOR | Hieu Tran Bao, Nguyen Cong Dat, Nguyen Duc Anh, Hoang Thanh-Tung |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-10954
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning to Stop Overthinking at Test Time Hieu Tran Bao, Nguyen Cong Dat, Nguyen Duc Anh, Hoang Thanh-Tung Abstract Test time scaling is currently one of the most active research areas that shows promise after training time scaling has reached its limits. Deep-thinking (DT) models are a class of recurrent models that can perform easy-to-hard generalization by assigning more compute to harder test samples. However, due to their inability to determine the complexity of a test sample, DT models have to use a large amount of computation for both easy and hard test samples. Excessive test time computation is wasteful and can cause the “overthinking” problem where more test time computation leads to worse results. In this paper, we introduce a test time training method for determining the optimal amount of computation needed for each sample during test time. We also propose Conv-LiGRU, a novel recurrent architecture for efficient and robust visual reasoning. Extensive experiments demonstrate that Conv-LiGRU is more stable than DT, effectively mitigates the “overthinking” phenomenon, and achieves superior accuracy. 1]FPT IS AI R&D Center, Ha Noi, Viet Nam 2]FPT Software AI Center, Ha Noi, Viet Nam 3]Kaopiz Solutions, Ha Noi, Viet Nam 4]VNU - University of Engineering and Technology, Ha Noi, Viet Nam 1 Introduction Recurrent Neural Networks (RNNs) have proven to be highly effective in tackling machine reasoning tasks, demonstrating remarkable capability to manage problems of different complexity levels within a single task [ Orvieto et al., 2023 , De et al., 2024 , Beck et al., 2024 ] . However, traditional RNNs struggle to autonomously generalize to more complex problems beyond those encountered during training. RNN’s sequential architecture and limited memory capacity hinder parallel training and scalability, causing them to fall behind Transformers. Despite extensive research on the reasoning capabilities of recurrent models, they are mainly used for simple sequence processing tasks like prefix sum or sequence copying. Some studies [ Eyzaguirre and Soto, 2020 , Veerabadran et al., 2024 ] explored their use in visual reasoning but focus on time-dependent tasks like maze-solving or chess. Static environments without explicit reasoning steps like object recognition, remain underexplored. Recent studies in vision-language reasoning have sought to integrate visual understanding into large language models (LLMs) [ Lin et al., 2024 , Wang et al., 2024 ] . To enhance reasoning capability, these models employ Chain-of-Thought (CoT), generating step-by-step demonstrations of images, similar to methods used in LLMs [ Dong et al., 2024 , Thawakar et al., 2025 ] . However, such approaches often overlook the models’ robustness to low-quality and noisy images. Training solely on curated datasets makes them highly vulnerable to inappropriate prompts. Furthermore, the discrete nature of language-based and tree-based reasoning models could lead to exponential complexity as the models try to imitate discrete search algorithms like DFS, BFS, and A ∗ [ Lehnert et al., 2024 , Yao et al., 2023 ] In contrast, studies on latent language models have revealed promising signs of enhanced robustness [ Hao et al., 2024 ] , and the efficacy of inference in latent space has been confirmed in other fields [ Rombach et al., 2022 , Radford et al., 2021 , Brooks et al., 2024 ] . disable disable todo: disable More on: Why is this an important problem? What are the new challenges this problem introduces? Why is it beneficial to study this problem in parallel with language reasoning? Evidence of humans doing both latent and language reasoning. The advantages of latent reasoning. Can robust latent OOD generalization benefit reasoning/systematic generalization? In this study, we take the first steps toward exploring the reasoning capabilities of visual recurrent models in latent space, in parallel with CoT techniques in LLMs. Motivated by Deep Thinking [ Schwarzschild et al., 2021 , Bansal et al., 2022 ] , our proposed model can generalize to tackle more complex problems at test time simply by iterating its recurrent units more times and no additional training is needed. Our approach enables zero-shot extrapolation to more challenging environments within the same task. The ability to handle problems under various conditions enables the development of robust and adaptable models, which are crucial for real-world applications and have the potential to apply to LLMs. We explore the effectiveness of RNNs in object recognition tasks using the CIFAR10-C and CIFAR100-C [ Hendrycks and Dietterich, 2019 ] datasets. The key contributions of this study are: • We explore the extrapolation capabilities of recurrent model architectures for simple visual reasoning tasks, specifically object recognition. We demonstrate that recurrent models enable strong extrapolation while utilizing significantly fewer parameters compared to conventional feedforward networks. • We show that the early stopping heuristic in previous works—which forces the model to halt as soon as possible—limits the extrapolation capabilities of RNNs. To enhance performance, we propose using a self-supervised task to estimate the accuracy trend across iterations, allowing us to determine the optimal number of iterations for the main task. • We propose Conv-LiGRU, a novel recurrent model for effective and compute-optimal visual reasoning. • Extensive analysis and experiments show that Conv-LiGRU is more stable than Conv-GRU, better mitigates the ”overthinking” phenomenon, and achieves superior accuracy compared to previous methods. 2 Related Works Thinking in Language vs. Latent Space: Recent studies, most notably OpenAI-O1 OpenAI [2024] , have demonstrated that large language models (LLMs) can handle more complex tasks by thinking longer before answering in natural language. While it brings large language models closer to human-like thinking, this approach activates all layers at any time. Furthermore, its performance depends largely on the thought sequence’s length, making it challenging to perform more difficult tasks with fewer computations. Recently, Deepseek-R1 Guo et al. [2025] has utilized a fraction of the large model for inference, allowing adaptation to edge devices. In this study, we focus on implicit reasoning embedded within recurrent models. Reasoning in the latent space allows models to synthesize and refine instance interpretability, akin to a conventional deep model. Xu et al. [2024] extends the latent reasoning to In-Context Learning, showing greater robustness with a faster inference time. As opposed to CoT reasoning, Hao et al. [2024] demonstrates that the continuous space can represent multiple alternative reasoning steps, thereby significantly expanding the model’s search space. Test-time Training (TTT): Another line of work coinciding with ours is learning at test time by directly updating model parameters on test data without supervision. Previous work has shown that TTT is robust to distribution shifts [ Sun et al., 2020 , Gandelsman et al., 2022 ] , while Muennighoff et al. [2025] shows that a simple test-time training can beat OpenAI-O1 on the math question. The connection between the RNN update mechanisms, the attention mechanisms, and the TTT has been highlighted in Sun et al. [2024] , therefore a new TTT layer is proposed for the generation of long sequences. Our study leverages self-supervised tasks to estimate the optimal reasoning depth, improving the model’s computational efficiency and reasoning performance. Deep Thinking: Schwarzschild et al. [2021] demonstrated that recurrent models trained on simple tasks can generalize to harder ones simply by repeating a set of layers more times during testing. However, Bansal et al. [2022] identified the ”overthinking” problem, where longer inference time leads to worse performance. To mitigate