VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model
Wenhao Li, Xiu Su, Yichao Cao, Hongyan Xu, Xiaobo Xia, Shan You, Yi Chen, Chang Xu · 2026
Read VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model by Wenhao Li, Xiu Su, Yichao Cao, Hongyan Xu, Xiaobo Xia, Shan You, Yi Chen, Chang Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01194.txt.
Introduction
Wenhao Li and seven co-authors introduce VLA-ATTC, a framework that gives vision-language-action robot models adaptive test-time compute. Such models decide through a fast, instinctive process without pausing to think, which can lead to suboptimal or catastrophic actions in complex or unclear scenes. An uncertainty-based cognitive clutch switches the system from reflexive running to a thinking phase when necessary.
During that phase, a Relative Action Critic identifies the best action from generated candidates through pairwise comparisons. That replaces unstable absolute value estimation and simplifies learning. An efficient sampling strategy amortizes cost, and an automated pipeline curates preference pairs without manual annotation. On a long-horizon manipulation benchmark, it cuts the failure rate of a leading model by more than half.
Catalog record
| CREATOR | Wenhao Li, Xiu Su, Yichao Cao, Hongyan Xu, Xiaobo Xia, Shan You, Yi Chen, Chang Xu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.01194
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model Wenhao Li, Xiu Su, Yichao Cao, Hongyan Xu, Xiaobo Xia, Shan You, Yi Chen, Chang Xu Abstract Vision-Language-Action (VLA) models have demonstrated remarkable capabilities and generalization in embodied manipulation. However, their decision-making relies on a fast, instinctive process that lacks deliberation. This strategy often leads to suboptimal or catastrophic actions when facing complex or ambiguous scenarios that require greater consideration. In this paper, we introduce VLA-ATTC , a framework that endows VLA models with adaptive test-time compute (TTC). VLA-ATTC employs an uncertainty-based “cognitive clutch” to dynamically transition from reflexive execution to a TTC deliberation phase when necessary. During TTC phase, a novel Relative Action Critic (RAC) model identifies the optimal action from generated candidates via pairwise comparisons. This relative mechanism replaces unstable absolute value estimation, significantly simplifying the learning objective. Furthermore, we introduce an efficient sampling strategy to amortize computational costs and an automated data pipeline that curates preference pairs without manual annotation. On the LIBERO-LONG benchmark, VLA-ATTC reduces the failure rate of the SOTA model PI0.5 by over 50%. Figure 1 : Performance overview and efficiency comparison. 1 Introduction The advent of VLA models ( 37 ; 2 ; 11 ; 34 ; 10 ; 16 ; 50 ; 48 ; 51 ; 17 ; 18 ) marks a significant milestone in Embodied AI ( 25 ; 31 ; 26 ; 5 ; 7 ; 6 ; 20 ; 21 ; 4 ; 14 ; 15 ; 36 ) . By leveraging the vast world knowledge embedded in pre-trained backbones ( 40 ; 54 ; 19 ) , these models have demonstrated impressive generalization capability across diverse complex manipulation tasks. However, their decision-making is governed by a fast, intuitive inference process ( 49 ) . While this fast, intuitive strategy is sufficient for simple scenarios, it often leads to suboptimal or even catastrophic failures when facing complex or ambiguous situations that require deeper deliberation. This capability gap raises a fundamental question: How can we endow VLA models with a powerful deliberation process, enabling them to evolve from fast, intuitive System 1 reasoning to the more considerate inference of System 2? Figure 2 : Comparison of VLA inference paradigms. (a) Standard Inference is fast but prone to failure in complex scenarios. (b) Sequential Deliberation needs costly retraining and data annotation. (c) Existing Parallel Deliberation incurs high costs and relies on unstable absolute scoring. (d) VLA-ATTC triggers deliberation only on hard situations, employing RAC model for robust candidate selection. Conceptually, deliberation can be classified into sequential and parallel paradigms ( 28 ; 56 ; 13 ; 9 ; 55 ) . Sequential approaches ( 27 ; 45 ) , such as Chain-of-Thought (CoT) ( 44 ; 47 ; 3 ; 52 ) , have seen some exploration in VLA models ( 58 ; 24 ; 1 ; 60 ; 59 ; 35 ; 22 ) . However, these methods impose significant overhead, necessitating costly fine-tuning, laborious CoT data annotation, and often degrading action performance by forcing action-centric models to generate text reasoning. In contrast, parallel deliberation strategies ( 33 ; 57 ; 46 ; 42 ; 41 ) —wherein the model generates a set of candidates and deliberates to select the one with the highest value—align better with the nature of embodied decision-making. However, its exploration in VLA models remains nascent. Some works attempt ( 12 ; 29 ) to employ a large-scale external critic model to select the best action from large number of candidates, while others ( 8 ) utilize a world model to guide exploration in a Monte Carlo Tree Search-like pattern. Although pioneering, these approaches apply deliberation to all scenarios indiscriminately and their deliberation processes are prohibitively costly, rendering them impractical for real-world application. This highlights that practical parallel deliberation methods for VLA models must address three critical challenges: i) quantifying situational difficulty for adaptive deliberation ; ii) minimizing the computational overhead of multi-action sampling ; and iii) designing a lightweight yet high-fidelity action critic model. To address these challenges, we introduce VLA-ATTC, a framework that equips VLA models with adaptive test-time deliberation without modifying the base model. VLA-ATTC incorporates a “cognitive clutch” that monitors uncertainty in the base VLA’s generation, triggering TTC deliberation phase only when necessary. During TTC phase, we mitigate candidates sampling costs via an efficient parallel strategy that amortizes vision-language computation. To solve the evaluation bottleneck, we propose a lightweight yet highly accurate relative critic model. This model shifts from predicting an absolute score to making a relative comparison—asking “Is action A preferable to action B?”—dramatically reduces the training difficulty and the required capacity of the evaluation model. Finally, to ensure scalability, we introduce an automated pipeline that curates high-quality preference pairs from existing manipulation datasets, eliminating the need for manual annotation. To sum up, our contributions are as follows: • We propose VLA-ATTC, a plug-and-play framework that enables VLA models to adaptively trigger an efficient test-time deliberation phase in uncertain scenarios, requiring no fine-tuning of the base model. • We design a lightweight yet robust RAC model, which identifies optimal actions via iterative pairwise comparisons, overcoming the accuracy and efficiency bottlenecks of prior parallel deliberation methods. • We develop a fully automated data pipeline that curates high-quality preference pairs directly from existing datasets, bypassing laborious manual data collection. • Extensive experiments demonstrate that VLA-ATTC reduces LIBERO-LONG’s SOTA failure rate by over 50% and boosts real-world success by 17.3% while maintaining a practical 20.8 Hz control frequency. Conflict of Interest Disclosure None. 2 Related Work Sequential Deliberation in VLA models. Early approaches like ECoT ( 53 ) , CoT-VLA ( 58 ) , RoboMamba ( 24 ) and PI0.5 ( 1 ) output predefined, structured information, such as sub-task decompositions, before an action. Subsequent works like ChatVLA ( 60 ) , ChatVLA2 ( 59 ) , Hume ( 35 ) , and OneTwoVLA ( 22 ) moved towards generating more adaptive, free-form natural language thoughts. However, all approaches demand costly fine-tuning to adapt the VLA for the auxiliary task of reasoning. Furthermore, they possess a conflict between the optimization of text and action. Parallel Deliberation in VLA models. Parallel deliberation typically employs Best-of-N sampling ( 33 ; 57 ; 46 ; 39 ; 38 ; 30 ) or Self-Consistency ( 42 ; 41 ; 32 ; 43 ) . For VLAs, one direction ( 8 ) uses a world model to guide Monte Carlo Tree Search, but is hampered by the immense computational cost and the limited fidelity of world models in real-world scenarios. Others ( 12 ; 29 ) sample numerous action candidates and use a large external critic model for selection. However, their indiscriminate deliberation is costly, and the absolute action scoring is unstable. 3 Preliminaries: VLA Inference Paradigm Contemporary VLA models, such as PI0 ( 1 ) , typically operate in a two-stage inference process. Given a multi-modal observation at timestep t , comprising an image I_{t} and a language instruction T , the process is as follows: Vision-Language Encoding: A high-capacity, pre-trained VLM backbone, \Phi_{VLM} , processes the inputs to produce a rich, multi-modal context embedding or inner features, C_{t} : C_{t}=\Phi_{VLM}(I_{t},T)\in\mathbb{R}^{L\times D_{\mathrm{emb}}} (1) This context C_{t}