LaST 0 : Latent Spatio-Temporal Chain-of-Thought for Robotic Vision-Language-Action Model
2026
Read LaST 0 : Latent Spatio-Temporal Chain-of-Thought for Robotic Vision-Language-Action Model (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05248.txt.
Introduction
Zhuoyang Liu and 13 co-authors give robot world models a hushed form of step-by-step thought in a 2026 paper. Such models tie what a robot sees and is told to what it does next. Spelled-out thought can help them. So can a guess at the next view. But words and shots both cost time ere a move, and robot work can not spare that time. Words also fail to catch facts of the touch-and-push world that are hard to say.
Their frame, LaST0, thinks in the model's own code space, in a chain that tracks both place and time. The chain does its work with no words to write and no shots to draw. That cuts the lag, and it frees thought from the word trap. Swift, rich thought of this kind could let robots work through mess and change at the pace real tasks demand.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-05248
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LaST 0 : Latent Spatio-Temporal Chain-of-Thought for Robotic Vision-Language-Action Model Abstract Vision-Language-Action (VLA) models have recently shown strong generalization, with some approaches seeking to explicitly generate linguistic reasoning traces or predict future observations prior to execution. However, explicit reasoning typically incurs non-negligible inference latency, which constrains the temporal resolution required for robotic manipulation. Moreover, such reasoning is confined to the linguistic space, imposing a representational bottleneck that struggles to faithfully capture ineffable physical attributes. To mitigate these limitations, we propose LaST 0 , a framework that enables efficient reasoning before acting through a Latent Spatio-Temporal Chain-of-Thought (CoT), capturing fine-grained physical and robotic dynamics that are often difficult to verbalize. Specifically, we introduce a token-efficient latent CoT space that models future visual dynamics, 3D structural information, and robot proprioceptive states, and further extends these representations across time to enable temporally consistent implicit reasoning trajectories. Furthermore, LaST 0 adopts a dual-system architecture implemented via a Mixture-of-Transformers design, where a reasoning expert conducts low-frequency latent inference and an acting expert generates high-frequency actions conditioned on robotics-oriented latent representations. To facilitate coordination, LaST 0 is trained with heterogeneous operation frequencies, enabling adaptive switching during deployment. Across 10 real-world tasks spanning tabletop, mobile, and dexterous hand manipulation, LaST 0 improves mean success rates by 13%, 14% and 14% over prior SOTA VLA methods, respectively. Zhuoyang Liu {}^{*\text{ }1,2,4} , Jiaming Liu {}^{*\text{ }\dagger\text{ }1,4} , Hao Chen {}^{*\text{ }3,4} , Jiale Yu 1 , Ziyu Guo 3 , Chengkai Hou 1,2 , Chenyang Gu 1 , Xiangju Mi 1 , Renrui Zhang 3 , Kun Wu 2 , Zhengping Che {}^{\dagger\text{ }2} , Jian Tang 2 , Pheng-Ann Heng 3 , Shanghang Zhang {}^{\text{\Letter}\text{ }1} 1 State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University 2 Beijing Innovation Center of Humanoid Robotics 3 CUHK 4 Simplexity Robotics Project page: https://vla-last0.github.io/ ∗ Equal Contribution † Project Lead {}^{\text{\Letter}} Corresponding Author \icml@noticeprintedtrue Figure 1 : Overview. (a) Unlike previous VLA methods that explicitly generate linguistic reasoning traces or future visual observations, (b) we propose LaST 0 , a framework that enables efficient reasoning before acting through a Latent Spatio-Temporal CoT. This latent CoT captures multimodal physical and robotic dynamics that are difficult to verbalize and propagates them over time to form temporally consistent reasoning. LaST 0 achieves SOTA performance across a wide range of tasks while enabling more efficient model inference. 1 Introduction By inheriting the semantic understanding and common-sense reasoning capabilities of Vision-Language Models (VLMs) ( 1 ; 36 ; 19 ) , Vision-Language-Action (VLA) models integrate rich pretrained knowledge with the low-level control capabilities of robotic policies ( 6 ; 5 ; 32 ) . This integration endows robotic agents with a unified framework for interpreting human instructions and executing corresponding manipulation primitives in dynamic environments. Rather than simply mapping observations to actions, recent advances in VLA models have been inspired by the Chain-of-Thought (CoT) reasoning paradigm in general VLMs ( 27 ) . In this line of work, some approaches enhance manipulation stability and interpretability by explicitly generating linguistic reasoning traces or affordance representations ( 77 ; 41 ) . In parallel, other studies seek to capture environmental dynamics by predicting future states ( 65 ; 81 ; 69 ; 82 ) . Despite their demonstrated benefits, explicit CoT VLA methods remain constrained by two fundamental challenges in robotic manipulation. On the one hand , explicit reasoning typically incurs non-negligible inference latency. The autoregressive generation paradigm introduces inevitable computational overhead ( 64 ; 68 ) , limiting the VLA model’s ability to achieve real-time responsiveness. This latency further restricts VLA models from reasoning effectively along the temporal dimension, thereby undermining the temporal consistency required for closed-loop manipulation. On the other hand , explicit reasoning is often confined to the linguistic space, imposing a representational bottleneck that struggles to faithfully capture ineffable physical attributes. In contrast, robotic agents must reason about and interact with the physical world, which is essential for robust manipulation in a dynamic environment. In this paper, we propose LaST 0 , a dual-system VLA model that enables efficient reason-before-act behavior through a La tent S patio- T emporal Chain-of-Thought (CoT). As shown in Fig. 1 , unlike prior explicit CoT-based VLA methods, LaST 0 performs reasoning in a compact latent space, enabling the capture of fine-grained physical and robotic dynamics that are difficult to verbalize, while supporting temporally coherent modeling. Specifically, we introduce a token-efficient latent CoT space that autoregressively predicts future latent tokens of 2D images, 3D point clouds, and proprioceptive states. As a result, the VLA model can implicitly model the semantic and geometric structure of physical dynamics, while forming an internal representation of the robot state, thereby capturing the relationship between the robot and its interactive environment. Meanwhile, the latent CoT space is extended across future keyframes, enabling temporally consistent causal reasoning, which improves action coherence in closed-loop robotic manipulation. Although the proposed latent CoT is compact and encodes richer physical information, incorporating it into action generation still introduces additional inference overhead. Therefore, leveraging temporally extended latent conditions, we further propose a dual-system architecture implemented via a Mixture-of-Transformers (MoT) design. Specifically, two experts are integrated within a single VLA model: a slow reasoning expert, which performs low-frequency latent inference to capture spatio-temporal dependencies, and a fast acting expert, which generates actions conditioned on high-frequency observations and periodically updated latent representations. Through shared self-attention mechanisms, LaST 0 enables long-context interaction between the latent CoT space and the action space, thereby effectively coordinating deliberative reasoning with responsive control. For the training procedure, both the latent reasoning expert and the action expert are initialized from the same pretrained VLM (i.e., Janus-Pro ( 13 ) ). We then perform large-scale pretraining of LaST 0 on diverse robotic manipulation datasets ( 56 ; 37 ; 74 ; 30 ) , ensuring seamless interaction between the two experts within a unified VLA model. During downstream training, we jointly optimize the two experts, with the action expert trained under heterogeneous fast-slow operating ratios, enabling the VLA model to adaptively select appropriate execution frequencies during deployment. For evaluation, we systematically assess LaST 0 on 10 simulated tasks and 10 complex real-world tasks spanning tabletop single- and dual-arm, mobile, and dexterous hand manipulation, where it outperforms prior SOTA VLA methods by 8% in simulation and by 13%, 14%, and 14% across three real-world scenarios, respectively, while achieving a 14× speedup over previous explicit CoT VLA approaches. In addition, we validate the manipulation capability of LaST 0 on long-horizon real-world tasks, such as repeatedly scooping eggs from a pan while adapting to dynamic environmental changes. Our contributions are summarized as follows: • We propose LaST 0 , a unified VLA model that enables efficient reason-before-act behavior through a La tent S patio- T emporal CoT, performing reasoning in a compact latent space to capture fine-grained physical and robotic dynamics that are difficult to verbalize. • We design a spatio-temporal latent CoT space, which autoregressively models future semantic, geometric, and proprioceptive information, allowing LaST 0 to reason about physical dynamics in a temporally coherent manner. • We introduce a dual system VLA architecture, implemented via MoT scheme, that coordinates low-frequency latent reasoning with high-frequency action