Fast-WAM: Do World Action Models Need Test-time Future Imagination?
Tianyuan Yuan, Zibin Dong, Yicheng Liu, Hang Zhao, [1ex] IIIS, Tsinghua University Galaxea AI https://yuantianyuan01.github.io/FastWAM/ · 2026
Read Fast-WAM: Do World Action Models Need Test-time Future Imagination? by Tianyuan Yuan, Zibin Dong, Yicheng Liu, Hang Zhao, [1ex] IIIS, Tsinghua University Galaxea AI https://yuantianyuan01.github.io/FastWAM/ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16666.txt.
Introduction
Yuan and co-authors ask if robot world models must imagine the future at test time. World action models foresee how scenes change under actions. Most versions imagine, then execute, which costs time. Their Fast-WAM keeps video co-training but skips test-time prediction. Variants split the two factors for a clean comparison. Dropping imagination barely hurt performance. Dropping video training hurt far more. Fast-WAM runs at 190 ms latency, over four times faster. Video's value lies in training, they conclude.
Catalog record
| CREATOR | Tianyuan Yuan, Zibin Dong, Yicheng Liu, Hang Zhao, [1ex] IIIS, Tsinghua University Galaxea AI https://yuantianyuan01.github.io/FastWAM/ |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35070 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.16666
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fast-WAM: Do World Action Models Need Test-time Future Imagination? Tianyuan Yuan, Zibin Dong, Yicheng Liu, Hang Zhao, [1ex] IIIS, Tsinghua University Galaxea AI https://yuantianyuan01.github.io/FastWAM/ Abstract World Action Models (WAMs) have emerged as a promising alternative to Vision-Language-Action (VLA) models for embodied control because they explicitly model how visual observations may evolve under action. Most existing WAMs follow an imagine-then-execute paradigm, incurring substantial test-time latency from iterative video denoising, yet it remains unclear whether explicit future imagination is actually necessary for strong action performance. In this paper, we ask whether WAMs need explicit future imagination at test time, or whether their benefit comes primarily from video modeling during training. We disentangle the role of video modeling during training from explicit future generation during inference by proposing Fast-WAM , a WAM architecture that retains video co-training during training but skips future prediction at test time. We further instantiate several Fast-WAM variants to enable a controlled comparison of these two factors. Across these variants, we find that Fast-WAM remains competitive with imagine-then-execute variants, while removing video co-training causes a much larger performance drop. Empirically, Fast-WAM achieves competitive results with state-of-the-art methods both on simulation benchmarks (LIBERO and RoboTwin) and real-world tasks, without embodied pretraining. It runs in real time with 190 ms latency, over 4 × \times faster than existing imagine-then-execute WAMs. These results suggest that the main value of video prediction in WAMs may lie in improving world representations during training rather than generating future observations at test time. 1 Introduction Building general-purpose embodied agents requires policies that can not only map visual observations to actions, but also reason about how the physical world evolves under interaction. This has motivated growing interest in World Action Models (WAMs), which combine future visual prediction and action modeling in a unified framework. Compared with standard Vision-Language-Action (VLA) models, WAMs are appealing because modeling future observations may help capture physical dynamics and task-relevant temporal structure. Most existing WAMs follow an imagine-then-execute paradigm: they first generate future observations, then predict actions conditioned on the imagined future. While intuitive, this design incurs substantial test-time latency due to iterative video denoising [ 23 , 19 , 17 , 31 , 2 ] . More fundamentally, it remains unclear whether explicit future imagination is actually necessary for strong action performance. The effectiveness of WAMs may stem from two distinct sources: (1) the video prediction objective during training, which may help the model acquire stronger physical priors and action-conditioned representations, and (2) explicit future generation during inference, which may provide additional foresight for action prediction. Existing WAM systems typically entangle these two factors, making it difficult to determine which one is actually responsible for the observed gains. In this paper, we revisit this design choice and ask a simple question: do WAMs need to imagine future observations at test time, or do they benefit primarily from learning to model them during training? Our key idea is to decouple the video prediction objective used in WAM training from explicit future generation at inference time. If the main value of world modeling lies in shaping better latent representations during training, then a WAM should be able to retain this benefit without paying the test-time cost of future video synthesis. Figure 1 : Three representative WAM paradigms. (A) Joint-modeling WAMs denoise future video and action tokens together. (B) Causal WAMs first generate future observations and then condition action prediction on the generated future representation. (C) Fast-WAM retains video co-training during training but removes explicit future generation at inference time, directly predicting actions from latent world representations in a single forward pass. Based on this perspective, we propose Fast-WAM , a WAM architecture that preserves video co-training during training but skips future prediction at test time. Instead of using a pretrained video generation model to iteratively synthesize future frames during inference, Fast-WAM repurposes a pretrained video Diffusion Transformer (DiT) as a single-pass world encoder for action generation. Concretely, we build Fast-WAM with a Mixture-of-Transformer (MoT) architecture with shared attention, consisting of a video DiT and an action expert DiT, as illustrated in Figure 1 (C). During training, the video prediction objective shapes the video DiT to encode physically meaningful motion and interaction structure. During inference, the video DiT processes the observation context in a single forward pass and provides latent world representations for action denoising, avoiding explicit future video denoising and enabling efficient real-time control. To study our central question in a controlled way, we instantiate Fast-WAM into variants that mirror representative imagine-then-execute WAM designs. For simplicity, we focus on single action chunk generation and omit the outer auto-regressive loop. As shown in Figure 1 , existing WAMs can be broadly grouped into two representative paradigms: (A) future videos and actions are jointly denoised with shared attention [ 31 , 37 , 2 ] ; and (B) actions are predicted after, and conditioned on, generated future videos [ 17 , 11 , 10 ] . We also implement a no-video-co-training variant, which serves as a direct control for the role of the training objective itself. Together, these controlled comparisons allow us to isolate the contribution of test-time future imagination from that of video co-training during training. Experiments on simulation benchmarks (LIBERO and RoboTwin) show that Fast-WAM achieves strong results without any embodied pretraining, demonstrating strong data efficiency. On real-world robotic tasks, Fast-WAM remains highly effective while running at only 190 ms latency, making it more than 4 \times faster than existing imagine-then-execute WAM approaches. More importantly, controlled comparisons show that Fast-WAM stays close to imagine-then-execute variants, while removing the video co-training objective causes a much larger performance drop. These results suggest that the main value of video prediction in WAMs may lie in improving world representations during training rather than in explicitly generating future observations at test time. Our contributions are three-fold: • We identify and study a basic question in WAMs: whether their gains come primarily from video modeling during training or from explicit future imagination during inference. • We propose Fast-WAM, a WAM architecture that retains video co-training during training while eliminating future prediction at test time, enabling real-time inference. • Through controlled comparisons on simulation and real-world benchmarks, including variants with and without video co-training, we show that much of the benefit of WAMs comes from the video co-training objective itself, while explicit future generation at inference time appears to be less critical than previously assumed. 2 Related Work Vision-Language-Action Policies. Recent progress in embodied foundation models has been driven by Vision-Language-Action (VLA) policies, which directly map visual observations and language instructions to robot actions using large pretrained vision-language backbones [ 16 , 4 , 13 , 3 , 38 , 22 , 5 , 24 , 26 , 25 , 28 ] . By inheriting strong semantic priors from web-scale pretraining, these models have shown strong generalization across objects, scenes, and language instructions. However, as noted in recent WAM work, standard VLA pretraining is largely based on static image-text data and does not explicitly model how the physical world evolves under action [ 17 , 31 ] . Our work is complementary to this line: Fast-WAM preserves a direct-policy interface at test time, similar to VLAs, but learns it under an