Mi nd Jou rn ey Test-Time Scaling with World Models for Spatial Reasoning
Yuncong Yang, Jiageng Liu, Zheyuan Zhang, Siyuan Zhou, Reuben Tan, Jianwei Yang, Yilun Du, Chuang Gan · 2025
Read Mi nd Jou rn ey Test-Time Scaling with World Models for Spatial Reasoning by Yuncong Yang, Jiageng Liu, Zheyuan Zhang, Siyuan Zhou, Reuben Tan, Jianwei Yang, Yilun Du, Chuang Gan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12508.txt.
Introduction
Yuncong Yang and co-authors gave vision-language models in 2025 a way to imagine new views before answering space questions. Such models read flat images well but stumble on how a scene would look after the viewer moves. Their frame, MindJourney, couples the model to a video world model. The language model sketches a short camera path, the world model renders each view, and the reasoner then works over the gathered views.
No retraining was needed. On a standard spatial test the pairing lifted scores by near eight points on average. It even beat models tuned by reinforcement for test-time thought. The team pitches world-model daydreaming as a plug-in route to firm 3D reasoning.
Catalog record
| CREATOR | Yuncong Yang, Jiageng Liu, Zheyuan Zhang, Siyuan Zhou, Reuben Tan, Jianwei Yang, Yilun Du, Chuang Gan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-12508
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mi nd Jou rn ey Test-Time Scaling with World Models for Spatial Reasoning Yuncong Yang, Jiageng Liu, Zheyuan Zhang, Siyuan Zhou, Reuben Tan, Jianwei Yang, Yilun Du, Chuang Gan Abstract Spatial reasoning in 3D space is central to human cognition and indispensable for embodied tasks such as navigation and manipulation. However, state-of-the-art vision–language models (VLMs) struggle frequently with tasks as simple as anticipating how a scene will look after an egocentric motion: they perceive 2D images but lack an internal model of 3D dynamics. We therefore propose MindJourney, a test-time scaling framework that grants a VLM with this missing capability by coupling it to a controllable world model based on video diffusion. The VLM iteratively sketches a concise camera trajectory, while the world model synthesizes the corresponding view at each step. The VLM then reasons over this multi-view evidence gathered during the interactive exploration. Without any fine-tuning, our MindJourney achieves over an average 8% performance boost on the representative spatial reasoning benchmark SAT, showing that pairing VLMs with world models for test-time scaling offers a simple, plug-and-play route to robust 3D reasoning. Meanwhile, our method also improves upon the test-time inference VLMs trained through reinforcement learning, which demonstrates the potential of our method that utilizes world models for test-time scaling. https://umass-embodied-agi.github.io/MindJourney/ 1 Introduction Humans inhabit—and effortlessly reason about—a three-dimensional world. Our innate 3D spatial understanding allows us to plan routes, manipulate objects, and make decisions in cluttered environments. Spatial intelligence is a fundamental component of human cognition, developing progressively throughout early life ( Gardner 2011 ; Vasilyeva and Lourenco 2012 ; Tommasi and Laeng 2012 ; Lohman 2013 ; Moore and Johnson 2020 ; Lauer and Lourenco 2016 ) . As such, reasoning underpins almost every physical task, and endowing embodied agents with comparable 3D intelligence has become a central goal of embodied AI research ( Koh et al. 2021 ; Koh et al. 2023 ; Yang et al. 2023 ; Wang et al. 2024b ; Du et al. 2024 ; Zhu et al. 2025a ) . Figure 1 : MindJourney. Given a spatial reasoning query, our method searches through the imagined 3D space through a world model and improves VLM’s spatial understanding through generated observations during test-time. Recent advances in vision–language models (VLMs) have produced systems that are already comparable to human performance in visual recognition and comprehension, even solving simple spatial-reasoning problems ( Chen et al. 2024a ; Zhang et al. 2025b ) . However, these models still fall short of reasoning about the actual 3D world that lies behind a 2D image as humans do. Recent spatial reasoning benchmarks ( Yang et al. 2024a ; Ray et al. 2025 ; Zhang et al. 2025b ; Zhang et al. 2025a ) reveal that VLMs struggle on tasks that require imagining the consequences of egocentric movements. Given a question shown in the upper-left corner of Fig. 1 , a state-of-the-art VLM easily fails on such a perspective-shift question, while given the same view, humans can solve it effortlessly by mentally simulating a short walk and visualizing the next view. This gap highlights a critical bottleneck: current VLMs do not yet treat an image as an interactive world, limiting their usefulness for embodied agents operating in 3D space. Encouragingly, recent controllable video diffusion models hint at a solution. Systems such as CamCtrl3D ( Popov et al. 2025 ) , CameraCtrl ( He et al. 2024 ) , Stable-Virtual-Camera ( Zhou et al. 2025a ) , and the History-Guided Transformer ( Song et al. 2025 ) take a single RGB frame plus a pose trajectory and synthesize a coherent, egocentric video that faithfully follows the specified motion. In effect, they serve as world models: given “where the agent will go”, they imagine “what the camera will see”. Leveraging this capability, we introduce MindJourney, a test-time scaling framework that enables a VLM to reason by interactively searching and exploring the imagined 3D space through a world model. Confronted with a spatial-reasoning question, MindJourney does not ask the VLM to answer immediately. Instead, the VLM iteratively plans a short exploratory trajectory, with the world model rendering the corresponding egocentric video at each step. The VLM then uses its gathered imagined rollouts in the world to reason and answer the spatial-reasoning question. As shown in Fig. 1 , the world model helps scale up the observation space given the image provided in the question, and helpful trajectories with descriptions and observations are gathered for the VLM to answer the question easily. By combining the high-level reasoning ability of a VLM with detailed 3D scene understanding of a world model, we are able to boost the VLM’s spatial-reasoning performance significantly. In a comprehensive evaluation on the SAT benchmark, SpatialNavigator achieves substantial gains on multiple spatial reasoning tasks. Our method improves top-1 accuracy performance across four very different VLM back-ends with two distinct world models by an average 8.1%, with the largest single gain reaching 15%. Our method also outperforms and can improve upon the o1-like test-time scaling VLMs, which demonstrates the compatibility of our method and showcases the potential of the idea of test-time scaling with world models. In summary, our key contributions are as follows: • We introduce MindJourney, the first test-time scaling framework that couples a VLM with a controllable video world model, enabling searching through imagined 3D space to improve 3D spatial reasoning without finetuning. • We empirically demonstrate that our model offers significant improvement on multiple spatial reasoning tasks. • We demonstrate that our method is model-agnostic: it boosts four different VLMs with two distinct world models. 2 Related work World Models Video generation models have shown their potential as promising world models for gaming and robotic applications ( Yang et al. 2023 ; Bar et al. 2024 ; Bruce et al. 2024 ; Gao et al. 2024 ) . Early works ( Du et al. 2023 ; Bruce et al. 2024 ; Zhou et al. 2024a ; Du et al. 2024 ) leverage strong video generation models to imagine the future frames for decision making. However, previous works primarily focus on static cameras and simple environments. More recently, several studies ( Bar et al. 2024 ; Parker-Holder et al. 2024 ; Zhou et al. 2025b ; Team et al. 2025 ) have explored the simulation of 3D environment dynamics using controllable video models that are conditioned on the actions or camera movement, thereby enhancing the spatial imagination capabilities of world models. In our work, we leverage the imagination abilities of world models to help the spatial reasoning ability of vision-language models. Vision-Language Models and Spatial Reasoning The growing advancements in vision-language models (VLMs) have rapidly progressed on various downstream tasks ( Radford et al. 2021 ; Li et al. 2022a ; Alayrac et al. 2022 ; Achiam et al. 2023 ; Team et al. 2023 ; Driess et al. 2023 ) . Many strong open-sourced models have been developed from visual instruction tuning on paired text-image data ( Dai et al. 2023 ; Liu et al. 2023b ; Liu et al. 2024 ; Dong et al. 2024 ; Yao et al. 2024 ) . More recent works explored region-level and pixel-level grounding ( Li et al. 2022b ; Ma et