CausalSpatial: A Benchmark for Object-Centric Causal Spatial Reasoning
Wenxin Ma, Chenlong Wang, Ruisheng Yuan, Hao Chen, Nanru Dai, S. Kevin Zhou, Yijun Yang, Alan Yuille, Jieneng Chen · 2026
Read CausalSpatial: A Benchmark for Object-Centric Causal Spatial Reasoning by Wenxin Ma, Chenlong Wang, Ruisheng Yuan, Hao Chen, Nanru Dai, S. Kevin Zhou, Yijun Yang, Alan Yuille, Jieneng Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-13304.txt.
Introduction
Wenxin Ma and co-authors test if vision language models can guess what a move will do in a 3D scene. A person can glance at a still scene and call the next act. Will this shift cause a crash? The team calls that skill causal spatial sense.
Today's big models fail at it, they say. The models read still layout well but stall on what if asks in 3D. Their bench, CausalSpatial, holds object centred tasks built to probe that skill. Each task asks for a call on cause in space, not just a name for what is seen. For model teams, the bench marks a gap that still pic tests hide.
Catalog record
| CREATOR | Wenxin Ma, Chenlong Wang, Ruisheng Yuan, Hao Chen, Nanru Dai, S. Kevin Zhou, Yijun Yang, Alan Yuille, Jieneng Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-13304
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CausalSpatial: A Benchmark for Object-Centric Causal Spatial Reasoning Wenxin Ma, Chenlong Wang, Ruisheng Yuan, Hao Chen, Nanru Dai, S. Kevin Zhou, Yijun Yang, Alan Yuille, Jieneng Chen Abstract Humans can look at a static scene and instantly predict what happens next — will moving this object cause a collision? We call this ability Causal Spatial Reasoning. However, current multimodal large language models (MLLMs) cannot do this, as they remain largely restricted to static spatial perception, struggling to answer “what-if” questions in a 3D scene. We introduce CausalSpatial , a diagnostic benchmark evaluating whether models can anticipate consequences of object motions across four tasks: Collision, Compatibility, Occlusion, and Trajectory. Results expose a severe gap: humans score 84% while GPT-5 achieves only 54%. Why do MLLMs fail? Our analysis uncovers a fundamental deficiency: models over-rely on textual chain-of-thought reasoning that drifts from visual evidence, producing fluent but spatially ungrounded hallucinations. To address this, we propose the C ausal O bject W orld Model (COW), a framework that externalizes the simulation process by generating videos of hypothetical dynamics. With explicit visual cues of causality, COW enables models to ground their reasoning in physical reality rather than linguistic priors. We make the dataset and code publicly available: https://github.com/CausalSpatial/CausalSpatial . 1 Introduction Humans can naturally perceive their surroundings and form a mental 3D model of the world. This mental model enables us to simulate possible physical interactions between objects in space. For example, as shown in Figure 1 , in a static scene where a car faces a metal vase, we can use spatial cues such as proximity and orientation to predict a potential collision if the car moves forward. We refer to this task of grounding causal inference in spatial reasoning as Causal Spatial Reasoning . Figure 1 : Causal spatial reasoning task. The task requires model to progress from 2D image understanding to 3D spatial perception and ultimately to 4D causal spatial reasoning—predicting how actions affect future spatial configurations. Current MLLMs fail at this complex task due to hallucinations. This task requires three progressive spatial reasoning capabilities. As illustrated in Figure 1 , the process begins with 2D image understanding and 3D static spatial reasoning. In these paradigms, models are tasked with recognizing objects and estimating spatial cues, such as camera perspective, orientation, and distance. While these capabilities form the foundation for further reasoning, they are inherently static —answering only “what/where is something” but failing to address “what will happen if…”, which is critical for understanding the physical world. To reason about causality, models must advance to 4D causal spatial reasoning, a comprehensive and dynamic paradigm that integrates spatial understanding with temporal prediction. Rather than analyzing spatial cues in isolation, models must synthesize this information to form coherent mental simulations. This requires first extracting 3D spatial relationships from static images, then simulating hypothetical or counterfactual interactions with temporal consistency ( e.g ., “The car will collide with the vase if it moves forward.”). Benchmark Evaluation Design 2D 3D TD CP OM RL CLEVR-Count ( Johnson et al. 2017b ) CLEVR ( Johnson et al. 2017a ) ✓ VQA ( Goyal et al. 2017 ) ✓ ✓ GQA ( Hudson & Manning 2019a ) ✓ ✓ CV-Bench ( Tong et al. 2024a ) ✓ ✓ ✓ SAT ( Ray et al. 2024 ) ✓ ✓ ✓ ✓ STI-Bench ( Li et al. 2025 ) ✓ ✓ ✓ ✓ Spatial457 (L1-4) ( Wang et al. 2025c ) ✓ ✓ ✓ CausalVQA ( Foss et al. 2025 ) ✓ ✓ ✓ ✓ VSI-Super ( Yang et al. 2025 ) ✓ ✓ ✓ ✓ CausalSpatial ✓ ✓ ✓ ✓ ✓ ✓ Table 1 : Comparison of benchmarks. 2D denotes 2D perception ; 3D denotes 3D static relation ; TD denotes T emporal D ynamics ; CP denotes C ausal P rediction . OM denotes O bject-level M anipulation . RL denotes R ea L istic . CausalSpatial involves diverse paradigms of spatial reasoning, spanning from 2D perception to temporal dynamics. It incorporates causal prediction into spatial reasoning, paving the way for the next-level vision intelligence. Complete table is available in Appendix B . While humans perform causal spatial reasoning effortlessly, whether MLLMs possess this capability remains largely underexplored. Current evaluation frameworks (as listed in Table 1 ) are limited to 2D and 3D static reasoning or overlook object interactions, failing to assess whether models can reason about how objects dynamically affect each other in the given spatial contexts. To fill this gap, we propose CausalSpatial, a synthetic benchmark designed to diagnose causal spatial reasoning capabilities from an object-centric perspective. Each evaluation item consists of an image showing multiple objects in a scene, paired with a hypothetical object-level motion context ( e.g ., If the car moves forward, a collision may occur.). This setup requires the model to move beyond static recognition of the given static image, and simulate the future object interaction outcomes according to the motion context. To provide a comprehensive diagnosis, we define four distinct forms of causal anticipation under different spatial configurations: Collision , Occlusion , Compatibility , and Trajectory . As the first open-source diagnostic benchmark of its kind, CausalSpatial provides the necessary testbed for advancing models toward more robust and causally grounded spatial understanding. Extensive experiments on CausalSpatial expose a critical disparity between state-of-the-art MLLMs and human capabilities. Our analysis attributes this failure to a fundamental deficiency: with recent improvements in reasoning capability, MLLMs typically over-rely on a textual Chain-of-Thought (CoT) to infer dynamics and reason about causality. However, such textual CoT struggles to maintain consistent alignment with the original visual input, resulting in inaccurate spatial information during reasoning. Consequently, subsequent textual causal reasoning often includes spatial illusion, making models to generate seemingly plausible yet spatially ungrounded predictions. To address the failure of text-based causal reasoning in maintaining spatial grounding, we propose leveraging world models to provide explicit causality hints with consistent 4D trajectory control. We propose C ausal O bject W orld Model (COW), an object-centric world model that externalizes the simulation process by rendering hypothetical object dynamics into video. Unlike textual reasoning, which drifts from reality, COW generates realistic future frames based on extracted 4D trajectories. This explicit visual evidence effectively compensates for the models’ inability to perform internal physical simulation, enabling grounded causal inference and demonstrating significant promise in complex spatial reasoning tasks. In summary, our contribution is three-fold: • We introduce CausalSpatial, the first object-centric causal spatial reasoning benchmark, comprising diverse causal spatial scenarios. It provides a comprehensive and diagnostic testbed for causal spatial reasoning. • We conduct extensive experiments on CausalSpatial across a diverse set of MLLMs, revealing a significant performance gap between machines and humans. Our analysis indicates that models hallucinate in textual CoT, struggling to conduct consistent causal reasoning anchored to actual 3D configurations. • We propose C ausal O bject W orld Model , an object-centric video generation framework that maintains 3D consistency by fusing spatial cues and simulates cause–and–effect dynamics via rendering videos, paving the way for leveraging WMs in advanced causal spatial reasoning in MLLMs. Figure 2 : CausalSpatial tasks . CausalSpatial encompasses four causal reasoning tasks that require models to anticipate physical outcomes in 3D scenes: Collision, Occlusion, Trajectory, and Compatibility.