YoCausal: How Far is Video Generation from World Model? A Causality Perspective
You-Zhe Xie, Yu-Hsuan Li, Jie-Ying Lee, Kaipeng Zhang, Yu-Lun Liu, Zhixiang Wang · 2026
Read YoCausal: How Far is Video Generation from World Model? A Causality Perspective by You-Zhe Xie, Yu-Hsuan Li, Jie-Ying Lee, Kaipeng Zhang, Yu-Lun Liu, Zhixiang Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30346.txt.
Introduction
You-Zhe Xie and five co-authors present YoCausal, a benchmark asking how far video models are from a world model. By flipping videos as reversed samples, YoCausal sets up a test plan. Level 1 brings the Reverse Surprise Index, measuring time perception via noise removal. Level 2 brings the Causality Cognition Index, which uses a VLM to split sets into causal and other subsets, freeing causal thought from time bias. Tests on 13 models reveal seeing time flow does not imply grasping causality, and a gap persists versus causal cognition.
Catalog record
| CREATOR | You-Zhe Xie, Yu-Hsuan Li, Jie-Ying Lee, Kaipeng Zhang, Yu-Lun Liu, Zhixiang Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74510 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30346
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
YoCausal: How Far is Video Generation from World Model? A Causality Perspective You-Zhe Xie, Yu-Hsuan Li, Jie-Ying Lee, Kaipeng Zhang, Yu-Lun Liu, Zhixiang Wang Abstract As video diffusion models (VDMs) advance toward world models, a key question arises: do they truly understand causality, or merely overfit to statistical temporal patterns? Existing benchmarks mostly rely on synthetic data, limiting real-world generalization due to the sim-to-real gap. We present YoCausal, a two-level benchmark inspired by the Violation of Expectation (VoE) paradigm from cognitive science. By temporally reversing real-world videos at zero cost as natural counterfactual samples, YoCausal establishes an arbitrarily extensible evaluation protocol. Level 1 introduces the Reverse Surprise Index (RSI), quantifying arrow-of-time perception via denoising loss. Level 2 introduces the Causality Cognition Index (CCI), which leverages a VLM to stratify datasets into causal and non-causal subsets, disentangling genuine causal reasoning from temporal bias. Evaluation of 13 state-of-the-art VDMs reveals that perceiving the arrow of time does not imply understanding causality, and a significant gap persists relative to human-level causal cognition. \github https://www.youzhexie.me/papers/YoCausal/index.html † † affiliation: National Yang Ming Chiao Tung University † † affiliation: Shanda AI Research Tokyo † † contribution: Equal contribution † † contribution: Corresponding authors † † correspondence: [email protected] , [email protected] † † date: August 10, 2026 \downarrow Figure 1 : Validation of the YoCausal benchmark. (Left) We evaluate and rank 13 state-of-the-art Video Diffusion Models alongside a human baseline based on our Causality Score (lower is better). (Right) Visualizations of a causal event (“ wiping a dirty plate ”) strongly align with our quantitative rankings. The top-ranked VDM, Wan2.2-A14B wan2025wan , successfully captures the cause-and-effect relationship by progressively removing the dirt ( green boxes ). In contrast, mid- to low-ranked models like CogVideoX1.5-5B hong2022cogvideo ; yang2024cogvideox and AnimateDiff-SDXL guo2023animatediff struggle to understand the underlying causal logic. They show severe causal errors, such as dirt reappearing or smearing in an illogical way ( red boxes ). This shows that our benchmark effectively disentangles genuine causal reasoning from simple visual generation ability. 1 Introduction “Welcome to the exploration of causal video generation.” — YoCausal , Derived from Yōkoso (“welcome” in Japanese). A long-standing aspiration of AI is to build machines that truly model the world lecun2022path ; ha2018world ; matsuo2022deep ; hu2023gaia ; bruce2024genie ; lin2023learning . One important ability of such world models is to capture causality 1 1 1 Throughout this paper, we focus on intuitively observable cause-and-effect mechanisms ( i.e . event A leads to event B ), rather than structural causal models (SCMs) or formal interventions neuberg2003causality ; didelez2001causality ; mcdonald2002judea . : recognizing that dragging a pencil across paper leaves traces, or that striking a match produces a flame. Among the avenues explored toward world models, video generation models have emerged as promising candidates liu2024sora ; esser2023structure ; qin2024worldsimbench ; li2025worldmodelbench ; zhu2024sora . Trained on vast real-world data, they learn rich spatio-temporal representations and produce highly realistic video, leading many to regard video generation as a direct path to world modeling. However, a fundamental question remains: do current video generation models actually understand causality? Previous research on “world knowledge” of generative models has focused on adherence to physical laws riochet2018intphys ; bordes2025intphys ; yuan2025likephys ; motamed2026generative ; wu2016physics ; bear2021physion ; kang2024far ; bansal2024videophy ; bansal2025videophy ; meng2024towards . However, a genuine world model must go beyond physics to comprehend broader causality. Moreover, existing physics benchmarks face a practical limitation: to isolate specific physical variables, they rely on synthetic data or small collections of controlled laboratory recordings, creating a sim-to-real gap that limits assessment of real-world generalization. To bridge this gap, we draw on the Violation of Expectation (VoE) paradigm from cognitive science leslie1987six ; margoni2024violation . In a seminal study ( fig. 2 ), Leslie and Keeble leslie1987six assessed whether infants perceive causality by showing temporally reversed videos: if an observer is truly causally cognitive, counterfactual reversed causality should elicit surprise . We adapt this to VDMs: under a generative model, “surprise” corresponds to low probability, so a causally aware VDM should assign lower likelihood to reversed video x^{r} than to forward one x^{f} . Figure 2 : Conceptual overview of YoCausal benchmark. We draw inspiration from the Violation of Expectation (VoE) paradigm in cognitive science. (Left) Infants show surprise when seeing videos played in reverse (bottom), violating their intuitive causal cognition leslie1987six ( \dashrightarrow ). (Right) We transfer this paradigm to generative models: treating the learned data distribution as the model’s cognition, a causally-aware VDM should assign lower probability (higher denoising loss) to counterfactual reversed videos than to forward ones. This elegant analogy allows us to benchmark causal understanding using arbitrarily scalable real-world videos. Building on this, we propose YoCausal , a two-level benchmark for evaluating causal cognition in VDMs. At Level 1, the Reverse Surprise Index (RSI) measures the proportion of videos for which the model assigns lower likelihood to the reversed than the forward version via the denoising loss. However, RSI alone cannot isolate causal cognition, as VDMs may merely perceive the arrow of time , which is the inherent directionality of time. To disentangle these factors, Level 2 therefore introduces the Causality Cognition Index (CCI) : the dataset is partitioned into a causal subset \mathcal{D}_{c} and a non-causal subset \mathcal{D}_{nc} , and CCI is defined as \text{RSI}(\mathcal{D}_{c})-\text{RSI}(\mathcal{D}_{nc}) . A model with genuine causal perception should be more surprised by reversed causal videos than non-causal ones. A key advantage is our arbitrarily extensible dataset design. Any real-world video can be temporally reversed at zero cost to produce a counterfactual sample, freeing the benchmark from the fixed synthetic scenes or controlled recordings of prior work. This bridges the sim-to-real gap and responds to a core demand: an ideal world model should learn causal relationships across diverse dimensions. We further provide a human upper bound by having annotators judge 1,200 videos as a reference for model performance. Comprehensive evaluation across 13 state-of-the-art VDMs reveals four key insights: (1) while advanced models perceive the arrow of time and some exhibit preliminary causality cognition, a significant human-model gap remains; (2) perceiving the arrow of time is not equivalent to understanding causality; (3) causal cognition correlates partially with intuitive physics but not with aesthetic quality, validating our benchmark’s unique focus; and (4) scaling parameters and advancing architectures ( e.g . UNet to DiT) improve causal cognition, indicating that scaling laws yin2025towards ; liang2024scaling ; kaplan2020scaling extend to this higher-order reasoning. In summary, our contributions are as follows: • The first causality benchmark for VDMs, built on a scalable real-world dataset free from sim-to-real gaps. • A cognitive-science-grounded two-level framework that disentangles arrow-of-time perception from causal cognition. • Evidence that current open-source VDMs lack causal understanding, revealing a critical gap toward world models and providing guidance. 2 Related Work Video Diffusion Models. Video synthesis has progressed from UNet-based diffusion architectures ho2022video ; wang2023modelscope ; guo2023animatediff ; blattmann2023stable ; blattmann2023align ; singer2022make to Diffusion Transformer (DiT) peebles2023scalable designs generating long, coherent sequences yang2024cogvideox ; kong2024hunyuanvideo ; wan2025wan ; hacohen2024ltx ; zheng2024open ; peng2025open ; kondratyuk2023videopoet ; yin2025slow , with commercial systems further raising quality brooks2024video ; polyak2024movie ; bar2024lumiere ; girdhar2024factorizing ; gupta2024photorealistic . This trajectory increases interest in treating VDMs as world models lecun2022path ;