WorldReasonBench: Human-Aligned Stress Testing of Video Generators as Future World-State Predictors
Keming Wu, Yijing Cui, Wenhan Xue, Qijie Wang, Xuan Luo, Zhiyuan Feng, Zuhao Yang, Sudong Wang, Sicong Jiang, Haowei Zhu, Zihan Wang, Ping Nie, Wenhu Chen, Bin Wang, [4pt] Tsinghua University, [2pt] Equal contribution Corresponding author Project page: https://unix-ai-lab.github.io/WorldReasonBench/ {wukm25, cuiyj25}@mails.tsinghua.edu.cn · 2026
Read WorldReasonBench: Human-Aligned Stress Testing of Video Generators as Future World-State Predictors by Keming Wu, Yijing Cui, Wenhan Xue, Qijie Wang, Xuan Luo, Zhiyuan Feng, Zuhao Yang, Sudong Wang, Sicong Jiang, Haowei Zhu, Zihan Wang, Ping Nie, Wenhu Chen, Bin Wang, [4pt] Tsinghua University, [2pt] Equal contribution Corresponding author Project page: https://unix-ai-lab.github.io/WorldReasonBench/ {wukm25, cuiyj25}@mails.tsinghua.edu.cn (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10434.txt.
Introduction
Keming Wu and thirteen colleagues test whether video generators truly grasp how the world evolves. Commercial systems such as Seedance and Veo have improved fast, feeding the view that video generators are becoming world models. Yet no benchmark had checked whether a model grasps how an observed world ought to evolve. Their 2026 paper introduces WorldReasonBench, reframing video testing as world-state prediction.
Starting from a state plus an action, can a model produce a future video that stays physically, socially, logically, and informationally sound? The benchmark holds 436 curated test cases with QA notes across four reasoning dimensions and 22 subcategories. Evaluation pairs reasoning checks, using QA to catch temporal and causal failures, with quality scoring for ranking and reward modeling. A companion choice benchmark, WorldRewardBench, adds about 6,000 expert pairs over 1,400 videos. Results expose a persistent gap: videos can look convincing while getting dynamics, causality, or detail preservation wrong.
Catalog record
| CREATOR | Keming Wu, Yijing Cui, Wenhan Xue, Qijie Wang, Xuan Luo, Zhiyuan Feng, Zuhao Yang, Sudong Wang, Sicong Jiang, Haowei Zhu, Zihan Wang, Ping Nie, Wenhu Chen, Bin Wang, [4pt] Tsinghua University, [2pt] Equal contribution Corresponding author Project page: https://unix-ai-lab.github.io/WorldReasonBench/ {wukm25, cuiyj25}@mails.tsinghua.edu.cn |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10434
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
WorldReasonBench: Human-Aligned Stress Testing of Video Generators as Future World-State Predictors Keming Wu, Yijing Cui, Wenhan Xue, Qijie Wang, Xuan Luo, Zhiyuan Feng, Zuhao Yang, Sudong Wang, Sicong Jiang, Haowei Zhu, Zihan Wang, Ping Nie, Wenhu Chen, Bin Wang, [4pt] Tsinghua University, [2pt] Equal contribution Corresponding author Project page: https://unix-ai-lab.github.io/WorldReasonBench/ {wukm25, cuiyj25}@mails.tsinghua.edu.cn Abstract Commercial video generation systems such as Seedance2.0 and Veo3.1 have rapidly improved, strengthening the view that video generators may be evolving into “world simulators.” Yet the community still lacks a benchmark that directly tests whether a model can reason about how an observed world should evolve over time. We introduce WorldReasonBench , which reframes video generation evaluation as world-state prediction : given an initial state and an action, can a model generate a future video whose state evolution remains physically, socially, logically, and informationally consistent? WorldReasonBench contains 436 curated test cases with structured ground-truth QA annotations spanning four reasoning dimensions and 22 subcategories. We evaluate generated videos with a human-aligned two-part methodology: Process-aware Reasoning Verification uses structured QA and reasoning-phase diagnostics to detect temporal and causal failures, while Multi-dimensional Quality Assessment scores reasoning quality, temporal consistency, and visual aesthetics for ranking and reward modeling. We further introduce WorldRewardBench , a preference benchmark with approximately 6K expert-annotated pairs over 1.4K videos, supporting pair-wise and point-wise reward-model evaluation. Across modern video generators, our results expose a persistent gap between visual plausibility and world reasoning: videos can look convincing while failing dynamics, causality, or information preservation. We will release our benchmarks and evaluation toolkit to support community research on genuinely world-aware video generation at https://github.com/UniX-AI-Lab/WorldReasonBench/ . {"1-a-4": {"prompt": "Using the input image as the first frame, when the needle in the hand is pressed down firmly, what happens?"},"1-a-19": {"prompt": "Using the input image as the first frame, this coal has been sitting here for a long time; show the complete process of removing it."},"1-a-31": {"prompt": "Using the input image as the first frame, after many days of heavy rain, what is likely to happen in this scene? Demonstrate it."},"1-a-64": {"prompt": "Using the input image as the first frame, after the person lets go, what happens?"},"1-a-34": {"prompt": "Using the input image as the first frame, what happens before thunder?"},"1-a-47": {"prompt": "Using the input image as the first frame, on the 15th day of the lunar month, from noon to 6 p.m., what does the scene look like?"},"1-a-45": {"prompt": "Using the input image as the first frame, after two weeks, what happens?"},"1-a-24": {"prompt": "Using the input image as the first frame, the person quickly pulls the tablecloth away; what happens?"},"1-b-02": {"prompt": "Using the input image as the first frame, the band is about to go on stage; how do the stage lights change?"},"1-b-05": {"prompt": "Using the input image as the first frame, the subway door warning lights are on; what happens next?"},"1-a-32": {"prompt": "Using the input image as the first frame, after an earthquake, what is likely to happen in this scene? Demonstrate it."},"1-c-10": {"prompt": "Using the input image as the first frame, generate the traditional Egyptian process of treating the dead as in the image."},"1-b-49": {"prompt": "Using the input image as the first frame, after the chameleon on the branch crawls onto the green leaves, what happens?"},"1-a-5": {"prompt": "Using the input image as the first frame, when the hand flicks the paper away quickly, what happens?"},"1-b-29": {"prompt": "Using the input image as the first frame, if this year is 2024, what date will the calendar show after today passes?"},"1-c-03": {"prompt": "Using the input image as the first frame, generate the process of correctly re-hanging the couplets in the image that were not posted properly."},"1-a-9": {"prompt": "Using the input image as the first frame, if this action continues, what happens?"},"1-a-25": {"prompt": "Using the input image as the first frame, show how the objects in the image change over one week; give the complete process."},"1-a-49": {"prompt": "Using the input image as the first frame, the person rubs their hair against the object in their hand repeatedly; what happens?"},"1-c-12": {"prompt": "Using the input image as the first frame, Christmas is coming soon; how will the home change?"},"2-a-10": {"prompt": "Use the input image as the first frame, what will happen?"},"2-a-18": {"prompt": "Use the input image as the first frame. What will happen if someone cuts in line?"},"2-a-4": {"prompt": "Use the input image as the first frame. What is wrong with the behavior of the characters in the picture? How should this object be conveyed?"},"2-a-19": {"prompt": "Use the input image as the first frame, what will happen next?"},"2-a-21": {"prompt": "Use the input image as the first frame. In the picture, the man walking toward you finds that the woman’s wallet has fallen. What will happen?"},"2-a-23": {"prompt": "Use the input image as the first frame. What will happen if the character holding an umbrella finds a passerby holding some documents that are easily wet?"},"2-a-3": {"prompt": "Use the input image as the first frame. What will happen if the man discovers that the woman is struggling to move boxes?"},"2-a-6": {"prompt": "Use the input image as the first frame. As time goes by, what will happen in this scene?"},"2-b-2": {"prompt": "Use the input image as the first frame. What will the characters in the picture do next?"},"2-b-6": {"prompt": "Use the input image as the first frame, what will happen? How to avoid this phenomenon from happening?"},"2-b-8": {"prompt": "Use the input image as the first frame, mark the wrong behavior of the characters in the picture, and show the correct behavior of the characters in the picture in the current situation."},"2-b-11": {"prompt": "Use the input image as the first frame. What will happen if the lights suddenly brighten and a harsh sound occurs?"},"2-b-12": {"prompt": "Use the input image as the first frame. The character in the picture wants to wash his car. The car wash shop is 50m away. Give the process of the character in the picture going to the car wash shop."},"2-b-15": {"prompt": "Use the input image as the first frame. The character in the picture cannot be seen clearly. What will he do to improve it?"},"2-b-21": {"prompt": "Use the input image as the first frame. The character in the picture cannot see the text in the book clearly. What will he do to make it clearer?"},"2-b-19": {"prompt": "Use the input image as the first frame. This box is too high. How should the characters in the picture use tools to get to the box?"},"2-c-12": {"prompt": "Use the input image as the first frame, The barista is flattening the coffee powder, what series of actions will he do next?"},"2-c-15": {"prompt": "Use the input image as the first frame, this man is driving nails, what will happen?"},"2-c-24": {"prompt": "Use the input image as the first frame, What happens when this man moves his hands?"},"2-c-26": {"prompt": "Use the input image as the first frame, What happens if the internal temperature spikes"},"2-c-19": {"prompt": "Use the input image as the first frame, a swimmer in an intense swim, what will happen"},"2-c-30": {"prompt": "Use the input image as the first frame, What will happen if the person in the picture succeeds in playing the game?"},"2-c-5": {"prompt": "Use the input image as the first frame, what will happen next?"},"2-c-6": {"prompt": "Use the input image