Toward Stable World Models: Measuring and Addressing World Instability in Generative Environments
Soonwoo KwonJin-Young Kim *, Hyojun Go, Kyungjune Baek, EverEx Sejong University {swkwon.john, seago0828, gohyojun15}@gmail.com, [email protected] · 2025
Read Toward Stable World Models: Measuring and Addressing World Instability in Generative Environments by Soonwoo KwonJin-Young Kim *, Hyojun Go, Kyungjune Baek, EverEx Sejong University {swkwon.john, seago0828, gohyojun15}@gmail.com, [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08122.txt.
Introduction
Soonwoo Kwon and co-authors name a blind spot in AI world models: when a virtual camera leaves a scene and comes back, the scene should still be there. Today's best generative models make gorgeous, varied worlds, but they quietly rebuild them, which poisons agent training and any safety-critical use. The team calls the missing quality World Stability.
Their test makes a model perform a string of moves and then the same moves in reverse, and compares the final view with the start. Leading models scored poorly. The paper then tries several fixes and reports what helps. The authors argue stability deserves a place beside image quality in judging world models.
Catalog record
| CREATOR | Soonwoo KwonJin-Young Kim *, Hyojun Go, Kyungjune Baek, EverEx Sejong University {swkwon.john, seago0828, gohyojun15}@gmail.com, [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-08122
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Toward Stable World Models: Measuring and Addressing World Instability in Generative Environments Soonwoo KwonJin-Young Kim *, Hyojun Go, Kyungjune Baek, EverEx Sejong University {swkwon.john, seago0828, gohyojun15}@gmail.com, [email protected] Abstract We present a novel study on enhancing the capability of preserving the content in world models, focusing on a property we term World Stability . Recent diffusion-based generative models have advanced the synthesis of immersive and realistic environments that are pivotal for applications such as reinforcement learning and interactive game engines. However, while these models excel in quality and diversity, they often neglect the preservation of previously generated scenes over time–a shortfall that can introduce noise into agent learning and compromise performance in safety-critical settings. In this work, we introduce an evaluation framework that measures world stability by having world models perform a sequence of actions followed by their inverses to return to their initial viewpoint, thereby quantifying the consistency between the starting and ending observations. Our comprehensive assessment of state-of-the-art diffusion-based world models reveals significant challenges in achieving high world stability. Moreover, we investigate several improvement strategies to enhance world stability. Our results underscore the importance of world stability in world modeling and provide actionable insights for future research in this domain. 1 Introduction Recent advancements in generative models, notably diffusion models [ 16 , 18 ] , have enhanced world models [ 10 ] , enabling the generation of immersive, realistic environments. They serve as engines that generate playable environments [ 20 , 4 ] for user or agent, creating simulation setups for reinforcement learning data collection [ 12 ] and making tasks like robot learning more sample-efficient [ 23 ] . Figure 1 : Revisiting the same place by a world model. When prompting the model to revisit the previously synthesized location, the newly generated environment fails to preserve key objects within the red box, such as a door or a picture frame. This inconsistency can be critically detrimental to both agent performance and user experience. To reliably support these applications with the world model, generated content requires three key characteristics: quality, diversity, and scene preservation. While recent diffusion-based world models [ 1 , 8 , 5 ] excel in quality and diversity, previous studies have not paid much attention to the ability to preserve the previously generated environment over time. Despite limited focus, keeping the previously generated scene is a characteristic that significantly differentiates world models from general video generation models. While video generation models aim to synthesize creative videos with generally unidirectional temporal and spatial progression, failing to maintain the previous scene in building an environment can introduce noise into agent learning, leading to slower learning speeds or degradation of the final policy’s quality [ 29 , 17 , 7 ] . Furthermore, when world models are used to train agents in low fault-tolerance settings such as autonomous driving, lacking this capability may induce incorrect policy and severe safety issues [ 33 ] . In this work, we introduce the term “world stability” to describe the property where, after an agent performs actions and returns to the same location, the environment remains consistent with its initial observation. We inspected existing state-of-the-art (SoTA) methods [ 1 , 5 ] and found that they struggle significantly with maintaining the environment. For example, in the upper image sequence of Figure. 1 , the door on the right disappears upon the agent’s return. This can significantly impact the agent’s actions, leading to degraded policy learning performance. From a gameplay perspective, it undermines the consistency of the game’s progression, severely degrading the user experience. To highlight the problem and provide direction for future researchers, we introduce an evaluation framework and metrics to assess the world stability of various models. Specifically, our framework is applicable when inverse actions are defined within the environment. For example, if an action rotates the agent’s view to the left, the inverse action would be rotating it to the right. We design the procedure such that the agent performs the action N times, and then performs the inverse action N times to return to the initial frame. We then compute the consistency between the first frame and the frame generated after the 2N actions. Within this framework, we evaluated the state-of-the-art methods’ world stability both quantitatively and qualitatively. Furthermore, we explore several potential improvements, including extending the context length, data augmentation by reversing the input sequences, short fine-tuning for reverse modeling, and inference-time scaling using advanced sampling methods. We implement a subset of these approaches and highlight their effectiveness and limitations concerning both generation quality and our newly proposed metric, world stability. In summary, our contributions are: • Introducing the novel concept of world stability and developing a structured evaluation framework to explicitly measure and emphasize the importance of environment persistency in world modeling. • Evaluating current SoTA diffusion-based world models using our proposed framework and finding the lack of world stability of the SoTA methods. • Investigating several methods to enhance world stability–such as context extension, reversed data augmentation, injection of reverse projection, and inference-time scaling–and analyzing their strengths and limitations. 2 Related Works 2.1 World Simulation World models, originally proposed as simulated environments for training reinforcement learning agents [ 10 ] , have seen significant evolution. The following works focused on improving the environment’s realism to enhance agent policies [ 11 , 27 , 35 , 3 ] . The concept has since broadened to include interactive virtual environments for user interaction [ 19 , 31 ] . Recent advances leverage diffusion-based generative models to dramatically improve the quality and diversity of these simulated worlds [ 1 , 5 , 8 , 4 ] . For example, DIAMOND [ 1 ] and DWM [ 8 ] utilize action-conditioned diffusion models for improved performance in Atari and locomotion tasks, with DIAMOND capable of learning from datasets without explicit rewards, such as Counter-Strike gameplay footage [ 26 ] . Other approaches, like Diffusion forcing [ 5 ] that combines diffusion with next-token prediction and GAMEGEN-X [ 4 ] focusing on open-world game engines), demonstrate the versatility of this technology. This work proposes an evaluation protocol for assessing the consistency of these world models and introduces a novel method to improve consistency across SoTA approaches. 2.2 Evaluation Metrics for World Models World models, a specialized type of generative model, possess unique temporal dynamics, action-conditioned generation, and interactivity. Because of its unique characteristics, world models require specialized evaluation metrics. A common indirect approach for world models for reinforcement learning is to assess policies trained within the environment [ 1 ] , however, this is inapplicable outside RL. As a sidestep, previous works often adopt metrics from generative models, such as Fréchet Inception Distance (FID) [ 15 ] and Fréchet Video Distance (FVD) [ 30 ] which measure distributional distances between real and generated features, LPIPS [ 34 ] assessing diversity, and CLIP score [ 14 ] evaluating action-content alignment. However, these metrics, designed primarily for images, are insufficient for assessing world models. FVD, despite using video features, is overly influenced by content, neglecting crucial temporal dynamics [ 9 ] . Critically, existing metrics fail to assess world stability: the coherent persistence of spatial relationships and object locations over time. Lack