stable-worldmodel : A Platform for Reproducible World Modeling Research and Evaluation

Lucas Maes* Quentin Le Lidec* Luiz Facury Nassim Massaudi Ayush Chaurasia, Francesco Capuano Richard Gao Taj Gillin Dan Haramati Damien Scieur, Yann LeCun Randall Balestriero, [4pt] Mila & Université de Montréal New York University Universidade Federal de Minas Gerais · 2026

Read stable-worldmodel : A Platform for Reproducible World Modeling Research and Evaluation by Lucas Maes* Quentin Le Lidec* Luiz Facury Nassim Massaudi Ayush Chaurasia, Francesco Capuano Richard Gao Taj Gillin Dan Haramati Damien Scieur, Yann LeCun Randall Balestriero, [4pt] Mila & Université de Montréal New York University Universidade Federal de Minas Gerais (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21800.txt.

Introduction

Lucas Maes and co-authors present stable-worldmodel, an open-source platform for reproducible world-model research and evaluation. The field is fragmented across one-off codebases, slow video loading, and missing generalization benchmarks. The platform offers a fast Lance-based data layer for MP4, HDF5, and LeRobot datasets, plus clean implementations of modern world-model baselines and planning solvers. Its environments carry controllable visual, geometric, and physical factors of variation. Unifying the full pipeline under one scalable framework cuts overhead and speeds trustworthy progress toward reliable world models.

Catalog record

CREATORLucas Maes* Quentin Le Lidec* Luiz Facury Nassim Massaudi Ayush Chaurasia, Francesco Capuano Richard Gao Taj Gillin Dan Haramati Damien Scieur, Yann LeCun Randall Balestriero, [4pt] Mila & Université de Montréal New York University Universidade Federal de Minas Gerais
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE106074
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.21800

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

stable-worldmodel : A Platform for Reproducible World Modeling Research and Evaluation Lucas Maes* Quentin Le Lidec* Luiz Facury Nassim Massaudi Ayush Chaurasia, Francesco Capuano Richard Gao Taj Gillin Dan Haramati Damien Scieur, Yann LeCun Randall Balestriero, [4pt] Mila & Université de Montréal New York University Universidade Federal de Minas Gerais Abstract World models are central to building agents that can reason, plan, and generalize beyond their training data. However, research on world models is currently fragmented, with disparate codebases, data pipelines, and evaluation protocols hindering reproducibility and fair comparison. Current practice is further limited by three key bottlenecks: fragile one-off codebases, slow video data loading, and the lack of standardized generalization benchmarks. We present stable-worldmodel ( swm ), an open-source platform for standardized and reproducible world modeling research and evaluation. It delivers (1) a high-performance Lance-based data layer with native support and conversion tools for MP4, HDF5, and LeRobot datasets, (2) clean, well-tested implementations of modern world model baselines and planning solvers, and (3) a broad suite of environments and tasks extended with controllable visual, geometric, and physical factors of variation for systematic in-silico evaluation of dynamics understanding, control performance, representation quality, and out-of-distribution generalization. By unifying the full pipeline under a single, scalable framework, swm dramatically reduces research overhead and accelerates trustworthy progress toward reliable world models. Code available here . † † footnotetext: * Equal contribution. Correspondence to [email protected] 1 Introduction Figure 1 : Overview of stable-worldmodel : data is efficiently collected from a world and used to train world models via provided baselines, then leveraged by solvers for control. The idea of using predictive models to guide decision-making dates back to the 1960s-1970s from the control theory community [ 51 , 56 ] . Most of these approaches relied on analytical, closed-form models or hand-crafted simulators to predict the outcome of actions (control variables) [ 37 , 55 ] . Yet, recent advances in deep learning have instead learned to build these predictive models directly from raw data, leveraging neural networks [ 20 , 23 , 25 , 28 , 5 ] , an approach more commonly referred to as world models . These world models enable the capture of far more complex real-world phenomena [ 2 , 19 ] without deriving dynamics equations explicitly. However, as for any learned system, strengths and weaknesses audits before real-world deployment are paramount. Yet, despite exciting progress, the world modeling community still lacks reliable baselines, standardized benchmarks, and reproducible evaluation protocols. Most research relies on custom, often fragile codebases, forcing researchers to repeatedly re-implement the same algorithms. As the history of computer science has repeatedly shown, this approach is a recipe for hidden bugs, inconsistent results, leading to reduced credibility and trustworthiness in the results reported in publications [ 9 , 53 , 34 ] . To address these challenges, we present stable-worldmodel ( swm ), an open-source platform for reproducible world modeling research and evaluation. Built on PyTorch [ 48 ] and Gymnasium [ 64 ] , swm provides a complete, modular test-bed that supports researchers across the entire world model pipeline: from dataset collection and training utilities to comprehensive evaluation (including control, representation probing, out-of-distribution, and zero-shot generalization). It enables systematic assessment of new algorithms, clear identification of in-silico model limitations, and fair comparisons against strong baselines. Our contributions are the following: • A high-performance Lance-based data layer with native support and conversion tools for MP4, HDF5, and LeRobot datasets, eliminating I/O bottlenecks in multimodal world model training. • Clean, well-tested, and reproducible implementations of modern world model baselines (DINO-WM, LeWorldModel, PLDM, TD-MPC2, etc.) together with efficient and reliable implementations of planning solvers (CEM, MPPI, GD, etc.). • A diverse benchmarking suite spanning classic control, MuJoCo, Atari, robotics, and open-world environments, augmented with systematic controllable factors of variation (visual, geometric, and physical) enabling standardized zero-shot generalization and robustness evaluation. (a) Classic Control (b) MuJoCo (c) Arcade Game (d) Robotics (e) Open-World Game Figure 2 : Environment families supported by swm . Top row: default (unperturbed) renderings of each environment. Bottom row: all visual factors of variation (e.g., agent, object, scene, geometry, lighting) jointly perturbed. Dynamic physical parameters (e.g., mass, density, gravity, or friction) can also be modified, but are omitted here as they are not visible in a single frame. 2 Background: the World Model Pipeline In this section, we provide the necessary background on world models and control, and highlight key challenges that arise in their design, training, and evaluation. Training World Models. A world model is mostly the association of two core components, an encoder and a predictor. The encoder \mathcal{E}:\mathbb{R}^{n}\rightarrow\mathbb{R}^{D} maps a (possibly partial) observation \mathbf{o}_{t}\in\mathbb{R}^{n} to a latent state \mathbf{s}_{t}\in\mathbb{R}^{D} . The predictor \mathcal{P}:\mathbb{R}^{D}\times\mathbb{R}^{A}\rightarrow\mathbb{R}^{D} learns the dynamics by predicting the next state \mathbf{s}_{t+1} given the current state \mathbf{s}_{t} and an action \mathbf{a}_{t} . In practice, learning such representations from high-dimensional sensory inputs, such as videos, has become ubiquitous, yet it requires compressing observations into compact latent states that retain only task-relevant features. This has led to a wide range of representation learning strategies, including reconstruction-based objectives [ 26 , 28 , 19 ] or JEPAs [ 39 , 60 , 3 , 41 ] . World modeling requires latent representations that faithfully capture a system’s underlying dynamics, since accurate long-horizon prediction and planning depend on understanding how states evolve over time. This places strong demands on the representations: they must support rich temporal reasoning and generalize robustly to out-of-distribution scenarios. Planning with World Models. Once learned, a world model can be used to determine a sequence of actions that drives the system toward a desired goal state {\bm{s}}_{g}\in\mathbb{R}^{D} . This problem can be framed as optimal control, where the objective is to find a policy \pi which minimizes the expected cumulative cost induced by the learned dynamics. Formally, given an initial state {\bm{s}}_{0} , we seek a mapping \pi:\mathbb{R}^{D}\rightarrow\mathbb{R}^{A} such that \displaystyle\pi^{*}= \displaystyle\argmin_{\pi}\sum_{t}c({\bm{s}}_{t},{\bm{a}}_{t})\quad\text{s.t.} \displaystyle{\displaystyle\bm{s}}_{t+1}=\mathcal{P}({\bm{s}}_{t},{\bm{a}}_{t}),\quad{\bm{a}}_{t}=\pi({\bm{s}}_{t}), (1) where \mathcal{P} denotes the world model predictor and c is a task-dependent stage cost measuring progress toward the goal {\bm{s}}_{g} . Approaches to solving equation 1 typically fall into two categories. Reinforcement Learning (RL) learns the policy \pi offline (or online) by optimizing it over many trajectories [ 25 , 26 ] , while Model Predictive Control (MPC) solves a finite-horizon ( T steps) version of this problem at test time by directly optimizing predicted trajectories over action sequences [ 71 , 41 ] . Unlike RL, MPC leverages the world model directly as part of the agent. For the rest of this work, we will rely on MPC to solve control, yet our platform is also compatible with RL as both approaches ultimately aim to solve the same underlying control problem. 3 stable-worldmodel : A Unified Framework for World Model Research We introduce stable-worldmodel (Fig. 1 ), an open-source platform for reproducible world model research and evaluation that supports researchers across the entire pipeline. As detailed in the following subsections, swm is motivated by key challenges in current practice, including fragmented implementations, data handling bottlenecks, and limitations in evaluation protocols. swm is entirely open-source and designed to integrate smoothly with existing code bases. 3.1 Challenges in World Modeling Research We highlight key challenges across the world-modeling pipeline that

Read the complete text