Einstein World Models

Munachiso Samuel Nwadike, Zangir Iklassov, Ali Mekky, Zayd M. Kawakibi Zuhri, Kentaro Inui · 2026

Read Einstein World Models by Munachiso Samuel Nwadike, Zangir Iklassov, Ali Mekky, Zayd M. Kawakibi Zuhri, Kentaro Inui (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26969.txt.

Introduction

Munachiso Samuel Nwadike and four colleagues propose Einstein World Models, a blueprint for language models that think in pictures. Some reasoning may need more than words: imagining how a scene unfolds could complement text. Their systems insert short visual rollouts into the reasoning trace. A world-module generates the rollout, a little film of the scenario under discussion.

The rollout is not treated as the answer. It returns as an inspectable hypothesis the model can criticise and build on. Tool calling, already used for search and code, is thus extended to visual thought experiments. The name honours Einstein's famous imagined rides alongside light beams. The authors argue such visualisation could support kinds of complex thought that language alone captures poorly. The work is a design proposal with its architecture laid out.

Catalog record

CREATORMunachiso Samuel Nwadike, Zangir Iklassov, Ali Mekky, Zayd M. Kawakibi Zuhri, Kentaro Inui
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.26969

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Einstein World Models Munachiso Samuel Nwadike, Zangir Iklassov, Ali Mekky, Zayd M. Kawakibi Zuhri, Kentaro Inui Abstract Does intelligence require the ability to reason about phenomena beyond direct experience? It is natural to suspect that some complex thought cannot be captured through language alone. However, of particular concern to this work, is whether visualising counterfactual events can complement language as a mechanism for complex thought. We ask whether LLMs can be trained to utilise such visualisation mechanisms, in a way that benefits their reasoning abilities. Motivated by this question, we propose Einstein World Models . EWMs are a blueprint for LLM-based reasoning systems that place visual-temporal rollouts inside the reasoning trace, allowing them to reason in ways that text alone may not support well. In an EWM, the LLM calls a world-module (not to be confused with a world model), to produce short rollouts of scenes under consideration. The returned rollout is treated not as the answer, but as an inspectable hypothesis that can support later reasoning. Einstein World Models extend the capability of LLMs for tool calling (such as web search or code execution), into the domain of visual thought experiments. Prologue Figure 1: Einstein World Models (proposed) build upon traditional LLM reasoning traces. However, in addition to generating tokens across N autoregressive steps, the model may, at a sparse set of M intermediate steps, invoke a callable world-module . The returned visual-temporal rollout becomes part of the trace as an inspectable hypothesis. A call for datasets becomes meaningful after the desirable capability has been specified. This culminates in Section 5 . The predominance of this work therefore aims to motivate a learnable format for visual thought experimentation, proposing the architecture and training objectives necessitating their training data. This work may therefore be understood as an operationalisation of a promising capability whose data requirements are, per this moment, a conceivably fertile frontier. 1 Introduction Scientific invention often makes abstract ideas tractable by turning them into thought experiments . In a thought experiment, we visualise a scene, let it unfold, and notice what changes. Einstein’s recollection of special relativity begins with precisely such a thought experiment, later popularised through the image of Bern’s famous clock tower. In his Autobiographical Notes 9 , he recalls imagining what it would be like to chase a beam of light. If he could accelerate until he matched the speed of the beam, would it eventually appear to hang motionless beside him? In those notes, Einstein writes that such a stationary light wave seemed impossible both empirically and according to Maxwell’s equations. His simple thought experiment had transformed an abstract tension between electrodynamics and intuitions about motion, into a concrete scene upon which reasoning could be built. It is precisely in this spirit that “Einstein World Models” invoke “ E instein ”. Vitally, the “E” in EWM also carries a dual reading, overloaded to mean “ E xternalised ”. Externalisation brings the thought experiment into view as an inspectable reasoning trace component, and therefore, as a measurable one 31 , as per chain-of-thought 47 . LLMs can already search the web when they lack reliable facts ( 28 ) , run code when numerical calculation is needed ( 10 ) , and call external tools when a task is easier to act out than to solve from tokens alone ( 37 ; 50 ; 33 ) . What we propose is to render LLMs capable of imagining a scene, when quantitatively beneficial. Hadamard 16 , in his inquiry into the inner mental processes behind mathematical invention, recorded Einstein’s self-description of the thought experiment process in strikingly imagistic terms: — Professor Albert Einstein 16 “The psychical entities which seem to serve as elements in [my] thought are certain signs and more or less clear images which can be ‘voluntarily’ reproduced and combined. …The above mentioned elements are, in my case, of visual and some of muscular type. Conventional words or other signs have to be sought for laboriously only in a secondary stage , when the mentioned associative play is sufficiently established and can be reproduced at will.” In a thought experiment, the combination of visuals, albeit subject to meaning, takes precedence, while symbols and words play an augmentative role. Although LLMs already excel with words and symbols in chain-of-thought, their visual-temporal reasoning faculties are yet to capture this dynamic (kindly see Section 4 ). Thus, in an effort towards precisely this dynamic, prior work has popularised world models 22 . These works often characterise world modelling as either passive visual prediction from experience 3 ; 11 , or action-conditioned prediction for embodied agents 27 ; 29 ; 24 . However, if world models are treated mainly as high-fidelity simulators of futures tethered either to observed states or to chosen actions, then thought experiments become correspondingly limited either to experience, or to intervention (see Supplementary Notes, Part C ). Einstein World Models reconsider this correspondence. Much like Einstein could visualise riding beside a beam of light without first having to ride one, a language model should be able to benefit from imagining how a described scene could unfold, without necessarily acting within it. A decisive element in Einstein World Models is the choice of a world-module capable of producing useful video thought experiment rollouts, as discussed in Section 3 . Equally central is the ability to integrate these rollouts back into the LLM’s reasoning trace, as discussed in Section 2 . Our analysis of this element forms one of three contributions: First, we propose Einstein World Models as a mechanism for selective visual-temporal thought experiments instantiated by tool-use behavior in LLM reasoning. Second, we distinguish Einstein World Models as reasoning systems, from the world-modules they call, treating generated rollouts as inspectable intermediate artifacts. Third, we offer dataset and training recommendations for training LLMs into Einstein World Model reasoners, capable of utilising visual-temporal thought-experiment traces. Figure 2: If Einstein were travelling away from the Bern clock tower at the speed of light, would the clock’s hands appear frozen in time? This figure compares how different reasoning paradigms would support such a thought experiment. Top left: In CoT, the LLM reasons only through N autoregressive text-generation steps. Top right: In VLMs, visual information can condition generation, but the relevant visuals are externally provided, rather than visualised during the reasoning trace. Bottom left: In VL-JEPA-style world models, predictive visual representations are learned from observed visual inputs, but the visual prediction itself is not selectively invoked as an intermediate reasoning artifact. Bottom right: In Einstein World Models , by contrast, the LLM (the reasoner) preserves autoregressive text generation while taking responsibility for deciding when to invoke a world-module M times, how to query it, and how to incorporate each returned rollout into subsequent reasoning. Each rollout therefore enters the trace as a visible thought experiment rather than as a pre-given input or final answer. 2 Einstein World Models 2.1 Overview The objectives of Einstein World Models are twofold. First, we wish to imbue language models with the ability to construct visualisations when answering questions that require physical intuition or scene-level visualisation. Second, we wish to obtain a window into those visualisations. An EWM rollout, as illustrated in Figure 1 ,

Read the complete text