The Global Neural World Model: Spatially Grounded Discrete Topologies for Action-Conditioned Planning

Noureddine Kermiche · 2026

Read The Global Neural World Model: Spatially Grounded Discrete Topologies for Action-Conditioned Planning by Noureddine Kermiche (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16585.txt.

Introduction

Kermiche offers the Global Neural World Model, a frame for action-based planning. It maps worlds onto a set 2D grid with shift symmetry and no pixel work. Grid snapping acts as an error fix, stopping shape drift during rollouts. Training by maximum entropy search through random walks teaches broad change motion. It learns change motion rather than copied expert paths. Tested across passive watching, active control and abstract series, it serves as a causal finding model. It sorts smooth concepts into ordered shape maps, beyond a mere physics model.

Catalog record

CREATORNoureddine Kermiche
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28070
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2604.16585

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Global Neural World Model: Spatially Grounded Discrete Topologies for Action-Conditioned Planning Noureddine Kermiche Abstract We present the Global Neural World Model (GNWM), a self-stabilizing framework that achieves topological quantization through balanced continuous entropy constraints. Operating as a continuous, action-conditioned Joint-Embedding Predictive Architecture (JEPA), the GNWM maps environments onto a discrete 2D grid, enforcing translational equivariance without pixel-level reconstruction. Our results show this architecture prevents manifold drift during autoregressive rollouts by using grid “snapping” as a native error-correction mechanism. Furthermore, by training via maximum entropy exploration (random walks), the model learns generalized transition dynamics rather than memorizing specific expert trajectories. We validate the GNWM across passive observation, active agent control, and abstract sequence regimes, demonstrating its capacity to act not just as a spatial physics simulator, but as a causal discovery model capable of organizing continuous, predictable concepts into structured topological maps. Keywords: Global Neural World Model, Self-Organizing Maps, Topological Quantization, Joint-Embedding Predictive Architecture (JEPA), Action-Conditioned Planning, Representation Collapse, Thermodynamic Equilibrium 1 Introduction The pursuit of artificial agents capable of long-term planning relies heavily on the development of accurate, persistent world models [5, Ha & Schmidhuber, 2018]. However, current state-of-the-art predictive architectures predominantly rely on continuous latent representations. While continuous spaces are efficient for gradient-based learning, they introduce two fundamental pathologies in temporal models: interpretability opacity and iterative drift. In autoregressive rollout scenarios, continuous models inevitably succumb to the “mean-prediction” problem. Small floating-point inaccuracies at step t+1 compound exponentially, causing the predicted state to diffuse into high-entropy regions of the latent space. This manifests as visual blur and a rapid loss of physical groundedness. To bridge the gap between continuous perception and discrete logic, we propose the Global Neural World Model (GNWM). The GNWM treats the latent space as a discrete topological grid governed by balanced entropy constraints. Inspired by the topological ordering of classic Self-Organizing Maps (SOMs)—which historically resisted deep learning integration due to non-differentiable operations—the GNWM introduces a fully differentiable method for unrolling an environment’s causal manifold. Our primary contributions are: 1. Self-Stabilizing Entropy Constraints: A balanced objective function that organically prevents representation collapse on a probability simplex, removing the need for asymmetric gradient routing, explicit variance penalties, or target networks. 2. Fully Differentiable Topological Smearing: We solve the historical incompatibility between SOMs and deep learning by replacing Kohonen’s non-differentiable Winner-Take-All spike and heuristic radial weight updates with a fixed, fully differentiable spatial convolution. This decouples topology from activation, allowing exact gradient flow. 3. Emergent Topological Disentanglement: Demonstration that 2D SOM convolutions inherently force continuous features to geometrically disentangle across discrete Cartesian axes. 4. Drift-Free Imagination: Empirical proof that discrete topological quantization allows for autoregressive planning over extended horizons without variance decay. 5. Compositional Factorization & Cognitive Mapping: Demonstration of architectures that organically separate multi-entity environments into independent grids, and successfully cluster abstract semantic concepts into structured topological dictionaries. 2 Related Work The GNWM builds upon and diverges from four primary paradigms in representation learning: 2.1 Continuous Predictive Models and Anti-Collapse Heuristics Non-contrastive predictive architectures like JEPAs [1, Bardes et al., 2024] and BYOL [4, Grill et al., 2020] aim to predict future states in continuous space. However, without explicit repulsive forces, these models inevitably succumb to representational collapse. To prevent this, they resort to a fragile stack of optimization heuristics: architectural asymmetry (Exponential Moving Average target networks with stop-gradients), heavy weight decay, and strict batch or variance normalization. Conversely, Contrastive Learning methods (e.g., SimCLR [3, Chen et al., 2020]) explicitly prevent collapse by pushing negative samples apart, but they scale quadratically with batch size ( \mathcal{O}(D\cdot N^{2}) ). Covariance whitening methods (e.g., VICReg [2, Bardes et al., 2021], Barlow Twins [8, Zbontar et al., 2021]) mitigate batch dependencies by decorrelating dimensions, but they scale quadratically with the embedding dimension ( \mathcal{O}(D^{2}\cdot N) ). Both approaches introduce severe computational bottlenecks. The GNWM circumvents this entire optimization stack. By formulating representation learning as a balanced thermodynamic equilibrium, the GNWM is mathematically self-stabilizing in strictly linear time. 2.2 Discrete Latent Variables (VQ-VAEs) Vector Quantized models project inputs into a discrete codebook. However, they struggle with the non-differentiability of the hard argmax step, relying on the Straight-Through Estimator. This often leads to codebook collapse. The GNWM replaces the STE with continuous differentiable probabilities during training, utilizing hard quantization only during inference. 2.3 Self-Organizing Maps (SOMs) Kohonen’s original SOMs [7, Kohonen, 1982] pioneered mapping high-dimensional data onto ordered grids but completely resisted integration into the modern deep learning revolution. This incompatibility stems from a fundamental flaw in the classic algorithm: it operates via a non-differentiable two-step process. First, it relies on a hard argmin to locate a Best Matching Unit (BMU), which instantaneously severs the computational graph. Second, it utilizes a Radial Basis Function (RBF) as a heuristic weight-update modifier (effectively a dynamic learning rate) rather than a mathematical operation within the forward pass, making standard backpropagation impossible. The GNWM revitalizes the SOM paradigm by fundamentally altering its mechanics. We replace the hard WTA spike with continuous thermodynamic entropy losses, and critically, we replace the heuristic radial weight update with a fixed spatial convolution applied directly to a continuous logit grid. This guarantees perfect end-to-end differentiability. 2.4 Self-Organizing Representation Learning Recent advances [6, Kermiche, 2021] demonstrated mapping datasets onto 2D grids using continuous embeddings and Gaussian kernels. The GNWM extends this static clustering into the temporal domain to create autoregressive world models. 3 Mathematical Framework Figure 1: The GNWM Architecture. Raw inputs are processed by the Retinotopic Encoder into a spatial grid. A fixed radial filter applies Topological Smearing. The Action-Conditioned Spatial Predictor then estimates the future latent state, enforcing a strict JEPA paradigm. 3.1 The Topological Probability Simplex Let the latent space be defined as a 2D grid of size H\times W , containing D=H\times W discrete neural nodes. For a given input state x_{t} , the encoder produces a continuous latent vector h_{t}\in\mathbb{R}^{D} . To enforce topological continuity without breaking the gradient, we apply a 2D SOM convolution to the latent activations via a fixed Gaussian kernel G_{\sigma} centered at each node: \tilde{h}_{t}=h_{t}\ast G_{\sigma} (1) By treating the radial filter as a structural, fixed spatial convolution rather than a dynamic activation function, gradients flow perfectly back through the neighborhood spread. Furthermore, this operation introduces “Topological Smearing.” Instead of a hard spike that causes activation mass to abruptly “teleport” between discrete nodes across frames, the probability mass smoothly transitions and smears across the grid. This allows the predictive alignment loss ( \mathcal{L}_{sim} ) to natively optimize for continuous physical motion over a discrete topology. This topologically smoothed vector is then projected onto the probability simplex and L_{2} -normalized to create a spherical probability distribution: p_{t}=\frac{\text{Softmax}(\tilde{h}_{t})}{\|\text{Softmax}(\tilde{h}_{t})\|_{2}} (2) As seen in Figure 1, both the predicted state p_{t+1} and target state z_{t+1} undergo this exact topological transformation. Crucially, the target state is defined strictly as z_{t+1}=\text{Encoder}(x_{t+1}) . While the forward pathways are inherently asymmetric—since the Spatial Predictor operates on a latent state modified by an action vector a_{t} , whereas the target branch solely processes raw future frames—the Encoder utilizes exact shared weights across all time steps. This shared-weight encoding mathematically proves that the GNWM’s thermodynamic equilibrium prevents representation collapse organically, entirely eliminating the need for the asymmetric Exponential Moving Average (EMA) target

Read the complete text