From Gradients to Riccati Geometry: Kalman World Models for Single-Pass Learning
Andrew J. Kiruluta · 2026
Read From Gradients to Riccati Geometry: Kalman World Models for Single-Pass Learning by Andrew J. Kiruluta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13423.txt.
Introduction
Andrew Kiruluta proposes Kalman World Models, a class of learned state-space models trained without backpropagation. Instead of gradient descent, parameter learning becomes Kalman-style gain adaptation through recursive Bayesian filtering. Error signals act as innovations, and training becomes online filtering. The framework extends to transformer LLMs, where internal activations are treated as latent dynamical states. Innovation terms correct those states, giving a gradient-free training and adaptation path from control theory. Tests on sequence modeling tasks showed competitive scores with better robustness.
Catalog record
| CREATOR | Andrew J. Kiruluta |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 80654 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.13423
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Gradients to Riccati Geometry: Kalman World Models for Single-Pass Learning Andrew J. Kiruluta Abstract Backpropagation dominates modern machine learning, yet it is not the only principled method for optimizing dynamical systems. We propose Kalman World Models (KWM) , a class of learned state-space models trained via recursive Bayesian filtering rather than reverse-mode automatic differentiation. Instead of gradient descent updates, we replace parameter learning with Kalman-style gain adaptation. Training becomes online filtering; error signals become innovations. We further extend this framework to transformer-based large language models (LLMs), where internal activations are treated as latent dynamical states corrected via innovation terms. This yields a gradient-free training and adaptation paradigm grounded in control theory. We derive stability conditions, analyze computational complexity, and provide empirical results on sequence modeling tasks demonstrating competitive performance with improved robustness and continual adaptation properties. 1 Introduction Backpropagation has been the dominant algorithmic mechanism underlying modern deep learning since its formalization in multilayer networks [ 18 ] . By leveraging reverse-mode automatic differentiation, backpropagation efficiently computes gradients of a scalar loss with respect to millions or billions of parameters, enabling large-scale optimization via stochastic gradient descent and its adaptive variants [ 19 , 20 ] . This paradigm has powered advances across computer vision, language modeling, reinforcement learning, and multimodal foundation models [ 21 , 45 , 22 ] . Despite its empirical success, backpropagation imposes structural and computational constraints that are increasingly relevant at scale. Reverse-mode differentiation requires retention of intermediate activations throughout the forward pass, incurs memory overhead proportional to model depth, and mandates reverse-time traversal of the computational graph. In distributed settings, gradient synchronization introduces additional communication costs and potential instability [ 23 , 24 ] . These characteristics are architectural commitments of the reverse-mode paradigm rather than intrinsic properties of learning itself. Parallel to the development of gradient-based learning, control theory and statistical estimation have long addressed the problem of adaptive inference in dynamical systems. In particular, the Kalman filter provides optimal recursive state estimation for linear systems under Gaussian noise assumptions [ 2 , 25 ] . Rather than minimizing an explicit loss through reverse accumulation of derivatives, the Kalman filter propagates uncertainty forward in time and corrects state estimates using innovation terms derived from new observations. The resulting update takes the form x_{t+1}=x_{t}+K_{t}(y_{t}-\hat{y}_{t}), (1) where the Kalman gain K_{t} is computed from covariance propagation equations. This gain is not a heuristic learning rate but a principled, uncertainty-aware preconditioner derived from Bayesian inference. Recursive filtering has been foundational in signal processing, aerospace guidance, econometrics, robotics, and control systems for over six decades [ 5 , 6 , 26 ] . The conceptual distinction between gradient descent and recursive filtering is subtle but profound. Gradient-based learning treats parameters as fixed but unknown quantities optimized via iterative descent on a static objective function. In contrast, filtering interprets parameters or latent variables as dynamic states of a stochastic process, updated sequentially as new information arrives. Under this view, learning becomes a problem of sequential Bayesian inference rather than deterministic optimization. This reinterpretation aligns naturally with online and continual learning scenarios, where data arrive over time and distributional stationarity cannot be assumed [ 29 , 30 ] . It also introduces explicit uncertainty quantification through covariance matrices, a feature largely absent in first-order optimization methods. Historically, Extended Kalman Filters (EKF) were applied to neural network training in the late 1980s and early 1990s [ 12 , 31 , 32 ] . These efforts demonstrated that recursive filtering could serve as an alternative to backpropagation for small networks. However, computational scaling limitations, combined with the rise of large-batch gradient methods and hardware acceleration, led to the dominance of gradient descent in deep learning practice. In recent years, renewed interest in second-order optimization and information geometry has highlighted deep connections between curvature-aware methods and probabilistic inference. Natural gradient descent [ 33 ] interprets learning as steepest descent in a Riemannian manifold defined by the Fisher information metric, while Kronecker-factored approximations [ 34 ] and Shampoo-style preconditioning [ 35 ] approximate second-order curvature at scale. These developments suggest that the geometry of parameter space plays a central role in stable and efficient learning. In this work, we revisit recursive filtering not as a historical curiosity but as a foundational alternative to reverse-mode training. We propose replacing gradient descent updates with Kalman-style recursive corrections of the form \theta_{t+1}=\theta_{t}+K_{t}(y_{t}-\hat{y}_{t}), (2) where \theta_{t} represents model parameters treated as latent states and K_{t} is a dynamically computed gain matrix derived from propagated uncertainty. Rather than computing gradients explicitly, the innovation term (y_{t}-\hat{y}_{t}) acts as a residual signal driving parameter correction. We demonstrate that under Gaussian observation models, this update is equivalent to a natural gradient step with Fisher information preconditioning, thereby unifying recursive filtering and information-geometric optimization within a common mathematical framework. This perspective reframes neural networks as stochastic dynamical systems whose internal representations and parameters evolve through Bayesian state estimation. The resulting framework naturally extends to world models [ 4 ] and latent state-space architectures [ 36 ] , where recursive inference over hidden states is already central. Moreover, viewing transformers and large language models as high-dimensional dynamical systems suggests the possibility of innovation-based correction not only of parameters but of intermediate activations, enabling online adaptation and robustness under distribution shift. The goal of this paper is not to discard gradient-based learning, but to establish recursive filtering as a principled, scalable alternative grounded in control theory and information geometry. By bridging Kalman filtering, natural gradient descent, and modern deep architectures, we seek to expand the algorithmic foundations of large-scale learning systems beyond the constraints of reverse-mode automatic differentiation. 2 Contributions Unlike classical Extended Kalman Filter (EKF) training of neural networks from the 1990s, which treated filtering as an alternative optimizer for small networks, this work introduces a modern control-theoretic framework with four novel components: 1. Kalman–Natural Gradient Equivalence: We prove that under Gaussian observation models, the Kalman gain update is equivalent to a natural gradient step with Fisher information preconditioning. 2. Filtering-as-Training Principle: We reinterpret learning as sequential Bayesian state estimation, unifying parameter updates and latent state correction. 3. Activation-Level Innovation Correction: We introduce Kalman-style innovation updates directly to transformer hidden states, enabling online correction without backpropagation. 4. Koopman-Lifted World Models: We lift nonlinear networks into linear operator space where Kalman filtering operates exactly, not approximately. 3 State-Space World Models Neural networks are typically presented as static function approximators mapping inputs to outputs. However, many modern architectures — including recurrent networks, transformers, latent dynamics models, and reinforcement learning agents — exhibit inherently dynamical behavior. A more general and principled representation views a neural network as a stochastic dynamical system evolving over time [ 1 , 41 ] . Under this perspective, computation unfolds through latent state transitions driven by inputs and internal parameters, producing observable outputs through a measurement process. We therefore model neural networks using the state-space formalism: \displaystyle x_{t+1} \displaystyle=f_{\theta}(x_{t},u_{t})+w_{t}, (3) \displaystyle y_{t} \displaystyle=h_{\theta}(x_{t})+v_{t}, (4) where x_{t}\in\mathbb{R}^{n} denotes the latent state, u_{t} represents exogenous input, \theta denotes model parameters, and w_{t},v_{t} are process and observation noise terms, respectively. This formulation unifies recurrent neural networks [ 46 ] , state-space models [ 2 ] , predictive coding architectures [ 3 ] ,