The Kalman Evolve: Closing the Gap in Kalman Filtering via Interpretable Algorithm Discovery

Vasileios Saketos, Ming Xiao · 2026

Read The Kalman Evolve: Closing the Gap in Kalman Filtering via Interpretable Algorithm Discovery by Vasileios Saketos, Ming Xiao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-26830.txt.

Introduction

In a 2026 paper, Saketos and Xiao present Kalman Evolve, a framework that discovers better Kalman-style filters by optimizing both noise parameters and update structure together. Large language models propose interpretable, non-affine tweaks to the classic filter while keeping its recursive form, motivated by proofs that affine estimators fall short under nonlinear sensing. Across Doppler radar, LiDAR, and pedestrian tracking benchmarks, the discovered filters beat strong baselines, cutting error by up to 12 percent.

Catalog record

CREATORVasileios Saketos, Ming Xiao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71829
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.26830

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Kalman Evolve: Closing the Gap in Kalman Filtering via Interpretable Algorithm Discovery Vasileios Saketos, Ming Xiao Abstract State estimation is a fundamental problem in control and signal processing, for which the Kalman Filter provides an optimal solution under linear dynamics, Gaussian noise, and known noise covariances. However, these assumptions often fail in realistic sensing settings such as Doppler radar and LiDAR. In these cases, the optimal estimator is inherently nonlinear, which leads to systematic performance degradation. This creates a performance gap that cannot be eliminated by tuning the noise covariance parameters (i.e., the process and measurement noise in the Kalman Filter) alone. To address this limitation, we propose Kalman Evolve, a framework for discovering improved filtering algorithms by jointly optimizing both noise parameters and the update structure. Our approach leverages large language models (LLMs) as a structured prior over program space, enabling the generation of interpretable, non-affine modifications to the classical Kalman filter while preserving its recursive form. We provide analytical results establishing the suboptimality of affine estimators under common nonlinear sensing models, motivating the need for structure-aware updates. Across a range of synthetic and real-world tracking benchmarks, including Doppler radar, LiDAR-based localization, and pedestrian tracking, the discovered algorithms consistently improve over strong baselines such as the Optimized Kalman Filter, achieving up to 12% reduction in RMSE. These results suggest that optimizing the structure of the Kalman filter, rather than only its parameters, provides a practical and interpretable way to improve state estimation. 1 Introduction The Kalman filter ( 17 ) is a cornerstone of state estimation, widely used due to its optimality and efficiency under linear dynamics and Gaussian noise assumptions. However, modern sensing systems—such as Doppler radar and LiDAR—produce observations that are inherently nonlinear functions of the underlying state. In these settings, the standard Kalman update, which is restricted to affine transformations of the measurement residual, cannot fully capture the structure of the optimal estimator. Various extensions, such as the Extended Kalman Filter (EKF) ( 10 ) and the Unscented Kalman Filter (UKF) ( 16 ) , handle nonlinear dynamics via local linearization and sigma-point approximations, respectively. While preserving the recursive structure of the original algorithm, they assume known system models (with EKF requiring explicit derivatives) and lack optimality guarantees and data-driven adaptability, often degrading under model mismatch. Most data-driven approaches focus on parameter estimation. In particular, ( 24 ) estimate the noise covariances Q and R when they are unknown, while more recent work such as the Optimized Kalman Filter (OKF) ( 12 ) learns these quantities directly, achieving strong empirical performance. However, these methods remain limited to the affine estimator class and therefore cannot overcome its fundamental limitations. In parallel, deep learning approaches such as Recurrent Neural Networks (RNNs), Long Short-Term Memory (LSTM) networks, and Gated Recurrent Units (GRUs) ( 15 ; 32 ; 4 ) have become standard tools for time-series prediction. Neural Kalman Filters ( 29 ; 11 ) aim to combine model-based and data-driven approaches to handle partially known dynamics. However, these methods typically rely on black-box function approximation, require substantial training data, lack interpretability, and in some cases may underperform classical Kalman Filters. Notably, prior work (e.g., OKF) demonstrates that optimized Kalman filtering methods consistently outperform neural Kalman Filter approaches across a range of settings, a trend we also observe in our experiments. Very recently, 33 introduced an algorithmic discovery framework based on FunSearch ( 30 ) for evolving the Kalman Filter in settings where its assumptions are violated. Their approach considers controlled scenarios in which the Kalman Filter is initially optimal with known parameters, and then systematically relaxes these assumptions, leading to performance degradation. The discovered algorithms demonstrate substantial improvements over the resulting mismatched Kalman Filter in these settings. While this highlights the potential of algorithmic discovery for state estimation, the evaluation is restricted to synthetic scenarios with known system parameters and does not include strong baselines such as adaptive Kalman filters, OKF, or KalmanNet. As a result, it remains unclear whether such approaches yield improvements in realistic settings with unknown system dynamics and parameter uncertainty. More importantly, what remains missing is a unified approach that jointly addresses both parameter uncertainty and the structural limitations of the Kalman update under model mismatch. To address this, we move beyond methods that focus solely on either parameter tuning or structure optimization, and instead optimize both the noise parameters and the structure of the Kalman Filter itself, enabling improved performance while preserving the recursive and interpretable form of the Kalman Filter. Unlike prior work on algorithmic discovery, which focuses on controlled settings with known system parameters, we address realistic scenarios in which both the system parameters and the inference structure must be learned from data. We first estimate the process and measurement noise covariances, Q and R, to obtain a well-calibrated and competitive baseline. Building on this, we employ an LLM-assisted evolutionary search to discover improved update structures, enabling improved performance while preserving the recursive and interpretable form of the Kalman Filter. This enables algorithm discovery in realistic settings with unknown dynamics, rather than only in controlled synthetic scenarios. • We show that affine Kalman-style measurement updates are structurally suboptimal under common nonlinear sensing models, including Doppler radar and LiDAR. • We introduce a framework that jointly optimizes noise parameters and update structure, enabling the discovery of interpretable, non-affine extensions of the Kalman Filter while preserving its recursive form. • We demonstrate that the discovered algorithms consistently outperform strong baselines, including the Optimized Kalman Filter (OKF), across synthetic and real-world benchmarks, achieving up to 12% reduction in RMSE with comparable computational cost. • We release code and discovered algorithms to support reproducibility and further research in interpretable algorithmic discovery. 2 Preliminaries In this work, we address two closely related yet fundamentally distinct tasks, as illustrated in Figure 1 . State estimation (SE) refers to inferring the posterior state given a prior belief and a new observation, whereas next state prediction (NSP) concerns estimating the state from the predictive distribution before the observation is received. Last observation Ground truth Estimate target state Figure 1 : State estimation (left), Next-state prediction (right) The Kalman Filter, as illustrated in Figure 2 , is designed for recursive Bayesian state estimation, i.e., computing the posterior distribution p(x_{t}\mid z_{1:t}) . This involves first performing the prediction step to obtain the prior distribution p(x_{t}\mid z_{1:t-1}) , followed by the update step that incorporates the observation z_{t} . In contrast, next state prediction is obtained by applying the prediction step to the updated state estimate, yielding p(x_{t}\mid z_{1:t}) . Operationally, this corresponds to first updating the state at time t and then propagating it forward. Thus, while state estimation follows a predict–update sequence, next state prediction can be viewed as an update–predict sequence. We consider a classical system evolving according to the following discrete-time linear state equations: \small x_{t}=Fx_{t-1}+w_{t-1},\hskip 9.24994ptw_{t-1}\sim\mathcal{N}(0,Q)\,\,\,\,\,\,\,\,\,\,\,\,\,\,\,\,\,\,\,\,z_{t}=Hx_{t}+v_{t},\hskip 9.24994ptv_{t}\sim\mathcal{N}(0,R), where F\in\mathbb{R}^{n\times n} is the state transition matrix, H\in\mathbb{R}^{m\times n} is the observation matrix, and Q and R are the covariance matrices of the process and observation noise, respectively. The Kalman Filter operates recursively in two main steps: predict and update. The predict step propagates the current state and its uncertainty forward in time, estimating the system’s next state without

Read the complete text