Koopman Kalman Filter (KKF): An asymptotically optimal nonlinear filtering algorithm with error bounds and its application to parameter estimation

Diego Olguín, Axel Osses, Héctor Ramírez · 2025

Read Koopman Kalman Filter (KKF): An asymptotically optimal nonlinear filtering algorithm with error bounds and its application to parameter estimation by Diego Olguín, Axel Osses, Héctor Ramírez (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04252.txt.

Introduction

Diego Olguin, Axel Osses, and Hector Ramirez propose the Koopman Kalman Filter, a nonlinear filtering method that trades a finite nonlinear problem for an infinite-dimensional linear one through the Koopman operator. Extended dynamic mode decomposition then builds a finite approximation whose state and covariance errors shrink at a stated rate as sample count grows.

Tests on linear and nonlinear dynamics match the optimal Kalman answer in the linear case and rival leading methods in error while running much faster. A parameter estimation algorithm built on the filter compares well with Markov chain Monte Carlo at lower execution time. Complexity figures for time and space are stated explicitly for practitioners weighing the trade.

Catalog record

CREATORDiego Olguín, Axel Osses, Héctor Ramírez
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE104 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-04252

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Koopman Kalman Filter (KKF): An asymptotically optimal nonlinear filtering algorithm with error bounds and its application to parameter estimation Diego Olguín, Axel Osses, Héctor Ramírez Abstract In this article, we propose a new filtering algorithm based in the Koopman operator, showing that a nonlinear filtering problem can be seen as an equivalent problem where the dynamics is infinite dimensional, but linear. Using Extended Dynamic Mode Decomposition (EDMD), we create a finite dimensional approximation of the filtering problem of dimension N N , in state and error covariance matrix, that accomplishes an error bound of order O ( N − 1 / 2 ) O(N^{-1/2}) in both where N N denotes the number of points used in the Koopman approximation. The algorithm is denominated Koopman Kalman Filter (KKF), and has computational complexity O ⁡ ( T ⋅ N 3 ) O(T\cdot N^{3}) in time, and O ⁡ ( T ⋅ N 2 ) O(T\cdot N^{2}) in space, where T T is the number of iterations of the filtering problem. We test the algorithm in linear and nonlinear dynamics cases, showing and effective error bound with respect to the Kalman filter, that corresponds to the optimal solution in the linear case, and equals the error performance of other methods in the state of the art, but with a much lower execution time. Also, we propose a parameter estimation algorithm based in KKF, comparing it with Markov Chain Monte Carlo techniques, showing similar performance with lower execution time. 1 Introduction The filtering problem concerns the estimation of the trajectory of a dynamical system, potentially stochastic, that is typically not fully observable and subject to noisy measurements. This problem arises in diverse areas of engineering and science, including signal processing, astronomy, fluid mechanics, meteorology, medical imaging, and the study of epidemiology and infectious disease dynamics, among others [ 37 ] . The first mathematical advances on the filtering problem were made independently by Wiener [ 23 ] and Kolmogorov [ 19 ] , who proposed general statistical approximations. The first algorithmic solution, the Kalman filter, was introduced by Kalman [ 17 ] , providing an exact solution in discrete time for the linear case. In parallel with Kalman’s work on the linear setting, Stratonovich investigated the general nonlinear case [ 40 ] . He showed that the problem reduces to solving a stochastic differential equation whose solution coincides with Kalman’s result in discrete time and with the Kalman–Bucy filter in continuous time [ 16 ] . However, in the most general case, Maurel and Michel [ 24 ] demonstrated that the solutions to the Stratonovich equation admit an infinite-dimensional representation, rendering them intractable for computation and motivating the search for practical approximations. To address the case of nonlinear dynamics, several methodologies have been developed to obtain suboptimal approximations to the filtering problem. Among the most prominent are the Extended Kalman Filter (EKF) [ 25 , 38 ] and the Unscented Kalman Filter (UKF) [ 15 ] . Although these methods extend the classical Kalman filter, they may, in certain cases, produce unsatisfactory results and lack the asymptotic properties necessary to ensure convergence to the optimal solution. Another widely adopted strategy is the use of Particle Filters [ 11 , 22 ] , which rely on Monte Carlo methods to approximate the solution while preserving the sequential structure of the problem. Owing to their asymptotic nature, and under appropriate conditions on the system and particle resampling, particle filters exhibit error bounds of order O(N_{p}^{-1/2}) , where N_{p} denotes the number of particles, for the solution of the filtering problem [ 6 ] . More recently, researchers have investigated the formulation of the filtering problem within Reproducing Kernel Hilbert Spaces (RKHS). These spaces, well known for their applications in statistics, machine learning, and numerical analysis [ 46 , 5 ] , possess powerful interpolation and approximation properties. Among the most significant contributions in this direction are those of Fukumizu and Song [ 8 , 39 ] , who introduced the Kernel Bayes rule, a generalization of the classical Bayes rule adapted to Hilbert space settings. On the other hand, data-driven methods applied to dynamical systems have found a powerful framework in the Koopman operator. Originally introduced by Koopman and von Neumann [ 21 , 20 ] , this operator enables the representation of finite-dimensional nonlinear dynamical systems as infinite-dimensional linear ones. Building on this foundation, the contributions of Mezić [ 27 ] , Schmid [ 36 ] , Surana [ 41 ] , Brunton [ 2 ] , and others have significantly expanded the use of the Koopman operator, particularly in fields such as fluid mechanics, where rich datasets facilitate the identification of complex dynamics. In this article, we propose an algorithm that integrates the Koopman operator with the Kalman filter: the Koopman Kalman Filter (KKF). The method achieves an error bound of O(N^{-1/2}) , where N denotes the number of points used in the Koopman approximation. Although the algorithm is not entirely new and similar formulations have been empirically proposed by other authors [ 13 , 29 , 42 , 44 , 45 , 47 ] , the novelty of our work lies in deriving the filter rigorously from the classical solution of the filtering problem together with its error bound, and in proving that is competitive with other nonlinear filters in relevant applications and also can be useful in parameter estimation of dynamical systems. The remainder of this paper is organized as follows. In Section 2, we review the necessary preliminaries for the filtering problem in the linear case, the Kalman filter, and the relevant elements of Reproducing Kernel Hilbert Spaces, following our previous work [ 30 ] . Section 3 presents our main results, structured into four parts: (i) the decomposition of the Kalman filter in the linear setting, (ii) the derivation of the filter equations in RKHS, (iii) the establishment of the corresponding error bound, and (iv) an application of the filter to parameter estimation. Section 4 provides numerical results for both filtering and parameter estimation, demonstrating improved precision in filtering compared to existing algorithms, as well as superior computational efficiency in parameter estimation a typically demanding task in terms of computational resources. 2 Preliminaries 2.1 Filtering problem Consider an autonomous and stochastic dynamical and observerd system, which can be represented by the following equations: \displaystyle\mathbf{x}_{k+1} \displaystyle=\mathbf{f}\left(\mathbf{x}_{k},\mathbf{w}_{k}\right) \displaystyle\mathbf{y}_{k} \displaystyle=\mathbf{g}\left(\mathbf{x}_{k},\mathbf{v}_{k}\right). Here, \mathbf{f}:\mathbb{R}^{n}\times\Omega_{\mathbf{w}}\to\mathbb{R}^{n} , \mathbf{g}:\mathbb{R}^{n}\times\Omega_{\mathbf{v}}\to\mathbb{R}^{p} where: • \mathbf{x}_{k} represents the state of the system at discrete time step k . • \mathbf{w}_{k} is a random variable with support equal to \Omega_{\mathbf{w}} , introducing stochasticity into the dynamics. • \mathbf{v}_{k} is a random variable with support equal to \Omega_{\mathbf{v}} , introducing stochasticity into the observations. The filtering problem up to a finite horizon T>0 can be formulated as an optimization problem of the mean square error of the estimation, conditional on the observations and inputs, given a prior distribution for the initial state X_{0}\in\mathbb{R}^{n} . So, this is: (P)\quad\begin{cases}\begin{aligned} \text{min}\quad&\quad\sum_{k=0}^{T}\mathbb{E}\left[(\hat{\mathbf{x}}_{k|k}-\mathbf{x}_{k})^{\top}(\hat{\mathbf{x}}_{k|k}-\mathbf{x}_{k})|\mathbf{y}_{1:k},\,\mathbf{u}_{0:k}\right]\\ \text{s.t.}\quad&\quad\mathbf{x}_{k+1}=\mathbf{f}(\mathbf{x}_{k},\mathbf{w}_{k})\\ \text{}\quad&\quad\mathbf{y}_{k}=\mathbf{g}(\mathbf{x}_{k},\mathbf{v}_{k})\\ \text{}\quad&\quad\mathbf{x}_{0}\sim X_{0}.\end{aligned}\end{cases} It is then that the problem (P) has as its solution the minimum mean square error estimator. It is known that this problem has a global optimum given by the conditional expectation. Proposition 1 ( [ 17 ] ) . The

Read the complete text