An Adaptive Kalman Filter that Learns the Coloring Dynamics of the Process Noise

Mohammad Almuhaihi, Dennis S. Bernstein · 2026

Read An Adaptive Kalman Filter that Learns the Coloring Dynamics of the Process Noise by Mohammad Almuhaihi, Dennis S. Bernstein (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21644.txt.

Introduction

Mohammad Almuhaihi and Dennis Bernstein design an adaptive Kalman filter for state estimation when the process noise is colored, meaning its errors follow patterns over time. The coloring pattern itself is unknown. Their whitening filter embeds an unknown coloring filter in a larger state model. It tunes itself by driving the measurement innovations toward whiteness, the sign of a correct noise model. The result gives back near-optimal results without knowing the noise pattern in advance.

Catalog record

CREATORMohammad Almuhaihi, Dennis S. Bernstein
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18494
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.21644

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An Adaptive Kalman Filter that Learns the Coloring Dynamics of the Process Noise Mohammad Almuhaihi, Dennis S. Bernstein Abstract In many applications of state estimation, the process noise is colored; this case is addressed by applying the standard Kalman filter (KF) to dynamics that are augmented with the coloring dynamics. The present paper considers the case where the coloring dynamics are unknown, which renders the estimates obtained from the standard approach suboptimal. To address this problem, the present paper proposes an adaptive technique based on the principle that, if the measurement noise is white, then the innovations sequence is white if and only if the process noise is white. Leveraging this fact, an Innovations-Whitening Adaptive Kalman Filter (IWAKF) is developed, which learns the process-noise coloring online. By embedding an unknown coloring filter in a state-augmentation framework, IWAKF adapts its parameters by minimizing the empirical autocorrelation of the innovations, thereby driving them toward whiteness and restoring near-optimality without prior knowledge of the coloring dynamics. I INTRODUCTION In the standard Kalman filter, the process noise is assumed to be white [ 4 , 3 , 6 , 1 ] . In many applications of state estimation, however, the process noise is colored. This case can addressed by applying the standard Kalman filter (KF) to dynamics that are augmented with the coloring dynamics [ 1 ] . This technique provides optimal state estimates for the given coloring dynamics. In practice, however, the process-noise spectrum is often colored with unknown coloring dynamics. The present paper focuses on this scenario. To address the problem of state estimation with unknown coloring dynamics, the present paper proposes an adaptive technique based on the principle that, if the measurement noise is white, then the innovations sequence is white if and only if the process noise is white. Leveraging this fact, an Innovations-Whitening Adaptive Kalman Filter (IWAKF) is developed, which learns the process-noise coloring online. By embedding an unknown coloring filter in a state-augmentation framework, IWAKF adapts its parameters by minimizing the empirical autocorrelation of the innovations, thereby driving them toward whiteness and restoring near-optimality without prior knowledge of the coloring dynamics. Recent efforts handle colored disturbances by either learning a disturbance model from covariance data or by de-correlating measurements in time. Zare et al formulate a data-enhanced approach that recovers a low-complexity colored-input model via convex covariance completion and then realizes an innovations model for use with an Ensemble Kalman Filter (EnKF) [ 7 ] . While effective at matching second-order statistics, this method relies on accurate batch/empirical covariances and requires solving a nuclear-norm–regularized optimization, which adds computational overhead and reduces responsiveness to time-varying spectra. The use of the innovations process for adaptivity traces back to the seminal study [ 5 ] . Under LTI dynamics and steady-state operation, Mehra shows that innovations whiteness is a necessary and sufficient signature of optimality and uses the sample autocorrelation of the innovations to (i) test optimality and (ii) estimate R together with (parts of) Q consistently from data. However, this identification proceeds at the level of the covariances (Q,R) rather than through an explicit dynamical shaping model for process noise. Consequently, it is not designed to recover or track unknown coloring dynamics in real time. The present work retains the innovations–whiteness principle but shifts the focus from covariance tuning to online learning of a parametric coloring filter embedded within a state-augmentation architecture, adjusting its parameters to drive empirical innovations autocorrelations toward zero and thereby restore near-optimal performance without prior spectral knowledge. This bridge from Mehra’s optimality test to real-time identification closes the gap for colored process noise and motivates the development that follows. The contents of the paper are as follows. Section II formulates the problem, and presents a 2nd-order uncertainty coloring filter and the resulting augmented dynamics. Assuming that the process noise and measurement noise are mutually independent and the measurement noise is white, Section III relates the the whiteness of the innovations and the whiteness of the process noise. Section IV presents a numerical example involving a damped pendulum with three distinct coloring filters. Finally, Section V provides some future research directions. II Problem Statement We consider the discrete-time state–space model \displaystyle x_{k} \displaystyle=Ax_{k-1}+Bv_{k-1}, (1) \displaystyle{y}_{k} \displaystyle=Cx_{k}+n_{k}, where the dynamics matrix A\in\mathbb{R}^{n\times n} , the input matrix B\in\mathbb{R}^{n\times l} , and the output matrix C\in\mathbb{R}^{m\times n} . The process noise v_{k}\sim\mathcal{N}(0,Q) and measurement noise n_{k}\sim\mathcal{N}(0,R) are zero mean and mutually independent. The standard Kalman filter (KF) recursions are summarized below for reference. Forecast (fc) \displaystyle x_{k}^{\mathrm{fc}} \displaystyle=A\,x_{k-1}^{\mathrm{da}}+B\,u_{k-1}, (2) \displaystyle e_{k}^{\mathrm{fc}}: \displaystyle=x_{k}-x_{k}^{\mathrm{fc}}, (3) \displaystyle P_{k}^{\mathrm{fc}} \displaystyle=A\,P_{k-1}^{\mathrm{da}}\,A^{\top}+Q. (4) Innovations and covariance \displaystyle z_{k} \displaystyle:=y_{k}-C\,x_{k}^{\mathrm{fc}}=Ce_{k}^{\mathrm{fc}}+n_{k}, (5) \displaystyle S_{k} \displaystyle:=\mathrm{Cov}(z_{k})=C_{k}P_{k}^{\mathrm{fc}}C_{k}^{\top}+R. (6) Data assimilation (da) \displaystyle K_{k} \displaystyle=P_{k}^{\mathrm{fc}}C^{\top}S_{k}^{-1}, (7) \displaystyle x_{k}^{\mathrm{da}} \displaystyle=x_{k}^{\mathrm{fc}}+K_{k}\,z_{k}, (8) \displaystyle e_{k}^{\mathrm{da}}: \displaystyle=x_{k}-x_{k}^{\mathrm{da}}, (9) \displaystyle P_{k}^{\mathrm{da}} \displaystyle=\big(I_{n\times n}-K_{k}C\big)P_{k}^{\mathrm{fc}}. (10) These equations are optimal under the classical assumption that both v_{k} and n_{k} are white (that is, i.i.d.) sequences. In the optimal KF, the innovations z_{k} is white; in particular, its first-lag autocorrelation implied by ( 5 ) is zero. When the process noise is colored , this whiteness property no longer holds and the KF becomes suboptimal. II-A Coloring Filter The standard approach for the case of colored process noise is to augment the system with a coloring filter that captures the autocorrelation of v_{k} . As a representative model, consider the second-order strictly proper transfer function \displaystyle H({\bf q})=\frac{\gamma_{3}{\bf q}+\gamma_{2}}{{\bf q}^{2}+\gamma_{1}{\bf q}+\gamma_{0}}, (11) where {\bf q} is the forward shift operator and \gamma_{0,1,2,3} are constants. In practice, however, these coloring dynamics are rarely known a priori. The objective of this article is therefore to develop an online algorithm that adapts to the unknown process-noise coloring in real time, thereby restoring near-optimality by driving the innovations towards whiteness. II-B State Augmentation Consider the coloring filter realization for the process noise given by \displaystyle X_{H,k+1} \displaystyle=A_{H}X_{H,k}+B_{H}w_{k}, (12) \displaystyle v_{k} \displaystyle=C_{H}X_{H,k}, where w_{k} is white with distribution \mathcal{N}\!\left(0,\frac{\sigma_{v}^{2}}{|H(z)|^{2}}\right) . The controllable-canonical realization of the second-order strictly proper transfer function in ( 11 ) is given by \displaystyle A_{H} \displaystyle=\begin{bmatrix}-\gamma_{1}&-\gamma_{0}\\ 1&0\end{bmatrix},\quad B_{H}=\begin{bmatrix}1\\ 0\end{bmatrix}, \displaystyle C_{H} \displaystyle=\begin{bmatrix}\gamma_{2}&\gamma_{3}\end{bmatrix}. To embed the coloring filter ( 12 ) into the plant model ( 1 ), we write \displaystyle x_{k} \displaystyle=Ax_{k-1}+Bv_{k-1} \displaystyle=Ax_{k-1}+B(C_{H}X_{H,k-1}) \displaystyle=Ax_{k-1}+BC_{H}(A_{H}X_{H,k-2}+B_{H}w_{k-2}), leading to the augmented system \displaystyle x_{{\rm aug},k} \displaystyle=A_{\rm aug}x_{{\rm aug},k-1}+B_{\rm aug}w_{k-1}, (13) \displaystyle y_{{\rm aug},k} \displaystyle=C_{\rm aug}x_{{\rm aug},k}, where x_{{\rm aug},k}=\begin{bmatrix}x_{k}\\ x_{H,k}\end{bmatrix} , A_{\rm aug}=\begin{bmatrix}A&BC_{H}\\ 0&A_{H}\end{bmatrix} B_{\rm aug}=\begin{bmatrix}0_{n\times 1}\\ B_{H}\end{bmatrix} , C_{\rm aug}=[C\quad 0_{1\times m}] . This technique fully specifies the augmentation of the coloring filter into the system dynamics. If the coloring model matches the true coloring of v_{k} , then the KF applied to the augmented system remains optimal and the innovations is white (that is, its first-lag autocorrelation is zero). In practice, the coloring dynamics may not be known exactly, which induces residual autocorrelation and suboptimality. Accordingly, we introduce an online optimization procedure to learn the coloring filter in real time. III Whiteness of Process Noise and Innovations This section establishes an equivalence between the whiteness of the innovations and the whiteness of the process noise under the assumption that the process noise v_{k} and measurement noise n_{k} are mutually independent and measurement noise n_{k} is white. Proposition 1. Assume that the process noise v_{k} and measurement noise n_{k} for a

Read the complete text