Unobservable Systems: No Problem for Noise Identification

Oliver Kost, Jindřich Duník, Ivo Punčochař, Ondřej Straka · 2025

Read Unobservable Systems: No Problem for Noise Identification by Oliver Kost, Jindřich Duník, Ivo Punčochař, Ondřej Straka (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23983.txt.

Introduction

Oliver Kost and co-authors show that a system can be partly blind and still have its noise levels identified. Engineers model moving systems with state-space equations and must know how strong the random kicks are, both inside the system and in its sensors. Some systems are unobservable, meaning their full state can never be reconstructed from outputs. That blindness was thought to block noise estimation too.

Their correlation method works from differences between measurements, and it delivers estimates that are unbiased and settle on the truth with enough data. It handles time-varying systems and even unknown inputs. The team packaged the method in a public MATLAB toolbox and tested it numerically. The title sums up the moral: unobservability is no excuse. Noise identification, they argue, asks less of a system than full state reconstruction does.

Catalog record

CREATOROliver Kost, Jindřich Duník, Ivo Punčochař, Ondřej Straka
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-23983

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Unobservable Systems: No Problem for Noise Identification Oliver Kost, Jindřich Duník, Ivo Punčochař, Ondřej Straka Abstract This paper deals with the noise identification of a linear time-varying stochastic dynamic system described by the state-space model. In particular, the stress is laid on the design of the correlation measurement difference method for estimation of the state and measurement noise covariance matrices for both observable and unobservable systems with possibly unknown input sequence. The method provides unbiased and consistent estimates and is implemented in a publicly available Matlab toolbox and numerically evaluated. I Introduction The availability of an accurate system model is a key prerequisite for the design of reliable algorithms for optimal control, fault detection, and signal-processing algorithms. Negligent system modelling may lead to insufficient control, detection, estimation quality, or even algorithm failure. Modern algorithms rely on the availability of the stochastic state-space model [ 1 ] . The model describes deterministic and stochastic phenomena governing the behaviour of the system quantities (called state) and the relation between the unknown state and the available noisy measurement produced by sensors. Hence, the state-space model can be virtually seen as a composition of two sub-models: deterministic and stochastic . The former captures system behaviour arising often from the first principles, based on physical, kinematical, chemical, mathematical, biological, or other laws and rules. The latter characterises the uncertain behaviour of the state and measurement, where the uncertainty is modelled by noises described in the stochastic framework. Due to the inherent difficulty in uncertainty modelling using the first principles, it has to be identified from data. Therefore, since the seventies, intensive research has been laid on the design of methods identifying properties, typically the covariance matrices, of the state and measurement noises. In the literature, five classes of noise identification methods are recognised [ 2 , 3 ] , namely, Bayesian [ 4 , 5 ] , covariance matching [ 6 , 7 ] , maximum likelihood [ 8 , 9 , 10 ] , machine-learning-based [ 11 ] , and correlation methods. In this paper, we focus on the correlation methods [ 12 , 13 , 14 ] , which, compared with other classes, are derived analytically without any assumption on the noise distribution or structure. These methods rely on the assumption of the system observability or detectability and known system input (if the input is present), which might be limiting for certain applications. For example, the unobservable system can be found in generation of the stable time scale 1 1 1 The accurate time synchronisation is required in a wide range of applications ranging from navigation through power distribution to financial services. The time scale is generated from an ensemble of (typically) atomic clocks using the Kalman-filter-based combination algorithms. As such, the accurate (linear) stochastic state-space model of the clock ensemble is required, where the deterministic part stems from the underlying physics and the stochastic part is identified from data [ 15 , 16 ] . , where the lack of observability is caused by measuring clock phase differences only [ 16 ] . The system with unknown input occurs, e.g., in a tracking, where the tracked object thrust need not be available [ 17 ] . In particular, we propose ordinary and weighted generalisations of the correlation measurement difference method (MDM) [ 14 ] allowing noise identification of linear stochastic system with unobservable state and unknown input sequence. Both generalisations, which differ in the estimation accuracy and algorithm complexity, adopt parametrisation of the unknown noise covariance matrices using a set of structure-defining matrices from [ 12 ] . These matrices allow simple and efficient descriptions of almost any noise structure. The developed MDM is implemented in available Matlab codes. II System Description and Noise Identification Consider the following linear time-varying (LTV) discrete-in-time stochastic dynamic model in state-space representation with additive noises and varying measurement dimension ​​​​ [ 18 ] ​​​ \displaystyle\mathbf{x}_{k+1} \displaystyle=\mathbf{F}_{k}\mathbf{x}_{k}+\mathbf{G}_{k}\mathbf{u}_{k}+\mathbf{E}_{k}\mathbf{w}_{k}, (1a) \displaystyle\mathbf{z}_{k} \displaystyle=\mathbf{H}_{k}\mathbf{x}_{k}+\mathbf{D}_{k}\mathbf{v}_{k}, (1b) for k=0,1,2,\ldots,\tau . The vectors \mathbf{x}_{k}\in\mathbb{R}^{n_{x}} , \mathbf{u}_{k}\in\mathbb{R}^{n_{u_{k}}} , and \mathbf{z}_{k}\in\mathbb{R}^{n_{z_{k}}} represent the immeasurable state of the system, the input, and the available measurement at time instant k , respectively. The state \mathbf{F}_{k}\in\mathbb{R}^{n_{x}\times n_{x}} , input \mathbf{G}_{k}\in\mathbb{R}^{n_{x}\times n_{u_{k}}} , state-noise-shaping \mathbf{E}_{k}\in\mathbb{R}^{n_{x}\times n_{w}} , measurement \mathbf{H}_{k}\in\mathbb{R}^{n_{z_{k}}\times n_{x}} , and measurement-noise-shaping \mathbf{D}_{k}\in\mathbb{R}^{n_{z_{k}}\times n_{v}} matrices are known and bounded. The state noise \mathbf{w}_{k}\in\mathbb{R}^{n_{w}} and the measurement noise \mathbf{v}_{k}\in\mathbb{R}^{n_{v}} are assumed to be zero-mean random variables with unknown but bounded covariance matrices \mathbf{Q}\in\mathbb{R}^{n_{w}\times n_{w}} and \mathbf{R}\in\mathbb{R}^{n_{v}\times n_{v}} . II-A Noise Identification The noise identification aims at the estimation of the covariance matrices \mathbf{Q} and \mathbf{R} from a set of measurements \mathbf{z}_{k} (and inputs \mathbf{u}_{k} if available) and known matrices \mathbf{F}_{k},\mathbf{G}_{k},\mathbf{E}_{k},\mathbf{H}_{k},\mathbf{D}_{k},\forall k . II-B Measurement Difference Method and the Goal The measurement difference method is a correlation method for the noise properties identification [ 19 , 14 ] . It is based on a statistical analysis of the available residual (or measurement prediction error) vector designed to be a linear function of the unknown state and measurement noise vectors. Availability of the residual vector allows noise identification (e.g., the noise covariance matrix (CM) estimation) using the least-squares (LS) method. Contrary to other correlation methods, the MDM provides unbiased and consistent estimates of the noise moments for an LTV model. The MDM, as well as any state-of-the-art noise identification method, relies on the assumptions of observable state \mathbf{x}_{k} and known input \mathbf{u}_{k},\forall k often under the assumption of time-invariant dimensions of the measurement and the input. In this paper, we generalise the MDM by relaxing the limiting assumptions on state observability, input availability, and invariant dimensions. In the following sections, we • Develop the residue calculation and analyse its statistical properties w.r.t. the state and measurement noises (Sec. III ). • Adopt noise CM parametrisation using a sum of known structure-defining matrices with unknown (and sought) weights that allow the efficient description of a priori known complex noise structures (Sec. III ). • Develop two MDM versions for noise covariance estimation differing in accuracy and complexity (Sec. IV ). • Analyse the MDM, relate it to other correlation methods and extend the MDM for identification under the assumption of an unknown input vector (Sec. V ). III Residue Definition, Calculation, and its Covariance The unique properties of the MDM stem from the definition of the residue, which can be calculated from available measurements and shown to be a linear function of the immeasurable state and measurement noises. III-A Augmented Measurement Vector Derivation of the MDM starts with a definition of the augmented measurement vector as [ 14 ] \displaystyle\mathbf{Z}_{k}=\mathcal{O}_{k}\mathbf{x}_{k}+\mathbf{\Gamma}_{k}\mathcal{G}_{k}\mathbf{U}_{k}+\mathbf{\Gamma}_{k}{E}_{k}\mathbf{W}_{k}+\mathcal{D}_{k}\mathbf{V}_{k} (2) for k=0,\ldots,\tau-\hskip 2.84526pt\mathbf{\grave{\!}}L , where \hskip 2.84526pt\mathbf{\grave{\!}}L\!=\!L-1 with L\!\geq\!1 is a user-defined parameter of which selection is discussed later, \mathbf{Z}_{k}\in\mathbb{R}^{n_{z\hskip-0.56905pt,\hskip-0.56905ptk\hskip-0.56905pt,\hskip-0.56905ptL}} , \mathcal{O}_{k}\in\mathbb{R}^{n_{z\hskip-0.56905pt,\hskip-0.56905ptk\hskip-0.56905pt,\hskip-0.56905ptL}\times n_{x}} , \mathbf{\Gamma}_{k}\in\mathbb{R}^{n_{z\hskip-0.56905pt,\hskip-0.56905ptk\hskip-0.56905pt,\hskip-0.56905ptL}\times\hskip 2.84526pt\mathbf{\grave{\!}}Ln_{x}} , \mathcal{G}_{k}\in\mathbb{R}^{\hskip 2.84526pt\mathbf{\grave{\!}}Ln_{x}\times n_{u\hskip-0.56905pt,\hskip-0.56905ptk\hskip-0.56905pt,\hskip-0.56905pt\hskip 2.84526pt\mathbf{\grave{\!}}L}} , {E}_{k}\in\mathbb{R}^{\hskip 2.84526pt\mathbf{\grave{\!}}Ln_{x}\times\hskip 2.84526pt\mathbf{\grave{\!}}Ln_{w}} , \mathcal{D}_{k}\in\mathbb{R}^{n_{z\hskip-0.56905pt,\hskip-0.56905ptk\hskip-0.56905pt,\hskip-0.56905ptL}\times Ln_{v}} , \mathbf{U}_{k}\in\mathbb{R}^{n_{u\hskip-0.56905pt,\hskip-0.56905ptk\hskip-0.56905pt,\hskip-0.56905pt\hskip 2.84526pt\mathbf{\grave{\!}}L}} , \mathbf{W}_{k}\in\mathbb{R}^{\hskip 2.84526pt\mathbf{\grave{\!}}Ln_{w}} , and \mathbf{V}_{k}\in\mathbb{R}^{Ln_{v}} are defined as \displaystyle\!\!\!\!\mathbf{Z}_{k} \displaystyle\triangleq\left[\begin{smallmatrix}\mathbf{z}_{k}\\ \mathbf{z}_{k+1}\\ \mathbf{z}_{k+2}\\[-2.00749pt] \vdots\\[-2.00749pt] \mathbf{z}_{k+\hskip 2.84526pt\mathbf{\grave{\!}}L}\end{smallmatrix}\right]\!,\ \mathcal{O}_{k}\triangleq\left[\begin{smallmatrix}\mathbf{H}_{k}\\ \mathbf{H}_{k+1}\mathbf{F}_{k}\\ \mathbf{H}_{k+2}\mathbf{F}_{k+1}\mathbf{F}_{k}\\[-3.01125pt] \vdots\\[0.0pt] \mathbf{H}_{k+\hskip 2.84526pt\mathbf{\grave{\!}}L}\mathcal{F}_{k}^{\hskip 2.84526pt\mathbf{\grave{\!}}L}\hskip-2.00749pt\end{smallmatrix}\right]\!, (3a) \displaystyle\!\!\!\!\mathcal{G}_{k} \displaystyle\triangleq\mathsf{blkdiag}\begin{bmatrix}\mathbf{G}_{k},&\mathbf{G}_{k+1},\mathbf{G}_{k+2},&\cdots&,\mathbf{G}_{k+L-2}\end{bmatrix}\!, (3b) \displaystyle\!\!\!\!{E}_{k} \displaystyle\triangleq\mathsf{blkdiag}\begin{bmatrix}\mathbf{E}_{k},&\mathbf{E}_{k+1},&\mathbf{E}_{k+2},&\cdots&,\mathbf{E}_{k+L-2}\end{bmatrix}, (3c) \displaystyle\!\!\!\!\mathcal{D}_{k} \displaystyle\triangleq\mathsf{blkdiag}\begin{bmatrix}\mathbf{D}_{k},&\mathbf{D}_{k+1},&\mathbf{D}_{k+2},&\cdots&,\mathbf{D}_{k+\hskip 2.84526pt\mathbf{\grave{\!}}L}\end{bmatrix}, (3d) \displaystyle\!\!\!\!\mathbf{\Gamma}_{k} \displaystyle\triangleq\left[\begin{smallmatrix}\mathbf{0}_{n_{z_{k}}\times n_{x}}&\mathbf{0}_{n_{z_{k}}\times n_{x}}&\cdots&\mathbf{0}_{n_{z_{k}}\times n_{x}}\\ \mathbf{H}_{k+1}&\mathbf{0}_{n_{z_{k+1}}\times n_{x}}&\cdots&\mathbf{0}_{n_{z_{k+1}}\times n_{x}}\\ \mathbf{H}_{k+2}\mathbf{F}_{k+1}&\mathbf{H}_{k+2}&\cdots&\mathbf{0}_{n_{z_{k+2}}\times n_{x}}\\[-2.00749pt] \vdots&\vdots&\hskip-3.01125pt\ddots&\vdots\\[0.0pt] \mathbf{H}_{k+\hskip 2.84526pt\mathbf{\grave{\!}}L}\mathcal{F}_{k+1}^{L-2}&\mathbf{H}_{k+\hskip 2.84526pt\mathbf{\grave{\!}}L}\mathcal{F}_{k+2}^{L-3}&\hskip 0.0pt\cdots\hskip 0.0pt&\mathbf{H}_{k+\hskip 2.84526pt\mathbf{\grave{\!}}L}\end{smallmatrix}\right]\!,\!\!\! (3e) \displaystyle\!\!\!\!\mathbf{U}_{k} \displaystyle\triangleq\!\left[\begin{smallmatrix}\mathbf{u}_{k}\\ \mathbf{u}_{k+1}\\ \mathbf{u}_{k+2}\\[-3.01125pt] \vdots\\[-3.01125pt] \mathbf{u}_{k+L-2}\end{smallmatrix}\right]\!,\ \mathbf{W}_{k}\triangleq\!\left[\begin{smallmatrix}\mathbf{w}_{k}\\ \mathbf{w}_{k+1}\\ \mathbf{w}_{k+2}\\[-3.01125pt] \vdots\\[-3.01125pt] \mathbf{w}_{k+L-2}\end{smallmatrix}\right]\!,\ \mathbf{V}_{k}\triangleq\!\left[\begin{smallmatrix}\mathbf{v}_{k}\\ \mathbf{v}_{k+1}\\ \mathbf{v}_{k+2}\\[-3.01125pt] \vdots\\[-3.01125pt] \mathbf{v}_{k+\hskip 2.84526pt\mathbf{\grave{\!}}L}\end{smallmatrix}\right]\!,\!\!\! (3f) where

Read the complete text