Sequential Markov Chain Monte Carlo for Filtering of State-Space Models with Low or Degenerate Observation Noise
2025
Read Sequential Markov Chain Monte Carlo for Filtering of State-Space Models with Low or Degenerate Observation Noise (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04975.txt.
Introduction
Abylay Zhumekenov and co-authors design filters for hidden state models when the sensor noise is tiny or fully absent. In such models, each sighting depends only on a hidden chain, and low noise makes standard filters hard to run.
The authors derive the filter law and its step-by-step update on spaces shaped by the sighting rule. They then build serial Monte Carlo methods that track the filter over time. For one linear case, they prove the low-noise method meets the no-noise method as noise fades, and tests show how the approach fares on hard cases.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-04975
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Sequential Markov Chain Monte Carlo for Filtering of State-Space Models with Low or Degenerate Observation Noise Abstract We consider the discrete-time filtering problem in scenarios where the observation noise is degenerate or low. More precisely, one is given access to a discrete time observation sequence which at any time k k depends only on the state of an unobserved Markov chain. We specifically assume that the functional relationship between observations and hidden Markov chain has either degenerate or low noise. In this article, under suitable assumptions, we derive the filtering density and its recursions for this class of problems on a specific sequence of manifolds defined through the observation function. We then design sequential Markov chain Monte Carlo methods to approximate the filter serially in time. For a certain linear observation model, we show that using sequential Markov chain Monte Carlo for low noise will converge as the noise disappears to that of using sequential Markov chain Monte Carlo for degenerate noise. We illustrate the performance of our methodology on several challenging stochastic models deriving from Statistics and Applied Mathematics. Key words : Observation Noise, Filtering, Manifold Markov Chain Monte Carlo. BY ABYLAY ZHUMEKENOV 1 , ALEXANDROS BESKOS 2 , DAN CRISAN 3 , AJAY JASRA 1 & NIKOLAS KANTAS 3 1 School of Data Science, The Chinese University of Hong Kong, Shenzhen, Shenzhen, CN. 2 Department of Statistical Science, University College London, London, WC1E 6BT, UK 3 Department of Mathematics, Imperial College London, London, SW7 2AZ, UK E-Mail: [email protected]; [email protected];[email protected]; [email protected]; [email protected] 1 Introduction We consider the following filtering problem (e.g. [ 2 ] ). We have access to discrete-time observations Y_{1},Y_{2},\dots , Y_{k}\in\mathbb{R}^{d_{y}} , k\in\mathbb{N} , that are associated to an unobserved discrete-time Markov chain X_{0},X_{1},\dots , X_{k}\in\mathbb{R}^{d_{x}} , k\in\mathbb{N} . It is supposed that at any time k\in\mathbb{N} we can write either \displaystyle Y_{k} \displaystyle=h_{k}(X_{k}),\quad\text{degenerate noise,} \displaystyle Y_{k} \displaystyle=\widetilde{h}_{k}(X_{k},\epsilon_{k}),\quad\text{low noise,} where h_{k}:\mathbb{R}^{d_{x}}\rightarrow\mathbb{R}^{d_{y}} is not injective and \epsilon_{1},\epsilon_{2},\dots is an independent and identically distributed (i.i.d.) sequence of \mathbb{R}^{d_{y}} random variables with ‘small variance’, \widetilde{h}_{k}:\mathbb{R}^{d_{x}}\times\mathbb{R}^{d_{y}}\rightarrow\mathbb{R}^{d_{y}} . To substantiate the phrase small variance, one could imagine that \epsilon_{k} has a d_{y}- dimensional Gaussian distribution of mean zero and covariance \Delta\mathtt{I}_{d_{y}} with \Delta>0 but close to zero and \mathtt{I}_{d_{y}} the d_{y}\times d_{y} identity matrix. The objective of either the degenerate or low (or small) noise case, assuming it is well-defined, is to estimate expectations with respect to (w.r.t.) the conditional distribution of X_{k} given all the observations up-to time k , Y_{1:k}=(y_{1},\dots,y_{k})^{\top} , recursively in time. These problems are important in many applications in filtering problems where it is expected that the signal dynamics (unobserved Markov chain) is strongly driving the observed data; see for instance [ 3 , 17 , 30 ] for several applications. Understanding filtering in the low noise regime has attracted long interest in the past from researchers focusing on continuous time dynamics and devising robust (extended) Kalman-Bucy type approximations of the filter [ 7 , 20 , 23 , 26 , 27 ] or establishing large deviations results for low \Delta [ 16 , 25 ] , see also [ 21 ] for a recent review. In general, we need to stress that the filtering distributions are typically analytically intractable except in fairly simple models, such as ones involving linear and Gaussian dynamics. Using analytical approximations such as the extended Kalman filter or variants are biased and most often do not perform well for a many models. As a result, there is a vast literature in designing numerical algorithms based on Monte Carlo for approximating the filter; we refer the reader to [ 2 , 11 ] and the references therein for a complete treatment. In this article we focus upon developing Monte Carlo based algorithms for approximating the filter for degenerate or low noise case. Perhaps the most popular simulation method for low-dimensional filtering problems ( d_{x}\in\{1,2,\dots,10\} ) is the particle filter (PF) (see e.g. [ 2 , 11 ] ) which entails sampling N\in\mathbb{N} particles in parallel, with the particles undergoing sampling, weighting and resampling operations. There are several related methods in high-dimensions such as [ 5 , 28 ] and the approach that we are to focus upon is sequential Markov chain Monte Carlo (SMCMC) [ 4 , 9 , 22 ] which has been shown to be one of the most competitive methods (at least empirically) when trying to approximate the filter in high-dimensions [ 29 ] . The main issue that we deal with in this article is the appropriate formulation of the filter in a manner that takes into consideration the observation regime of interest and the corresponding development of effective computational approximations. In the degenerate noise case, we follow works such as [ 12 , 14 , 15 ] in defining the filter on a manifold \mathsf{M}_{k}=\{x\in\mathbb{R}^{d_{x}}:y_{k}-h_{k}(x)=0\} . In general, this manifold has zero Lebesgue measure and one must seek to derive a filter w.r.t. a more appropriate dominating measure. Under appropriate mathematical conditions we are able to derive the filtering density and the traditional filtering recursions of this density w.r.t. the Riemannian measure, i.e. we focus on the case where we can perform filtering on Riemannian manifolds. Previously, [ 18 ] also considered defining the filter along these lines, but focused only on continuous time dynamics for X and did not provide filtering recursions useful for discrete time models or appropriate numerical methods, which is the focus of this paper. We further show that the low-noise case can be cast in a similar framework and this can have substantial benefits in designing efficient numerical methods that are robust to very low observation noise. Having formulated the filter and its recursions we then seek to design computational methods for its approximation. Generic particle filtering or SMCMC methodologies referenced in the previous paragraph are not designed for filtering with degenerate noise. In particular, using a particle filter in the setting of interest in this work gives rise to some challenges: 1. In the context of degenerate noise one has to design importance sampling proposal dynamics that can move from one manifold to another. 2. In the small noise case, one expects that standard implementations of particle filters, oblivious to the prescribed model structure, will be rather inefficient, with a likely collapse of the importance weights to zero. Whilst 1. is certainly an interesting open research question, it requires a substantial effort and then, at best, one can address low dimensional filtering problems. In 2. this circumvents the use of the PF in small noise filtering problems. In the context of using MCMC for sampling from probability measures defined on a manifold, there is already a substantial number of methods; a non-exhaustive list includes [ 6 , 8 , 14 , 15 , 31 ] . Given the success of the application of SMCMC in filtering in [ 29 ] it therefore seems natural to then design SMCMC for our class of filtering problems. The main contributions of this article are as follows: • Establishing a sequence of filtering densities w.r.t. the Riemannian measure, along with filtering recursions for the degenerate noise case and then extending this framework to encompass the low noise case. • Designing SMCMC methods for the afore-mentioned