Two Localization Strategies for Sequential MCMC Data Assimilation with Applications to Nonlinear Non-Gaussian Geophysical Models
2026
Read Two Localization Strategies for Sequential MCMC Data Assimilation with Applications to Nonlinear Non-Gaussian Geophysical Models (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05817.txt.
Introduction
Ruzayqat and team present step-by-step Markov Chain Monte Carlo uptake for high-D, non-line, non-Gauss state-space models. Particle filters differ: step-by-step MCMC assigns no sample weights, dodging collapse in small groups. Two local methods exploit sight thinness to cut degrees. The first gathers seen blocks into one domain with side-by-side chains over it. The second splits the region into apart blocks with halos, thinning distant sights. Tests on high-D models show heavy-tailed errors handled where group Kalman methods split.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 91004 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.05817
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Two Localization Strategies for Sequential MCMC Data Assimilation with Applications to Nonlinear Non-Gaussian Geophysical Models Abstract We present a localized data assimilation (DA) scheme based on the sequential Markov Chain Monte Carlo (SMCMC) technique [ 49 ] , a provably convergent method for filtering high-dimensional, nonlinear, and potentially non-Gaussian state-space models. Unlike particle filters, which are exact methods for nonlinear non-Gaussian models, SMCMC does not assign weights to samples and therefore avoids weight degeneracy in small-ensemble regimes. We design two localization approaches within the SMCMC framework that exploit spatial sparsity of observations to reduce the effective degrees of freedom and improve efficiency. The first variant collects observed blocks into a single reduced domain and runs parallel MCMC chains over this combined region. The second variant further reduces the per-chain state dimension by decomposing the observed region into independent blocks, each augmented with a compact halo, and applying Gaspari–Cohn observation-noise tapering to smoothly down-weight distant observations. When the observation model is linear and Gaussian, we show that our approximate filtering density reduces to a Gaussian mixture from which independent samples can be drawn exactly. For nonlinear or non-Gaussian observation models, we employ an MCMC kernel. We test on high-dimensional ( d ∼ 10 4 − 10 5 d\sim 10^{4}-10^{5} ) state-space models, including a linear Gaussian model and a nonlinear multilayer shallow water equation with both linear and nonlinear observation operators. We consider Gaussian and non-Gaussian (Student- t t ) observation noise, showing that LSMCMC naturally handles heavy-tailed errors that cause ensemble Kalman methods to diverge. Observations include synthetic and real data from the Surface Water and Ocean Topography (SWOT) mission (NASA) and ocean drifter data (NOAA). We compare the two variants against each other and the local ensemble transform Kalman filter (LETKF). Keywords : Ensemble Data Assimilation, Localization, Sequential Markov Chain Monte Carlo, High-Dimensional Filtering, Non-Gaussian Noise, Nonlinear Data Assimilation MSC classes : 62M20, 60G35, 60J20, 94A12, 93E11, 65C40 Corresponding author : Hamza Ruzayqat. E-mail: [email protected] Code: https://github.com/ruzayqat/LSMCMC Hamza Ruzayqat 1 , Hristo G. Chipilski 2 , and Omar Knio 1 1 Applied Mathematics and Computational Science Program, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology, Thuwal, 23955-6900, KSA. 2 Department of Scientific Computing, Florida State University, 400 Dirac Science Library, Tallahassee, FL 32306-4120, USA. E-Mail: [email protected] , [email protected] , [email protected] 1 Introduction Data assimilation (DA) plays a crucial role in understanding and predicting complex systems states as accurately as possible. By combining partial, noisy observational data with numerical models, DA aims to predict the conditional probability distribution, or the filter distribution, of underlying hidden state variables that cannot be directly observed. In practice, data assimilation is widely utilized across various fields. In finance, it helps in predicting market trends and managing risks by improving the accuracy of financial models. In engineering, it is used to optimize systems and processes by refining predictions based on real-time data. In geophysical sciences, data assimilation is crucial for applications such as numerical weather prediction, where it provides vital information for forecasting weather patterns, understanding atmospheric conditions, and modeling oceanographic phenomena. These applications are particularly useful for paleoclimate reconstructions, ensuring maritime safety, and predicting natural hazards like tsunamis [ 41 ] . For a comprehensive introduction on DA and stochastic filtering see [ 7 , 11 , 34 , 16 ] . For a deeper exploration of specific applications and methodologies see [ 13 , 27 , 35 ] . Ensemble methods, such as the ensemble Kalman filter (EnKF) [ 22 , 31 , 23 ] and sequential Monte Carlo methods such as particle filters (PFs) [ 28 , 19 , 53 ] , are powerful DA tools that have gained significant attention in recent work; see [ 54 ] for a review of DA methods. These probabilistic methods, which can be formalized within a sequential Bayesian inference framework, use multiple ensemble members or particles to represent and propagate the system’s state dynamics, in conjunction with the available observations. Despite their inherent computational efficiency and their wide usage, ensemble Kalman methods can be inaccurate when dealing with strongly nonlinear and non-Gaussian models. Additionally, they have a tendency to significantly underestimate the overall uncertainty in the system in small ensemble regimes [ 44 , 52 , 54 ] . PFs, on the other hand, are exact methods (see e.g. [ 18 ] ) that assign weights to the ensemble members (also called particles) that reflect the likelihood of the observations. As the number of particles approaches infinity, the PF estimates the conditional distribution of the hidden state exactly, regardless of the type of noise present in the system or whether the underlying dynamical model is linear or non-linear. The computational complexity of PFs is fixed per-time-step update. However, in order to prevent the so-called weight degeneracy (see e.g. [ 8 ] ), the number of particles must grow exponentially with the dimensionality of the state space. This is the primary limitation of standard PF approaches, as they are typically only practical for low-dimensional problems. Several works in the literature have explored different techniques such as tempering, lagging and nudging to tackle this issue; see e.g. [ 1 , 48 , 17 , 36 ] . Another exact method for filtering is Markov chain Monte Carlo (MCMC) [ 11 ] . MCMC can be used to sample from the filter distribution, however, its computational complexity grows linearly with time, which makes it impractical for real-time applications. A possible solution to the linear growth of complexity is to use sequential MCMC. At each assimilation time step, one builds an MCMC chain initialized from one random sample at the previous time step. Sequential MCMC has been used in dynamic contexts in several works. For instance, in the work of [ 51 ] , a sequential MCMC based on Hamiltonian Monte Carlo (HMC) [ 42 ] was presented. The authors use HMC to build a chain of N samples from the posterior initialized from a uniformly picked sample from the previous time step. Another example is the work of [ 12 ] , where the authors use Sequential MCMC for dynamical cluster tracking. In [ 49 ] , a more practical filtering approach is presented where sequential MCMC chains are used to target the filter distribution at each time-step update. The method was mainly developed for state-space models (SSMs) with unknown random observational locations, but it can be used for general SSMs. The initial idea behind their scheme first appeared in [ 9 ] and was later used for point process filtering in [ 38 ] . The authors in [ 49 ] demonstrate that when high accuracy is needed and the state dimension is very large, the sequential MCMC filtering scheme (which we refer to as SMCMC from now on) is much more accurate and efficient when compared to ensemble methods. When the forward model noise covariance matrix Q_{k} (and the observation noise covariance R_{k} ) are dense, evaluating the transition and likelihood densities requires \mathcal{O}(d^{2}) and \mathcal{O}((d_{y}^{k})^{2}) operations per sample, respectively, due to the matrix–vector products in the quadratic forms. In many practical applications, Q_{k} and R_{k} are diagonal, so the quadratic forms reduce to element-wise operations and the overall