Rapid Approximation Prediction for Kriging

Ziyu Li, Gregory Fasshauer, Douglas Nychka · 2026

Read Rapid Approximation Prediction for Kriging by Ziyu Li, Gregory Fasshauer, Douglas Nychka (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29284.txt.

Introduction

Ziyu Li and colleagues present a fast approximation for the Kriging prediction step for Gaussian processes on a regular grid. Exact Kriging and conditional simulation are too slow for modern spatial work with many observations and dense grids. Their method approximates each off-grid covariance vector by a sparse mix of on-grid values within a local neighborhood of grid points. This cuts compute sharply while keeping accuracy. A factorial study shows error falls with more smoothness, higher neighbor order, and finer grids, matching kernel theory.

Catalog record

CREATORZiyu Li, Gregory Fasshauer, Douglas Nychka
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54312
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.29284

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Rapid Approximation Prediction for Kriging Ziyu Li, Gregory Fasshauer, Douglas Nychka Abstract Exact Kriging and conditional simulation (CS) for uncertainty quantification are computationally infeasible for modern spatial analyses with large numbers of observations and dense prediction grids. We present a rapid approximation to the Kriging prediction step for stationary Gaussian processes for a regular prediction grid by approximating each off-grid covariance vector by a sparse linear combination of on-grid covariances within a local L L -order neighborhood of M = ( 2 ​ L ) 2 M=(2L)^{2} neighboring grid points. This reformulation reduces complexity from 𝒪 ⁡ ( N ​ n 3 ) \mathcal{O}(Nn^{3}) to 𝒪 ⁡ ( N ​ log ⁡ N + n ​ M + M 3 ) \mathcal{O}(N\log N+nM+M^{3}) while preserving accuracy. A factorial study shows that approximation error decreases systematically with increased Matérn smoothness, neighbor order L L , and grid resolution, aligning with bounds from kernel approximation theory. In a North American summer-rainfall application ( n = 1368 n=1368 ), our method produces predictions visually indistinguishable from exact Kriging with point-wise errors on the order of 10 − 5 10^{-5} inches and achieves more than 150 150 times speedups at a 350 × 350 350\times 350 grid, also outperforming Vecchia and LatticeKrig predictions. Embedded in a fast CS scheme, the approach reproduces Kriging standard errors and scales favorably with both n n and N N . We recommend a practical workflow that uses a fast method for parameter estimation followed by our rapid predictor for fine-grid mapping and uncertainty quantification. Keywords: computational statistics, gaussian process, spatial statistics, kernel approximation methods, error bound, Kriging, uncertainty quantification 1 Introduction A central problem in spatial statistics is the modeling of point-wise scattered or gridded data with spatial components and making predictions at unobserved locations. The field of spatial statistics builds on Tober’s First Law of Geography: “everything is related to everything else, but near things are more related than distant things” ( Tobler 1970 ) using the covariance function of a Gaussian process as a way to quantify relatedness. In addition to making predictions at unobserved locations, spatial statistical tools can also attach a measure of uncertainty to those predictions. Both of these tasks can be prohibitively time consuming using exact methods with many observations and at many prediction locations. In this work we propose a simple but accurate approximation to the prediction step in a spatial statistical analysis based on stationary Gaussian processes (GP) and document dramatic speedups in the computation. Our analysis is based on the observational spatial model under a universal Kriging context z_{i}=X_{i}\beta+g(\mathbf{s}_{i}^{O})+\epsilon_{i},\text{ for }i=1,\dots,n. (1) We use z_{i} to denote the i -th observation at its possibly irregularly distributed spatial location \mathbf{s}_{i}^{O} . Note that \mathbf{s}_{i}^{O} is the spatial location and the “ O ” indicates it is an observation location. X_{i} are known covariates as part of the linear model fixed process, and g is a mean zero Gaussian process that depends on the spatial location. \epsilon_{i} are independent errors with \epsilon_{i}\sim N(0,\tau^{2}) with \tau^{2} also known as the nugget variance . The goal is to draw inferences about the linear model parameters, \beta , and the spatial field f_{j}=X_{j}\beta+g(\mathbf{s}_{j}) with j=1,\dots,N , where j indexes unobserved locations. The base method for estimating f we term Kriging ( Krige 1952 ) , even though we will make more distributional assumptions than in geostatistics. Throughout we denote the spatial estimate as \hat{f} . Under the assumptions that the covariance function for g and \tau^{2} are known, then \hat{f} will be the best linear unbiased estimate for f , and the distribution of \hat{f} is multivariate normal with covariance matrix depending on the locations of observations and predictions and \tau^{2} ( Matheron 1965 ) . Despite having a closed form, using this distribution analytically for statistical inference is difficult for at least two reasons. One is that for large n and N the computations can grow as \mathcal{O}(Nn^{3}) and storage increases as \mathcal{O}(n^{2}+N) . Due to the cubic complexity in n , there is a limit to the size of spatial data sets that can be easily analyzed with typical computing resources. For a laptop and R this limit is currently around several thousand for n and tens of thousands for N , and prohibits the flexible and interactive analysis of larger spatial data sets. A second limitation is that inference for a spatial field is often a nonlinear function of the predictions and requires Monte Carlo sampling. This requires additional computation that is determined by both n and N . In this work, we propose a numerical algorithm for rapid spatial prediction onto a regular grid and for stationary covariance functions. This has a direct benefit of evaluating the Kriging prediction on a large grid to provide a smooth surface for visualization and for finding contours. Moreover, rapid prediction is also valuable for spatial inference when Monte Carlo computations are used to approximate the Kriging uncertainty. In either case, our goal is to provide accurate approximations that can give speedups on the order of a hundred or more. Our experience is that when this kind of efficiency is obtained it offers new ways of thinking about interactive data analysis and building statistical models. Here, we leverage the fast numerical operation of convolution on a regular grid via the Fast Fourier Transform (FFT). This is done by approximating any covariance evaluation using just the covariance evaluated at grid points. Because our method is efficient, one can entertain a fine grid without much penalty for the extra computation time, and so it is easy to improve the accuracy of the approximations. Conditional Simulation (CS) is a Monte Carlo-based algorithm that is well suited for quantifying Kriging prediction uncertainty. The idea is that a Monte Carlo sample can be used to approximate the prediction variances or to find an empirical distribution for nonlinear functions of the predictions. A smaller number of Monte Carlo draws from the multivariate normal is often more efficient to estimate the sampling distributions rather than direct analytical formulas. This strategy is akin to sampling from the posterior distribution in a Bayesian analysis rather than working directly with the posterior probability density function. The key steps of CS are to (1) simulate an unconditional GP at the combined observation and prediction locations and (2) compute the Kriging prediction based on the simulated observations according to (1). Although we do not address Bayesian computations directly, it should be noted that CS is also intrinsic to sampling the posterior of the spatial process given posterior samples of the other statistical parameters. CS becomes difficult to implement for large problems.For large prediction grids, unconditional simulation becomes computationally intensive if observation locations are not also on the prediction grid. Previous work by Bailey et al. proposed a local simulation algorithm to provide fast, approximate unconditional fields for this first step ( Bailey et al. 2022 ) when the observations are at irregular locations. The success of the local simulation algorithm, however, then identified the prediction step as a computational bottleneck. Reducing the time for this second step in CS is the motivation for this work. It may come as a surprise to the reader that the

Read the complete text