Numerical Considerations for the Construction of Karhunen-Loève Expansions

Cosmin Safta, Habib N. Najm · 2026

Read Numerical Considerations for the Construction of Karhunen-Loève Expansions by Cosmin Safta, Habib N. Najm (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-19108.txt.

Introduction

Safta and Najm examine how to build Karhunen-Loeve expansions for random processes with care. The method breaks a covariance operator into modes through an integral equation. On a grid, that task becomes a matrix eigen problem. They show it matches a scaled singular value split of the sample matrix. That link gives one path for model-based and data-driven builds. Known kernel cases serve as checks in one dimension. Tests in two and three dimensions show how grid, rule, and sample choices trade off.

Catalog record

CREATORCosmin Safta, Habib N. Najm
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56245
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.19108

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Numerical Considerations for the Construction of Karhunen-Loève Expansions Cosmin Safta, Habib N. Najm Abstract This report examines numerical aspects of constructing Karhunen-Loève expansions (KLEs) for second-order stochastic processes. The KLE relies on the spectral decomposition of the covariance operator via the Fredholm integral equation of the second kind, which is then discretized on a computational grid, leading to an eigendecomposition task. We derive the algebraic equivalence between this Fredholm-based eigensolution and the singular value decomposition of the weight-scaled sample matrix, yielding consistent solutions for both model-based and data-driven KLE construction. Analytical eigensolutions for exponential and squared-exponential covariance kernels serve as reference benchmarks to assess numerical consistency and accuracy in 1D settings. The convergence of SVD-based eigenvalue estimates and of the empirical distributions of the KL coefficients to their theoretical 𝒩 ⁡ ( 0 , 1 ) \mathcal{N}(0,1) target are characterized as a function of sample count. Higher-dimensional configurations include a two-dimensional irregular domain discretized by unstructured triangular meshes with two refinement levels, and a three-dimensional toroidal domain whose non-simply-connected topology motivates a comparison between Euclidean and shortest interior path distances between the grid points. The numerical results highlight the interplay between the discretization strategy, quadrature rule, and sample count, and their impact on the KLE results. K eywords Karhunen-Loeve Expansion \cdot random field \cdot Fredholm equation \cdot singular value decomposition \cdot numerical quadradure 1 Introduction Random field representations are a foundational tool in computational science and engineering, providing a rigorous mathematical framework for quantifying field uncertainty in physical systems. Applications span a broad range of disciplines, including subsurface flows, material science, and uncertainty quantification (UQ) for high-fidelity simulations. A common challenge in all of these settings is the need to represent, discretize, and sample from infinite-dimensional stochastic processes using a finite number of parameters, while preserving the statistical structure of the underlying field. The Karhunen-Loève expansion (KLE) [ 3 ] addresses this challenge by providing an optimal, mean-square-convergent series spectral representation of a second-order stochastic process in terms of a set of deterministic orthogonal basis functions and uncorrelated scalar random variables. † † footnotetext: Paper published as Sandia National Laboratories Technical Report SAND2026-18707. In its continuous form, the KLE is computed via the solution of a Fredholm integral equation of the second kind, whose kernel is the covariance function of the process. The resulting eigen-pairs - eigenvalues and eigenfunctions - provide a hierarchical decomposition of the process variance, with the leading modes capturing the dominant spatial correlations. The KLE is optimal in the mean-square sense, i.e. any truncation to a finite number of terms minimizes the mean-square reconstruction error among all linear orthogonal expansions of the same dimension, which lends itself useful for dimensionality reduction. This property is shared with principal component analysis (PCA) in the data-driven setting [ 5 ] . The use of KLEs in computational science and UQ gained momentum following the work of Ghanem and Spanos [ 2 ] , who employed it in the stochastic finite element method to propagate input uncertainties through partial differential equation (PDE) models. Their framework, combined with polynomial chaos expansions for the output quantities of interest, established a spectral approach to stochastic computation. Le Maître and Knio [ 4 ] provide a comprehensive overview of spectral methods for UQ that encompasses KLE methods. The accuracy and efficiency of the downstream UQ computation depends on the fidelity of the KLE used to parameterize uncertain input fields. Numerous studies have examined the numerical aspects of constructing KLEs in practical settings. The discretization of the Fredholm equation on a finite spatial mesh converts the continuous eigenproblem into a discrete one. Betz et.al. [ 1 ] provide a systematic comparison of discretization strategies - including the Galerkin, collocation, and midpoint methods - and their accuracy as a function of the mesh resolution relative to the correlation length. Schwab and Todor [ 6 ] analyzed the convergence properties of KLE approximations and developed fast multipole-based methods to reduce the computational cost of assembling and solving large covariance eigenproblems. Alternative computational approaches avoid the explicit formation of the covariance matrix by working with an ensemble of field realizations: the singular value decomposition (SVD) of the sample matrix yields the same eigenpairs as the discretized Fredholm equation when quadrature weights are incorporated appropriately. This connection to PCA and the SVD is well-established in the statistical literature [ 5 ] and motivates data-driven KLE constructions in settings where an analytical covariance model is not available. The choice of covariance kernel - exponential, squared-exponential, and others - governs the smoothness of the random field realizations and the rate of eigenvalue decay, which in turn determines how many KLE terms are needed for a given accuracy. Analytical eigensolutions exist only for a limited class of kernels on simple domains, e.g. the exponential kernel on a bounded interval [ 2 ] and the squared-exponential kernel on the real line under a Gaussian spatial measure [ 5 , 7 ] , and these serve as benchmarks for validating numerical implementations. The accuracy of a numerical KLE depends on the interplay between several modeling choices: the discretization of the computational domain, the correlation length of the covariance kernel relative to the domain size, and - in the data-driven setting - the number of available random field samples. Under-resolved grids fail to capture the oscillatory structure of high-frequency eigenmodes, while an insufficient sample count introduces statistical variability in the estimated eigenvalues and may lead to empirical KLE coefficients that deviate from the expected distribution. These issues become particularly pronounced in multi-dimensional settings and on complex, non-simply-connected domains, where the choice of distance metric used to evaluate the covariance function (Euclidean versus shortest interior path) can affect the eigensolution. In this technical report we present the theoretical underpinnings of the KLE, derive analytical solutions for the exponential and squared-exponential covariance kernels, and then study the effect of modeling choices highlighted above on the numerical KLE results. The report is organized as follows. Section 2 establishes the mathematical framework, presenting the Karhunen-Loève expansion, the Fredholm integral equation of the second kind, and the relationship between the continuous expansion and its discretized counterparts, including both the assembly-based and SVD-based solution strategies. Section 3 presents a numerical study of KLE construction across a range of mesh discretizations, correlation lengths, and sample sizes. One-, two-, and three-dimensional test cases are considered, including domains with unstructured meshes and a toroidal geometry for which the effect of the choice of distance metric (Euclidean versus shortest interior path) on the eigensolution is examined. Section 4 summarizes this report. 2 Karhunen-Loève Expansions 2.1 Definitions Let (\Omega,\Sigma,\mathrm{P}_{\mathrm{\Sigma}}) be a probability space, with \Omega being the sample space, \Sigma a \sigma- algebra over \Omega , and \mathrm{P}_{\mathrm{\Sigma}} a probability measure assigning probabilities for each event \omega in \Sigma . We consider a d- dimensional space \mathfrak{D}\subset\mathbb{R}^{d} . Let Y(\bm{x},\omega) , with \bm{x}\in\mathfrak{D} , e.g. spatial and/or temporal coordinates, and \omega\in\Sigma a random event, be a stochastic process over the space \mathfrak{D}\times\Omega , Y:\mathfrak{D}\times\Omega\rightarrow\mathbb{R} . For any fixed \bm{x}\in\mathfrak{D} , Y(\bm{x},\cdot) is a random variable and for any fixed event \omega\in\Sigma , Y(\cdot,\omega) is a sample from a stochastic process over \mathfrak{D} . We consider the case with second-order random variables (RVs), i.e. RVs with finite

Read the complete text