Fast Quadratic Manifold Learning For Nonlinear Dimensionality Reduction in Large-scale Systems using Riemannian Optimization
Gavin Paxton, Seunghee Cheon and Rudy Geelen, Shane A. McQuarrie · 2026
Read Fast Quadratic Manifold Learning For Nonlinear Dimensionality Reduction in Large-scale Systems using Riemannian Optimization by Gavin Paxton, Seunghee Cheon and Rudy Geelen, Shane A. McQuarrie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-26039.txt.
Introduction
Paxton, Cheon, Geelen and McQuarrie speed up quadratic manifold learning, a way to shrink nonlinear systems. Quadratic manifolds add bend terms to a reduced basis, but bases from top principal components suit straight fits, not curved ones. Greedy basis hunts improve fits yet cost too much for large bases. FastQM instead treats basis choice as smooth optimisation on the Stiefel manifold, turning the basis inside a span of candidate singular vectors. Tests on a turbulent airfoil wake show strong curved fits learned fast.
Catalog record
| CREATOR | Gavin Paxton, Seunghee Cheon and Rudy Geelen, Shane A. McQuarrie |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50944 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.26039
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fast Quadratic Manifold Learning For Nonlinear Dimensionality Reduction in Large-scale Systems using Riemannian Optimization Gavin Paxton, Seunghee Cheon and Rudy Geelen, Shane A. McQuarrie Abstract The effectiveness of dimensionality reduction with quadratic manifolds hinges on the choice of a reduced basis and the associated quadratic correction terms. Existing approaches typically rely on subspaces spanned by the leading principal components of the training data. Although optimal for linear approximation, such bases are inherently suboptimal for quadratic manifold learning. Greedy basis-selection methods can significantly improve the representational capacity of quadratic manifolds by searching over a larger pool of candidate principal components, but the combinatorial cost limits the basis sizes that can be used in practice. This work proposes FastQM , an approach that treats the identification of an optimal quadratic approximation as a continuous optimization problem on the Stiefel manifold. By rotating the reduced basis within a candidate span of singular vectors, FastQM learns an ideal coordinate alignment tailored to quadratic manifold approximation. A feature-space formulation ensures that the optimization cost scales independently of the full state-space dimension. The efficacy of the proposed method is demonstrated on a turbulent airfoil-wake large-eddy simulation. 1 Nomenclature t = Time variable N = Dimension of the high-dimensional state vector K = Number of training snapshots r = Dimension of the reduced-order linear subspace q = Dimension of the nonlinear correction subspace m = Number of candidate/feature modes \mathbf{s} = State vector, \mathbf{s}(t)\in\mathbb{R}^{N} \hat{\mathbf{s}} = Reduced-order state vector, \hat{\mathbf{s}}(t)\in\mathbb{R}^{r} \mathbf{S} = Snapshot matrix, \mathbf{S}\in\mathbb{R}^{N\times K} \tilde{\mathbf{S}} = Representation of the snapshot data in the candidate basis, \tilde{\mathbf{S}}\in\mathbb{R}^{m\times K} \boldsymbol{\Xi} = Weight matrix for nonlinear correction terms, \boldsymbol{\Xi}\in\mathbb{R}^{q\times r(r+1)/2} \gamma = Regularization parameter , \gamma\geq 0\in\mathbb{R} \sigma_{j} = j th singular value, \sigma_{i}\geq 0\in\mathbb{R} \mathbf{V}_{\!r} = Basis matrix for the linear term, \mathbf{V}_{\!r}\in\mathbb{R}^{N\times r} \mathbf{V}_{\!q} = Basis matrix for quadratic correction term, \mathbf{V}_{\!q}\in\mathbb{R}^{N\times q} \tilde{\mathbf{V}} = Basis matrix for candidate modes, \tilde{\mathbf{V}}\in\mathbb{R}^{N\times m} \mathbf{Q}_{r},\mathbf{Q}_{q} = Orthogonal matrices, [~\mathbf{Q}_{r}~~\mathbf{Q}_{q}~]\in\text{St}(m,r+q) \mathbf{I} = Identity matrix \mathbf{0} = Zero matrix \operatorname{Tr} = Matrix trace operator \otimes = Kronecker product \|\cdot\|_{F} = Frobenius norm \operatorname{St}(m,r) = Stiefel manifold of m\times r matrices with orthonormal columns 2 Introduction Large-scale physical systems are simulated by solving high-dimensional numerical models obtained by discretizing the governing equations, for example systems of partial differential equations (PDEs). Because such numerical models are often computationally expensive to solve, they are not typically suitable for real-time or multi-query applications such as design, optimization, or uncertainty quantification [ 5 , 24 ] . Model reduction addresses this challenge by constructing computationally efficient reduced-order models (ROMs) that approximate the dominant system behavior. Because the fidelity of a ROM is fundamentally constrained by its underlying state-space representation, dimensionality reduction is a core pillar of ROM design. Classical model reduction methods leverage linear subspaces to capture the essential dynamics; however, linear approximations often struggle to account for the intrinsic curvature of highly nonlinear solution manifolds. Consequently, building accurate ROMs may require large subspace dimensions, diminishing computational gains. In this work, we introduce FastQM , a framework for learning quadratic manifolds that minimizes reconstruction error by identifying a linear subspace and a matching quadratic correction term through numerical optimization. Importantly, the dimensionality of the search space does not scale with the size of the original state space, ensuring that the computational cost remains manageable even for large-scale problems. Our numerical results demonstrate that FastQM outperforms proper orthogonal decomposition (POD) and POD-based quadratic manifolds in reconstruction accuracy, establishing it as a viable choice for large-scale model reduction tasks. While POD [ 22 , 30 , 6 ] remains a primary tool for dimensionality reduction, it is restricted by the approximation properties of linear subspaces. For problems with strong nonlinearities, such as turbulent flows, this necessitates a large number of modes to accurately represent the system’s dynamics. This limitation has prompted efforts to bridge the gap between linear and nonlinear representations by approximating the system state with a linear projection plus a nonlinear correction term. Notable strategies include quadratic manifolds (QM) [ 18 , 25 , 3 , 15 , 29 , 28 , 27 , 26 , 9 ] , which augment linear representations with structured quadratic terms; higher-order polynomial and rational manifolds [ 13 , 14 , 8 , 20 , 34 ] , offering more general approximation spaces; and probabilistic manifold decompositions (PMD) [ 16 , 17 ] , which embed residuals into probabilistic latent spaces. Similarly, recent works have employed Gaussian process regression (GPR) and radial basis function (RBF) interpolation [ 4 , 2 ] , deep operator networks (DeepONets) [ 10 ] , and reproducing kernel Hilbert spaces (RKHS) [ 11 , 12 ] to learn the mapping from the latent state to the correction term. These methods all employ regression to reconstruct the components of the approximation space not captured by the linear basis, offering a data-efficient way to account for the physics discarded during traditional modal truncation while maintaining the original reduced-order dimension. We distinguish these nonlinear representation approaches from classical ROM closure modeling. While the latter introduces correction terms to the ROM governing equations to account for truncated modes, the methods discussed here enrich the approximation space itself. For a comprehensive review on modern ROM closures, we refer the reader to [ 1 ] . In what follows, we focus on QMs, which offers a compelling balance between nonlinear expressivity and structural transparency. While initial QM implementations use leading POD modes to define the linear subspace [ 3 , 13 , 14 ] , recent work by Schwerdtner and Peherstorfer has demonstrated that the principal components optimal for linear reconstruction are not necessarily the most effective basis for quadratic representation [ 28 , 27 ] . In these works, a greedy algorithm is used to select an optimal subset of modes from a larger candidate pool, and it is demonstrated that higher-order modes often contain crucial information for capturing nonlinear interactions. However, such greedy strategies are inherently combinatorial and discrete, restricting the search to fixed singular vector orientations and suffering from factorial complexity as the candidate pool grows. Recent extensions have incorporated dimension-dependent regularization [ 19 ] , yet the fundamental limitation remains: the subspace is constructed via selection rather than continuous optimization. It should also be noted that the choice of POD coordinates is largely one of practical convenience. Although POD is easy to implement, its optimality is strictly limited to the class of linear approximations, as it minimizes the \ell_{2} reconstruction error between snapshots and their projection onto a fixed-dimensional subspace. Coordinate transformations have been proposed to optimize the regression landscape [ 13 , 14 ] , but these formulations remain computationally intensive and lack the scalability required for large-scale applications. This work proposes a shift from discrete basis selection to continuous subspace identification via Riemannian optimization. Moving beyond the combinatorial selection of POD modes, we frame the search for an optimal basis as an optimization problem on the Stiefel manifold. By searching the space of all orthonormal frames, we identify a subspace specifically well suited for quadratic reconstruction. Our framework restricts the linear subspace to a predefined span of features (the leading POD modes) within which an optimal representation is identified. This allows for the continuous