Localized PCA-Net Neural Operators for Scalable Solution Reconstruction of Elliptic PDEs
Mrigank Dhingra, Romit Maulik, Adil Rasheed, Omer San · 2025
Read Localized PCA-Net Neural Operators for Scalable Solution Reconstruction of Elliptic PDEs by Mrigank Dhingra, Romit Maulik, Adil Rasheed, Omer San (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-18110.txt.
Introduction
Mrigank Dhingra and 3 co-authors shrink equation solvers by working patch by patch. Their 2025 paper deals with neural operators, nets that learn to solve a class of equations from data. A global squeeze of a huge solution field costs a lot, which caps scale.
Their frame cuts the field into small patches and squeezes each patch on its own. Two patch styles are weighed: one that pools patches into a global code, and one that keeps each patch local. Add-ons such as overlap with smoothing, and a net-based polish, lift the best style. Run time fell near fourfold, with score held high.
Catalog record
| CREATOR | Mrigank Dhingra, Romit Maulik, Adil Rasheed, Omer San |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-18110
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Localized PCA-Net Neural Operators for Scalable Solution Reconstruction of Elliptic PDEs Mrigank Dhingra, Romit Maulik, Adil Rasheed, Omer San Abstract Neural operator learning has emerged as a powerful approach for solving partial differential equations (PDEs) in a data-driven manner. However, applying principal component analysis (PCA) to high-dimensional solution fields incurs significant computational overhead. To address this, we propose a patch-based PCA-Net framework that decomposes the solution fields into smaller patches, applies PCA within each patch, and trains a neural operator in the reduced PCA space. We investigate two different patch-based approaches that balance computational efficiency and reconstruction accuracy: (1) local-to-global patch PCA, and (2) local-to-local patch PCA. The trade-off between computational cost and accuracy is analyzed, highlighting the advantages and limitations of each approach. Furthermore, within each approach, we explore two refinements for the most computationally efficient method: (i) introducing overlapping patches with a smoothing filter and (ii) employing a two-step process with a convolutional neural network (CNN) for refinement. Our results demonstrate that patch-based PCA significantly reduces computational complexity while maintaining high accuracy, reducing end-to-end pipeline processing time by a factor of 3.7 to 4× compared to global PCA, thefore making it a promising technique for efficient operator learning in PDE-based systems. 1 Introduction Numerical simulation and analysis of PDEs play a central role across numerous fields, including fluid dynamics, heat transfer, and electromagnetics. Traditional PDE solvers, such as finite-difference and finite-element methods, often require significant computational resources, especially for high-dimensional systems or large-scale domains brandt1977multi ; blanusa2022roleinternalvariabilityglobal ; quarteroni2008numerical . Recently, data-driven neural operators have emerged as powerful alternatives, capable of rapidly approximating PDE solutions by learning mappings directly from input conditions to PDE solution spaces li2021fourierneuraloperatorparametric ; lu2021deeponet ; kovachki2023neural ; HUA202321 ; kadeethum2023latentNO ; TRIPURA2023115783 ; 10.5555/3648699.3649087 ; 10.5555/3618408.3618917 ; 10.1093/nsr/nwad336 ; RAMEZANKHANI2025109886 ; GRADY2023105402 ; seo2022pretraining . PCA is a widely-used dimensionality reduction technique frequently integrated into neural operators to reduce computational complexity and enhance generalization capabilities SMAI-JCM_2021__7__121_0 ; 10.5555/3648699.3649017 . However, applying PCA globally across high-dimensional solution fields poses a significant computational bottleneck, primarily due to the expensive singular value decomposition (SVD) step involved. Specifically, performing PCA via SVD on an m\times n data matrix ( m samples, each of dimension n ) entails computational complexity of: \mathcal{O}(\min(mn^{2},m^{2}n)). (1) Recent advances in operator learning have increasingly adopted domain decomposition strategies to address the scalability limitations of global neural solvers klawonn2024mlddm . These approaches divide the computational domain into smaller, localized regions and train separate neural networks or operators within each subdomain 10.5555/3618408.3618917 ; LI2025117732 . For example, Finite Basis PINNs (FBPINNs) Moseley2021FBPINN decompose the domain into overlapping patches and assign a dedicated sub-network to each, significantly improving convergence by reducing spectral bias and enabling localized feature learning. Extensions such as multilevel FBPINNs DOLEAN2024117116 and multifidelity PINN decomposition frameworks heinlein2024multifidelitydomaindecompositionbasedphysicsinformed further integrate coarse global components and heterogeneous fidelity levels to ensure continuity and scalability across subdomains. Similarly, Schwarz-type methods have been employed to couple multiple physics-informed neural networks (PINNs) across overlapping or non-overlapping subdomains, often learning interface conditions such as Robin boundary terms to enhance communication between patches feeney2023breakingboundariesdistributeddomain ; basir2023generalizedschwarztypenonoverlappingdomain . In the context of neural operators, localized Fourier Neural Operators (Local-FNO) QIN2025112668 have demonstrated improved accuracy and efficiency by training operators on overlapping spatial tiles, with additional blending mechanisms to enforce global coherence. These works collectively highlight the benefits of localizing the learning process — enabling reduced memory footprints, distributed training, and more accurate resolution of multiscale features. Motivated by this trend, our proposed framework introduces a patch-based neural operator architecture that operates within a PCA-reduced subspace for each patch. Unlike previous domain decomposition methods which typically learn in the full solution space, we exploit PCA to achieve dimensionality reduction and computational savings within each subdomain. Furthermore, we introduce refinements such as overlapping patch blending and CNN-based post-processing to mitigate reconstruction artifacts and preserve global consistency, thereby bridging the efficiency of localized learning with the fidelity of global reconstructions 6795724 ; NIPS2012_c399862d . Tensor-compressed operator learning architectures have provided compelling alternatives to traditional global solvers for high-resolution PDEs. In particular, the Multi-Grid Tensorized Fourier Neural Operator (MG-TFNO) kossaifi2023multigridtensorizedfourierneural ; tran2023factorizedfourierneuraloperators ; rahman2023unoushapedneuraloperators ; Panagakis_2021 ; doi:10.1137/07070111X ; guibas2022adaptivefourierneuraloperators ; li2023physicsinformedneuraloperatorlearning ; 10.1145/3592979.3593412 addresses two critical limitations in operator learning: memory overhead and limited generalization in low-data regimes. MG-TFNO achieves significant compression by (i) tensorizing the convolutional weights in the spectral domain using low-rank decompositions such as Tucker and CP, and (ii) decomposing the spatial domain into multigrid-structured patches to enable localized learning and parallelization. These enhancements allow MG-TFNO to outperform standard FNOs and other baselines with over 150 \times parameter compression and reduced input dimensionality, all while maintaining or improving prediction accuracy on PDE benchmarks like Navier-Stokes and Burgers’ equation. In this work, we directly compare our proposed patch-based PCA-Net neural operator with MG-TFNO. While MG-TFNO reduces dimensionality through spectral-domain tensor factorization, our approach achieves similar compression by leveraging spatial-domain PCA within localized patches. This comparison aims to highlight the trade-offs between spectral versus spatial dimensionality reduction, particularly in terms of computational efficiency, representation quality, and reconstruction smoothness. For PDE solutions discretized on fine grids (e.g., 128\times 128 ), the dimension n is large, leading to prohibitively high computational costs. This complexity becomes especially critical when processing large datasets containing thousands of samples, making the global PCA approach impractical for scalable neural operator frameworks (Fig. 1 shows the increase in compute times with the domain size). To address these challenges, we propose a patch-based PCA-Net neural operator framework, wherein the solution domain is partitioned into smaller, manageable patches XIAO201915 ; WANG2022114424 . PCA is subsequently performed independently on each patch. By decomposing the original large data matrix into smaller patch matrices, the computational complexity reduces substantially. If we partition each solution field of dimension D\times D into patches of dimension p\times p , we obtain \frac{D^{2}}{p^{2}} patches per sample. Conducting PCA on each patch independently yields complexity per patch as: \mathcal{O}\left(\frac{D^{2}}{p^{2}}\cdot\min(mp^{4},m^{2}p^{2})\right). (2) Since typically p\ll D , this significantly reduces total computational overhead compared to global PCA. While this patch-based approach efficiently addresses the computational bottleneck, independent processing of patches may introduce reconstruction artifacts, primarily manifesting as discontinuities or blockiness at patch boundaries. To mitigate this, we explore two key refinements: (i) introducing overlapping patches coupled with smoothing filters (e.g., the Hanning window) to blend reconstructions smoothly 2020SciPy-NMeth , and (ii) employing a CNN as a refinement step, effectively removing blocky artifacts post-PCA reconstruction. In this paper, we systematically investigate these patch-based PCA strategies on a 2D Poisson equation dataset, analyzing the trade-offs between computational complexity and reconstruction accuracy. Furthermore, extensive parametric studies are presented to evaluate the impact of patch size, overlap degree, and CNN refinement parameters, thereby offering practical insights and guidelines for efficiently employing patch-based PCA-Net neural operators. (a) PCA Compute Time vs Grid Size (b) Number of PCA Components vs Grid Size Figure 1: Computational Costs of PCA on Different Grid Sizes. Each plot highlights a separate metric: compute time, and number of PCA components. 2 Methodology 2.1 2D Poisson’s Dataset We generate a synthetic dataset (see Fig. 2 for some samples) representing solutions to the two-dimensional (2D) Poisson equation, widely used in scientific computing to model steady-state diffusion