Learning Solution Operators for Partial Differential Equations via Monte Carlo-Type Approximation
Salah Eddine Choutri, Prajwal Chauhan, Engineering Division, New York University Abu Dhabi, United Arab Emirates, UAE, [email protected], Othmane Mazhar, Laboratoire de Probabilités, Statistique et Modélisation, Sorbonne University & Université Paris Cité, Paris, France, [email protected], Saif Eddin · 2025
Read Learning Solution Operators for Partial Differential Equations via Monte Carlo-Type Approximation by Salah Eddine Choutri, Prajwal Chauhan, Engineering Division, New York University Abu Dhabi, United Arab Emirates, UAE, [email protected], Othmane Mazhar, Laboratoire de Probabilités, Statistique et Modélisation, Sorbonne University & Université Paris Cité, Paris, France, [email protected], Saif Eddin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-18930.txt.
Introduction
Salah Eddine Choutri, Prajwal Chauhan, Othmane Mazhar, and Saif Eddin Jabari introduce a light neural operator that learns to solve whole families of partial differential equations at once. Rather than solving one equation instance, such operators learn the mapping from inputs to solutions. Their design approximates the core integral directly with a Monte Carlo style sample. Representing the kernel as a learnable grid over a fixed set of random points, and it makes no assumptions about spectra or shift invariance.
Because it avoids fixed global basis functions, the model generalises across grid resolutions without resampling during training. On standard one-dimensional benchmarks it reaches competitive accuracy at low cost. The authors offer it as a simple, practical alternative to the spectral and graph-based operators that dominate the area.
Catalog record
| CREATOR | Salah Eddine Choutri, Prajwal Chauhan, Engineering Division, New York University Abu Dhabi, United Arab Emirates, UAE, [email protected], Othmane Mazhar, Laboratoire de Probabilités, Statistique et Modélisation, Sorbonne University & Université Paris Cité, Paris, France, [email protected], Saif Eddin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 15 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-18930
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Solution Operators for Partial Differential Equations via Monte Carlo-Type Approximation Salah Eddine Choutri, Prajwal Chauhan, Engineering Division, New York University Abu Dhabi, United Arab Emirates, UAE, [email protected], Othmane Mazhar, Laboratoire de Probabilités, Statistique et Modélisation, Sorbonne University & Université Paris Cité, Paris, France, [email protected], Saif Eddin Jabari, Engineering Division, New York University Abu Dhabi, United Arab Emirates, UAE, [email protected] Abstract The Monte Carlo-type Neural Operator (MCNO) introduces a lightweight architecture for learning solution operators for parametric PDEs by directly approximating the kernel integral using a Monte Carlo approach. Unlike Fourier Neural Operators, MCNO makes no spectral or translation-invariance assumptions. The kernel is represented as a learnable tensor over a fixed set of randomly sampled points. This design enables generalization across multiple grid resolutions without relying on fixed global basis functions or repeated sampling during training. Experiments on standard 1D PDE benchmarks show that MCNO achieves competitive accuracy with low computational cost, providing a simple and practical alternative to spectral and graph-based neural operators. 1 Introduction Neural operators extend the success of neural networks from finite-dimensional vector mappings to infinite-dimensional function spaces, enabling the approximation of solution operators for partial differential equations (PDEs). These models learn mappings from problem inputs, such as coefficients or boundary conditions, to PDE solutions, allowing rapid inference and generalization across parameterized problem families. Early architectures like DeepONet [ 6 ] use branch and trunk networks, while Fourier Neural Operators (FNO) [ 5 ] leverage spectral convolutions and FFTs for efficient operator approximation on uniform grids. Wavelet-based models such as MWT [ 1 ] and WNO [ 7 ] improve spatial localization, and graph-based approaches like GNO [ 4 ] extend operator learning to irregular domains. We propose the Monte Carlo-type Neural Operator (MCNO), a lightweight architecture that approximates the integral kernel of a PDE solution operator via Monte Carlo sampling, requiring only a single random sample at the beginning of training. By avoiding spectral transforms and deep hierarchical architectures, MCNO offers a simple yet efficient alternative that balances accuracy and computational cost. We evaluate MCNO on standard 1D PDEs, including Burgers’ and Korteweg–de Vries equations, using benchmark datasets, and show competitive performance against existing neural operators while maintaining architectural simplicity. Our contributions include the MCNO design, feature mixing for spatial and cross-channel dependencies, an interpolation mechanism for structured grids and benchmark evaluation. 2 Monte Carlo-type Neural Operator (MCNO) Neural operators provide a framework for learning mappings between infinite-dimensional function spaces, enabling efficient approximation of solution operators for parametric PDEs [ 2 ] . For a generic PDE, the true solution operator G^{\dagger} is a mapping that takes an input a to the corresponding PDE solution u s.t G^{\dagger}:\;a\mapsto u=G^{\dagger}(a) . For many inputs, evaluating G^{\dagger} with classical solvers can be prohibitively expensive. Given a dataset \{(a_{j},u_{j})\}_{j=1}^{N} with u_{j}=G^{\dagger}(a_{j}) , the goal is to learn a parameterized approximation G_{\theta}\approx G^{\dagger} by minimizing a suitable loss. A neural operator adopts iterative architectures to compute such approximate operator G_{\theta} , to this end it lifts the input to a higher-dimensional representation v_{0}(x)=P\big(a(x)\big),\ x\in\mathcal{D}\subset\mathbb{R}^{d} via a local map P . It then, updates it through a linear transformation via matrix W and a kernel-integral transformation (\mathcal{K}_{\phi}v)(x) with nonlinear activations \sigma . The (t+1)\text{th},\ t\in\mathbb{N}, neural operator layer is expressed as: v_{t+1}(x)=\sigma\left(Wv_{t}(x)+(\mathcal{K}_{\phi}v_{t})(x)\right),\quad x\in\mathcal{D}, with (\mathcal{K}_{\phi}v_{t})(x)=\int_{D}\kappa_{\phi}(x,y,a(x),a(y))v_{t}(y)dy, where \kappa_{\phi} is a learned kernel inspired by the Green function commonly involved in the solution of linear PDEs. A final projection Q maps the final features back to the target function space \big(G_{\theta}(a)\big)(x)=Q\big(v_{T}(x)\big),\qquad x\in\mathcal{D}. (1) MCNO follows this framework but replaces the integral with a Monte Carlo estimate over a fixed set of sampled points, i.e., (\hat{\mathcal{K}}_{N,\phi}v_{t})(x)=\frac{1}{N}\sum_{i=1}^{N}\kappa_{\phi}(x,v_{t}(y_{i}))v_{t}(y_{i}). (2) This avoids spectral transforms or hierarchical architectures and achieves linear complexity in the number of sampled points. To enhance efficiency, MCNO leverages PyTorch’s einsum to perform the per-sample feature mixing in parallel by evaluating the kernel as \kappa_{\phi}(y_{i},v_{t}(y_{i}))=\phi_{i}v_{t}(y_{i}), where each \phi_{i}\in\mathbb{R}^{d_{v}\times d_{v}} is a learnable tensor acting on the feature vector v_{t}(y_{i})\in\mathbb{R}^{d_{v}} , and we write \phi=\{\phi_{i}\}_{i=1}^{N} for the full set of kernel parameters. This design enables efficient GPU parallelization and avoids costly per-sample matrix operations before the Monte Carlo aggregation step. The Monte Carlo–type Neural Operator (MCNO) achieves linear computational complexity with respect to the number of samples N , since kernel interactions are computed only at the sampled points. Because the Monte Carlo integral is evaluated on a subset of points, the resulting latent representation is interpolated to the full grid using lightweight linear interpolation, preserving efficiency while producing a structured output compatible with standard neural architectures. Although applied across the full grid, our reconstruction step scales linearly with N_{\text{grid}} and involves only inexpensive local averaging, introducing only modest overhead compared to the kernel evaluation. Figure 1: MCNO architecture. Algorithm 1 MCNO — Forward Pass 1: Given: parameters \phi , W ; samples \{y_{i}\}_{i=1}^{N} ; grid; activation \sigma ; interpolation rule 2: Input: current representation v_{t} 3: Output: v_{t+1}(x) 4: Estimate kernel: (\hat{\mathcal{K}}_{N,\phi}v_{t})(x)=\tfrac{1}{N}\sum_{i=1}^{N}\kappa_{\phi}\!\big(x,v_{t}(y_{i})\big)\,v_{t}(y_{i}) 5: Interpolate (\hat{\mathcal{K}}_{N,\phi}v_{t}) onto the full grid 6: Update: v_{t+1}(x)=\sigma\!\left(Wv_{t}(x)+(\hat{\mathcal{K}}_{N,\phi}v_{t})(x)\right) 3 Bias–Variance Analysis and Dimensional Scaling At each layer, MCNO computes the kernel aggregation ( 2 ) using N points \{y_{s_{i}}\}_{i=1}^{N} sampled uniformly from the grid \{y_{j}\}_{j=1}^{N_{\text{grid}}}\subset D\subset\mathbb{R}^{d} . Each sample–feature update is used once, so the per-layer cost is \mathrm{Cost}_{\text{MCNO}}=\mathcal{O}(N\,d_{v}) (feature width d_{v} ). In practice, tensor contractions parallelized over x give aggregation \mathcal{O}(N) , while interpolation/reconstruction scales with N_{\text{grid}} . Error decomposition. Define E(x)=(\hat{\mathcal{K}}_{N,\phi}v_{t})(x)-(\mathcal{K}_{\phi}v_{t})(x). (3) Adding and subtracting (\mathcal{K}_{\phi}^{\text{grid}}v_{t})(x)=\tfrac{1}{N_{\text{grid}}}\sum_{j=1}^{N_{\text{grid}}}\kappa_{\phi}(x,y_{j})v_{t}(y_{j}) yields E(x)=\underbrace{(\mathcal{K}_{\phi}^{\text{grid}}v_{t})(x)-(\mathcal{K}_{\phi}v_{t})(x)}_{\text{Bias}}+\underbrace{(\hat{\mathcal{K}}_{N,\phi}v_{t})(x)-(\mathcal{K}_{\phi}^{\text{grid}}v_{t})(x)}_{\text{Variance}}. (4) Bias. Partition D into hypercubes \{C_{j}\}_{j=1}^{N_{\text{grid}}} with side h so N_{\text{grid}}=(1/h)^{d} . For each C_{j} centered at y_{j} , \int_{C_{j}}\kappa_{\phi}(x,y)v_{t}(y)\,dy=\kappa_{\phi}(x,y_{j})v_{t}(y_{j})h^{d}+R_{j}(x) with |R_{j}(x)|\leq L\,\tfrac{\sqrt{d}}{2}\,h^{d+1} , hence \displaystyle\big|(\mathcal{K}_{\phi}^{\text{grid}}v_{t})(x)-(\mathcal{K}_{\phi}v_{t})(x)\big| \displaystyle\leq\sum_{j=1}^{N_{\text{grid}}}|R_{j}(x)|\leq L\,\tfrac{\sqrt{d}}{2}\,h\,N_{\text{grid}}h^{d}=C_{1}N_{\text{grid}}^{-1/d}. (5) Variance. For fixed x , (\hat{\mathcal{K}}_{N,\phi}v_{t})(x)=\frac{1}{N}\sum_{i=1}^{N}Z_{i}(x) with Z_{i}(x)=\kappa_{\phi}(x,y_{s_{i}})v_{t}(y_{s_{i}}) , |Z_{i}(x)|\leq C . Hoeffding gives \mathbb{P}\!\left(\big|(\hat{\mathcal{K}}_{N,\phi}v_{t})(x)-\mathbb{E}[(\hat{\mathcal{K}}_{N,\phi}v_{t})(x)]\big|>t\right)\leq 2\exp\!\left(-\frac{Nt^{2}}{2C^{2}}\right). (6) By a union bound over \{x_{j}\}_{j=1}^{N_{\text{grid}}} and failure \delta , \sup_{x\in D}\big|(\hat{\mathcal{K}}_{N,\phi}v_{t})(x)-(\mathcal{K}_{\phi}^{\text{grid}}v_{t})(x)\big|\;\leq\;C_{2}\sqrt{\frac{\log(2N_{\text{grid}}/\delta)}{N}}. (7) Sample complexity and cost. From ( 5 )–( 7 ), \sup_{x\in D}|E(x)|\;\lesssim\;C_{1}N_{\text{grid}}^{-1/d}+C_{2}\sqrt{\frac{\log N_{\text{grid}}}{N}}. (8) To reach tolerance \varepsilon , choose N_{\text{grid}}=\mathcal{O}(\varepsilon^{-d}) and N=\mathcal{O}(\varepsilon^{-2}\log(\varepsilon^{-d})) . Since aggregation is \mathcal{O}(N) and reconstruction is \mathcal{O}(N_{\text{grid}}) , the total cost is \mathrm{Cost}_{\text{MCNO}}(\varepsilon,d)=\mathcal{O}(N)+\mathcal{O}(N_{\text{grid}})=\tilde{\mathcal{O}}(\varepsilon^{-2}+\varepsilon^{-d}), (9) with \tilde{\mathcal{O}} hiding logarithms. High-dimensional note. Dimension d enters via the bias (through N_{\text{grid}}^{-1/d} ) and grid cost; the Monte Carlo variance, and thus the stochastic sample complexity, remains dimension-independent. 4 Numerical experiments We evaluate the Monte Carlo-type Neural Operator on two standard benchmark problems: Burgers’ equation and Korteweg-de Vries (KdV) equation. These benchmarks are widely used for testing operator learning methods due to their diversity in complexity and relevance to applications. To ensure fairness and consistency, we adopt the same datasets and experimental setups as described in [ 5 ] . The MCNO employs a four-layer architecture of Monte Carlo kernel integral operators, with ReLU activations. Training uses 1000 samples, with 100 additional samples reserved for testing. Optimization is performed with the Adam optimizer, starting at a learning rate of 0.001, halved every 100 epochs over a total of 500 epochs. We set the width to 64,\ N=100 for Burgers’ equation and N=75 for Korteweg-de Vries (KdV) equation. All experiments are conducted on an Tesla V100-SXM2-32GB of memory GPU and the accuracy is reported in terms of relative L_{2} loss. The errors for the main benchmarks FNO, MWT and WNO are reported with our implementation on the same