MC 2 : Monte Carlo Correction for Fast Elliptic PDE Solving
Ethan Hsu*, Ivan Ge*, Hong Meng Yam* · 2026
Read MC 2 : Monte Carlo Correction for Fast Elliptic PDE Solving by Ethan Hsu*, Ivan Ge*, Hong Meng Yam* (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09288.txt.
Introduction
Hsu and two colleagues present MC2, a hybrid Walk-on-Spheres network solver for elliptic PDEs correcting a low budget Monte Carlo solution toward the field. Classical Monte Carlo solvers like Walk-on-Spheres are unbiased and geometry agnostic but slow, while learned solvers run fast yet carry bias and break on shifts. MC2 learns a single pass neural correction recovering a high fidelity solution from the low budget estimate.
MC2 equals the accuracy of solutions using 1000 times more Monte Carlo compute, beating all classical, denoising, and neural operator baselines. The team also releases PDEZoo, the largest standardised elliptic PDE benchmark: 2M PDEs across five families, with analytic truth and multi budget trajectories. Together, MC2 and PDEZoo show finite sample Monte Carlo error has structure and can be learned and corrected in one pass. They solve PDEs about 1000 times faster than Walk-on-Spheres alone and supply missing evaluation infrastructure.
Catalog record
| CREATOR | Ethan Hsu*, Ivan Ge*, Hong Meng Yam* |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.09288
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MC 2 : Monte Carlo Correction for Fast Elliptic PDE Solving Ethan Hsu*, Ivan Ge*, Hong Meng Yam* Abstract Partial differential equation (PDE) solvers underpin scientific computing, but real-world deployment is bounded by compute. Classical Monte Carlo solvers such as Walk-on-Spheres (WoS) are unbiased and geometry-agnostic but are slow. Learned solvers are fast but biased and brittle under distribution shift. We present MC 2 , a hybrid WoS-Neural Network (WoS-NN) PDE solver that treats a low-budget Monte Carlo solution as a structured estimator of the true field and learns a single-pass neural correction to recover a high-fidelity solution. MC 2 matches the accuracy of solutions using over 1000 × 1000\times more Monte Carlo compute, outperforming all evaluated classical, denoising, and neural-operator baselines. To enable reproducible study of finite-compute PDE solving, we additionally release PDEZoo , the largest standardized elliptic PDE benchmark to date: 2M PDEs spanning five elliptic families and unlimited geometric compositions, with analytic ground truth and multi-budget Monte Carlo trajectories. Together MC 2 and PDEZoo (1) empirically establish that finite-sample Monte Carlo error is structured, learnable, and correctable in a single forward pass, (2) show that we can solve PDEs ∼ \sim 1000x faster than with just WoS, and (3) provide the evaluation infrastructure the field has so far lacked. 1 Introduction Elliptic partial differential equations (PDEs) are a core computational primitive across scientific computing, geometry processing, and computer graphics, critical for tasks such as reconstruction, simulation, and physical modeling [ 3 , 6 , 15 ] . In practice, solvers must operate reliably across diverse forcing functions, boundary conditions, and geometries, while remaining fast enough for large-scale or latency-sensitive pipelines. Despite decades of progress, we lack approaches that simultaneously achieve generality, accuracy, and efficiency in this regime. Classical deterministic solvers such as finite difference and finite element methods (FDM/FEM) can be highly accurate, but rely on explicit meshing and problem-specific discretization choices that limits flexibility on irregular domains [ 5 , 4 , 30 ] . Monte Carlo solvers, most notably Walk-on-Spheres (WoS), address many of these limitations. They are mesh-free, unbiased, and applicable to broad classes of elliptic PDEs and geometries [ 27 , 30 , 31 ] . However, their finite-iteration outputs suffer from high variance, requiring orders of magnitude more samples to reach acceptable accuracy [ 32 ] . Learning-based solvers, such as PINNs, neural operators, transformer models, offer fast inference but introduce bias, and can fail under distribution shifts or unseen PDE specifications [ 1 , 21 , 7 , 23 ] . Recent hybrid approaches integrate neural networks into Monte Carlo solvers (e.g., neural caches [ 38 ] ) or condition generative models on sparse numerical samples [ 16 ] , but require per-problem retraining, slow iterative inference, or both. In this work, we propose MC² (Monte Carlo error correction with Monte Carlo solvers): a new approach to hybrid PDE solving that treats the low-iteration output of a Monte Carlo method as a structured estimator of the true solution and learns a neural network correction that reduces error in a single forward pass. Rather than modifying a Monte Carlo solver or replacing it with a learned surrogate, MC² applies a transformer-based field-to-field model to early Walk-on-Spheres outputs, recovering solution quality that would otherwise require around 1000× more Monte Carlo iterations [ 10 ] . This preserves the generality and robustness of Monte Carlo solvers while dramatically accelerating convergence and lowering the bias of standalone neural solvers. To support this setting and enable reproducible evaluation, we introduce PDEZoo, a benchmark offering nearly limitless diversity within the elliptic PDE regime. PDEZoo spans Laplace, Poisson, Yukawa, Biharmonic, and Helmholtz equations with explicit forcing functions, boundary conditions, and dense reference solutions. Unlike existing PDE benchmarks, PDEZoo is designed for finite-compute evaluation: it includes Monte Carlo solver trajectories at multiple compute budgets, exposing how solvers behave before asymptotic convergence and allowing methods to be compared under practical resource constraints. We further release the full procedural generator, enabling arbitrarily large training sets while preserving a fixed benchmark for standardized evaluation. Our contributions are twofold: 1. MC² , a hybrid WoS–NN solver that corrects structured Monte Carlo error across diverse elliptic PDEs, matching the quality of using 512–2,048× more Monte Carlo compute and outperforming all evaluated baselines. In other words, it combines the generality and unbiasedness of Monte Carlo PDE solvers with learned error correction to yield a more than 1000x wall-clock speedup on PDE solving without sacrificing robustness. 2. PDEZoo , the largest standardized benchmark to date for elliptic PDEs with explicit forcing and boundary functions, augmented with Monte Carlo solver trajectories and a scalable procedural generator. 2 Related Work Monte Carlo PDE Solvers: Walk-on-Spheres (WoS) estimates solutions to elliptic PDEs via random walks guided by Green’s functions [ 27 ] . Since WoS is mesh-free and unbiased, it extends to irregular geometries and has been generalized to mixed Dirichlet–Neumann conditions [ 32 ] , boundary integral formulations [ 33 ] , and Monte Carlo finite element settings [ 19 ] . These properties make WoS attractive for graphics and simulation [ 30 , 31 ] . However, the estimator variance decays only as \mathcal{O}(1/K) , meaning that the typical estimation error decays only as \mathcal{O}(1/\sqrt{K}) . As a result, reaching acceptable accuracy in budget-constrained settings can require prohibitively many samples. Neural Networks for PDEs: Physics-informed neural networks (PINNs) enforce PDE residuals through specialized loss functions [ 1 , 18 , 28 ] , while neural operators such as FNO learn mappings between function spaces [ 24 ] . More recent work has explored generative approaches using diffusion models. DiffusionPDE conditions a diffusion model on sparse observations to jointly recover coefficients and solutions while CoCoGen augments score-based sampling with PDE-residual guidance to improve physical consistency [ 16 , 17 ] . Transformer-based architectures have further enabled fast inference and some degree of cross-PDE generalization. However, neural solvers face non-convex loss landscapes, spectral bias [ 37 , 29 ] , and distribution-shift fragility, producing biased solutions that degrade on out-of-distribution problems [ 23 , 7 ] . Hybrid Monte Carlo-Neural Network Methods: Recent work combines neural networks with Monte Carlo solvers to retain unbiasedness while reducing variance. 23 train a neural field to approximate the PDE solution, then use it as a control-variate cache during WoS sampling. While effective, this requires per-problem training and manual hyperparameter tuning. Diffusion-based approaches condition generative models on sparse numerical samples to reconstruct full solution fields [ 16 ] , but suffer from slow multi-step inference and conditioning instability [ 20 ] . Our approach differs in two key ways: (i) the corrector is trained once across the entire PDE distribution rather than per-instance, and (ii) correction is a single deterministic forward pass, not iterative sampling. Benchmarks and Scientific Progress. Despite a rapidly growing literature on neural and hybrid PDE solvers, the field lacks the unified, standardized evaluation infrastructure that has driven progress in adjacent areas of machine learning. 9 argues that “frictionless reproducibility”, fostered by shared tasks, common data, and open leaderboards, was the engine behind transformative progress in NLP and computer vision, where benchmarks like GLUE [ 36 ] , SuperGLUE [ 35 ] , and ImageNet [ 8 ] created a