When can a neural operator replace a coarse solve? Architectural principles for two-level preconditioning

Hugo Melchers, Michael Abdelmalik, Victorita Dolean · 2026

Read When can a neural operator replace a coarse solve? Architectural principles for two-level preconditioning by Hugo Melchers, Michael Abdelmalik, Victorita Dolean (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19867.txt.

Introduction

Melchers, Dolean and Abdelmalik ask when a neural operator can replace a coarse solve in a two level preconditioner for linear PDEs. Varying four DeepONet like architectures along input handling and source linearity, they find one favourable corner: the Neural Green's Operator. Moving away gives failures, from non symmetric spectra to conjugate gradient breakdown on self adjoint problems and stagnation on non self adjoint ones. As a correction, the NGO matches an exact coarse solve on diffusion and advection diffusion problems, showing basis integration enables Galerkin type correction.

Catalog record

CREATORHugo Melchers, Michael Abdelmalik, Victorita Dolean
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE94020
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.19867

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

When can a neural operator replace a coarse solve? Architectural principles for two-level preconditioning Hugo Melchers, Michael Abdelmalik, Victorita Dolean Abstract Neural operators are increasingly used as drop-in accelerators inside classical numerical methods, but it is rarely clear which architectural ingredients matter for which role. We answer this question for one important role: the coarse-space correction inside a two-level preconditioner for discretised linear partial differential equations. By systematically varying four DeepONet-like architectures along two design axes — input discretisation (sampling versus integration against a basis) and source-term linearity — we show that the favourable corner of this 2 × \times 2 design is occupied by a single architecture, the Neural Green’s Operator (NGO), and that moving away from it produces predictable failure modes: structurally non-symmetric preconditioned spectra, breakdown of preconditioned conjugate gradients on self-adjoint problems, and stagnation on non-self-adjoint ones. Used as a coarse-space correction, the NGO matches the iteration count of an exact coarse solve on diffusion and advection-diffusion problems. We also characterise the failure of fixed-size learned coarse spaces at high Helmholtz wave numbers, isolating it as a property of the basis rather than of the architecture. The principle generalises: integrating inputs against the basis used for the output is what allows a neural operator to serve as a Galerkin-type coarse-space correction. 1 Introduction Solving large, sparse linear systems arising from the discretisation of partial differential equations (PDEs) is a workhorse computation across the physical sciences. Iterative Krylov solvers — conjugate gradients (CG) and the generalised minimal residual method (GMRES) and their variants — dominate this regime, but their convergence depends critically on the choice of preconditioner. Constructing preconditioners that are simultaneously robust (effective across a parameter range), cheap to apply (ideally with cost scaling linearly in the number of unknowns), and compatible with the Krylov method of choice (e.g. symmetric and positive definite for CG) remains a central challenge of numerical linear algebra. Two-level preconditioners — which combine a local smoother with a global coarse-space correction — are an established answer to this challenge [ 13 , 49 , 53 ] , with multigrid the canonical and often gold-standard instance [ 53 ] . Over the last decade, machine learning has emerged as a complementary route. Neural operators [ 29 , 33 , 38 ] approximate maps between function spaces and so, in principle, learn the solution operator of a parametric PDE directly. By themselves, however, neural operators rarely deliver the accuracy required by downstream applications, and they offer no guarantee that the predicted field satisfies the discrete equations. A natural way to harness their speed without sacrificing reliability is to use them as preconditioners inside a classical Krylov method: an accurate neural operator then accelerates an iterative solver whose final accuracy is governed only by the discretisation and a user-set tolerance, not by the network [ 45 , 56 ] . This division of labour is the line of work this paper contributes to. Families of learned preconditioners Existing approaches to learning preconditioners can be grouped into three broad families. • Algebraic preconditioners take the matrix \mathbf{A} alone and produce, via a neural network, an approximation to \mathbf{A}^{-1} or to a sparse factorisation thereof. Examples include direct inverse approximation [ 46 ] , learned incomplete LU/Cholesky factorisations [ 19 , 20 , 31 , 32 ] , and graph-neural-network preconditioners [ 9 , 52 ] . These methods are PDE-agnostic but typically do not exploit the structure of the underlying equation. • Hybrid iterative methods alternate a neural operator with a classical smoother inside a fixed-point iteration. The Hybrid Iterative Numerical Transferable Solver (HINTS) [ 56 ] is the most prominent representative, with closely related schemes proposed in [ 23 , 27 ] . Because the neural component is non-linear, these methods are generally combined with flexible variants of the Krylov method, e.g. flexible GMRES (F-GMRES) [ 47 ] or flexible CG [ 45 ] . Recent analyses, however, show that HINTS-style methods can stagnate or diverge unless the training paradigm is chosen carefully [ 55 ] . • Multigrid- and deflation-based learned preconditioners use a learned component as a coarse-grid solver [ 1 , 30 , 35 ] or as a deflation/coarse subspace [ 28 ] . This is the family the present work belongs to. The methodology of Kopaničáková et al. [ 28 ] is particularly close to ours: there, a DeepONet trunk net is trained explicitly so that its basis can be repurposed as a deflation subspace inside PCG. The methods above are increasingly competitive with classical preconditioners, but they typically introduce a learned component whose internal structure is opaque and whose effectiveness is documented empirically rather than tied to specific architectural choices. What this paper proposes A two-level preconditioner has two components: the smoother and the coarse-space correction. The smoother is well understood and largely PDE-specific; the coarse-space correction, by contrast, is exactly what a neural operator naturally approximates — a global map from a right-hand side to an approximate solution, expressed as a linear combination of basis functions. This raises a sharp question: which architectural properties of a neural operator govern its effectiveness as a coarse-space correction? Most existing studies pick one architecture and tune it; very few isolate the architectural ingredients that matter. To answer this question, we keep the smoother and the coarse basis \varphi_{1},\dots,\varphi_{m} fixed and vary only the neural operator that maps right-hand sides to coarse-space coefficients. We compare four DeepONet-like architectures — DeepONet [ 38 ] , RINO [ 2 ] , VarMiON [ 43 ] , and the Neural Green’s Operator (NGO) [ 40 ] — chosen because they sit at the four corners of a 2 \times 2 design matrix: linear in source non-linear in source samples inputs at sensor nodes VarMiON DeepONet integrates inputs against a basis NGO RINO This design lets us attribute every difference in preconditioning behaviour to one of two architectural axes: how the input is discretised, and whether the model preserves the linear dependence of the PDE solution on the source term. Contributions We make four contributions. 1. An architectural principle for learned coarse corrections. We show that the way a neural operator discretises its inputs — by sampling versus by integration against a basis — is the dominant architectural factor controlling its effectiveness as a coarse-space correction inside a two-level preconditioner. Sampling-based architectures (DeepONet, VarMiON) produce learned operators whose row and column spaces differ structurally, leading to spectra with non-negligible imaginary parts even on self-adjoint problems and to PCG breakdown on diffusion. Integration-based architectures (RINO, NGO) remove this asymmetry. 2. The role of linearity. We show that whether a neural operator preserves the linear dependence of the PDE solution on the source term is a secondary but consequential design axis. Linearity becomes essential precisely when the spectrum of the discrete operator is structurally complex (advection-diffusion, Helmholtz), separating the NGO from the RINO. 3. NGO-based coarse corrections are competitive with exact coarse solves. On the diffusion and advection-diffusion equations, an NGO-based coarse correction matches an exact coarse solve in iteration count, while requiring no recursive linear solve at the coarse level. On the Helmholtz equation it remains the best of the four learned architectures but reveals a fundamental limitation

Read the complete text