Numerical PDE solvers outperform neural PDE solvers

Patrick Chatain and Michael Rizvi‑Martel and Guillaume Rabusseau and Adam Oberman · 2025

Read Numerical PDE solvers outperform neural PDE solvers by Patrick Chatain and Michael Rizvi‑Martel and Guillaume Rabusseau and Adam Oberman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21269.txt.

Introduction

Patrick Chatain and co-authors argued in a 2025 paper that classic solvers beat neural ones at their own game, and they built DeepFDM to show a better blend. Neural solvers for partial differential equations draw hype, but plain finite-difference codes remain hard to beat for soundness. Their frame hides a classic solver inside a learning net.

DeepFDM lays a forward-Euler grid scheme into a convolutional net, with weights that are the equation's own coefficients. Step rules tied to the CFL condition keep it stable and true to first order. Tests span flow, spread, and reaction equations in one to three dimensions. The read stays plain: each weight means a physical trait.

Catalog record

CREATORPatrick Chatain and Michael Rizvi‑Martel and Guillaume Rabusseau and Adam Oberman
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-21269

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Numerical PDE solvers outperform neural PDE solvers Patrick Chatain and Michael Rizvi‑Martel and Guillaume Rabusseau and Adam Oberman Abstract . We present DeepFDM, a differentiable finite‑difference framework for learning spatially varying coefficients in time‑dependent partial differential equations (PDEs). By embedding a classical forward‑Euler discretization into a convolutional architecture, DeepFDM enforces stability and first‑order convergence via CFL‑compliant coefficient parametrizations. Model weights correspond directly to PDE coefficients, yielding an interpretable inverse‑problem formulation. We evaluate DeepFDM on a benchmark suite of scalar PDEs: advection, diffusion, advection–diffusion, reaction–diffusion and inhomogeneous Burgers’ equations—in one, two and three spatial dimensions. In both in‑distribution and out‑of‑distribution tests (quantified by the Hellinger distance between coefficient priors), DeepFDM attains normalized mean‑squared errors one to two orders of magnitude smaller than Fourier Neural Operators, U‑Nets and ResNets; requires 10–20× fewer training epochs; and uses 5–50× fewer parameters. Moreover, recovered coefficient fields accurately match ground‑truth parameters. These results establish DeepFDM as a robust, efficient, and transparent baseline for data‑driven solution and identification of parametric PDEs. 1. Introduction Neural networks have recently been applied in various ways to solve Partial Differential Equations (PDEs), [ KKL+21 , LMMK21 , LKA+20a , LKA+20b ] . Neural network methods offer a highly flexible and adaptive approach to solving PDEs, compared to traditional numerical PDE solvers, as they can work with a wide variety of equations and input data. They are more flexible than standard numerical solvers, because they treat the problem of solving PDEs as a problem of learning from data. This model-free approach allows for PDEs to be solved without explicit knowledge of the coefficients (or even the terms) in the PDE. Moreover, they allow users to compute approximate solutions without the technical skills needed to implement standard PDE solvers. As a result, these methods have been very popular, with thousands of recent citations for the works cited above. However, the learned operators do not correspond to solution operators of the underlying PDE from which the data was generated. While the neural network approaches have been extensively compared against each other, they have not, until now, been carefully compared to established numerical PDE methods. In this article we set out to carefully compare these approaches. Reproducible code for this paper can be found at https://github.com/adam-oberman/deep-pdes 1.1. Benchmark PDEs It is necessary to specify a class of PDEs to be solved in order to compare the neural network solvers with standard numerical PDE methods. The choice of PDEs was based on choosing a maximal subset of those considered in the paper [ LKA+20a ] . Because our goal was to build a single model which could learn any of the included PDEs, we required that they all have the same data structure, in the sense of being scalar equations (rather than vector equations), and time-dependent (rather than stationary). This required us to exclude the two dimensional Stokes equations, because it is a vector PDE, and the Darcy equation, because it is not time-dependent. The rest of the PDEs considered in the paper are addressed here. In order to better explore the performance differences of the methods, we then extended these PDEs to a wider class, and further studied performance under (i) increased coefficient variability, and (ii) shift in the data-generation distribution (via different Fourier-coefficients priors). We also implemented one and three dimensional solvers. To make the notation concise, we write \bm{x} for the vector spatial variable, which is two dimensional in most cases. We considered the following PDEs. Advection equation (non-diffusive), \partial_{t}u(\bm{x},t)=b(\bm{x})\cdot\nabla u(\bm{x},t) Diffusion equation (inhomogeneous), \partial_{t}u(\bm{x},t)=a(\bm{x})\Delta u(\bm{x},t) Advection-Diffusion, \partial_{t}u(\bm{x},t)=b(\bm{x})\cdot\nabla u(\bm{x},t)+a(\bm{x})\Delta u(\bm{x},t) Reaction diffusion equation, \partial_{t}u(\bm{x},t)=a(\bm{x})\Delta u(\bm{x},t)+c(\bm{x})u(\bm{x},t)(1-u(\bm{x},t)) Burgers’ equation (inhomogeneous), \partial_{t}u(\bm{x},t)=b(\bm{x})u(\bm{x},t)\cdot\nabla u(\bm{x},t)+a(\bm{x})\Delta u(\bm{x},t) Here \nabla is the spatial gradient operator and \Delta is the spatial Laplacian. We implemented a model which was designed to learn finite difference solution operators from a broader class of PDEs. When given data corresponding to solutions of one of the PDEs above, the solver did not know the form of the PDE. Rather, we implemented a single model capable of learning a solution operator for a class of time-dependent PDEs which covers all the cases above. It is described in the following section. 1.2. Parametric PDE family We considered the nonlinear PDE, (PDE) \partial_{t}u(\bm{x},t)=L\left(u(\bm{x},t);a(\bm{x})\right)+N\left(u(\bm{x},t);b(\bm{x})\right) where the PDE operator as a combination of linear operators and nonlinear operators parameterized by a(\bm{x}) , and b(\bm{x}) , which are vectors of PDE coefficients, P\left(u(\bm{x},t);a(\bm{x}),b(\bm{x})\right)=L\left(u(\bm{x},t);a(\bm{x})\right)+N\left(u(\bm{x},t);b(\bm{x})\right) These coefficients are assumed to be bounded, with known upper and lower bounds. The linear part of the operator is given by (1) \displaystyle L(u(\bm{x},t),a(\bm{x})) \displaystyle=a_{0}(\bm{x})+a_{1}(x)u(\bm{x},t)+a_{2}(\bm{x})\cdot\nabla u(\bm{x},t)+a_{3}(x)\Delta u(\bm{x},t) The nonlinear part corresponds to two terms, N(u(\bm{x},t);b(\bm{x}))=b_{1}(\bm{x})u(\bm{x},t)(1-(u(\bm{x},t))+b_{2}(\bm{x})u(\bm{x},t)\nabla u(\bm{x},t) the first is the reaction term, and the second term corresponds to the Burgers’ equations. Whenever this term is nonzero, we ensure that there is also a diffusion term with coefficients bounded away from zero, which ensures the solution is smooth enough. We require that, for all admissible coefficients, the PDE problem is well-posed, in the PDE sense, meaning that for admissible initial and boundary data, u_{0}(x) , there exist unique solutions which are stable in a specified norm. The operator above includes, by setting some coefficients to zero, each of the PDEs discussed in the previous section. We focus mainly on the two dimensional case, but we also include a one dimensional and a three dimensional implementation. We also present one dimensional results below, for illustration purposes. 2. Related work 2.1. Neural PDEs Early machine learning methods [ RBPK17 ] focused on data discovery of PDEs, without building solution operators. Physics-informed neural networks (PINNs) [ KKL+21 , SDK20 ] were among the first models to leverage neural networks for solving PDEs. These methods learn a specific instance of the PDE, rather than a solution operator. Key Neural PDE Operator learning papers [ LJK19 ] propose the DeepONet architecture, which learn PDE solution operators. However, in this case, the PDE is fully known, and the PDE residual is included in the loss. Subsequently, [ LKA+20b ] proposed a similar approach by learning Green’s function for a given PDE. This method gave rise to the Fourier neural operator [ LKA+20a ] , which leverages certain assumptions on Green’s function to solve the problem in Fourier space. [ LSZ+22 ] build neural network models which integrate PDE operators directly in the model’s architecture, while retaining the large capacity neural network architecture. There are too many recent works on neural PDEs to mention. [ Zha24 ] lists over seven hundred papers, most of them from the last three years, including survey and benchmark papers. We mention a few relevant papers: [ TPL+22 ] , provide a benchmark dataset and interface for learning PDEs. Solver in the loop [ UBF+20 ] integrate NN methods with a PDE solver. ClimODE [ VHG24 ] solves an advection equation with source. Neural-networks architectures related to differential equations Several works connect neural network architectures and solution operators for differential equations. [ CRBD18 ] proposed a neural network architecture based on ODE solvers and [ HR17 ] focused on the stability aspects of the architecture. Also have Neural SDEs [ TR19 ] . [ RH20 ] proposed network architectures based on discretized PDE solvers, however they do not learn PDE operators. The early contribution [ LLMD18 ] represents a PDE solution

Read the complete text