Rigorous Error Certification for Neural PDE Solvers: From Empirical Residuals to Solution Guarantees

Amartya Mukherjee*, Maxwell Fitzsimmons*, David C. Del Rey Fernández, Jun Liu · 2026

Read Rigorous Error Certification for Neural PDE Solvers: From Empirical Residuals to Solution Guarantees by Amartya Mukherjee*, Maxwell Fitzsimmons*, David C. Del Rey Fernández, Jun Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-19165.txt.

Introduction

Mukherjee and co-authors give firm error bounds for neural solvers of partial differential equations. Such solvers cut loss at sample points, but that alone does not prove the answer is close to the true one. The team proves that when trial answers sit in a compact set, small residuals force convergence. They derive sure and likely bounds that turn residual, edge, and start errors into clear limits. The result gives these solvers a firmer base for use.

Catalog record

CREATORAmartya Mukherjee*, Maxwell Fitzsimmons*, David C. Del Rey Fernández, Jun Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE124087
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.19165

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Rigorous Error Certification for Neural PDE Solvers: From Empirical Residuals to Solution Guarantees Amartya Mukherjee*, Maxwell Fitzsimmons*, David C. Del Rey Fernández, Jun Liu Abstract Uncertainty quantification for partial differential equations is traditionally grounded in discretization theory, where solution error is controlled via mesh/grid refinement. Physics-informed neural networks fundamentally depart from this paradigm: they approximate solutions by minimizing residual losses at collocation points, introducing new sources of error arising from optimization, sampling, representation, and overfitting. As a result, the generalization error in the solution space remains an open problem. Our main theoretical contribution establishes generalization bounds that connect residual control to solution-space error. We prove that when neural approximations lie in a compact subset of the solution space, vanishing residual error guarantees convergence to the true solution. We derive deterministic and probabilistic convergence results and provide certified generalization bounds translating residual, boundary, and initial errors into explicit solution error guarantees. The implementation of our method is in the following GitHub repository . 1 Introduction Partial differential equations (PDEs) play a crucial role in modelling phenomena across physics [ 16 ] , engineering [ 41 ] , finance [ 42 ] , and control [ 24 ] . However, they are conceptually difficult and computationally expensive to solve. In recent years, neural network-based approaches have attracted growing attention across machine learning, applied mathematics, and physics. In particular, physics-informed neural networks (PINNs) approximate solutions by fitting functions that satisfy the governing equations at sampled locations [ 27 , 14 , 4 , 12 , 31 , 36 ] ;see 17 for a comprehensive overview of the physics-informed learning paradigm and its applications. In many scientific and decision-making settings, solving a PDE is not sufficient: one must also quantify the uncertainty and reliability of the computed solution. For example, classical numerical methods such as finite difference [ 15 ] , finite element [ 28 ] , and spectral methods [ 30 ] provide a well-developed theory of discretization error, where the dominant source of error arises from domain discretization. Unlike classical discretization schemes, the loss minimized by PINNs is defined through residual evaluations at finitely many collocation points. Consequently, small training residual does not automatically imply small error in the underlying function space. The central theoretical difficulty is therefore to understand when residual control translates into convergence to the true PDE solution. Without such a link, the reliability of neural PDE solvers cannot be rigorously assessed. While recent works have begun to bound residual errors, boundary violations, or testing errors for PINNs, a fundamental question remains largely unexplored: When does a small residual loss imply that the neural network is close to the true solution in the solution space? Our results establish, for the first time, a direct theoretical link between residual-based training objectives and error in the solution space for PINNs. Unlike prior works that bound residual, boundary, or initial condition errors in isolation [ 39 , 37 , 7 ] , we show how such quantities affect the true solution error. This perspective reframes uncertainty quantification for neural PDE solvers: residual control alone is insufficient; structural regularity is essential. We complement our theoretical analysis with numerical experiments on ODEs and PDEs, including elliptic, parabolic, and hyperbolic examples. Using formal verification tools, we illustrate how error certification yields verifiable generalization guarantees and empirically stable convergence. The main contributions of this paper are as follows: 1. We conduct a convergence analysis of PINNs via compactness arguments. 2. We provide generalization bounds based on errors that can be explicitly computed without access to the true solution. 3. We do formal verifications on several systems and show that the true solution error is bounded above by our generalization error. 2 Related Works Neural PDE Solvers. There are various machine learning-based solvers for PDEs, among which PINNs [ 27 ] and extreme learning machines (ELMs) [ 14 ] are widely used. PINNs incorporate the PDE residuals and initial/boundary conditions directly into the loss function, while ELMs perform a least squares approximation. Both methods demonstrate remarkable empirical performance in solving a wide variety of PDEs. Despite their success, a rigorous understanding of when residual minimization guarantees convergence in the solution space, and how residual error translates into solution error, remains largely unresolved. Formally Verified Neural Networks. Motivated by adversarial attacks in neural networks, verifiability and perturbation analysis has been of interest to the trustworthy machine learning community. Satisfiability modulo theories (SMT) solvers such as dReal [ 10 ] have been used to verify inequalities in neural networks by finding counterexamples. Similarly, \alpha -CROWN [ 39 ] and \beta -CROWN [ 34 ] compute bounds in neural networks under perturbations via linear or quadratic relaxations of activation functions. AutoLiRPA [ 37 ] builds upon CROWN to bound neural networks provided a bounded range of perturbations. Formal Verifications in PDEs. More recently, verifications in neural networks have been extended to PDE residuals. An early example is neural Lyapunov functions [ 3 , 40 , 21 , 22 ] , where SMT solvers were used to verify that the learned neural network satisfies the inequalities required for it to be a Lyapunov function. Among these, 21 , 22 specifically used PINNs to learn neural Lyapunov functions. The work of 7 proposes \delta -CROWN, which bounds derivatives of neural networks with respect to their inputs, and therefore, bounds residual errors in PINNs. Finally, generalization bounds in PDEs were explored by 25 in various settings under some stability and training process assumptions. Recent works have developed residual-based error bounds for neural differential equation solvers. The work of 23 derives computable residual-to-error bounds for PINNs across ODEs and first-order PDEs, while 18 proposes recursive error-network constructions for bounding worst-case approximation errors in Fokker–Planck equations. Additionally, 9 incorporates deterministic residual-based bounds into Bayesian PINNs to improve uncertainty calibration, and 38 develops operator-learning frameworks for parabolic PDEs. Our paper builds upon these works by first establishing convergence guarantees under compactness assumptions, showing that vanishing residual error implies convergence to the true solution. We then provide generalization bounds that can be computed explicitly without knowing the true solution. Using verification tools, we bound all sources of error (residual, initial, and boundary) and combine them with theoretically derived error estimates to obtain bounds on the true solution error. Numerical examples demonstrate that these bounds are computable for a variety of ODE and PDE problems and that the true solution error is indeed bounded by our generalization bounds. 3 Problem formulation Let X\subseteq\mathbb{R}^{d_{X}} be compact and Y\subseteq\mathbb{R}^{d_{Y}} . Let \mathcal{G} be a Banach space of functions from X to Y , equipped with norm \|\cdot\|_{\mathcal{G}} , representing the solution space. Typical examples include C(X,Y) with the uniform norm or L^{p}(X,Y) . Let \mathcal{F}\subseteq\mathcal{G} denote a hypothesis class, e.g., functions representable by neural networks of a prescribed architecture type. 3.1 Equation Operator Formulation Let O:\mathcal{G}\times X\to\mathbb{R}^{d_{O}} be a (possibly nonlinear) differential operator defining the equation of interest. For each f\in\mathcal{G} , we define the residual function O(f,\cdot)=:O_{f}:X\to\mathbb{R}^{d_{O}} . Let \mathcal{O} denote a complete normed function space equipped with norm \|\cdot\|_{\mathcal{O}} . We will make the following assumptions: 1. O admits a unique solution g\in\mathcal{G} that satisfies \|O(g,\cdot)\|_{\mathcal{O}}=0 . 2. The map f\to\|O(f,\cdot)\|_{\mathcal{O}} is continuous. For each f\in\mathcal{G} , we

Read the complete text