Prediction error certification for PINNs: Theory, computation, and application to Stokes flow
Birgit Hillebrecht ⋆ and Benjamin Unger † · 2025
Read Prediction error certification for PINNs: Theory, computation, and application to Stokes flow by Birgit Hillebrecht ⋆ and Benjamin Unger † (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-07994.txt.
Introduction
Birgit Hillebrecht and Benjamin Unger worked on certifying error in physics-informed neural networks in two thousand twenty-five. Such networks solve equations that describe physical systems, but users need a firm bound on how wrong a prediction may be. Earlier work by the authors gave such a bound for simple cases.
The bound had been hard to use because it needs stability values that are tough to compute. The authors change the bound and give numeric ways to estimate those values. That opens the method to a much wider class of problems. They show it on Stokes flow around a cylinder, a classic test of slow fluid motion past a solid body.
Catalog record
| CREATOR | Birgit Hillebrecht ⋆ and Benjamin Unger † |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-07994
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Prediction error certification for PINNs: Theory, computation, and application to Stokes flow Birgit Hillebrecht ⋆ and Benjamin Unger † Abstract . Rigorous error estimation is a fundamental topic in numerical analysis. With the increasing use of physics-informed neural networks (PINNs) for solving partial differential equations, several approaches have been developed to quantify the associated prediction error. In this work, we build upon a semigroup-based framework previously introduced by the authors for estimating the PINN error. While this estimator has so far been limited to academic examples – due to the need to compute quantities related to input-to-state stability – we extend its applicability to a significantly broader class of problems. This is accomplished by modifying the error bound and proposing numerical strategies to approximate the required stability parameters. The extended framework enables the certification of PINN predictions in more realistic scenarios, as demonstrated by a numerical study of Stokes flow around a cylinder. Keywords. Physics-informed neural networks, rigorous error bound, Stokes flow, Trotter-Kato approximation Mathematics subject classification. 65N15, 47D06, 35A35, 35F16, 41A65 1. Introduction Scientific machine learning, which refers to the use of machine learning methods to learn solution maps of dynamical systems for predictive purposes, has received considerable attention in recent years. Although the practical benefits of neural networks over classical methods for dynamical systems have yet to be shown or are even challenged [ 20 ] , machine learning still offers attractive prospects, such as the potential to overcome the curse of dimensionality. Since the introduction of physics-informed neural networks ( PINNs ) for approximating solutions to partial differential equations ( PDEs ) [ 45 ] , research has rapidly expanded to encompass various adaptations, including variational formulations ( vPINNs ) [ 44 , 30 ] , Lagrangian formulations ( LPINNs ) [ 39 ] , and domain decomposition strategies ( XPINNs ) [ 27 ] . The increasing interest from both methodological and application-driven perspectives (e.g., [ 5 , 44 , 48 , 21 ] ) has led to comprehensive survey articles such as [ 28 , 7 , 38 ] . While paving the way for more competitiveness with traditional numerical methods, considerable effort has been devoted to establishing convergence guarantees and rigorous error analysis for scientific machine learning. A priori error estimates have been derived for either specific problems or specific network geometries [ 10 , 9 , 11 , 46 , 3 ] which also show convergence properties of the PINN as numerical algorithm. While these results ensure the existence of neural networks that approximate the exact solution within a prescribed tolerance, they offer no insight into the prediction quality of a specific trained model. In fact, [ 19 ] highlights that the theory-to-practice gap in deep learning prevents algorithms based on finite sampled data from achieving the theoretical optimum. Consequently, one must resort to a posteriori error estimates to assess the accuracy of a given trained PINN . In this context, [ 23 , 24 ] derive a rigorous error bound based on semigroup theory, [ 2 ] develops a computable a posteriori error estimator for vPINNs , and [ 13 ] proposes a wavelet-based estimator. In this paper, we focus on the practical applicability of the a posteriori error estimators of [ 24 ] by developing tools to numerically estimate the required constants in the error certificates for challenging engineering and applied sciences problems. In more detail, given Banach spaces (Z,\|\cdot\|_{Z}) and (U,\|\cdot\|_{U}) , a time interval \mathbb{T}\vcentcolon=[0,T]\subseteq\mathbb{R} , and a spatial domain \Omega\subseteq\mathbb{R}^{d} , we consider the boundary and initial value problem ( BIVP ) (1.1) \left\{\quad\begin{aligned} \dot{z}&=\mathfrak{A}z\quad&\mathrm{in}\;\mathbb{T}\times\Omega,\\ \mathfrak{D}z&=z_{\mathrm{b}}\quad&\mathrm{on}\;\mathbb{T}\times\partial\Omega,\\ z&=z_{0}\quad&\mathrm{in}\;\left\{t=0\right\}\times\Omega,\end{aligned}\right. where \mathfrak{A}\colon D(\mathfrak{A})\subseteq Z\to Z is a linear (potentially unbounded) operator, the boundary operator \mathfrak{D}\colon D(\mathfrak{D})\subseteq Z\rightarrow U with D(\mathfrak{A})\subseteq D(\mathfrak{D}) is a linear operator, and z_{\mathrm{b}}\in L^{1}(\mathbb{T};U) and x_{0}\in Z are the boundary and initial values, respectively. It is worth noting, that the dynamical systems under consideration are assumed to be PDEs . In particular, the differential operator \mathfrak{A} might contain derivatives w.r.t. the spatial coordinates. For example for the heat equation \displaystyle\partial_{t}z(t,x)=\alpha\partial_{xx}z(t,x) the operator is given by \mathfrak{A}=\alpha\partial_{xx} . We refer to the forthcoming Section 4.1 for further details on the associated spaces and the boundary operator. In our setting, training a PINN to approximate ( 1.1 ) means that we design a candidate function \tilde{z} , typically a deep neural network, that takes the time t (and maybe further model parameters) as input and compute an approximation \tilde{z}(t)\in Z of z(t)\in Z . Assuming that \tilde{z} is sufficiently smooth, the PINN approximation satisfies the perturbed BIVP (1.2) \left\{\quad\begin{aligned} \dot{\tilde{z}}&=\mathfrak{A}\tilde{z}+\delta\quad&\mathrm{in}\;\mathbb{T}\times\Omega,\\ \mathfrak{D}\tilde{z}&=z_{\mathrm{b}}+\delta_{\mathrm{b}}\quad&\mathrm{in}\;\mathbb{T}\times\partial\Omega,\\ \tilde{z}&=x_{0}+\delta_{\mathrm{0}}\quad&\mathrm{in}\;\left\{t=0\right\}\times\Omega,\end{aligned}\right. with error contributions \delta\colon\mathbb{T}\rightarrow Z , \delta_{\mathrm{b}}\colon\mathbb{T}\rightarrow U , and \delta_{\mathrm{0}}\in Z for the state equation, the boundary condition, and the initial value, respectively. For instance, the approximation is in general smooth enough if the hyperbolic tangent is used as an activation function. We emphasize that for a given PINN instance the error contributions \delta,\delta_{\mathrm{b}},\delta_{\mathrm{0}} can be computed efficiently using algorithmic differentiation to calculate the residuals of \tilde{z} in the BIVP ( 1.1 ). When deriving an error bound or error estimator for \|z(t)-\tilde{z}(t)\|_{Z} , it is important to note that the contribution of the boundary error might be significant. Using input-to-state stability ( ISS ) [ 51 ] , semigroup theory [ 42 ] , the forthcoming 2.1 , and the set of growth functions \mathcal{K}\vcentcolon=\{\mu\colon\mathbb{R}_{0}^{+}\to\mathbb{R}_{0}^{+}\mid\mu(0)=0,\mu\text{ continuous, strictly increasing}\}, the following a posteriori error bound was derived in [ 24 ] . Theorem 1.1 ( [ 24 , Thm. 2] ) . Let the BIVPs ( 1.1 ) and ( 1.2 ) satisfy 2.1 . Then there exists constants M>0 , \omega\in\mathbb{R} and a growth function \gamma\in\mathcal{K} such that the mild solutions z and \tilde{z} of ( 1.1 ) and ( 1.2 ) satisfy (1.3) \|z(t)-\tilde{z}(t)\|_{Z}\leq M\mathrm{e}^{\omega t}\|\delta_{0}\|_{Z}+\int_{0}^{t}M\mathrm{e}^{\omega(t-s)}\|\delta(s)\|_{Z}\,\mathrm{d}s+\gamma(\|\delta_{\mathrm{b}}\|_{L_{\infty}(0,t;U)}). To apply Theorem 1.1 to practical problems, it is necessary to determine the constants M and \omega , as well as the growth function \gamma . For simple benchmark problems, such as the heat equation on a bounded one-dimensional domain, these quantities can be computed analytically; see [ 24 , Sec.,V.A] , which builds on results from [ 50 ] and [ 26 ] . For more complex problems and geometrically challenging domains, however, a direct computation of the ISS functions remain infeasible. The goal of this work is to partially bridge this gap, thereby enabling the application of Theorem 1.1 to a broader class of problems. Specifically, our main contributions are as follows: (i) We show in Theorem 3.4 that the constants M and \omega in ( 1.3 ) can be approximated via established numerical approximation methods that do not require solving the BIVP ( 1.1 ). (ii) Instead of approximating the growth function \gamma in ( 1.3 ) numerically, we use the Fattorini trick [ 15 ] to derive a modified error bound in Theorem 3.1 , which circumvents the need for a suitable growth function \gamma\in\mathcal{K} to be available. Together with Theorem 3.4 , this enables us to compute the error bound for a large class of problems. (iii) For a one-dimensional heat equation, we prove in Lemma 4.1 that the approximated quantities agree with the analytically derived constants from the literature and show that