Evidential Physics-Informed Neural Networks for Scientific Discovery

Hai Siong Tan, Kuancheng Wang, Rafe McBeth · 2025

Read Evidential Physics-Informed Neural Networks for Scientific Discovery by Hai Siong Tan, Kuancheng Wang, Rafe McBeth (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-14568.txt.

Introduction

Hai Siong Tan, Kuancheng Wang and Rafe McBeth present evidential physics informed neural networks in 2025, adding calibrated uncertainty to equation solving networks. Standard physics informed models give one answer with no honest error bar. Scientific discovery needs to know when a model is guessing.

Their E-PINN uses evidential deep learning losses to estimate output uncertainty directly. Unknown equation parameters are also inferred as a learned posterior distribution. Tests on a one dimensional Poisson problem and a two dimensional Fisher-KPP problem show coverage probabilities calibrated better than Bayesian and ensemble rivals. Real world demonstrations follow in the study. Uncertainty aware solvers can flag where new data would teach the most, guiding experiments rather than merely fitting them.

Catalog record

CREATORHai Siong Tan, Kuancheng Wang, Rafe McBeth
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-14568

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evidential Physics-Informed Neural Networks for Scientific Discovery Hai Siong Tan, Kuancheng Wang, Rafe McBeth Abstract We present the fundamental theory and implementation guidelines underlying Evidential Physics-Informed Neural Network (E-PINN) – a novel class of uncertainty-aware PINN. It leverages the marginal distribution loss function of evidential deep learning for estimating uncertainty of outputs, and infers unknown parameters of the PDE via a learned posterior distribution. Validating our model on two illustrative case studies – the 1D Poisson equation with a Gaussian source and the 2D Fisher-KPP equation, we found that E-PINN generated empirical coverage probabilities that were calibrated significantly better than Bayesian PINN and Deep Ensemble methods. To demonstrate real-world applicability, we also present a brief case study on applying E-PINN to analyze clinical glucose-insulin datasets that have featured in medical research on diabetes pathophysiology. 1 Introduction A central problem in scientific machine learning is the inference of latent and unknown parameters governing the physical system from observed data. This has typically been addressed through a variety of methods, including Physics-Informed Neural Networks (PINN) [ 17 , 20 ] when there is a presumed description via differential equations, neural ODE systems [ 7 ] which embeds neural networks within ODE solvers, and Bayesian neural networks that could incorporate known mathematical models (e.g. B-PINN [ 25 ] ). Most recently, Evidential Physics-Informed Neural Networks (E-PINN) was proposed in [ 22 ] , where principles of Evidential Deep Learning (EDL) 1 1 1 Evidential Deep Learning [ 2 , 21 ] is a framework where a higher-order set of priors are placed over likelihood functions for the outputs, and model training is then used to infer uncertainty estimates from closed-form functions of the learned prior hyperparameters. was blended with those of PINN to yield uncertainty estimates for the target outputs assumed to follow a set of PDEs. E-PINN [ 22 ] was conjectured to be able to generate uncertainty estimates also for the unknown PDE parameters (apart from the target output) by averaging the PDE residual term over a hypothetical distribution. A limitation of the work of [ 22 ] is that it only applies to a subclass of PDEs where its parameters can be separated out as linear terms in a certain form (as expressed in equation 3 of [ 22 ] ). It was also not clear how one should specify the hypothetical distribution for the learnable PDE parameters. In our work here, we present a significant refinement of the framework of [ 22 ] , in particular, proposing a novel approach for inferring the unknown parameters that is much more aligned with Bayesian statistics. We formulate a data-driven, information-theoretic approach to specify a prior distribution for the parameters. Unlike ordinary PINN or the work in [ 22 ] , the loss weight of the PDE residual is not fixed a priori but is learned adaptively, evolving throughout training. This refinement requires a two-phase model training algorithm where model is first trained purely on data in the first phase, allowing us to construct priors and appropriate initial conditions for the PDE residual and the learnable parameters, before invoking the PDE constraints in the second phase. As validation case studies, we applied our model to a 1D Poisson equation with Gaussian source and a 1+1D nonlinear Fisher-KPP equation, a prototype of the reaction-diffusion model. We compared the performance of our model against two popular uncertainty-aware frameworks that could also be synthesized with PINN. As reviewed in [ 8 ] , a state-of-the-art proposal for uncertainty quantification in PINNs is the framework of Bayesian-PINN (B-PINN) of [ 25 ] , where the PDE residual loss forms part of the posterior distribution. Another popular framework is that of Deep Ensemble ( [ 11 , 18 ] ) where a set of similar models with different initial weights are taken to provide a distribution of predictions. The main performance metric we adopt here is the degree of calibration of the uncertainty quantification measured by the empirical coverage probability [ 12 ] . To illustrate its applicability in a real-world setting, we also apply E-PINN on published intravenous glucose tolerance test (IVGTT) data assuming the Bergman minimal model of glucose-insulin dynamics [ 3 , 4 ] which has played a crucial role in modeling diabetes pathophysiology [ 5 ] . Our paper is organized as follows. We begin with an exposition of our theoretical derivations in Sec. 2 . In Sec. 3 , we validate our model on two case studies, followed by an application of E-PINN on a real-world clinical dataset in Sec. 4 , before concluding in Sec. 5 . 2 Theoretical Formulation 2.1 A posterior density from merging principles of Deep Evidential Regression and PINN Our loss function is the negative logarithm of a probability density-like function that can be schematically expressed as follows. \mathcal{L}=-\log\left[P(\mathcal{D}|\mathcal{M}(\vec{w}))\,P(\mathcal{M}(\vec{w})|\vec{\Omega})\,\pi(\vec{\Omega})\right], (1) where \mathcal{M} refers to a neural network providing a surrogate model for the empirical dataset \mathcal{D}=\{\left(\vec{x}_{i},\vec{y}_{i}\right)\}_{i=1}^{N}, with \vec{w} being its weights, and \vec{\Omega} denoting the set of unknown parameters of an underlying PDE description of data \mathcal{D} . In this current work, we take \mathcal{M} to be a multilayer feedforward neural network. In ( 1 ), the term P(\mathcal{M}(\vec{w})|\vec{\Omega}) refers to the exponential of (the negative of) the PDE residual term in PINN. P(\mathcal{M}(\vec{w})|\vec{\Omega})\sim\exp{\left[-\frac{1}{2\sigma^{2}_{R}}\sum^{N_{D}}_{k=1}\mathcal{R}^{2}_{k}\left(\partial y,y,x_{k},\vec{\Omega}\right)\right]}, (2) where N_{D} is the number of independently sampled points within the domain of the PDE and \mathcal{R}\left(\partial y,y,x,\vec{\Omega}\right)=0 refers to the partial differential equation, with \sigma^{2}_{R} being the variance parameter of a density function for the residual. 2 2 2 One can extend this to a system of PDEs by defining a separate residual for each differential equation. The negative logarithm of ( 2 ) is the PDE residual loss, with the parameter \sigma^{2}_{R} quantifying the weight of this loss term relative to the data loss term \sim-\log P(\mathcal{D}|\mathcal{M}(\vec{w})) . In standard PINN, this is a free parameter and, to our knowledge, there is no principled approach towards determining its choice. Here we lift \sigma^{2}_{R} to be a learnable parameter with the relative weight of the PDE residual evolving as the model shifts towards a minimum in the loss landscape. We regularize the dynamical evolution of \sigma^{2}_{R} through a prior density function \pi(\sigma^{2}_{R};\alpha_{r},\beta_{r}) which we pick to be the inverse-gamma distribution. Since the residual is a function of the unknown parameters \vec{\Omega} , the form of ( 1 ) suggests that we can interpret it as the (unnormalized) posterior density for \vec{\Omega} , with \pi(\vec{\Omega}) being the prior distribution and the product P(\mathcal{D}|\mathcal{M}(\vec{w}))\,P(\mathcal{M}(\vec{w})|\vec{\Omega}) being the likelihood function. The model’s weights are then latent variables with model training equivalent to a maximum a posteriori estimation. This interpretation enables us to compute the uncertainty of \vec{\Omega} as being defined with respect to the posterior density function f_{p}\left(\vec{\Omega}|\mathcal{D},\mathcal{M}(\vec{w})\right)=\frac{P(\mathcal{M}(\vec{w})|\vec{\Omega})\pi(\vec{\Omega})}{\int d\vec{\Omega}\,P(\mathcal{M}(\vec{w})|\vec{\Omega})\pi(\vec{\Omega})}, (3) where we have used the fact that the likelihood function factorizes P(\mathcal{D},\vec{w}|\vec{\Omega})=P(\mathcal{D}|\mathcal{M}(\vec{w}))P(\mathcal{M}(\vec{w})|\vec{\Omega}), (4) and thus the data loss term does not appear explicitly, being canceled away in the normalization factor. Restoring the input indices, we note that since the data loss term and PDE residual term are products of i.i.d. individual observations, ( 4 ) represents P(\mathcal{D}|\mathcal{M}(\vec{w}))P(\mathcal{M}(\vec{w})|\vec{\Omega})\equiv\prod^{N_{D}}_{j=1}P(\mathcal{D}_{j}|\mathcal{M}(\vec{w}),x_{j})\prod^{N_{p}}_{k=1}P(\mathcal{M}(\vec{w})|\vec{\Omega},x_{k}), (5) where N_{D} is the total number of empirically observed targets and N_{p} is the number of

Read the complete text