Spatio-Temporal Uncertainty-Modulated Physics-Informed Neural Networks for Solving Hyperbolic Conservation Laws with Strong Shocks
Darui Zhao, Ze Tao, Fujun Liu · 2026
Read Spatio-Temporal Uncertainty-Modulated Physics-Informed Neural Networks for Solving Hyperbolic Conservation Laws with Strong Shocks by Darui Zhao, Ze Tao, Fujun Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-00029.txt.
Introduction
Zhao and team propose UM-PINN, a system for training physics-informed neural networks as multi-task learning under steady uncertainty. Physics-informed neural networks struggle with shock waves in high-speed flows, a failure attributed to gradient trouble. A space mask with tunable variance values trades equation errors and initial conditions across the domain, steadied by Sobol samples. The team tests the system on the Sod shock tube, Shu-Osher problem, and Riemann case, where schemes fail. UM-PINN improves accuracy and sharpness by orders of magnitude over rivals.
Catalog record
| CREATOR | Darui Zhao, Ze Tao, Fujun Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47332 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.00029
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Spatio-Temporal Uncertainty-Modulated Physics-Informed Neural Networks for Solving Hyperbolic Conservation Laws with Strong Shocks Darui Zhao, Ze Tao, Fujun Liu Abstract Physics-Informed Neural Networks (PINNs) frequently encounter difficulties in accurately resolving shock waves within high-speed compressible flows, a failure largely attributed to the ”gradient pathology” arising from extreme stiffness at discontinuities. To overcome this limitation, we propose the Spatio-Temporal Uncertainty-Modulated PINN (UM-PINN), a probabilistic framework that reinterprets the training process as a multi-task learning problem governed by homoscedastic aleatoric uncertainty. By integrating a gradient-based spatial mask with learnable variance parameters, our method dynamically balances the conflicting contributions of Partial Differential Equation (PDE) residuals and initial conditions across the spatiotemporal domain, further stabilized by Quasi-Monte Carlo Sobol sampling. We validate the framework against challenging benchmarks, including the one-dimensional (1D) Sod shock tube, the high-frequency Shu-Osher problem, and the complex two-dimensional (2D) Riemann interaction, where standard gradient-based weighting schemes typically fail. Experimental results demonstrate that UM-PINN achieves orders of magnitude improvement in accuracy and shock resolution compared to baseline methods, establishing a robust new paradigm for mesh-free Computational Fluid Dynamics in hyperbolic systems. [style=chinese, orcid=0009-0003-6352-6317] [style=chinese, orcid=0009-0004-0202-3641] [style=chinese, orcid=0000-0002-8573-450X] † † highlights: Spatio-Temporal UM-PINN resolves gradient pathology in hyperbolic systems. Dual modulation via spatial masking and uncertainty weighting balances loss. Captures high-frequency waves in Shu-Osher and 2D Riemann problems accurately. Superior robustness and accuracy compared to LRA and GradNorm methods. {graphicalabstract} keywords Physics-Informed Neural Networks ,Hyperbolic conservation laws ,Shock waves ,Uncertainty modulation ,Homoscedastic uncertainty † † corresponding: Corresponding author. † † These authors contributed equally to this work. 1 Introduction Hyperbolic conservation laws, particularly the Euler equations, serve as the foundational mathematical models for simulating supersonic aerodynamics, explosion mechanics, and astrophysical phenomena. While accurately resolving shock waves and contact discontinuities is crucial for applications ranging from aircraft design to large-scale cosmic evolution simulations, capturing these discontinuous solutions remains a central challenge in computational fluid dynamics (CFD). These physical phenomena are characterized by extremely high spatial gradients and strong nonlinear coupling. Consequently, traditional grid-based methods frequently encounter significant computational costs when addressing high-dimensional problems or complex boundaries [ 14 , 23 , 24 , 8 ] . In recent years, Physics-Informed Neural Networks (PINNs) [ 19 , 22 , 15 , 5 ] have emerged as a promising mesh-free paradigm driven by the rise of deep learning. Researchers have leveraged the nonlinear fitting capabilities of neural networks to embed physical equations directly into loss functions via automatic differentiation (AD). This approach has yielded significant progress in solving both forward simulations and inverse parameter inversion problems [ 1 , 16 , 20 , 9 ] . Despite these advancements, existing PINN frameworks still face limitations when dealing with strong shock waves. A primary obstacle is the phenomenon known as ”gradient pathology,” where a severe magnitude imbalance exists between the partial differential equation (PDE) residual term and the initial condition (IC) term. As a result, standard optimization algorithms often become trapped in local optima, causing excessive smoothing of shock profiles or non-physical Gibbs oscillations [ 4 , 3 , 13 , 6 ] . Such limitations challenge the reliability of PINNs for industrial-grade hypersonic flow simulations. To improve robustness, our research incorporates ”homoscedastic aleatoric uncertainty” to dynamically adjust the loss weights across different tasks. The core of this strategy involves treating the loss function weights as learnable noise variances within the model rather than fixed hyperparameters. This adaptive mechanism offers a viable path to resolve the trade-off between physical constraints and boundary conditions(BCs). Furthermore, it is expected to fundamentally alleviate the gradient conflicts that arise between distinct loss terms [ 17 , 11 , 18 , 7 ] . Based on this concept, we develop the Uncertainty-Modulated PINN (UM-PINN) framework to effectively address the shortcomings of current methods regarding shock wave capturing. By deriving a physics-informed loss function based on maximum likelihood estimation, the network autonomously regulates the gradient flow according to the training state. We further augment this approach with Sobol Sequence quasi-Monte Carlo sampling to improve search efficiency. Experimental results demonstrate that UM-PINN accurately captures sharp shock wave fronts with high fidelity. Moreover, the proposed method surpasses traditional PINN models in terms of computational accuracy and convergence speed without requiring manual weight tuning. These findings validate the utility of probabilistic modeling in scientific machine learning and suggest a new technical route for the intelligent simulation of complex compressible fluids. 2 Mathematical Framework and Methodology We consider the two-dimensional (2D) Euler equations describing the motion of an inviscid, compressible fluid. In conservative form, the system represents the conservation of mass, momentum, and energy: \frac{\partial\mathbf{U}}{\partial t}+\frac{\partial\mathbf{F}(\mathbf{U})}{\partial x}+\frac{\partial\mathbf{G}(\mathbf{U})}{\partial y}=0, (1) where \mathbf{U} is the vector of conserved variables, and \mathbf{F}(\mathbf{U}) and \mathbf{G}(\mathbf{U}) are the flux vectors in the x - and y -directions, respectively. Their mathematical expressions are defined as follows: \mathbf{U}=\begin{bmatrix}\rho\\ \rho u\\ \rho v\\ E\end{bmatrix},\quad\mathbf{F}(\mathbf{U})=\begin{bmatrix}\rho u\\ \rho u^{2}+p\\ \rho uv\\ (E+p)u\end{bmatrix},\quad\mathbf{G}(\mathbf{U})=\begin{bmatrix}\rho v\\ \rho uv\\ \rho v^{2}+p\\ (E+p)v\end{bmatrix}. (2) where \rho denotes the fluid density, u and v are the velocity components in the x - and y -directions, p is the static pressure, and E is the total energy per unit volume. To close the system mathematically, an equation of state(EOS) is required to establish the relationship between pressure p and the other conserved variables. For an ideal gas, the thermodynamic relation follows: E=\frac{p}{\gamma-1}+\frac{1}{2}\rho(u^{2}+v^{2}). (3) Consequently, the formula for pressure is given by: p=(\gamma-1)\left(E-\frac{1}{2}\rho(u^{2}+v^{2})\right), (4) where \gamma is the ratio of specific heats. In the numerical experiments of this work, we set \gamma=1.4 for the Sod and Shu-Osher problems, while for the 2D Riemann problem, the constant is selected according to the specific configuration. For the one-dimensional cases involved in this study (e.g., Sod Shock Tube and Shu-Osher Problem), the physical fields exhibit translational invariance in the y -direction, implying \partial/\partial y=0 and v=0 . Under these conditions, Equation. ( 1 ) degenerates to the one-dimensional (1D) conservative form: \frac{\partial\mathbf{U}_{1D}}{\partial t}+\frac{\partial\mathbf{F}(\mathbf{U}_{1D})}{\partial x}=0. (5) The corresponding variables are simplified to: \mathbf{U}_{1D}=\begin{bmatrix}\rho\\ \rho u\\ E\end{bmatrix},\quad\mathbf{F}(\mathbf{U}_{1D})=\begin{bmatrix}\rho u\\ \rho u^{2}+p\\ (E+p)u\end{bmatrix}. (6) In the PINN framework, we employ a deep neural network f_{\theta} to approximate the primitive variables. This mapping can be represented as: \hat{\mathbf{y}}(t,x,y)=\begin{bmatrix}\hat{\rho}\\ \hat{u}\\ \hat{v}\\ \hat{p}\end{bmatrix}=f_{\theta}(t,x,y). (7) Leveraging Automatic Differentiation (AD), we can precisely compute the derivatives of the network outputs with respect to the input coordinates. The physical residuals \mathcal{R} are defined as follows: \displaystyle\mathcal{R}_{\rho} \displaystyle:=\partial_{t}\hat{\rho}+\partial_{x}(\hat{\rho}\hat{u})+\partial_{y}(\hat{\rho}\hat{v}) \displaystyle\mathcal{R}_{\rho u} \displaystyle:=\partial_{t}(\hat{\rho}\hat{u})+\partial_{x}(\hat{\rho}\hat{u}^{2}+\hat{p})+\partial_{y}(\hat{\rho}\hat{u}\hat{v}) \displaystyle\mathcal{R}_{\rho v} \displaystyle:=\partial_{t}(\hat{\rho}\hat{v})+\partial_{x}(\hat{\rho}\hat{u}\hat{v})+\partial_{y}(\hat{\rho}\hat{v}^{2}+\hat{p}) (8) \displaystyle\mathcal{R}_{E} \displaystyle:=\partial_{t}\hat{E}+\partial_{x}((\hat{E}+\hat{p})\hat{u})+\partial_{y}((\hat{E}+\hat{p})\hat{v}) where \hat{E} is computed from the predicted primitive variables using the EOS.To specifically handle the extreme gradient fluctuations near shock waves, we introduce a Spatial Modulation mechanism. Inspired by the concept of flux limiters in traditional CFD, we define the modulated physical residuals \hat{R} as: \hat{R}=\frac{1}{1+\alpha\left|\nabla\hat{U}\right|^{\beta}}\odot R (9) where \left|\nabla\hat{U}\right| denotes the norm of the gradient of predicted conserved variables, and \alpha,\beta are hyperparameters that control the degree of attenuation. This mechanism prevents the optimization from being dominated by localized high-gradient spikes at discontinuities. Mathematically, at shock locations where |\nabla\hat{U}|\gg 1 , the modulation factor \frac{1}{1+\alpha|\nabla\hat{U}|^{\beta}}\to 0 , effectively down-weighting the residual contribution from these extreme points. This ensures a smoother loss landscape and prevents gradient explosion during backpropagation, analogous to how flux limiters suppress oscillations in traditional CFD. These residual terms are incorporated into the loss function. When the neural