High precision PINNs in unbounded domains: application to singularity formulation in PDEs
Yixuan Wang, Ziming Liu, Zongyi Li, Anima Anandkumar, Thomas Y. Hou · 2025
Read High precision PINNs in unbounded domains: application to singularity formulation in PDEs by Yixuan Wang, Ziming Liu, Zongyi Li, Anima Anandkumar, Thomas Y. Hou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-19243.txt.
Introduction
Yixuan Wang and co-authors train physics-guided networks to high precision in a 2025 paper. Such networks solve equations by folding the physics into their loss. On endless domains, and near blow-up points, plain training lacks the needed sharpness.
Their modular plan weighs net shape, sample spots, and optimizer choice one by one. Paired with proof tools and classic analysis, sharp network solutions can probe whether equations blow up. For a one-dimensional flow case, the frame hits very high precision. For a two-dimensional case tied to famous open problems, loss fell far below prior work with fewer steps. The path points toward machine-level precision.
Catalog record
| CREATOR | Yixuan Wang, Ziming Liu, Zongyi Li, Anima Anandkumar, Thomas Y. Hou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-19243
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
High precision PINNs in unbounded domains: application to singularity formulation in PDEs Yixuan Wang, Ziming Liu, Zongyi Li, Anima Anandkumar, Thomas Y. Hou Abstract We investigate the high-precision training of Physics-Informed Neural Networks (PINNs) in unbounded domains, with a special focus on applications to singularity formulation in PDEs. We propose a modularized approach and study the choices of neural network ansatz, sampling strategy, and optimization algorithm. When combined with rigorous computer-assisted proofs and PDE analysis, the numerical solutions identified by PINNs, provided they are of high precision, can serve as a powerful tool for studying singularities in PDEs. For 1D Burgers equation, our framework can lead to a solution with very high precision, and for the 2D Boussinesq equation, which is directly related to the singularity formulation in 3D Euler and Navier-Stokes equations, we obtain a solution whose loss is 4 4 digits smaller than that obtained in [ 57 ] with fewer training steps. We also discuss potential directions for pushing towards machine precision for higher-dimensional problems. 1 Introduction Singularity formulation is one of the key challenges in the study of partial differential equations (PDEs). Unlike well-posed equations, where one can apply classical existence and uniqueness theorems, singularities often occur in certain solutions of nonlinear PDEs, where we only have guarantees of existence for a short time, but the solution may blow up in finite time. The study of singularities often involves a case-by-case approach and is related to some of the most intriguing mathematics and physical properties, such as the onset of turbulence in the Navier-Stokes equations. The singularity of the Navier-Stokes equations is one of the seven Millennium Prize Problems [ 13 ] : widely regarded as the most fundamental and challenging problem in analysis, and is still open. One of the key difficulties in the study of singularities is the lack of understanding of the singularity pattern and its mechanism. The computation of the singularity itself, or infinity, is intractable numerically. A general roadmap is thus to first propose a plausible singularity ansatz that renders the computation feasible, then find candidates of such blowup by numerical simulations, and finally verify the stability of such an ansatz by PDE analysis. We are often interested in a special structure of singularity: self-similar singularity. Self-similarity relates to the invariance of the solution under scaling transformations and reduces singularity to the existence of a self-similar profile. To be precise, for the quantity of interest u(x,t) , we put the ansatz u(x,t)=(T-t)^{-\alpha}U(x(T-t)^{-\beta}) , where U is the profile function independent of time, T is the blowup time, and \alpha>0,\beta are the scaling exponents to be determined. Now we can reduce the computation of an infinite u to the computation of a finite, smooth profile U , along with scaling exponents \alpha,\beta to be inferred. Physics-Informed Neural Networks (PINNs) [ 43 ] serve as a powerful tool to find such profiles, with the scaling parameters jointly inferred as inverse problems. It was first introduced in the context of identifying singularity profiles in [ 57 ] and has seen success even in problems that are unstable for traditional numerical methods. While PINNs offer a powerful tool to search for candidate profiles, solutions identified by PINNs are often of limited accuracy and far from applicable to rigorous PDE analysis, to the best of the authors’ knowledge. In this work, we aim to systematically study the high-precision training of PINNs, with a special focus on applications to solve profile equations governing singularity formulations in PDEs, in fluid dynamics and beyond. We will take a modularized perspective without diving into sophisticated tricks and investigate the following aspects: a good neural network ansatz representing the profile function, a good sampling strategy to tackle the infinite domain with a special focus on imposing boundary conditions, and a good optimization algorithm to train the neural network. We apply our findings to the 1D Burgers equation and the 2D Boussinesq equation, obtaining a precision amenable to rigorous PDE analysis for the 1D Burgers equation and 4 digits better than [ 57 ] with fewer training steps for the 2D Boussinesq equation. The 2D Boussinesq equation shares many similarities with the 3D axisymmetric Euler equation for the ideal fluid without viscosity; see the pioneering works of [ 8 , 6 , 7 ] for the connection between the two equations, where the authors used the connection to establish singularity formulation for the 3D axisymmetric Euler with boundary. 2 Related Works 2.1 PINNs Neural networks have witnessed success in solving PDEs and surrogate modeling in math and science. PINNs in particular have been widely used due to their flexibility and applicability to a wide range of problems [ 4 , 43 , 20 ] . The key idea of PINNs is to enforce the PDE constraints at a set of collocation points and to minimize the residual of the PDEs as a loss function. By posing the solution of PDEs as an optimization problem, PINNs are especially suited to solve inverse problems [ 44 , 64 , 31 , 63 ] , where the solution of the PDE and the underlying parameters can be jointly inferred. In [ 57 ] , the authors used PINNs to study the blowup of the 1D Burgers equation, the 1D family of generalized Constantin-Lax Majda equations, and the 2D Boussinesq equation. Another line of work, operator learning [ 22 ] , focuses on learning the solution operator instead of learning a single instance of solution, where Fourier Neural Operators (FNOs) [ 24 , 23 , 25 , 26 ] and DeepONets [ 30 ] are two families of representative works in this direction. Once a solution operator is learned, it can be evaluated in a resolution-free manner at any point in the domain. Data are often augmented to enhance the solution accuracy, while the loss function can also incorporate the PDE constraints, termed Physics Informed Neural Operator (PINO) [ 27 ] . In [ 32 ] , the authors used PINO with Fourier continuation to study the blowup of the 1D Burgers equation. 2.2 Self-similar Singularity and Computer Assisted Proofs Self-similar singularity of the ansatz u(x,t)=(T-t)^{-\alpha}U(x(T-t)^{-\beta}) is generic in the study of singularity formation in PDEs, where one uses the scaling invariance of the PDE and can reduce the computation of an infinite u to the computation of a finite, smooth (approximate) profile U . Such structures exist even in the simple Riccati ODE u_{t}=u^{2} with an exact solution u=(T-t)^{-1} . The approximate profile can be identified via explicit construction or numerical computation. Working in the rescaled, self-similar variables and performing stability analysis around the profile U provides a powerful tool to establish the singularity formation, for nonlinear Schrodinger equations [ 34 , 37 ] , incompressible fluids [ 12 , 5 , 8 , 6 , 16 ] , compressible fluids [ 36 , 35 ] , and beyond. Until recently, most of the works relied on an explicit profile and spectral information of the associated linearized operator to establish linear and nonlinear stability. In [ 6 , 7 ] , the authors used computer-assisted proofs with a sophisticated numerical profile obtained by solving the dynamic rescaling equations in time to obtain an approximate steady