NewPINNs: Physics-Informing Neural Networks Using Conventional Solvers for Partial Differential Equations

Maedeh Makki [email protected], Satish Chandran [email protected], Maziar Raissi [email protected], Adrien Grenier [email protected], Behzad Mohebbi [email protected] · 2026

Read NewPINNs: Physics-Informing Neural Networks Using Conventional Solvers for Partial Differential Equations by Maedeh Makki [email protected], Satish Chandran [email protected], Maziar Raissi [email protected], Adrien Grenier [email protected], Behzad Mohebbi [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17207.txt.

Introduction

Maedeh Makki and four co-authors present NewPINNs, a learning frame for equations that rule physics. Standard physics-informed networks learn by punishing gaps in the equations. They also punish missed edge conditions through loss terms. NewPINNs takes a new path. It puts a classic solver right inside the training loop.

Learning goals then come from solver consistency. The network must agree with what the trusted solver gives. That link keeps training tied to known good math. It may cut the drift that loss-only training can allow. For engineers, the draw is clear. They gain fast neural models that still respect the solvers they already trust.

Catalog record

CREATORMaedeh Makki [email protected], Satish Chandran [email protected], Maziar Raissi [email protected], Adrien Grenier [email protected], Behzad Mohebbi [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE85 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-17207

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

NewPINNs: Physics-Informing Neural Networks Using Conventional Solvers for Partial Differential Equations Maedeh Makki [email protected], Satish Chandran [email protected], Maziar Raissi [email protected], Adrien Grenier [email protected], Behzad Mohebbi [email protected] Abstract We introduce NewPINNs, a physics-informing learning framework that couples neural networks with conventional numerical solvers for solving differential equations. Rather than enforcing governing equations and boundary conditions through residual-based loss terms, NewPINNs integrates the solver directly into the training loop and defines learning objectives through solver-consistency. The neural network produces candidate solution states that are advanced by the numerical solver, and training minimizes the discrepancy between the network prediction and the solver-evolved state. This pull–push interaction enables the network to learn physically admissible solutions through repeated exposure to the solver’s action, without requiring problem-specific loss engineering or explicit evaluation of differential equation residuals. By delegating the enforcement of physics, boundary conditions, and numerical stability to established numerical solvers, NewPINNs mitigates several well-known failure modes of standard physics-informed neural networks, including optimization pathologies, sensitivity to loss weighting, and poor performance in stiff or nonlinear regimes. We demonstrate the effectiveness of the proposed approach across multiple forward and inverse problems involving finite volume, finite element, and spectral solvers. 1 Introduction Solving partial differential equations (PDEs) is a fundamental task in many different scientific and engineering disciplines such as electrodynamics, fluid dynamics, and solid mechanics ( 35 ; 56 ; 20 ; 83 ) . However, outside of simplified toy-models, it is nearly impossible to write down an analytical solution to a given differential equation system ( 23 ) . As a result, myriad numerical methods such as the finite difference method (FDM), finite volume methods (FVM), finite element methods (FEM), lattice Boltzmann methods (LBM), material point methods (MPM), etc., have been developed over the centuries to solve PDEs accurately for many scientific and engineering problems ( 67 ; 42 ; 41 ; 66 ; 50 ; 32 ; 27 ; 4 ; 18 ; 54 ; 30 ) . Over the past decade deep-learning has been used to solve many scientific and engineering problems involving differential equations. Traditional data-driven neural networks often struggle with physical consistency when modeling complex systems, requiring a prohibitively large number of samples and often failing to generalize beyond training distributions ( 60 ) . To address this, the physics-informed neural networks (PINNs) were developed as a flexible method to solve forward and inverse problems ( 59 ; 82 ; 25 ; 79 ) . In the PINNs framework, a neural network learns the solution of a PDE by having its loss function be composed of residuals of the differential equation and the boundary/initial conditions ( 59 ) . Despite their success, PINNs face significant structural limitations that hinder their reliability in complex scenarios: • Optimization Difficulties: The standard PINN loss function is a complex weighted sum of PDE residuals, boundary conditions, and initial conditions. This creates a highly non-convex loss landscape that is difficult to optimize, often leading to convergence failures in stiff systems or multi-scale problems ( 62 ; 64 ) . • Hyperparameter Sensitivity: Balancing the competing terms in the loss function requires tuning multiple scalar weights, a process that is often stiff and problem-dependent. • Spectral Bias: Neural networks tend to learn low-frequency functions first, which causes standard PINNs to struggle with high-frequency or chaotic dynamics where the PDE residual does not provide a strong enough gradient signal for fine-scale features ( 80 ; 53 ; 38 ) . To address these challenges, many different approaches have been developed. These methods can broadly be classified into 3 distinct categories, namely PINNs, hybrid neural-numerical methods, and data-driven methods. Physics-Informed Neural Networks (PINNs): Since the introduction of “classical” PINNs, there have been many modified versions of them to improve their performance across multiple scientific and engineering tasks ( 59 ; 73 ; 36 ; 40 ) . Wang et al. divided their simulation domain into subdomains and trained local PINNs on each one to mitigate very small and very large gradients, and also address poor scaling of PDE residuals ( 75 ) . Hybrid Neural-Numerical Models: Combining traditional numerical solvers with neural networks to use the strength of both approaches, has gained significant interest in recent years ( 81 ; 55 ; 52 ) . The neural ODE model implements the neural network output as a derivative in an ODE solver, and then used an integrator to solve the ODE and compute the gradients to train the network ( 16 ) . The NNfoil framework that PINNs with a finite element mesh transformation to simulate subsonic, inviscid flow around airfoils ( 13 ) . Time-Stepping-Oriented Neural Network (TSONN) resolves the ill-conditioning in PINNs by adjusting the Jacobian condition number to enhance performance ( 14 ) . Universal Differential Equations (UDEs) splits the solution space into a multiple neural networks and feeds them into traditional solvers to train them ( 58 ) . The neural-initialized Newton (NiN) strategy accelerates nonlinear finite element solvers by using a pretrained physics-informed neural operator as an initial guess for Newton–Raphson iterations ( 68 ) . The Pretrained Finite Element Method (PFEM) introduces a two-stage hybrid framework in which a transformer-based physics-informed neural operator is trained solely from PDE constraints on unstructured point clouds and subsequently used to warm-start classical finite element solvers ( 76 ) . Data-Driven Discovery of Differential Equations: Extracting physical properties from known or measured data (i.e. inverse problems) is another critical problem in many scientific and engineering domains ( 21 ; 57 ; 51 ; 78 ) . The Sparse Identification of Nonlinear Dynamics (SINDy) algorithm is a popular method for discovering governing equations from data by expressing derivatives as sparse combinations of candidate (often polynomial) basis functions of a few dominant terms, and uses sparse regression to identify them from time series data ( 34 ) . However SINDy requires a comprehensive library of functions and often fail to handle noisy data ( 12 ) . Raissi et al. used a PINN-like training approach to find the unknown parameters of equations by approximating the solution and non-linear differential operators as neural networks and fitting the residual to the observed data ( 61 ) . Long et al. developed PDE-Net 2.0, which learns coefficients of PDEs from time dependent data by combining both convolutional and symbolic neural networks ( 46 ) .Neural operator methods such as DeepONet and Fourier Neural Operators have also gained traction in recent years. The neural operator frameworks aim to learn global mappings between function spaces, typically by training on large datasets of input–output pairs generated by numerical solvers ( 48 ; 45 ) . While these approaches have demonstrated strong performance in data-rich regimes, they rely on extensive precomputed datasets and primarily function as supervised surrogate models. To address these fundamental challenges, we introduce NewPINNs, a novel framework that fundamentally alters how physics is injected into the network. Instead of forcing the network to minimize a PDE residual derived via automatic differentiation, NewPINNs couples the network with a traditional numerical solver in a “pull-push” closed-loop solver-consistency training procedure (see Figure 1 ). PDE Parameters Neural Network \widehat{u}(x,t_{n}) Numerical Solver u_{S}(x,t_{n+1}) Loss \widehat{u}(x,t_{n+1}) Optimizer Figure 1 : Transient NewPINNs: At each training iteration, the neural network

Read the complete text