Enforcing governing equation constraints in neural PDE solvers via training-free projections
Omer Rochman Sharabi, Gilles Louppe · 2025
Read Enforcing governing equation constraints in neural PDE solvers via training-free projections by Omer Rochman Sharabi, Gilles Louppe (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17258.txt.
Introduction
Omer Rochman and Gilles Louppe tackle a flaw in neural solvers for partial differential equations, the equations that govern many physical systems. Such solvers are fast, but their outputs often break the very rules the equations impose, like conservation laws. Easy rules can be enforced cheaply, while curved, nonlinear rules are much harder to respect, above all when effects stretch across time.
The authors test two fixes applied after the solver runs, with no retraining. One solves a small optimisation problem to pull the output back to the allowed set, and the other uses a local straight-line shortcut built from derivative products. Across sample equations, both fixes cut rule breaks sharply and improve accuracy over standard physics-guided baselines.
Catalog record
| CREATOR | Omer Rochman Sharabi, Gilles Louppe |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-17258
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enforcing governing equation constraints in neural PDE solvers via training-free projections Omer Rochman Sharabi, Gilles Louppe Abstract Neural PDE solvers used for scientific simulation often violate governing equation constraints. While linear constraints can be projected cheaply, many constraints are nonlinear, complicating projection onto the feasible set. Dynamical PDEs are especially difficult because constraints induce long-range dependencies in time. In this work, we evaluate two training-free, post hoc projections of approximate solutions: a nonlinear optimization-based projection, and a local linearization-based projection using Jacobian-vector and vector-Jacobian products. We analyze constraints across representative PDEs and find that both projections substantially reduce violations and improve accuracy over physics-informed baselines. 1 Introduction Neural PDE solvers for scientific simulations often break physical constraints, even when they score well on standard metrics ( zhengInverseBenchBenchmarkingPlugandPlay2025 ; chen2023Machine ; yin2024Precipitation ) . In particle systems this could mean violating mass and momentum conservation ( Prantl2022GuaranteedCO ) ; in fluids, incompressibility and adherence to Navier–Stokes ( boxho2025Turbulent ) ; in medical imaging, physiologically plausible ranges for parameters ( ahmadi2025Physicsinformed ) . Depending on the system, physical constraints can be linear or nonlinear, local or global, static or dynamical. In many problems, physical consistency is best understood as satisfying the constraints implied by the governing PDE, the problem specification, and known physics. Per-timestep conditions, such as divergence-free in incompressible fluids, restrict admissible states but can leave temporal consistency underdetermined, since they hold at each step independently. Conservation laws can help but do not guarantee consistent time evolution. Treating the governing equation itself as a constraint couples space and time and addresses this gap, providing a limit on temporal consistency. In this case, the PDE residual often serves as an informative and, sometimes, the only feasible metric of time consistency, because it dictates how plausible states evolve. Nonetheless, even local near-consistency can result in trajectories that are inconsistent globally. Existing constraint enforcement methods involve significant tradeoffs. Physics-informed approaches like PINNs ( raissi2017pinn ) , PINO ( li2023pino ) , and their generative counterparts ( zhou2025Generating ) add penalty terms to the loss function, complicating training and potentially preventing convergence ( sophiya2025comprehensive ) . Architectural enforcement guarantees constraint satisfaction ( mattheakis2019physical ) but reduces model expressiveness and requires custom designs for each constraint type. Helper networks ( constanteflores2025enforcing ) introduce additional training overhead and hyperparameter tuning. Constrained sampling methods for generative models ( huang2024DiffusionPDE ; jacobsen2024CoCoGen ; baldan2025Flow ; luGenerativeDownscalingPDE2024 ) require backpropagation through sampling paths with repeated constraint evaluations. Moreover, these approaches are rarely validated on complex dynamical constraints like Navier–Stokes, focusing instead on simpler linear constraints such as divergence-free conditions. Finally, PDE determinism can lead to degenerate posteriors with unique solutions, making sampling from such narrow distributions challenging. Contributions. We focus on hard governing equation constraints from nonlinear dynamical PDEs that induce long-range temporal dependencies. We evaluate two training-free, post hoc projection operators of approximate solutions: a nonlinear optimization-based projection and a local linearization-based projection implemented with Jacobian-vector and vector-Jacobian products for scalability. In experiments, both projections substantially reduce violations and improve accuracy over physics-informed training baselines. 2 Projection operators We consider a PDE of the general form \mathcal{L}[u]=f, (1) over \Omega\times(0,T) , where u is the unknown function we seek to find, \Omega is the spatial domain, (0,T) is the time interval, \mathcal{L} is a differential operator that may be nonlinear, and f is a known source function on \Omega\times(0,T) . The PDE is subject to initial and boundary conditions \mathcal{I}[u]=u_{0} and \mathcal{B}[u]=g , where \mathcal{I} and \mathcal{B} are the initial and boundary condition operators, u_{0} specifies the initial state on \Omega , and g specifies the boundary values on \partial\Omega\times(0,T) . To enforce global consistency, the full solution must be considered at once. Let the discretized state u\in\mathbb{R}^{N} be a vector of function evaluations at N points in space and time, u=\{u(x_{i},t_{i})\}_{i=1}^{N} , where the points \{(x_{i},t_{i})\in\Omega\times(0,T)\}_{i=1}^{N} are chosen to be sufficiently dense to ensure accurate operator discretization. Note that we overload u to denote both the continuous function and its discretized representation. The discretized PDE problem becomes a system of nonlinear equations h(u)=c\in\mathbb{R}^{N} where h(u)=[\mathcal{L}_{d}(u),\mathcal{B}_{d}(u),\mathcal{I}_{d}(u)] is the concatenation of the discretized operators and c=[f_{d},g_{d},u_{0,d}] is the concatenation of the discretized right-hand sides. Given the output \hat{u} of a neural PDE solver, we seek a physically consistent solution u that satisfies the constraint h(u)=c . If consistency is defined in the L_{2} sense, then this can be formulated as finding the projection of \hat{u} into the feasible manifold, \min_{u}\|u-\hat{u}\|\quad\text{s.t.}\quad h(u)=c. (2) Nonlinear projection. When h is nonlinear, there is no closed form solution to Equation 2 . Instead, the problem can be formulated as an unconstrained minimization problem \min_{u}\|u-\hat{u}\|+\lambda\|h(u)-c\|, (3) with weight \lambda\geq 0 , which can be solved by numerical optimization. We use the LBFGS algorithm ( lbfgs ) throughout this work. Linear projection. As Equation 2 admits analytical solutions when h is linear, an alternative is to linearize the constraints about \hat{u} and rearrange h(u)\approx h(\hat{u})+J_{h}(u-\hat{u})\Rightarrow J_{h}u=c-h(\hat{u})+J_{h}\hat{u}, (4) where J_{h} is the Jacobian of h computed at \hat{u} . We denote this linear system as \mathcal{C}u=b , where \mathcal{C}=J_{h} and b=c-h(\hat{u})+J_{h}\hat{u} . With linearized constraints, we formulate either the projection of \hat{u} onto the feasible set (Equation 5 ) or, if we suspect \hat{u} to be a poor approximation, the relaxed variant (Equation 6 ) \min_{u}\|u-\hat{u}\|\quad\text{s.t.}\quad\mathcal{C}u=b (5) \min_{u}\|u-\hat{u}\|+\lambda\|\mathcal{C}u-b\|. (6) Both admit closed-form solutions ( nocedal ) u=\hat{u}-\mathcal{C}^{\top}(\mathcal{C}\mathcal{C}^{\top})^{-1}(\mathcal{C}\hat{u}-b) (7) u=(I+\lambda\mathcal{C}^{\top}\mathcal{C})^{-1}(\hat{u}+\lambda\mathcal{C}^{\top}b). (8) The first is a projection enforcing the linearized constraints exactly when they are consistent, while the second trades constraint satisfaction and proximity to \hat{u} through \lambda\geq 0 . Therefore, we call the first projection constrained and the second relaxed . Depending on the size of the system, \mathcal{C} can be too large to fully materialize, and matrix inversion is known to be unstable ( LA1 ; LA2 ; LA3 ) . In this case, instead of direct inversion, we solve the linear systems \mathcal{C}\mathcal{C}^{\top}X=\mathcal{C}\hat{u}-b,\qquad (9) (I+\lambda\mathcal{C}^{\top}\mathcal{C})X=\hat{u}+\lambda\mathcal{C}^{\top}b, (10) and respectively compute u=\hat{u}-\mathcal{C}^{\top}X or u=X , using sparse solvers such as CG ( cg ) , GMRES ( gmres ) , or BiCGSTAB ( bicgstab ) . These solvers only require access to the matrix-vector operators, so we leverage the fact that Equations 9 and 10 can be rewritten in terms of the \text{JVP}(v):=v\mapsto\mathcal{C}v and \text{VJP}(v):=v\mapsto\mathcal{C}^{\top}v to obtain favorable scaling. Alternatively, for moderately sized systems the sparse matrix \mathcal{C} can be used directly. 3 Experiments We investigate three dynamical systems: the 3D Lorenz ODE ( lorenz63 ) , the 1D Kuramoto–Shivashinsky (KS) PDE ( kuramoto ; shivashinksy ) , and the 2D Navier–Stokes (NS) PDE. More details on data generation are given in App. A . In the KS and NS PDEs, we train a neural network to predict the full trajectory x_{1:T} from the initial state x_{0} , whereas in the Lorenz system we give x_{T} as additional context to the network. For every equation we train two models: one that minimizes MSE only, and a physics-informed one that minimizes the MSE plus the MSE of the constraint loss h(u)-c . As physics-informed models, PINNs ( raissi2017pinn ) are used for Lorenz, while PINOs ( li2023pino ) are used for KS and NS. We report test-set Mean Squared Error (MSE) and the squared L_{2} norm of the constraint