Auxiliary Finite-Difference Residual-Gradient Regularization for PINNs Controlled Poisson evidence and a body-fitted 3D shell application

Stavros Kassinos · 2026

Read Auxiliary Finite-Difference Residual-Gradient Regularization for PINNs Controlled Poisson evidence and a body-fitted 3D shell application by Stavros Kassinos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-14472.txt.

Introduction

Kassinos studies a hybrid network design where the governing equation residual stays auto-differentiation based, while finite differences enter only a weak auxiliary term that fines residual gradients. The auxiliary term steadies the residual field without swapping out the equation residual itself. Tests run in two stages: a Poisson test, then a three-dimensional annular heat-conduction case where errors gather near a wavy outer wall. The shell regularizer lifts outer-wall flux and boundary conduct, cutting both errors roughly tenfold under the best setup.

Catalog record

CREATORStavros Kassinos
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55402
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2604.14472

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Auxiliary Finite-Difference Residual-Gradient Regularization for PINNs Controlled Poisson evidence and a body-fitted 3D shell application Stavros Kassinos Abstract Physics-informed neural networks (PINNs) are often selected by a single scalar loss even when the quantity of interest is more specific. This paper studies a hybrid design in which the governing PDE residual remains automatic-differentiation (AD) based, while finite differences (FD) appear only in an auxiliary term that penalizes gradients of the sampled residual field. Unlike AD residual-gradient penalties, FD/ND substitutions inside the main physics loss, or fully discrete residual objectives, the FD term regularizes the residual field without replacing the PDE residual itself. We examine the idea in two stages. Stage 1 is a controlled study on a manufactured two-dimensional Poisson problem, comparing a baseline PINN, the FD residual-gradient regularizer, and a matched AD residual-gradient baseline. The FD term reproduces the main effect of residual-gradient control while exposing a clear trade-off between field accuracy and residual cleanliness. Stage 2 transfers the same residual-field logic to a three-dimensional annular heat-conduction benchmark (PINN3D), where baseline errors concentrate near a wavy outer wall; there the auxiliary grid is implemented as a body-fitted shell adjacent to the wall. In Stage 2, the shell regularizer improves the application-facing quantities, namely outer-wall flux and boundary-condition behavior. Across seeds 0–5 and 100k epochs, the most reliable tested configuration is a fixed shell weight of 5 × 10 − 4 5\times 10^{-4} under the Kourkoutas-β optimizer regime: relative to a matched run without the shell term, it reduces the mean outer-wall BC RMSE from 1.22 × 10 − 2 1.22\times 10^{-2} to 9.29 × 10 − 4 9.29\times 10^{-4} and the mean wall-flux RMSE from 9.21 × 10 − 3 9.21\times 10^{-3} to 9.63 × 10 − 4 9.63\times 10^{-4} . A linearly scheduled shell weight helps on some seeds but is less consistent. Optimizer and learning-rate choice also matter: under the baseline cosine schedule with initial learning rate 7.5 × 10 − 3 7.5\times 10^{-3} , Adam with β 2 = 0.95 \beta_{2}=0.95 or β 2 = 0.999 \beta_{2}=0.999 is unreliable. Adam with β 2 = 0.999 \beta_{2}=0.999 becomes usable when the initial learning rate is reduced to 10 − 3 10^{-3} , but its shell benefit is less robust than under Kourkoutas-β. Overall, the results support a targeted view of hybrid PINNs: an auxiliary-only FD regularizer is most valuable when it is aligned with the physical quantity of interest, here the outer-wall flux. 1 Introduction A physics-informed neural network is asked to satisfy several scientific requests at once. It should reduce a PDE residual, honor multiple boundary conditions, remain periodic or symmetric when required, and sometimes fit data or auxiliary constraints as well. The resulting scalar loss is useful, but it is only a compressed summary of a negotiation among these terms. A model can look satisfactory under one scalar objective while still being poor for the quantity that ultimately matters in the application, for example a wall flux or a boundary-condition residual. That practical mismatch is the starting point of this paper. The motivating PINN3D annular benchmark [ 8 , 9 ] already had a clear pain point before the present work began: the baseline PINN was most fragile near the undulating outer wall, and the quantity of real interest there was not a generic loss value but the wall-normal heat flux and the associated boundary residual. This raised a natural question. If the governing PDE itself only needs low-order derivatives, can we add a weak structured prior that improves the residual field in the region where the baseline model is weakest, without replacing the underlying continuous PINN formulation? Our answer is deliberately focused. We keep the main PDE residual in automatic-differentiation (AD) form, sample that residual on a structured auxiliary grid, and apply finite differences (FD) only to the sampled residual field. The auxiliary term is therefore not a discrete replacement for the PDE residual. It is a structured regularizer on how the already-defined residual field varies in space. In Stage 1 this idea is tested in a clean manufactured Poisson problem. In Stage 2 the same logic is transferred to a body-fitted outer shell wrapped around the PINN3D annulus. A reader coming from outside the PINN literature may want one sentence of terminology up front. We use automatic differentiation (AD) for the exact derivative operators provided by the computational graph of the neural network, and finite differences (FD) for the discrete derivative operators used on a structured auxiliary grid. The method in this paper is hybrid in a very specific sense: the governing residual remains continuous and AD-based, while the auxiliary regularizer is FD-based. The prior literature already constrains how broad the novelty claim can be. Standard PINNs are well established [ 1 ] ; gradient-enhanced variants already use derivatives of the residual [ 4 ] ; and hybrid AD/FD or AD/ND ideas are also present in the literature [ 5 , 6 ] . The present paper therefore makes a narrower claim. The governing residual remains continuous and AD-based, while finite differences are introduced only through an auxiliary regularizer acting on the sampled residual field. In Stage 2 that auxiliary term is further localized to a body-fitted shell near the boundary quantity of interest. Section 3 positions this design more carefully relative to the nearest prior work. What is new here is the combination of that specific hybrid formulation with a controlled two-stage study. Stage 1 asks a mechanism question: does a structured FD residual-gradient term change training in a meaningful and interpretable way, how does it compare with a matched AD residual-gradient baseline, and is it merely sensitive to one auxiliary-grid phase? Stage 2 asks an application question: can the same residual-field logic, deployed on a body-fitted outer shell, improve the outer-wall flux behavior of a realistic PINN3D annular benchmark? These two stages play different roles, and the manuscript is organized to keep that distinction explicit. Because the Stage 2 benchmark and model family are inherited from prior PINN3D/Kourkoutas-β work, it is useful to separate what is reused from what is new. Table 1 does that explicitly. Table 1 : Benchmark inheritance versus new contribution. The present manuscript reuses the PINN3D annular benchmark from earlier work, but adds a new structured residual-gradient regularizer together with a two-stage empirical study designed to separate mechanism from application. Inherited benchmark ingredients New in this manuscript Steady PINN3D annular heat-conduction workload, wavy outer-wall geometry, six-term weighted objective, reference FD solution, and the base MLP/optimizer context from the prior PINN3D and Kourkoutas-β work [ 8 , 9 ] . An auxiliary-only FD regularizer applied to the sampled AD residual field ; the controlled Stage-1 Poisson mechanism study; the body-fitted outer-shell deployment in Stage 2; seedwise wall-reference audits; and the optimizer and learning-rate (LR) sensitivity checks used to interpret the Stage-2 result carefully. The paper is organized to separate controlled mechanism evidence from application evidence. Stage 1 serves as the controlled mechanism study, whereas Stage 2 provides the body-fitted application case. Throughout, the notation is kept as light as possible, and the metric hierarchy is made explicit whenever the scalar objective and the physically meaningful wall quantities disagree. Contributions The paper makes four concrete contributions. 1. It formulates

Read the complete text