The Coercivity Gap in Neural PDE Solvers: Parameter Escape and State Convergence
Enrique Zuazua[0.9em] [1] Friedrich–Alexander–Universität Erlangen–Nürnberg, Department of Mathematics, Chair for Dynamics, Control, Machine Learning and Numerics (Alexander von Humboldt Professorship), Cauerstr. 11, 91058 Erlangen, Germany. [2] Chair of Computational Mathematics, University of Deusto, 48007 Bilbao, Basque Country, Spain. [3] Departamento de Matemáticas, Universidad Autónoma de Madrid, 28049 Madrid, Spain. [email protected] · 2026
Read The Coercivity Gap in Neural PDE Solvers: Parameter Escape and State Convergence by Enrique Zuazua[0.9em] [1] Friedrich–Alexander–Universität Erlangen–Nürnberg, Department of Mathematics, Chair for Dynamics, Control, Machine Learning and Numerics (Alexander von Humboldt Professorship), Cauerstr. 11, 91058 Erlangen, Germany. [2] Chair of Computational Mathematics, University of Deusto, 48007 Bilbao, Basque Country, Spain. [3] Departamento de Matemáticas, Universidad Autónoma de Madrid, 28049 Madrid, Spain. [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-04018.txt.
Introduction
Zuazua studies neural approximations of elliptic PDE solutions through a variational lens. A gap sits between parameter geometry and the physical states they give. An elliptic energy can be coercive and strictly convex in its natural space. Restricted to a neural ansatz, it may lose coercivity in parameter space. The cause is non-closed neural manifolds and neuron condensation.
Yet the state functions can stay bounded through that failure. They can converge strongly to the exact PDE solution. Zuazua proves this for Gaussian wave-packet models in the whole space. Rates come with the proof. The same state-level stability covers PINN-type and hybrid methods, he argues. Relaxation and Tikhonov regularization are also discussed for practice.
Catalog record
| CREATOR | Enrique Zuazua[0.9em] [1] Friedrich–Alexander–Universität Erlangen–Nürnberg, Department of Mathematics, Chair for Dynamics, Control, Machine Learning and Numerics (Alexander von Humboldt Professorship), Cauerstr. 11, 91058 Erlangen, Germany. [2] Chair of Computational Mathematics, University of Deusto, 48007 Bilbao, Basque Country, Spain. [3] Departamento de Matemáticas, Universidad Autónoma de Madrid, 28049 Madrid, Spain. [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 84 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.04018
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Coercivity Gap in Neural PDE Solvers: Parameter Escape and State Convergence Enrique Zuazua[0.9em] [1] Friedrich–Alexander–Universität Erlangen–Nürnberg, Department of Mathematics, Chair for Dynamics, Control, Machine Learning and Numerics (Alexander von Humboldt Professorship), Cauerstr. 11, 91058 Erlangen, Germany. [2] Chair of Computational Mathematics, University of Deusto, 48007 Bilbao, Basque Country, Spain. [3] Departamento de Matemáticas, Universidad Autónoma de Madrid, 28049 Madrid, Spain. [email protected] Abstract We study variational PDE solvers based on neural-network ansatzes. In this setting, the PDE energy is minimized over a nonlinear family of realizations rather than over a linear trial space. The resulting optimization problem may have minimizing sequences for which the parameters diverge while the corresponding states remain bounded and even converge in the natural energy norm. We call this mismatch the coercivity gap . We first formulate the phenomenon abstractly and then analyze a whole-space elliptic model with fixed-variance Gaussian mixtures. In this model, the relevant mechanism is the collision of two active neurons. The realized states converge to a Gaussian derivative, while the parameters escape and the reduced minimum is not attained. Under suitable regularity and decay assumptions on the forcing term, the states still converge in the energy norm, with an explicit logarithmic rate. We also discuss measure-valued relaxations, Tikhonov regularization, residual minimization in stability norms, and a state-space HYCO formulation for hybrid physics–data problems with bounded observations. Keywords. Neural PDE solvers; coercivity gap; state convergence; parameter escape; variational approximation; residual minimization; nonattainment; Gaussian neural networks; HYCO. MSC 2020. 35J20; 41A30; 49J45; 65N35; 68T07. 1 Introduction 1.1 Problem formulation and main results Physics-informed neural networks, the Deep Ritz method, and related variational or residual formulations are now widely used for partial differential equations (PDEs); see [ 32 , 11 , 19 , 28 , 9 , 8 ] and the overview [ 2 ] . Their appeal is clear in high-dimensional and mesh-free settings, but replacing a linear trial space by a nonlinear realization class changes the geometry of the approximation problem: classical questions of approximation, stability, compactness, and convergence acquire new forms, because the topology that is natural for the physical state need not control the parameters of its neural representation. The central phenomenon is the coercivity gap . A PDE energy may be coercive on a function space, but once it is pulled back through a nonlinear neural parametrization, compactness in parameter space may be lost. In particular, a sequence of parameter vectors may become unbounded while the corresponding neural functions remain bounded, or even converge strongly, in the natural norm. Figure 1 illustrates this split. The parameter sequence may escape, while the realized states remain controlled by the PDE energy. In that case, the relevant quantity to monitor is the state error, not the convergence of a particular parameter representation. This point is important in practice. Parameter escape, large weights, or nearly colliding centers do not by themselves mean that the PDE approximation has failed. They may simply reflect an ill-conditioned or nonunique parametrization, while the computed state is already accurate in the relevant energy or residual norm. In numerical work, the state, the energy gap, the residual in a stability norm, and the data misfit are the main objects of interest; the parameters are only a way to generate them. Parameter world bounded region bounded parameters optimizer found escaping parameters infinity State world finite ansatz states state closure target inside the ansatz states converge target on the boundary realization map same map coercive control here need not control this side Figure 1: The coercivity gap. The algorithm searches in parameter space, while the PDE energy controls the realized state. When the target is represented inside the finite ansatz, a minimizing sequence may stay bounded. When the target is reached only as a boundary state, the realized states may converge even though the corresponding parameters escape. This distinction can be hidden by the way the discrete problem is formulated. Some analyses introduce an auxiliary constrained or regularized parameter problem: the weights are restricted to a bounded set, compactness is imposed a priori, or a direct parameter penalty is added. Such devices are useful for proving existence or convergence, but they should not be confused with coercivity of the original PDE loss pulled back through the neural parametrization. By imposing compactness at the parameter level, they rule out parameter escape by assumption. The coercivity gap studied here concerns the untruncated realization problem, where the PDE energy controls the realized state but need not control the parameters that represent it. We first formulate this phenomenon abstractly, and then study it for a whole-space elliptic equation with fixed-variance Gaussian mixtures. In that model the neural states converge quantitatively, while the reduced optimization problem has no minimizer and no bounded minimizing parameter sequence. The main contributions of this paper are the following. (i) a Hilbert-space abstract description of the coercivity gap phenomenon; (ii) a whole-space, fixed-variance Gaussian construction in H^{1}(\mathbb{R}^{d}) : two distinct active neurons collide and converge to a Gaussian derivative outside every finite realization class; a suitable elliptic right-hand side then yields an unattained reduced infimum and forces every parameter-space minimizing sequence to escape; (iii) quantitative state estimates, including a constructive whole-space O((\log P)^{-1/2}) bound under weighted regularity, with the neuron count made explicit; and (iv) extensions to measure relaxation, Tikhonov regularization, residual minimization, and a HYCO-type hybrid formulation, always in norms compatible with PDE stability. We use fixed-variance Gaussian radial-basis functions (see [ 4 , 26 , 37 ] ) because the collision mechanism, the closure defect, and the approximation estimates can be written explicitly. No claim of architectural optimality is intended. The point is rather to show, in a model where the mechanism can be followed by hand, that parameter escape can coexist with convergence in the PDE energy norm. Most of the ingredients are known in approximation theory and neural-network topology; see the bibliographical discussion below. The point here is to place them inside a variational, or residual, PDE setting where nonattainment and parameter escape occur together with strong state convergence. The estimates also clarify why good state-level performance can coexist with poor parameter behavior. This gives a mathematical reason for a common computational observation: neural PDE solvers may produce reliable fields even when their weights, centers, or other coordinates are hard to interpret. The main point is a state-space one. A neural PDE solver maps parameters to a physical field, and the PDE energy, residual, or observation loss depends on that field. Divergence or nonuniqueness of the coordinates is therefore a conditioning or identifiability issue, not a PDE error by itself. Conversely, a small training loss is meaningful for the PDE only when it is measured in a norm that controls the state. 1.2 Literature review The parameter–realization distinction has been analyzed in the context of the existence of best neural approximants [ 14 ] . The instability of best-approximation maps, including for Gaussian radial-basis networks, was studied in [ 18 ] . For fixed architectures, [ 31 ] analyzed the nonclosedness of realization sets for broad classes of activations, the failure of inverse stability, and the resulting blow-up of weights along near-best approximation sequences when a best approximation is not attained. In [ 27 ] , nonclosedness phenomena