Non-normal spectral signatures of instability in neural network training dynamics

Souvik Ghosh · 2026

Read Non-normal spectral signatures of instability in neural network training dynamics by Souvik Ghosh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23476.txt.

Introduction

Ghosh explains training instabilities in deep networks, loss spikes, wobbly convergence, and gradient pathologies, through non-normal operator theory. The linearized update operators for common optimizers are generically non-normal. For Adam, non-normality tracks the commutator between the Hessian and the adaptive preconditioner, while for momentum SGD it comes from the augmented state-space form. A pseudospectral precursor bound warns of transient growth even when the spectral radius stays below one. Tests on two-layer networks confirm the indicator separates stable from unstable phases by about tenfold.

Catalog record

CREATORSouvik Ghosh
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36699
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.23476

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Non-normal spectral signatures of instability in neural network training dynamics Souvik Ghosh Abstract Training instabilities in deep networks—loss spikes, oscillatory convergence, and gradient pathologies—are empirically prevalent but lack a rigorous operator-theoretic explanation. We show that the linearized update operators for practically used optimizers are generically non-normal: for Adam, non-normality is controlled by the commutator [ H , M ] [H,M] between the Hessian and the diagonal adaptive preconditioner, while for SGD with momentum it arises from the augmented state-space structure of the update map. Applying non-normal stability theory to these operators, we derive a conservative pseudospectral precursor bound in which κ ⁡ ( V ) \kappa(V) serves as an early-warning indicator of transient amplification even when the spectral radius remains below one, and we establish that exceptional points of the update operator appear as the κ ⁡ ( V ) → ∞ \kappa(V)\to\infty limiting case of this framework. Numerical experiments on two-layer networks confirm that the spectral radius ρ ⁡ ( J ) \rho(J) provides no separation between stable and unstable training phases while κ ⁡ ( V ) \kappa(V) separates them by approximately one order of magnitude, complementing the classical sharpness criterion with a continuous severity measure of non-normal amplification. These results establish non-Hermitian operator theory as a useful and underexplored framework for neural network optimization stability, offering a diagnostic language and proof-of-concept benchmark for understanding adaptive optimization stability. I Introduction Training instabilities—loss spikes, oscillatory convergence, and gradient pathologies—are among the most practically consequential phenomena in deep learning, yet they remain theoretically undercharacterized. The standard theoretical framework for optimization stability rests on the eigenspectrum of the Hessian H=\nabla^{2}L(\theta) : a loss landscape is considered sharp when \lambda_{\max}(H) is large, and a training trajectory is predicted to be unstable when \lambda_{\max}(H) exceeds 2/\eta for gradient descent with step size \eta 2 . Recent work on the Edge of Stability 3 ; 4 has refined this picture considerably, showing that the top Hessian eigenvalue evolves dynamically and that sharpness-driven instabilities recur progressively throughout training. Despite this progress, the Hessian-based framework carries an implicit assumption that has gone largely unexamined: since the Hessian H is symmetric, the stability analysis built on its eigenvalues inherits that symmetry. For vanilla gradient descent the update operator J=I-\eta H is symmetric and hence normal —its eigenvectors are orthogonal and its spectrum fully determines all dynamical behavior. The spectral radius criterion \rho(J)<1 is necessary and sufficient for stability in this setting. This assumption of normality fails for the update operators of practically used optimizers. For Adam-preconditioned gradient descent, the linearized update operator takes the form J=I-\eta M^{-1}H , where M is the diagonal adaptive preconditioner. We show that J is normal if and only if [H,M]=0 —a condition requiring the Hessian to be diagonal in the coordinate basis, which does not hold generically for finite-width networks. For SGD with momentum, the augmented state-space update operator on (\theta,v) is non-normal by virtue of its off-diagonal block structure, irrespective of the Hessian. In both cases the non-normality has a concrete consequence: transient amplification of perturbations can occur and persist over many steps even when all eigenvalues lie inside the stability boundary—a phenomenon the spectral radius criterion is structurally incapable of detecting 7 ; 8 . Non-normal operators and their associated stability pathologies are well-studied in fluid mechanics 8 , numerical analysis 7 , and non-Hermitian condensed matter physics 1 , but have not been systematically applied to neural network optimization dynamics. This paper makes that connection explicit. We establish three main results. First (Sec. II ), we prove that the linearized update operators for Adam and SGD with momentum are generically non-normal and characterize the non-normality in terms of computable operator quantities. Second (Sec. III ), we derive a conservative precursor bound showing that the eigenvector condition number \kappa(V) detects impending transient amplification before the spectral radius crosses any instability threshold, and connect this bound to the \varepsilon -pseudospectrum and the Kreiss matrix theorem. Third (Sec. IV ), we validate these predictions numerically: for SGD with momentum at a learning rate in the unstable regime, \kappa(V) separates stable and unstable training phases by one order of magnitude while \rho(J_{\mathrm{aug}}) provides no separation, consistent with Theorem 2 . The classical sharpness criterion \lambda_{\max}(H)>2/\eta provides a binary threshold signal consistent with the Edge of Stability literature; \kappa(V) provides complementary information as a continuous severity measure within the unstable regime. Exceptional points of the update operator appear naturally as the \kappa(V)\to\infty mathematical limit of the framework (Sec. V ), and implications for optimizer design are discussed in Sec. VI . II The Linearized Update Operator and Its Non-Normality II.1 Optimizer Dynamics and Notation Let \theta\in\mathbb{R}^{n} denote the network parameters and L:\mathbb{R}^{n}\to\mathbb{R} the training loss. We consider two representative optimizer classes. Adam-preconditioned gradient descent. At step t , Adam maintains first- and second-moment estimates m_{t},s_{t}\in\mathbb{R}^{n} : \displaystyle m_{t+1} \displaystyle=\beta_{1}m_{t}+(1-\beta_{1})\nabla L(\theta_{t}), (1) \displaystyle s_{t+1} \displaystyle=\beta_{2}s_{t}+(1-\beta_{2})\bigl(\nabla L(\theta_{t})\bigr)^{\circ 2}, (2) \displaystyle\theta_{t+1} \displaystyle=\theta_{t}-\eta M_{t}^{-1}\nabla L(\theta_{t}), (3) where \circ 2 denotes elementwise squaring and M_{t}=\mathrm{diag}\!\bigl(\sqrt{s_{t}/(1-\beta_{2}^{t})}+\varepsilon\bigr) is the diagonal preconditioner. In the quasi-static approximation —valid when \|\partial_{t}M_{t}\|/\|M_{t}\|\ll\eta^{-1} , i.e., when the preconditioner timescale is long compared to the gradient step—we freeze M_{t}=M : \theta_{t+1}=F(\theta_{t}):=\theta_{t}-\eta M^{-1}\nabla L(\theta_{t}). (4) SGD with momentum. Introducing the momentum buffer v_{t}\in\mathbb{R}^{n} : v_{t+1}=\beta v_{t}+\nabla L(\theta_{t}),\qquad\theta_{t+1}=\theta_{t}-\eta v_{t+1}. (5) The full system state is the augmented vector z_{t}=(\theta_{t},v_{t})^{\top}\in\mathbb{R}^{2n} . II.2 The Linearized Update Operator Linearizing Eq. ( 4 ) around a trajectory point \theta^{*} gives \delta\theta_{t+1}=J\,\delta\theta_{t},\qquad J:=I-\eta M^{-1}H, (6) where H=\nabla^{2}L(\theta^{*}) is the Hessian at \theta^{*} . For Adam with first-moment buffer, define the reduced augmented state \delta z_{t}=(\delta\theta_{t},\delta m_{t})^{\top}\in\mathbb{R}^{2n} . In the quasi-static limit the linearized dynamics read \displaystyle\delta m_{t+1} \displaystyle=\beta_{1}\,\delta m_{t}+(1-\beta_{1})H\,\delta\theta_{t}, \displaystyle\delta\theta_{t+1} \displaystyle=\bigl(I-\eta(1-\beta_{1})M^{-1}H\bigr)\delta\theta_{t}-\eta\beta_{1}M^{-1}\delta m_{t}, yielding the 2n\times 2n augmented Jacobian J_{\mathrm{aug}}^{\mathrm{Adam}}=\begin{pmatrix}I-\eta(1-\beta_{1})M^{-1}H&-\eta\beta_{1}M^{-1}\\ (1-\beta_{1})H&\beta_{1}I\end{pmatrix}. (7) The second-moment perturbation \delta s_{t} decouples at first order in the quasi-static limit and enters only at O(\delta\theta^{2}) through variations in M . For SGD with momentum, linearizing the augmented dynamics ( 5 ) on \delta z_{t}=(\delta\theta_{t},\delta v_{t})^{\top} gives J_{\mathrm{aug}}^{\mathrm{SGD}}=\begin{pmatrix}I-\eta H&-\eta\beta I\\ H&\beta I\end{pmatrix}. (8) II.3 Non-Normality of the Update Operator Proposition 1 (Non-normality of Adam update operator) . The Adam update operator J=I-\eta M^{-1}H is non-normal—that is, J^{\dagger}J\neq JJ^{\dagger} —if and only if H and M do not commute. Proof. Since M is real diagonal with positive entries and H is real symmetric, both are self-adjoint. The adjoint of J is J^{\dagger}=I-\eta HM^{-1}. (9) Computing the normality commutator, JJ^{\dagger}-J^{\dagger}J=\eta^{2}\!\left(M^{-1}H^{2}M^{-1}-HM^{-2}H\right). (10) This vanishes if and only if M^{-1}H^{2}M^{-1}=HM^{-2}H . Pre- and post-multiplying by M reduces this to H^{2}=(MHM^{-1})^{2} , which holds if and only if [H,M]=0 . ∎ Corollary 1 . For any finite-width network whose Hessian H is non-diagonal in the coordinate basis, the Adam update operator is non-normal. Proof. The off-diagonal entries of [H,M] are (HM-MH)_{ij}=H_{ij}(m_{j}-m_{i}) for i\neq j . This vanishes only if H is diagonal or M=cI . For a finite-width network, H has generically non-zero off-diagonal entries, and the Adam preconditioner M=\mathrm{diag}(m_{i}) is non-scalar since its entries m_{i}=\sqrt{s_{i}}+\varepsilon inherit coordinate-dependent gradient history. Hence [H,M]\neq 0 generically. ∎ Two structural remarks follow immediately. For vanilla SGD ( M=I ), J=I-\eta H is symmetric and hence normal—standard Hessian-based stability analysis is exact in this case, and our framework recovers the classical result as a limiting case. Non-normality is therefore

Read the complete text