Incorruptible Neural Networks: Training Models that can Generalize to Large Internal Perturbations

Philip Jacobson, Ben Feinberg, Suhas Kumar, Sapan Agarwal, T. Patrick Xiao, Christopher Bennett · 2026

Read Incorruptible Neural Networks: Training Models that can Generalize to Large Internal Perturbations by Philip Jacobson, Ben Feinberg, Suhas Kumar, Sapan Agarwal, T. Patrick Xiao, Christopher Bennett (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07320.txt.

Description

Neural networks that survive corruption of their own weights matter for low-power hardware, where noise is a fact of life. Philip Jacobson and five co-authors study training methods that find minima robust to internal weight perturbations, from both generalization and tuning angles.

They show theoretically and empirically that an over-regularized random-weight perturbation objective is optimal for noise-robust generalization. They map where sharpness-aware minimization helps or hurts, especially under small noise. The paper connects flat minima to a concrete engineering need: models that keep working when their weights wobble. Hardware-aware machine learning teams get guidance on which training objective to trust.

Catalog record

CREATORPhilip Jacobson, Ben Feinberg, Suhas Kumar, Sapan Agarwal, T. Patrick Xiao, Christopher Bennett
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07320

Browse the full library · About the Tower of Babel