Incorruptible Neural Networks: Training Models that can Generalize to Large Internal Perturbations
Philip Jacobson, Ben Feinberg, Suhas Kumar, Sapan Agarwal, T. Patrick Xiao, Christopher Bennett · 2026
Read Incorruptible Neural Networks: Training Models that can Generalize to Large Internal Perturbations by Philip Jacobson, Ben Feinberg, Suhas Kumar, Sapan Agarwal, T. Patrick Xiao, Christopher Bennett (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07320.txt.
Description
Neural networks that survive corruption of their own weights matter for low-power hardware, where noise is a fact of life. Philip Jacobson and five co-authors study training methods that find minima robust to internal weight perturbations, from both generalization and tuning angles.
They show theoretically and empirically that an over-regularized random-weight perturbation objective is optimal for noise-robust generalization. They map where sharpness-aware minimization helps or hurts, especially under small noise. The paper connects flat minima to a concrete engineering need: models that keep working when their weights wobble. Hardware-aware machine learning teams get guidance on which training objective to trust.
Catalog record
| CREATOR | Philip Jacobson, Ben Feinberg, Suhas Kumar, Sapan Agarwal, T. Patrick Xiao, Christopher Bennett |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-07320