Softly Induced Functional Simplicity: Implications for Neural Network Generalisation, Robustness, and Distillation
Maciej Glowacki · 2026
Read Softly Induced Functional Simplicity: Implications for Neural Network Generalisation, Robustness, and Distillation by Maciej Glowacki (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-06584.txt.
Description
Lean learned forms tend to work past their drill set and shrug off noise. Maciej Glowacki shows how to lean a net toward lean forms in a 2026 paper. His test bed is a sort task from high-energy physics, where nets read vast, rich data and name what made each burst.
A soft bias that heeds a flip rule warps the loss field as the drill runs. Flat spots in that field act like the soft modes known from mass lore; Glowacki names them pseudo-Goldstone modes. He grades form bulk two ways: from the bend of the loss field, and from how tight the form can be packed. Lean forms read new data with more truth, stood firm when the ins were nudged, and could be poured into small nets with less loss. The chain from bias to bulk to worth is shown end to end.
Catalog record
| CREATOR | Maciej Glowacki |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-06584