A Complete Symmetry Classification of Shallow ReLU Networks
Pranavkrishnan Ramakrishnan · 2026
Read A Complete Symmetry Classification of Shallow ReLU Networks by Pranavkrishnan Ramakrishnan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-14037.txt.
Description
Ramakrishnan classifies all symmetries of shallow ReLU networks, settling which distinct parameters give the same function. Earlier full lists needed smooth activations, leaving out ReLU. By using ReLU's kink head-on, he maps the full symmetry structure of the shallow case. That shows the neuromanifold shape that shapes training dynamics.
Catalog record
| CREATOR | Pranavkrishnan Ramakrishnan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63145 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.14037