A Complete Symmetry Classification of Shallow ReLU Networks

Pranavkrishnan Ramakrishnan · 2026

Read A Complete Symmetry Classification of Shallow ReLU Networks by Pranavkrishnan Ramakrishnan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-14037.txt.

Description

Ramakrishnan classifies all symmetries of shallow ReLU networks, settling which distinct parameters give the same function. Earlier full lists needed smooth activations, leaving out ReLU. By using ReLU's kink head-on, he maps the full symmetry structure of the shallow case. That shows the neuromanifold shape that shapes training dynamics.

Catalog record

CREATORPranavkrishnan Ramakrishnan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63145
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.14037

Browse the full library · About the Tower of Babel