From Latent Space to Training Data: Explainable Specialization in Minimal MLPs Note: Code, data, figures, and tables for full reproduction will be released on manuscript publication. Journal: Neural Networks

Enrique Alba, Ezequiel López-Rubio · 2026

Read From Latent Space to Training Data: Explainable Specialization in Minimal MLPs Note: Code, data, figures, and tables for full reproduction will be released on manuscript publication. Journal: Neural Networks by Enrique Alba, Ezequiel López-Rubio (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25939.txt.

Description

Alba and Lopez-Rubio ask whether training biases can make hidden neurons in a tiny network specialise. Specialised neurons would each cover a distinct part of the training data. They compare three added losses against plain fitting on one-dimensional data. The losses reward coverage, separation between prototypes, and low overlap of responses. Coverage wins at every size, giving the lowest rebuilding error and the most specialised neurons. Separation helps unevenly, while overlap penalties harm by driving prototypes outside the input range.

Catalog record

CREATOREnrique Alba, Ezequiel López-Rubio
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42257
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25939

Browse the full library · About the Tower of Babel