From Latent Space to Training Data: Explainable Specialization in Minimal MLPs Note: Code, data, figures, and tables for full reproduction will be released on manuscript publication. Journal: Neural Networks
Enrique Alba, Ezequiel López-Rubio · 2026
Read From Latent Space to Training Data: Explainable Specialization in Minimal MLPs Note: Code, data, figures, and tables for full reproduction will be released on manuscript publication. Journal: Neural Networks by Enrique Alba, Ezequiel López-Rubio (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25939.txt.
Description
Alba and Lopez-Rubio ask whether training biases can make hidden neurons in a tiny network specialise. Specialised neurons would each cover a distinct part of the training data. They compare three added losses against plain fitting on one-dimensional data. The losses reward coverage, separation between prototypes, and low overlap of responses. Coverage wins at every size, giving the lowest rebuilding error and the most specialised neurons. Separation helps unevenly, while overlap penalties harm by driving prototypes outside the input range.
Catalog record
| CREATOR | Enrique Alba, Ezequiel López-Rubio |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42257 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.25939