Approximating Latent Manifolds in Neural Networks via Vanishing Ideals
Nico Pelleriti, Max Zimmer, Elias Wirth, Sebastian Pokutta · 2025
Read Approximating Latent Manifolds in Neural Networks via Vanishing Ideals by Nico Pelleriti, Max Zimmer, Elias Wirth, Sebastian Pokutta (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-15051.txt.
Description
Nico Pelleriti, Max Zimmer, Elias Wirth, and Sebastian Pokutta link algebra with neural network design in a 2025 paper. Deep networks learn inner representations that, by a common view, lie on curved low-dimensional surfaces inside a much larger space. The team uses vanishing ideals, sets of polynomials that are zero on a surface, to describe those inner surfaces exactly.
Their design cuts a trained network at a middle layer, fits each class's surface with polynomial rules, and adds one polynomial layer that turns the result into cleanly separable features. The smaller models kept accuracy close to the full networks while running faster with fewer weights. The authors also prove sharper learning guarantees for the design than standard theory gives.
Catalog record
| CREATOR | Nico Pelleriti, Max Zimmer, Elias Wirth, Sebastian Pokutta |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-15051