TopoNets: High performing vision and language models with brain-like topography
Mayukh Deb, Mainak Deb, N. Apurva Ratan Murty · 2025
Read TopoNets: High performing vision and language models with brain-like topography by Mayukh Deb, Mainak Deb, N. Apurva Ratan Murty (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-16396.txt.
Description
Brain neurons sit in maps: nearby cells tend to share a function. AI models lack that layout, and past attempts to add it usually cost task performance. The three authors present TopoLoss, a loss function that grows spatially organized representations inside standard architectures without much performance loss. They apply it to vision models, ResNet-18, ResNet-50, and ViT, and to language models, GPT-Neo-125M and NanoGPT.
The resulting TopoNets are the strongest supervised topographic models yet, the authors report. They show brain-like traits: localized feature processing, lower dimensionality, and better efficiency. They also predict brain responses and copy the topographic signatures of the visual and language cortices. The paper frames TopoLoss as a general way to build high-performing models that work more like the brain.
Catalog record
| CREATOR | Mayukh Deb, Mainak Deb, N. Apurva Ratan Murty |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-16396