TopoNets: High performing vision and language models with brain-like topography

Mayukh Deb, Mainak Deb, N. Apurva Ratan Murty · 2025

Read TopoNets: High performing vision and language models with brain-like topography by Mayukh Deb, Mainak Deb, N. Apurva Ratan Murty (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-16396.txt.

Description

Brain neurons sit in maps: nearby cells tend to share a function. AI models lack that layout, and past attempts to add it usually cost task performance. The three authors present TopoLoss, a loss function that grows spatially organized representations inside standard architectures without much performance loss. They apply it to vision models, ResNet-18, ResNet-50, and ViT, and to language models, GPT-Neo-125M and NanoGPT.

The resulting TopoNets are the strongest supervised topographic models yet, the authors report. They show brain-like traits: localized feature processing, lower dimensionality, and better efficiency. They also predict brain responses and copy the topographic signatures of the visual and language cortices. The paper frames TopoLoss as a general way to build high-performing models that work more like the brain.

Catalog record

CREATORMayukh Deb, Mainak Deb, N. Apurva Ratan Murty
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-16396

Browse the full library · About the Tower of Babel