Barycentric alignment for instance-level comparison of neural representations

Shreya Saha, Zoe Wanying He, Meenakshi Khosla · 2026

Read Barycentric alignment for instance-level comparison of neural representations by Shreya Saha, Zoe Wanying He, Meenakshi Khosla (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-09225.txt.

Description

Neural networks that learn the same task can still organize knowledge differently, and comparing them is tricky because units can be reordered or rotated without changing what the network does. Shreya Saha and two co-authors introduce barycentric alignment, a framework that quotients out those nuisance symmetries to build a shared embedding space across many models. Unlike summary similarity scores, it compares representations stimulus by stimulus.

That fine grain reveals which inputs drive models together or apart, and which input properties predict convergence across vision and language families. The same framework builds shared spaces for brain representations across people and visual areas. It also aligns unimodal vision and language models so well that image-text scores track human cross-modal judgments, nearing contrastively trained models.

Catalog record

CREATORShreya Saha, Zoe Wanying He, Meenakshi Khosla
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-09225

Browse the full library · About the Tower of Babel