On the Spectral Geometry of Cross-Modal Representations: A Functional Map Diagnostic for Multimodal Alignment CCS: Computing methodologies Spectral methods CCS: Computing methodologies Cross-modal retrieval CCS: Computing methodologies Neural networks CCS: Mathematics of computing Graph algorithms CCS: Applied computing Multi-criterion optimization and decision-making

Krisanu Sarkar · 2026

Read On the Spectral Geometry of Cross-Modal Representations: A Functional Map Diagnostic for Multimodal Alignment CCS: Computing methodologies Spectral methods CCS: Computing methodologies Cross-modal retrieval CCS: Computing methodologies Neural networks CCS: Mathematics of computing Graph algorithms CCS: Applied computing Multi-criterion optimization and decision-making by Krisanu Sarkar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-08579.txt.

Description

Sarkar tests whether vision and language encoders trained alone share spectral structure, using maps between graph Laplacian bases. The two models' spectra look alike, with a scaled distance of just 0.043, hinting at similar inner structure. Yet their vector bases barely align, with near zero diagonal dominance and large mismatch, a gap he calls the spectral complexity orientation gap.

Catalog record

CREATORKrisanu Sarkar
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41964
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.08579

Browse the full library · About the Tower of Babel