On the Spectral Geometry of Cross-Modal Representations: A Functional Map Diagnostic for Multimodal Alignment CCS: Computing methodologies Spectral methods CCS: Computing methodologies Cross-modal retrieval CCS: Computing methodologies Neural networks CCS: Mathematics of computing Graph algorithms CCS: Applied computing Multi-criterion optimization and decision-making
Krisanu Sarkar · 2026
Read On the Spectral Geometry of Cross-Modal Representations: A Functional Map Diagnostic for Multimodal Alignment CCS: Computing methodologies Spectral methods CCS: Computing methodologies Cross-modal retrieval CCS: Computing methodologies Neural networks CCS: Mathematics of computing Graph algorithms CCS: Applied computing Multi-criterion optimization and decision-making by Krisanu Sarkar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-08579.txt.
Description
Sarkar tests whether vision and language encoders trained alone share spectral structure, using maps between graph Laplacian bases. The two models' spectra look alike, with a scaled distance of just 0.043, hinting at similar inner structure. Yet their vector bases barely align, with near zero diagonal dominance and large mismatch, a gap he calls the spectral complexity orientation gap.
Catalog record
| CREATOR | Krisanu Sarkar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41964 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.08579