Global Geometry Is Not Enough for Vision Representations
Jiwan Chung, Seon Joo Kim · 2026
Read Global Geometry Is Not Enough for Vision Representations by Jiwan Chung, Seon Joo Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03282.txt.
Description
Global shape of a vector space says little about composition, according to Jiwan Chung, with 1 co-author. Representation learning often assumes well-distributed vectors imply robust, generalizable traits. Global geometry encodes which elements are present in an image. It can be insensitive to how those elements are composed. That is the binding problem: whether a model knows which attribute belongs to which object in a scene.
The authors test whether geometric metrics predict compositional binding across a diverse suite of vision encoders. Standard geometry statistics showed near-zero correlation with binding ability. Functional sensitivity, measured through the input-output Jacobian, tracked the capability reliably instead. An analytic account traces the disparity to training objectives, which constrain vector geometry but leave the local input-output mapping unconstrained. Geometry, they conclude, is only a partial view.
Catalog record
| CREATOR | Jiwan Chung, Seon Joo Kim |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-03282