Global Geometry Is Not Enough for Vision Representations

Jiwan Chung, Seon Joo Kim · 2026

Read Global Geometry Is Not Enough for Vision Representations by Jiwan Chung, Seon Joo Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03282.txt.

Description

Global shape of a vector space says little about composition, according to Jiwan Chung, with 1 co-author. Representation learning often assumes well-distributed vectors imply robust, generalizable traits. Global geometry encodes which elements are present in an image. It can be insensitive to how those elements are composed. That is the binding problem: whether a model knows which attribute belongs to which object in a scene.

The authors test whether geometric metrics predict compositional binding across a diverse suite of vision encoders. Standard geometry statistics showed near-zero correlation with binding ability. Functional sensitivity, measured through the input-output Jacobian, tracked the capability reliably instead. An analytic account traces the disparity to training objectives, which constrain vector geometry but leave the local input-output mapping unconstrained. Geometry, they conclude, is only a partial view.

Catalog record

CREATORJiwan Chung, Seon Joo Kim
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03282

Browse the full library · About the Tower of Babel