Not Only Text: Exploring Compositionality of Visual Representations in Vision-Language Models
Davide Berasi, Matteo Farina, Massimiliano Mancini, Elisa Ricci, Nicola Strisciuglio · 2025
Read Not Only Text: Exploring Compositionality of Visual Representations in Vision-Language Models by Davide Berasi, Matteo Farina, Massimiliano Mancini, Elisa Ricci, Nicola Strisciuglio (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17142.txt.
Description
Davide Berasi and co-authors test in 2025 whether AI models that join images and text build picture meanings from parts, as they plainly do for words. Word meanings in such models nest neatly: king minus man plus woman lands near queen. Whether picture codes blend the same way was unclear, and picture data is noisy and sparse.
Their framework fits picture codes with curved-geometry part structures, respecting the space's true shape. Pretrained models do show such part-whole order, they report. On part-based sorting their method beat a straight-line rival. On fairness-style tests, where some groups lack data, the gain grew. If picture codes compose, models could reason about new mixes they never saw whole.
Catalog record
| CREATOR | Davide Berasi, Matteo Farina, Massimiliano Mancini, Elisa Ricci, Nicola Strisciuglio |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-17142