CVT-Bench: Counterfactual Viewpoint Transformations Reveal Unstable Spatial Representations in Multimodal LLMs

Shanmukha Vellamcheti, Uday Kiran Kothapalli, Disharee Bhowmick, Sathyanarayanan N. Aakur · 2026

Read CVT-Bench: Counterfactual Viewpoint Transformations Reveal Unstable Spatial Representations in Multimodal LLMs by Shanmukha Vellamcheti, Uday Kiran Kothapalli, Disharee Bhowmick, Sathyanarayanan N. Aakur (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21114.txt.

Description

Vellamcheti and co-authors test whether multimodal models keep a coherent spatial state as viewpoints change. Models do well on single spatial tasks, but their answers may not stay consistent across views. Their CVT-Bench suite spans synthetic and real scenes and three representations. It asks nearly twelve thousand relational queries across two hundred scenes. Five leading models lose persistence fast and often give jointly impossible states, despite high local accuracy. Text with bounding boxes helps, but does not remove the instability.

Catalog record

CREATORShanmukha Vellamcheti, Uday Kiran Kothapalli, Disharee Bhowmick, Sathyanarayanan N. Aakur
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61514
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.21114

Browse the full library · About the Tower of Babel