EscherVerse: An Open World Benchmark and Dataset for Teleo-Spatial Intelligence with Physical-Dynamic and Intent-Driven Understanding
Tianjun Gu, Chenghua Gong, Jingyu Gong, Zhizhong Zhang, Yuan Xie, Lizhuang Ma, Xin Tan, [6pt] East China Normal University Shanghai AI Lab Shanghai Innovation Institute · 2026
Read EscherVerse: An Open World Benchmark and Dataset for Teleo-Spatial Intelligence with Physical-Dynamic and Intent-Driven Understanding by Tianjun Gu, Chenghua Gong, Jingyu Gong, Zhizhong Zhang, Yuan Xie, Lizhuang Ma, Xin Tan, [6pt] East China Normal University Shanghai AI Lab Shanghai Innovation Institute (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-01547.txt.
Description
Gu and 6 co-authors test whether vision-language models grasp how people move objects for a purpose. People read a scene by linking change over time to a goal, not just by naming things. Models that score well on fixed tests often miss that link in messy real settings.
The team built EscherVerse from more than eleven thousand real videos, with a test set and a larger training set. Twenty-seven models were tried against human answers. The best model reached about fifty-seven percent, while people averaged about ninety-one percent. Extra training on goal-aware real data helped open models, but a wide gap remained.
Catalog record
| CREATOR | Tianjun Gu, Chenghua Gong, Jingyu Gong, Zhizhong Zhang, Yuan Xie, Lizhuang Ma, Xin Tan, [6pt] East China Normal University Shanghai AI Lab Shanghai Innovation Institute |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-01547