How Far Are Large Multimodal Models from Human-Level Spatial Action? A Benchmark for Goal-Oriented Embodied Navigation in Urban Airspace CCS: Computing methodologies Artificial intelligence

Baining Zhao, Ziyou Wang, Jianjie Fang, Zile Zhou, Yanggang Xu, Yatai Ji, Jiacheng Xu, Qian Zhang, Weichen Zhang, Chen Gao, Xinlei Chen · 2026

Read How Far Are Large Multimodal Models from Human-Level Spatial Action? A Benchmark for Goal-Oriented Embodied Navigation in Urban Airspace CCS: Computing methodologies Artificial intelligence by Baining Zhao, Ziyou Wang, Jianjie Fang, Zile Zhou, Yanggang Xu, Yatai Ji, Jiacheng Xu, Qian Zhang, Weichen Zhang, Chen Gao, Xinlei Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-07973.txt.

Description

Zhao and ten colleagues benchmark large multimodal models on goal-oriented navigation in urban 3D spaces to test spatial action. Such models show strong visual-linguistic reasoning, but spatial decision capacity stays unclear. The team spent over 500 hours building a dataset of 5,037 high-quality navigation samples emphasizing vertical actions and rich urban semantics. They then assess 17 representative models spanning non-reasoning models, reasoning models, agent-based methods, and vision-language-action models. Current models show emerging action skills yet remain far from human-level performance.

Catalog record

CREATORBaining Zhao, Ziyou Wang, Jianjie Fang, Zile Zhou, Yanggang Xu, Yatai Ji, Jiacheng Xu, Qian Zhang, Weichen Zhang, Chen Gao, Xinlei Chen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE86177
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.07973

Browse the full library · About the Tower of Babel