NavBench: Probing Multimodal Large Language Models for Embodied Navigation

Yanyuan Qiao, Haodong Hong, Wenqi Lyu, Dong An, Siqi Zhang, Yutong Xie, Xinyu Wang, Qi Wu · 2025

Read NavBench: Probing Multimodal Large Language Models for Embodied Navigation by Yanyuan Qiao, Haodong Hong, Wenqi Lyu, Dong An, Siqi Zhang, Yutong Xie, Xinyu Wang, Qi Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01031.txt.

Description

Yanyuan Qiao and co-authors present NavBench, a test suite for how well multimodal language models navigate indoor spaces, in a research paper from 2025. Such models read images and text together, but acting inside real places is a sterner test. The suite probes both understanding and step-by-step movement.

Understanding tasks cover matching instructions to scenes, judging progress, and linking views to actions, across 3,200 question pairs. Movement trials run 432 episodes in seventy-two indoor scenes of graded difficulty. A converter turns model words into robot actions. Top models did well overall, yet most stumbled on judging progress over time. Map context sharpened choices in mid-difficulty scenes.

Catalog record

CREATORYanyuan Qiao, Haodong Hong, Wenqi Lyu, Dong An, Siqi Zhang, Yutong Xie, Xinyu Wang, Qi Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-01031

Browse the full library · About the Tower of Babel