Where Did It Go Wrong? Capability-Oriented Failure Attribution for Vision-and-Language Navigation Agents

Jianming Chen, Yawen Wang, Junjie Wang, Xiaofei Xie, Shoubin Li, Qing Wang, Fanjiang Xu · 2026

Read Where Did It Go Wrong? Capability-Oriented Failure Attribution for Vision-and-Language Navigation Agents by Jianming Chen, Yawen Wang, Junjie Wang, Xiaofei Xie, Shoubin Li, Qing Wang, Fanjiang Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25161.txt.

Description

Chen and six colleagues propose capability-based testing for vision-and-language navigation agents. Such agents rely on perception, memory, planning and decision, so failures are hard to localize. Existing system-level tests say little about which capability caused a failure. Their approach combines test generation that adapts by changing seed cases, oracles that flag errors by capability and a feedback loop that attributes failures and guides further tests. Experiments show the method finds more failure cases and pinpoints weak capabilities more accurately than current baselines.

Catalog record

CREATORJianming Chen, Yawen Wang, Junjie Wang, Xiaofei Xie, Shoubin Li, Qing Wang, Fanjiang Xu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54571
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.25161

Browse the full library · About the Tower of Babel