Where Did It Go Wrong? Capability-Oriented Failure Attribution for Vision-and-Language Navigation Agents
Jianming Chen, Yawen Wang, Junjie Wang, Xiaofei Xie, Shoubin Li, Qing Wang, Fanjiang Xu · 2026
Read Where Did It Go Wrong? Capability-Oriented Failure Attribution for Vision-and-Language Navigation Agents by Jianming Chen, Yawen Wang, Junjie Wang, Xiaofei Xie, Shoubin Li, Qing Wang, Fanjiang Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25161.txt.
Description
Chen and six colleagues propose capability-based testing for vision-and-language navigation agents. Such agents rely on perception, memory, planning and decision, so failures are hard to localize. Existing system-level tests say little about which capability caused a failure. Their approach combines test generation that adapts by changing seed cases, oracles that flag errors by capability and a feedback loop that attributes failures and guides further tests. Experiments show the method finds more failure cases and pinpoints weak capabilities more accurately than current baselines.
Catalog record
| CREATOR | Jianming Chen, Yawen Wang, Junjie Wang, Xiaofei Xie, Shoubin Li, Qing Wang, Fanjiang Xu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54571 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.25161