WorldVLN: Autoregressive World Action Model for Aerial Vision-Language Navigation

Baining Zhao, Jiacheng Xu, Weicheng Feng, Xin Zhang, Zhaolu Wang, Haoyang Wang, Shilong Ji, Ziyou Wang, Jianjie Fang, Zhiheng Zheng, Weichen Zhang, Yu Shang, Wei Wu, Chen Gao, Xinlei Chen, Yong Li · 2026

Read WorldVLN: Autoregressive World Action Model for Aerial Vision-Language Navigation by Baining Zhao, Jiacheng Xu, Weicheng Feng, Xin Zhang, Zhaolu Wang, Haoyang Wang, Shilong Ji, Ziyou Wang, Jianjie Fang, Zhiheng Zheng, Weichen Zhang, Yu Shang, Wei Wu, Chen Gao, Xinlei Chen, Yong Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15964.txt.

Description

Baining Zhao and fifteen colleagues propose WorldVLN, an autoregressive world action model for aerial navigation. Aerial navigation means following instructions through perception and action in 3D settings. WorldVLN adapts a video backbone to predict short world-state transitions and decode them into waypoint actions. Training grounds the video prior in navigation dynamics, then develops Action-aware GRPO, a reinforcement learning method for waypoint decisions. On outdoor and indoor benchmarks, WorldVLN beats baselines by over 12 percent in success rate, with larger advantages on hard cases, and transfers zero-shot to drones.

Catalog record

CREATORBaining Zhao, Jiacheng Xu, Weicheng Feng, Xin Zhang, Zhaolu Wang, Haoyang Wang, Shilong Ji, Ziyou Wang, Jianjie Fang, Zhiheng Zheng, Weichen Zhang, Yu Shang, Wei Wu, Chen Gao, Xinlei Chen, Yong Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59267
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.15964

Browse the full library · About the Tower of Babel