SE-VLN: A Self-Evolving Vision-Language Navigation Framework Based on Multimodal Large Language Models

Xiangyu Dong, Haoran Zhao, Jiang Gao, Haozhou Li, Xiaoguang Ma, Yaoming Zhou, Fuhai Chen, Juan Liu · 2025

Read SE-VLN: A Self-Evolving Vision-Language Navigation Framework Based on Multimodal Large Language Models by Xiangyu Dong, Haoran Zhao, Jiang Gao, Haozhou Li, Xiaoguang Ma, Yaoming Zhou, Fuhai Chen, Juan Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-13152.txt.

Description

Xiangyu Dong and co-authors build a robot guide that keeps learning while it works, in a 2025 paper. Vision-language navigation asks an agent to follow spoken or written directions through a space using what it sees. Big multimodal models brought strong skills to the task, but their knowledge stays frozen after training.

The team's framework, SE-VLN, lets the agent improve during testing itself. It stores what it learns from each run and folds that experience back into later choices. Borrowing the idea from living things, the system grows more capable the more it navigates. The authors present it as the first self-evolving design of its kind for this task. Guides that learn on the job could serve homes, hospitals, and warehouses better over time.

Catalog record

CREATORXiangyu Dong, Haoran Zhao, Jiang Gao, Haozhou Li, Xiaoguang Ma, Yaoming Zhou, Fuhai Chen, Juan Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-13152

Browse the full library · About the Tower of Babel