VLN-Pilot: Large Vision-Language Model as an Autonomous Indoor Drone Operator

Bessie Dominguez-Dager*, Sergio Suescun-Ferrandiz, Felix Escalona, Francisco Gomez-Donoso, Miguel Cazorla · 2026

Read VLN-Pilot: Large Vision-Language Model as an Autonomous Indoor Drone Operator by Bessie Dominguez-Dager*, Sergio Suescun-Ferrandiz, Felix Escalona, Francisco Gomez-Donoso, Miguel Cazorla (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05552.txt.

Description

Flying a drone indoors by spoken instruction, with no GPS to lean on, is the goal of VLN-Pilot, a framework by Bessie Dominguez-Dager, Sergio Suescun-Ferrandiz, and 3 co-authors. A large vision-language model acts as the pilot, reading free-form commands and grounding them in what the drone sees. The system plans and adjusts flight paths on its own, reacting to obstacles and surprises along the way.

Unlike rule-based planners, the approach uses semantic understanding to pick context-aware behaviors with little task-specific engineering. Tests run in a custom photorealistic indoor simulator built by the team. The agent scored high success rates on complex tasks, including long routes with several semantic targets in sequence. The authors argue that language-guided pilots could cut operator workload for jobs like inspection, search and rescue, and facility checks.

Catalog record

CREATORBessie Dominguez-Dager*, Sergio Suescun-Ferrandiz, Felix Escalona, Francisco Gomez-Donoso, Miguel Cazorla
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-05552

Browse the full library · About the Tower of Babel