G-DRAGON: Geospatial Reasoning and Dynamic Planning for Retrieval-Augmented Outdoor Navigation

Dongzhihan Wang, Yi Du, Jianan Sun, Yuan Xue, Yingchen Zhang, Bing Xiao, Chen Wang, Liang Xu · 2026

Read G-DRAGON: Geospatial Reasoning and Dynamic Planning for Retrieval-Augmented Outdoor Navigation by Dongzhihan Wang, Yi Du, Jianan Sun, Yuan Xue, Yingchen Zhang, Bing Xiao, Chen Wang, Liang Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25646.txt.

Introduction

Wang and colleagues present G-DRAGON for outdoor robot navigation over long distances. Visual-language navigation handles only short ranges, while map-based methods hallucinate and cannot finish the last mile. G-DRAGON turns spoken commands into coordinates from versioned local OpenStreetMap entities, plans global routes, and projects waypoints through SLAM. It then switches to frontier exploration with open-set semantic voxel mapping for the final approach. In simulation it beats leading baselines, and a ground vehicle completes person-search missions on unseen urban streets.

Catalog record

CREATORDongzhihan Wang, Yi Du, Jianan Sun, Yuan Xue, Yingchen Zhang, Bing Xiao, Chen Wang, Liang Xu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32897
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25646

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

G-DRAGON: Geospatial Reasoning and Dynamic Planning for Retrieval-Augmented Outdoor Navigation Dongzhihan Wang, Yi Du, Jianan Sun, Yuan Xue, Yingchen Zhang, Bing Xiao, Chen Wang, Liang Xu Abstract Autonomous ground robots operating in large-scale outdoor environments require both robust long-range navigation and fine-grained “last-mile” exploration. Current advances in visual-language navigation (VLN) work well at short-range tasks, lacking geospatial grounding for long-distance missions. Some OpenStreetMap (OSM)-based methods relying on cloud-based Large Language Models (LLMs) are prone to factual hallucination and cannot conduct “last-mile” exploration based on human instruction. To address these challenges, we present G-DRAGON, a retrieval-augmented framework for outdoor, open-world navigation. This framework maps natural-language commands to versioned, local OSM entities via generative retrieval based on lightweight LLM, yielding accurate coordinates for global route planning. A high-level planning module bridges global topological routes with the SLAM system, projecting geospatial waypoints into the robot’s navigable frame. For the “last mile,” the framework transitions to frontier-based exploration and open-set semantic voxel mapping to localize open-vocabulary targets. Experimental results in simulation demonstrate our framework outperforms state-of-the-art baselines. Furthermore, we validate the system in unseen real-world urban environments on an Unmanned Ground Vehicle (UGV), successfully completing person-search missions with trajectories of up to 500m. I INTRODUCTION A utonomous ground robots are increasingly tasked with complex missions in large-scale outdoor environments, ranging from campus delivery to safety patrols. A typical instruction, such as “Navigate to the library and find the person in a red jacket” , requires the robot to first traverse long distances across complex campus environments and then shift to close-range semantic search in the “last mile.” Long-distance navigation in urban terrains prioritizes efficiency by operating on coarse environmental priors, while last-mile exploration instead requires fine-grained perception for identifying open-vocabulary targets. Existing methods often struggle to address these dual challenges. End-to-end navigation methods, ranging from goal-conditioned policies [ 18 , 16 ] to vision-language-action (VLA) models applied in visual-language navigation (VLN) [ 28 , 5 , 9 ] , excel in short-horizon tasks but often struggle with long-distance navigation. Since they rely solely on visual inputs without geospatial grounding, they are prone to getting lost in unstructured outdoor environments and cannot generate reliable plans for long-distance missions. While OpenBench [ 20 ] provides a solution in such scenario, it suffers from grounding latency and hallucination inherent to cloud-based LLMs, and lacks the flexibility to handle targets beyond static OSM addresses or doors. To bridge these gaps, we propose G-DRAGON ( G eospatial Reasoning and D ynamic Planning for R etrieval- A u G mented O utdoor N avigation), a unified framework designed for large-scale navigation and “last-mile” exploration that decouples high-level reasoning from low-level control. Crucially, instead of relying on cloud-based LLMs, we leverage locally deployed models to handle reasoning tasks. We formulate the localization of natural language targets as a generative retrieval problem [ 19 ] , [ 4 ] , mapping semantic aliases i.e., “library” to concrete OSM entities with geodetic coordinates. This output informs a high-level planner to parse tasks via Behavior Trees and synthesize global paths for downstream navigation modules. Subsequently, the system employs environmental feedback to generate local trajectories that track the global reference, activating an open-vocabulary search mode upon reaching the target’s vicinity. We conduct comprehensive evaluations of the entire system in campus-level simulation environments and the results show that we outperform baselines by 50%. Furthermore, we demonstrate the real-world feasibility of our approach by completing 4 long-range navigation trials on a mobile robot. The main contributions of this work are summarized as follows: • GeoQA for Global Route Generation: We design a geospatial Question-Answering (QA) module based on generative retrieval to align natural language commands with appropriate OSM entities. It precisely outputs latitude and longitude coordinates, which are passed to the downstream global planner to initialize the route. • RAPPER ( R etrieval- A ugmented P lanner with P rogrammatic and E xecutable R easoning): We propose a hierarchical planner which parses tasks from natural language, queries GeoQA and synthesizes Behavior Trees through a locally deployed LLM. By constraining the LLM to structured programmatic outputs, the system safely generates executable task planning and global path planning. • NæVIS (Navigation and Exploration System): We present a seamless integration of long-range navigation and “last-mile” exploration. It employs frontier-based navigation coupled with open-set semantic voxel mapping to robustly localize the specific target objects mentioned in the user’s command. Fig. 1: The architecture of G-DRAGON . The system processes natural language instructions within a local deployed environment. The GeoQA module retrieves OSM metadata to ground semantic targets from abstract user commands into precise geodetic coordinates. The RAPPER module serves as the reasoning orchestrator, leveraging a locally deployed Qwen2.5 LLM to reason and generate task-and-motion planning. The NæVIS module executes the generated task planning by fusing multi-modal sensor data, handling long-range navigation and open-vocabulary object search in the “last-mile”. II Related Work II-A Long-range Language-Guided Outdoor Navigation Driven by foundation models, language-guided navigation has advanced through goal-conditioned methods [ 18 ] , [ 16 ] and VLA [ 28 ] [ 5 ] , [ 9 ] frameworks. However, these vision-centric approaches remain largely confined to short-horizon or indoor settings. To address long-range outdoor navigation, recent works [ 15 ] and [ 14 ] integrate topological graphs or aerial hints with pre-trained models. Yet, they rely heavily on visual correspondence, limiting their reliability in repetitive environments or under varying lighting conditions in large-scale open worlds, unlike approaches grounded in explicit geospatial data. II-B Geospatial Reasoning and OSM-Based Navigation To bridge semantic instructions with actionable targets, recent works utilize a hierarchical architecture [ 11 ] to decouple task planning from control. However, existing methods lack robustness for autonomous ground systems. GeoNav [ 23 ] is designed for aerial perspectives, rendering it unsuitable for ground-level path planning. Embodied-RAG [ 22 ] supports retrieval but confines its search to historical traversal data rather than global semantic locations. Additionally, frameworks like OpenBench [ 20 ] rely entirely on cloud-based LLMs i.e. GPT-4o, which prevents fully offline operation and suffers from hallucinations in large-scale spatial reasoning tasks. II-C “Last-Mile” Exploration In “last-mile” scenarios, instead of exploring continuously, the system activates exploration only when the robot approaches the destination. It requires open-vocabulary perception for natural language queries, robustness in outdoor environments, and crucially, the ability to run on an onboard edge device. Current methods are limited in bridging these gaps. Traditional frontier methods [ 25 ] maximize coverage but remain semantically blind. Conversely, recent methods like SG-Nav [ 27 ] and ApexNav [ 29 ] rely heavily on cloud-based inference and disigned for indoor scenarios. While OpenBench [ 20 ] explicitly proposes a solution for such last-mile navigation, its lightweight visual encoders and flat 2D projection limit its open-vocabulary exploration performance in complex outdoor environments. III Methods To support robust query-driven outdoor navigation on resource-constrained ground robots, we propose G-DRAGON, an end-to-end framework consisting of three modules, as shown in Fig. 1 . GeoQA grounds natural-language queries in OSM and returns geodetic targets. RAPPER parses the task and generates a global route. NæVIS executes long-distance outdoor navigation and, near the target region, performs open-vocabulary search to localize the final object. The following sections describe these modules and the

Read the complete text