A Large-Scale Remote Sensing Dataset and VLM-based Algorithm for Fine-Grained Road Hierarchy Classification

Ting Han, Xiangyi Xie, Yiping Chen, Yumeng Du, Jin Ma, Aiguang Li, Jiaan Liu, Yin Gao · 2026

Read A Large-Scale Remote Sensing Dataset and VLM-based Algorithm for Fine-Grained Road Hierarchy Classification by Ting Han, Xiangyi Xie, Yiping Chen, Yumeng Du, Jin Ma, Aiguang Li, Jiaan Liu, Yin Gao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21222.txt.

Introduction

Han and co-authors release a large road data set and a model for fine-grained road hierarchy mapping from remote sensing images. Their SYSU-HiRoads data set covers a wide area in Henan Province with over one thousand image tiles. Each tile has dense road masks, vectorized centerlines, and three level hierarchy labels. Their RoadReasoner model builds road masks and topology preserving networks, then assigns hierarchy grades at the skeleton segment level. On two data sets, it beats leading road extraction baselines.

Catalog record

CREATORTing Han, Xiangyi Xie, Yiping Chen, Yumeng Du, Jin Ma, Aiguang Li, Jiaan Liu, Yin Gao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59908
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.21222

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Large-Scale Remote Sensing Dataset and VLM-based Algorithm for Fine-Grained Road Hierarchy Classification Ting Han, Xiangyi Xie, Yiping Chen, Yumeng Du, Jin Ma, Aiguang Li, Jiaan Liu, Yin Gao Abstract Accurate and up-to-date road hierarchy information is fundamental to transport infrastructure mapping, road asset inventory, maintenance planning, and digital urban management. Although high-resolution remote sensing imagery enables large-area road mapping, existing datasets and methods are still poorly aligned with practical infrastructure needs, as most benchmarks focus on binary road extraction and provide limited support for hierarchy-aware mapping. This gap restricts the development of automated workflows that jointly support road surface delineation, road network reconstruction, and fine-grained road hierarchy classification. In this work, we present SYSU-HiRoads , a large-scale hierarchical road dataset, and RoadReasoner , a vision-language-geometry framework for automatic multi-grade road mapping from remote sensing imagery. SYSU-HiRoads is built from GF-2 imagery covering 3,631 km 2 in Henan Province, China, and contains 1,079 image tiles at 0.8 m spatial resolution. Each tile is annotated with dense road masks, vectorized centerlines, and three-level hierarchy labels, enabling the joint training and evaluation of segmentation, topology reconstruction, and hierarchy classification. Building on this dataset, RoadReasoner is designed to generate robust road surface masks, topology-preserving road networks, and semantically coherent hierarchy assignments. We strengthen road feature representation and network connectivity by explicitly enhancing frequency-sensitive cues and multi-scale context. Moreover, we perform hierarchy inference at the skeleton-segment level with geometric descriptors and geometry-aware textual prompts, queried by vision–language models to obtain linguistically interpretable grade decisions. Experiments on SYSU-HiRoads and the CHN6-CUG dataset show that RoadReasoner surpasses state-of-the-art road extraction baselines and produces accurate and semantically consistent road hierarchy maps with 72.6% OA, 64.2% F1 score, and 60.6% SegAcc. The dataset and code will be publicly released to support automated transport infrastructure mapping, road inventory updating, and broader infrastructure management applications. [orcid=0000-0003-1465-6599] keywords Road Extraction ,Road Hierarchy Classification ,Dataset ,Semantic Segmentation ,Vision-Language Model ,Remote Sensing † † titlenote: This work was supported by the National Natural Science Foundation of China under Project 42371343, and Guangdong Basic and Applied Basic Research Foundation with Grant No.2024A1515010986. † † corresponding: The authors contribute equally. † † corresponding: Corresponding author 1 Introduction Roads are fundamental components of transport infrastructure and play a central role in urban mobility, logistics, infrastructure maintenance, and regional development ( 10 ; 61 ; 43 ) . Accurate and up-to-date road information is essential for infrastructure inventory, transport planning, traffic management, and digital urban governance. With the rapid development of high-resolution Earth observation platforms and sensing technologies, remote sensing imagery has become an efficient data source for large-scale and automated road mapping. As a result, road extraction from high-resolution remote sensing images has emerged as a key task in remote sensing and geospatial analysis, with broad application potential in infrastructure monitoring, urban planning, and intelligent transportation systems ( 65 ; 9 ; 20 ; 21 ; 17 ) . With the rapid advancement of high-resolution Earth observation systems, including the Gaofen series, WorldView satellites, and commercial aerial imaging platforms, detailed and large-scale observations of road networks have become increasingly accessible. Consequently, the key challenge is no longer the availability of imagery, but how to automatically and reliably extract, reconstruct, and interpret complex road networks from massive image data for infrastructure mapping and management ( 48 ) . Early studies mainly relied on handcrafted features and classical image processing or probabilistic models to delineate roads from remote sensing imagery. Morphological operators, template matching, active contours, and Markov random fields were designed to exploit the elongated, relatively homogeneous, and topologically connected nature of roads ( 27 ; 41 ; 31 ; 7 ; 18 ; 3 ) . These approaches can be effective in constrained scenarios, but their performance is highly sensitive to parameter settings and background clutter, and their ability to generalize to diverse environments (e.g., dense urban cores, industrial areas, mountainous regions) is limited. In particular, occlusions by trees and buildings, shadows, heterogeneous pavements, and complex junctions often lead to fragmented or missing roads in the extracted maps. The advent of deep convolutional neural networks (CNNs) and more recent Transformer-based architectures ( 26 ; 19 ; 62 ) has led to substantial progress in road extraction. These methods have shown a strong capability in learning discriminative features directly from data and in improving the completeness of road masks ( 64 ; 45 ; 68 ; 6 ; 58 ; 63 ) . Subsequent work further incorporated dilated convolutions, attention mechanisms, and auxiliary losses on boundaries or centerlines to enhance the continuity and topology of road predictions. Despite these advances, three important limitations remain: (1) Pixel-wise segmentation methods often produce geometrically noisy or locally inconsistent masks, making it difficult to derive high-quality vector road networks without additional post-processing. (2) Existing models rarely account for the semantic relationship between road geometry (e.g., width, length, and curvature) and its hierarchical role in the transport infrastructure system. (3) Most methods focus on binary road extraction and treat all roads as a single semantic class, ignoring their hierarchical attributes such as functional class, capacity, and administrative level, which are crucial for many downstream tasks (e.g., speed estimation, accessibility analysis, infrastructure assessment, and route planning). The lack of suitable benchmark datasets is a major bottleneck behind these limitations. Most publicly available road datasets derived from remote sensing imagery, such as Massachusetts, DeepGlobe, and CHN6-CUG ( 40 ; 15 ; 70 ) , provide only pixel-level binary masks without any information on road hierarchy or matched vector-level networks ( 1 ) . In contrast, road-network-oriented datasets, such as SpaceNet Roads, RoadTracer, and City-scale ( 50 ; 5 ; 23 ) , mainly offer vectorized centerlines that are rasterized with fixed widths; they lack true pixel-wise masks and do not encode multi-grade attributes of road infrastructures. This separation between segmentation-oriented and network-oriented datasets makes it difficult to jointly study road surface extraction and network reconstruction within a unified framework. Moreover, accessible, high-quality road data in China is particularly scarce. OpenStreetMap (OSM) data, which are widely used in many existing benchmarks, exhibit non-negligible offsets in China due to coordinate restrictions and thus cannot be directly used as precise labels ( 69 ) . To the best of our knowledge, there is still no large-scale, high-resolution dataset that simultaneously provides aligned pixel-level masks, vector-level centerlines, and fine-grained hierarchical road labels for Chinese cities. At the same time, the rapid development of vision language models (VLMs) ( 44 ) and multimodal generative models ( 2 ; 37 ) , such as GPT-v, has opened up new opportunities for infrastructure analysis ( 56 ; 49 ; 46 ; 59 ; 21 ) . These foundation models are pre-trained on massive image–text pairs and encode rich semantic knowledge about objects, scenes, and their functional roles ( 33 ) . Recent works have begun to explore VLMs for land-cover classification ( 53 ; 55 ) , change detection ( 30 ) , and cross-modal retrieval ( 14 ) , but their potential for modeling structured geographic entities, such as road networks, particularly for inferring road hierarchy from geometric and contextual cues, remains largely unexplored. A key observation of our work is that translating quantitative geometric attributes (e.g., width, length, and

Read the complete text