A Benchmark for Vision-Centric HD Mapping by V2I Systems
Miao Fan, Shanshan Yu, Shengtong Xu, Kun Jiang, Haoyi Xiong, Xiangzeng Liu · 2025
Read A Benchmark for Vision-Centric HD Mapping by V2I Systems by Miao Fan, Shanshan Yu, Shengtong Xu, Kun Jiang, Haoyi Xiong, Xiangzeng Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-23963.txt.
Introduction
Miao Fan and co-authors release a benchmark for road mapping that fuses car and roadside cameras in a 2025 paper. Self-driving cars lack a global view, and vector maps drawn on board stay limited by what the car can see. Roadside cameras can widen that view through vehicle-to-infrastructure links, but no real-world data set served the task.
Their data set pairs frames from vehicles and roadside units on real roads, with human-marked map elements. A companion network, V2I-HD, builds vectorized maps end to end from those feeds. A decoupled attention trick cuts compute cost for on-car use. Tests showed top inference speed and steady map quality across complex scenes. Code and data are public for further work.
Catalog record
| CREATOR | Miao Fan, Shanshan Yu, Shengtong Xu, Kun Jiang, Haoyi Xiong, Xiangzeng Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-23963
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Benchmark for Vision-Centric HD Mapping by V2I Systems Miao Fan, Shanshan Yu, Shengtong Xu, Kun Jiang, Haoyi Xiong, Xiangzeng Liu Abstract Autonomous driving faces safety challenges due to a lack of global perspective and the semantic information of vectorized high-definition (HD) maps. Information from roadside cameras can greatly expand the map perception range through vehicle-to-infrastructure (V2I) communications. However, there is still no dataset from the real world available for the study on map vectorization onboard under the scenario of vehicle-infrastructure cooperation. To prosper the research on online HD mapping for Vehicle-Infrastructure Cooperative Autonomous Driving (VICAD), we release a real-world dataset, which contains collaborative camera frames from both vehicles and roadside infrastructures, and provides human annotations of HD map elements. We also present an end-to-end neural framework (i.e., V2I-HD) leveraging vision-centric V2I systems to construct vectorized maps. To reduce computation costs and further deploy V2I-HD on autonomous vehicles, we introduce a directionally decoupled self-attention mechanism to V2I-HD. Extensive experiments show that V2I-HD has superior performance in real-time inference speed, as tested by our real-world dataset. Abundant qualitative results also demonstrate stable and robust map construction quality with low cost in complex and various driving scenes. As a benchmark, both source codes and the dataset have been released at OneDrive 1 1 1 https://1drv.ms/f/c/76645c25a8914a0b/EgWy5XCUk6pKgvE9vB-HbVEBCdCQjJvgx1KKjeKF7hPdZw for the purpose of further study. I Introduction High-definition (HD) maps [ 1 ] are the most fundamental component of autonomous driving systems, providing centimeter-level details of traffic elements, vectorized topology, and navigation information. HD maps instruct the ego-vehicle to precisely locate itself on the road and anticipate what is coming up ahead. Currently, traditional SLAM-based solutions [ 2 , 3 , 4 ] have been widely adopted in practice. However, challenges such as high annotation costs and delayed updates have led to a gradual shift from offline approaches to learning-based online HD map construction using onboard sensors. Recently, online HD maps constructed in real-time around the ego vehicle using onboard sensors have effectively addressed these issues. Fig. 1: Cooperative systems in autonomous driving. A comprehensive autonomous driving perception system is composed of the ego vehicle and cooperative interactions among vehicles, infrastructure, and networks. Recent works employ vehicle-mounted surround view perception and point cloud data to enable end-to-end construction of high-definition (HD) maps. Despite advances in single-vehicle perception, they are restricted to limited field of view, occlusions, and short-range perception, which result in suboptimal performance in these scenarios. Additionally, compared to offline maps, online HD map construction also encounters inherent limitations stemming from on-vehicle sensors and real-time road conditions. These challenges include variations in data quality caused by swift movement and limitations in the sensor field of view. A promising solution to address these challenges is to leverage infrastructure information through Vehicle-to-Everything (V2X) communication, which has been proven to significantly extend perception range and improve the safety of autonomous driving, as shown in Fig. 1 . Intelligent roadside infrastructure or roadside units (RSUs) equipped with sensors provide uninterrupted and continuous observations with an extensive field of view. These observations enable real-time updates to the dynamically evolving HD map, enhancing its overall perceptual accuracy. Recently, several datasets have been collected from a roadside perspective, making them particularly valuable for advancing perception algorithms in V2X systems. However, these datasets are deficient in certain map element annotations, limiting their applicability for HD map construction. Fig. 2: The pipeline of V2I-HD framework. V2I-HD is a hybrid architecture that combines CNNs with DETR, for real-time HD map learning in a BEV representation. Starting with the input of collaborative camera frames from vehicles and infrastructures, a unified BEV representation is extracted by projecting and fusing image features. The V2I-HD models the map elements through an equivalent vectorized point set, with the final vectorized HD map elements generated throughout the DETR architecture. According to the work mentioned, it can be recognized that unified map element annotations of camera images from the roadside perspective encompassing diverse traffic participants and scenarios remain rare. The DAIR-V2X-Seq dataset [ 5 ] encompassing 2D/3D object annotations sampled from the real world, designed for trajectory tracking and prediction in vehicle-infrastructure collaboration. However, with the lack of vectorized annotations for HD map elements, we release a dataset inherited from DAIR-V2X-Seq, which encompasses corresponding HD map element annotations by cropping vector maps from frames captured by vehicle-mounted and roadside cameras, making it appropriate for HD map construction tasks in V2I contexts. To our knowledge, the transformed dataset is the first release that focuses on HD map construction, making it an ideal resource for the development and evaluation of cooperative perception. We further propose a novel method called V2I-HD, which copes with creating HD maps onboard for autonomous driving at a minimal cost while achieving superior state-of-the-art performance. In our design, infrastructure cameras from a bird’s eye view cooperate with the front-view image of a vehicle [ 6 ] to construct HD maps. V2I-HD initially extracts features from both vehicle&infrastructure-side images, and subsequently transforms these features into a cohesive BEV representation via a map encoder. Then, we leverage the map decoder to estimate and update the map topology. The map decoder comprises map queries and decoder layers. Each decoder layer updates the map query utilizing a direction-decoupled attention scheme. The contributions of this paper are thus the following: • We release a real-world dataset, which contains collaborative camera frames from both vehicles and roadside infrastructures and provides HD map element annotations. • We propose a structured end-to-end framework for efficient online vectorized HD map construction, building on DETR. To reduce computation costs, we introduce directionally decoupled self-attention. • We demonstrate the capabilities of the solution on the map and traffic data, and conduct a quantitative assessment of the algorithm to a sub-optimal methods. This work is structured as follows: Section II discusses related work. Section III presents the problem formulation, neural architecture, and our training strategy. Implementation and experiments are described in sections IV. Finally, section V gives a conclusion. II Related Work This section reviews related work concerning HD map construction under Vehicle-to-Infrastructure (V2I) communication, deriving information from available datasets. II-A Vectorized HD Map Construction HD maps consist of geometric objects and semantic properties, both of which are crucial for downstream tasks. HD map construction in BEV space [ 7 , 8 ] relies on data gathered by onboard sensor observations, encompassing RGB images from multi-view cameras and point clouds from LiDAR. Current methodologies for HD map construction can be broadly classified into two categories: rasterized HD map estimation [ 9 , 10 , 11 , 12 ] and vectorized HD map construction [ 7 , 13 , 14 , 15 ] . Rasterized HD maps often require extensive post-processing, making them less ideal for downstream tasks. In contrast, vectorized HD map construction addresses these constraints by representing maps using a collection of map elements. For instance, VectorMapNet [ 14 ] explores the keypoint-based representation within a hierarchical two-stage network. InsightMapper [ 16 ] demonstrates the benefits of leveraging internal instance point data. The MapTR series [ 13 , 17 ] introduces permutation-equivalent modeling of point sets and a DETR-like [ 18 ] single-stage network. Recent works have focused on learning element-level information. For example, MapVR [ 19 ] incorporates differentiable rasterization