BEVDiffLoc: End-to-End LiDAR Global Localization in BEV View based on Diffusion Model
Ziyue Wang, Chenghao Shi*, Neng Wang, Qinghua Yu, Xieyuanli Chen, Huimin Lu · 2025
Read BEVDiffLoc: End-to-End LiDAR Global Localization in BEV View based on Diffusion Model by Ziyue Wang, Chenghao Shi*, Neng Wang, Qinghua Yu, Xieyuanli Chen, Huimin Lu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11372.txt.
Introduction
Ziyue Wang and co-authors locate robots from laser scans in a top-down view in 2025. Classic localization fetches a map match, then aligns to it, which needs heavy map storage. Direct methods skip storage but can lack accuracy and toughness.
Their frame treats localization as generating a pose, refined step by step by a diffusion model. A bird's-eye view of the scan keeps layout and scale while shrinking the data. Special augmentation adds variety to the training views. Feature tools built for large rotation changes feed the refinement. On two driving datasets, the method beat the baselines tested.
Catalog record
| CREATOR | Ziyue Wang, Chenghao Shi*, Neng Wang, Qinghua Yu, Xieyuanli Chen, Huimin Lu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-11372
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BEVDiffLoc: End-to-End LiDAR Global Localization in BEV View based on Diffusion Model Ziyue Wang, Chenghao Shi*, Neng Wang, Qinghua Yu, Xieyuanli Chen, Huimin Lu Abstract Localization is one of the core parts of modern robotics. Classic localization methods typically follow the retrieve-then-register paradigm, achieving remarkable success. Recently, the emergence of end-to-end localization approaches has offered distinct advantages, including a streamlined system architecture and the elimination of the need to store extensive map data. Although these methods have demonstrated promising results, current end-to-end localization approaches still face limitations in robustness and accuracy. Bird’s-Eye-View (BEV) image is one of the most widely adopted data representations in autonomous driving. It significantly reduces data complexity while preserving spatial structure and scale consistency, making it an ideal representation for localization tasks. However, research on BEV-based end-to-end localization remains notably insufficient. To fill this gap, we propose BEVDiffLoc, a novel framework that formulates LiDAR localization as a conditional generation of poses. Leveraging the properties of BEV, we first introduce a specific data augmentation method to significantly enhance the diversity of input data. Then, the Maximum Feature Aggregation Module and Vision Transformer are employed to learn robust features while maintaining robustness against significant rotational view variations. Finally, we incorporate a diffusion model that iteratively refines the learned features to recover the absolute pose. Extensive experiments on the Oxford Radar RobotCar and NCLT datasets demonstrate that BEVDiffLoc outperforms the baseline methods. Our code is available at https://github.com/nubot-nudt/BEVDiffLoc . Fig. 1: Comparison between classic localization approaches and end-to-end localization methods. Classic localization approaches typically follow a two-step process: place recognition followed by pose estimation. This approach demands substantial memory resources to store map database. Furthermore, their reliance on multiple cascaded modules makes optimization challenging. In contrast, end-to-end methods implicitly encode environmental information into network parameters, resulting in a simpler structure and reduced storage requirements. I Introduction LiDAR-based localization is one of the core technologies in modern robotics due to its unparalleled ability to provide accurate environmental geometric information. This paper focuses on the problem of LiDAR-based localization in the presence of prior environmental knowledge. Currently, mainstream approaches typically involve retrieving target point clouds from a prebuilt database and subsequently performing registration to determine the pose of the query [ 1 , 2 , 3 , 4 , 5 ] . However, this strategy not only requires computationally intensive registration processes but also demands significant memory resources to store map points and descriptors. Recently, mapless localization systems have demonstrated significant potential in enabling end-to-end localization. These methods implicitly encode environmental information into network parameters through training, allowing for direct pose estimation based on current sensor observations. By storing only the network parameters, these approaches significantly reduce the need for memory-intensive maps and descriptors, as shown in Fig. 1 . The sparsity and non-uniformity of LiDAR point clouds are well-known challenges in the field. A widely adopted solution is to project point clouds into range images [ 6 , 7 ] . Such an approach yields promising results by reducing the complexity of point cloud data processing. However, due to the nature of spherical projection, range images are susceptible to scale distortion, which ultimately limits their localization accuracy. Bird’s-Eye-View (BEV)-based point cloud representation has recently gained increasing attention in autonomous driving perception and localization. BEV significantly simplifies data complexity while clearly illustrating the position and size of objects. For localization tasks, compared to range images, BEV images provide more stable target scales and spatial relationships, as well as better generalization capabilities. However, during the process of generating BEV images, there may be point cloud stacking, which can result in information loss. Therefore, despite its advantages, according to recent study of Wang et al. [ 8 ] , research on BEV-based end-to-end LiDAR-based localization remains limited. This work aims to fill this gap. In this paper, we propose BEVDiffLoc, a novel framework that achieves state-of-the-art end-to-end localization based on BEV representation. Our approach incorporates a Maximum Feature Aggregation (MFA) module to extract orientation-equivariant features, followed by a Vision Transformer (ViT) [ 9 ] to enhance the network’s understanding of spatial scene structures. Leveraging the orientation-equivariant property, the ViT can effectively handle significant rotational view changes, thereby better capturing positional information in the map. For pose regression, we adopt a diffusion model conditioned on the robust features, progressively refining the poses from noisy inputs. To fully leverage the advantages of BEV representation, we introduce a specific data augmentation strategy for BEV images. This strategy involves first stitching BEV images into a map and then sampling new BEV images from random positions and random orientation, significantly enhancing the diversity of the input data. Our contributions can be summarized as follows: • We introduce BEVDiffLoc, a novel BEV-based end-to-end localization framework that achieves state-of-the-art performance among existing works. • We incorporate the Maximum Feature Aggregation (MFA) module and the Vision Transformer (ViT) module for feature extraction, enabling the network to robustly handle significant rotational view changes and demonstrating its effectiveness in end-to-end localization tasks. • To maximize the benefits of BEV representation, we concatenate BEV images and generate input data by randomly sampling positions from the map, enhancing training data diversity and thereby boosting localization performance. • We open-source our approach to benefit the research community. We evaluated our approach on multiple datasets, demonstrating the leading performance of our method and validating the contributions of each proposed component to the overall performance improvement. Fig. 2: The pipeline of the BEVDiffLoc framework. First, it merges continuous M frames of point cloud data with an interval of S frames and generates new BEV images from random positions with random orientations. Then, the MFA module and ViT module are employed to extract robust features {\mbox{{{F\/}}}}^{i}_{P} , effectively addressing the challenges posed by varying orientations. The pose estimation is modeled as denoising task, ultimately yielding the predicted poses. II Related work In this section, we introduce works related to end-to-end localization tasks, which can be broadly categorized into two approaches: absolute pose regression (APR) and scene coordinate regression (SCR). II-A Absolute pose regression The absolute pose regression (APR) method aims to learn feature descriptions of the scene and then regress its pose. PointLoc [ 10 ] is the first APR method based on LiDAR, which encodes features using PointNet++ [ 11 ] followed by a self-attention module. Yu et al. [ 12 ] proposes four different methods for feature extraction. Some studies [ 13 , 14 ] have explored sequence constraints and achieved significant improvements. HypLiLoc [ 8 ] fuses multi-modal features in hyperbolic Euclidean space and achieves better results. FlashMix [ 15 ] uses a frozen, scene-uncertain backbone to extract local point descriptors, which are aggregated with an MLP mixer to predict the sensor’s pose, greatly reducing the training time. DiffLoc [ 16 ] is the state-of-the-art APR method. It uses the basic model and a static object perception pool to learn robust features of range images and employs a diffusion model to extract features as a condition to learn pose restoration. Due to the robustness of LiDAR to changes in lighting conditions, APR based on LiDAR has achieved impressive results in large-scale outdoor scenes. The works most closely related to our study are HypLiLoc [ 8 ]