Towards classification-based representation learning for place recognition on LiDAR scans
Maksim Konoplia, Dmitrii Khizbullin · 2025
Read Towards classification-based representation learning for place recognition on LiDAR scans by Maksim Konoplia, Dmitrii Khizbullin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-00738.txt.
Introduction
Maksim Konoplia and Dmitrii Khizbullin reframe place recognition, the task that lets a self-driving car know where it is from sensor data. Nearly all methods learn by contrast, pulling matching LiDAR scans together and pushing others apart. The authors instead treat the problem as multi-class classification: each location gets a discrete label, and an encoder-decoder learns to name the place of each scan directly.
Evaluated on the NuScenes dataset, the classification approach reaches performance competitive with contrastive learning methods. It also brings practical advantages in training efficiency and stability, two properties that matter when models are retrained often on growing fleets. The study widens the design space for localization, showing that a plain classification head can rival a contrastive pipeline built with far more machinery.
Catalog record
| CREATOR | Maksim Konoplia, Dmitrii Khizbullin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-00738
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards classification-based representation learning for place recognition on LiDAR scans Maksim Konoplia, Dmitrii Khizbullin Abstract Place recognition is a crucial task in autonomous driving, allowing vehicles to determine their position using sensor data. While most existing methods rely on contrastive learning, we explore an alternative approach by framing place recognition as a multi-class classification problem. Our method assigns discrete location labels to LiDAR scans and trains an encoder-decoder model to classify each scan’s position directly. We evaluate this approach on the NuScenes dataset and show that it achieves competitive performance compared to contrastive learning-based methods while offering advantages in training efficiency and stability. 1 Introduction Place recognition using Lidar data is a fundamental task in robotics and autonomous driving, aiming to determine a vehicle’s location based on 3D Lidar scans. Accurate localization is essential for navigation, mapping, and decision-making, particularly in environments where GPS signals are unreliable. Over the past decade, significant progress has been made in Lidar-based place recognition, with various approaches leveraging handcrafted descriptors, deep learning-based feature extraction, and cross-modal fusion techniques. Place recognition can be framed as an instance of information retrieval, where a query scan must be matched against a database of previously recorded scans. This problem shares similarities with face recognition, where embeddings are learned to differentiate between different entities while maintaining invariance to viewpoint and domain shifts. Traditional approaches have focused on contrastive learning-based techniques to generate robust descriptors, but these methods require complex negative sample mining strategies and careful data augmentation. An alternative to contrastive learning is to formulate place recognition as a multi-class classification problem. However, defining a classification objective is not trivial in this setting, as places do not have rigid class boundaries like objects in standard classification tasks. Instead, a place can have variations in perspective, occlusions, and structural changes over time, making direct class assignment challenging. In this work, we explore how to effectively define and optimize such a classification objective for place recognition. Our primary contribution is a novel formulation of the problem that enables the use of classification-based learning. 1.1 Early Methods in Place Recognition Early advances in place recognition were driven by NetVLAD Arandjelović et al. 2015 , which introduced a learnable VLAD-based feature aggregation method for visual localization. PointNet Qi et al. 2016 and PointNet++ Qi et al. 2017 demonstrated the effectiveness of directly processing raw point clouds for 3D tasks. Building on these ideas, PointNetVLAD Uy and Lee 2018 extended NetVLAD’s principles to Lidar data by combining PointNet’s permutation-invariant encoding with VLAD-based feature aggregation, enabling large-scale place recognition in unstructured environments. These methods laid the foundation for modern learning-based place recognition, shaping advancements in both visual and Lidar-based localization. 1.2 Advancements in Lidar-Based Place Recognition Recent years have seen significant progress in Lidar-based place recognition, with multiple methods improving the processing of 3D point clouds Komorowski 2020 ; Zywanowski et al. 2021 ; Komorowski 2022 ; Guan et al. 2023 . Among these, the MinkLoc3D family Komorowski 2020 ; Zywanowski et al. 2021 ; Komorowski 2022 achieved state-of-the-art performance across several benchmarks. MinkLoc3D employs sparse 3D convolutions within a feature pyramid framework, enhancing feature extraction while maintaining computational efficiency. The integration of generalized-mean pooling further improves descriptor quality, leading to robust place recognition in large-scale environments. Although convolutional architectures for point cloud-based place recognition had been explored in prior works Sun et al. 2020b ; Liu et al. 2018b , MinkLoc3D demonstrated their effectiveness at scale, reinforcing their importance in modern Lidar-based methods. 1.3 Multi-Modal Architectures: Image and Point Cloud Fusion Integrating multiple sensor modalities, such as camera images and Lidar point clouds, has proven to be an effective strategy for enhancing place recognition performance. This research direction has gained traction in recent years Zhou et al. 2023 ; Lai et al. 2021 ; Pan et al. 2023 ; Cai et al. 2024 ; Puligilla et al. 2023 ; Komorowski 2020 ; Xu et al. 2023 , leading to notable advancements in the field. LCPR Zhou et al. 2023 introduced a fusion architecture that combines image and point cloud feature maps at multiple representation levels using self-attention mechanisms. Evaluated on the large-scale NuScenes dataset Caesar et al. 2019 , LCPR demonstrated superior performance over existing methods. Another notable approach Xu et al. 2023 leveraged image sequences instead of single frames to improve robustness and mitigate outliers. The authors trained their model to learn a similarity function between image sequences and point cloud descriptors, enabling cross-modal retrieval. At inference, the model requires only an image sequence as input, retrieving the corresponding point cloud descriptor for localization, making the method more practical for real-world deployment. Despite the effectiveness of these approaches, challenges remain in benchmarking cross-modal methods. Xu et al. 2023 highlights the difficulty in direct performance comparison due to varying evaluation setups, as their model’s retrieval mechanism differs fundamentally from traditional methods. Further standardized evaluations are necessary to validate the generalization and applicability of such multi-modal architectures in diverse conditions. 1.4 Recent Advancements in Place Recognition A leading approach in modern place recognition is the CrossLoc3D model Guan et al. 2023 , which addresses the challenge of aligning Lidar descriptors across variations in viewpoint and scan quality. The model enhances robustness by processing voxelized Lidar scans at multiple resolutions, allowing its feature extractor to learn stable structural representations. A key contribution of Guan et al. 2023 is the introduction of the CS-Campus3D dataset, an aerial-ground Lidar dataset designed to evaluate place recognition across differing perspectives. The dataset was used for training, validation, and benchmarking, demonstrating that CrossLoc3D outperforms even cross-modal architectures in retrieval accuracy. These results indicate that improving descriptor consistency across viewpoints can significantly enhance place recognition performance, setting a new benchmark in the field. 1.5 Training Objectives of the Baseline Methods PointNetVLAD, LCPR, MinkLoc3D, CrossLoc3D, and OverlapTransformer use the metric learning objective and, specifically, variations of the triplet margin loss for training the embedding model. 1.6 Datasets Several publicly available datasets have played a crucial role in advancing place recognition research, particularly in terms of scale and environmental diversity. Among them, KITTI Geiger et al. 2013 , Oxford RobotCar Maddern et al. 2020 , NuScenes Caesar et al. 2019 , and Waymo Open Dataset Sun et al. 2020a stand out as the most widely used. KITTI, one of the earliest datasets, contains 22 driving sequences with multiple route variations. While limited in scene diversity, it remains a standard benchmark. Oxford RobotCar offers significantly greater variability, featuring over 100 traversals of the same route in Oxford under different weather conditions and times of day, making it ideal for evaluating robustness to environmental changes. NuScenes is the largest and most comprehensive, consisting of 1000 urban driving scenes recorded in Boston and Singapore. It provides high-quality multimodal sensor data across diverse routes and includes an extensive API, facilitating ease of use and integration into research pipelines. The Waymo Open Dataset provides another large-scale alternative, featuring Lidar and camera data collected from multiple locations in the United States. 1.7 Related works in Face Recognition One of the first applications of metric learning Xing et al. 2002 is face recognition (FR). The early deep face recognition models use the classification objective to train the encoder model: DeepFace Taigman