SuperPlace: The Renaissance of Classical Feature Aggregation for Visual Place Recognition in the Era of Foundation Models

Bingxi Liu, Pengju Zhang, Li He, Hao Chen, Shiyi Guo, Yihong Wu, Jinqiang Cui, Hong Zhang · 2025

Read SuperPlace: The Renaissance of Classical Feature Aggregation for Visual Place Recognition in the Era of Foundation Models by Bingxi Liu, Pengju Zhang, Li He, Hao Chen, Shiyi Guo, Yihong Wu, Jinqiang Cui, Hong Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13073.txt.

Introduction

Bingxi Liu and co-authors revisit an old idea for teaching computers to recognize places from photos. Recent systems lean on huge foundation models but pair them with new, heavy ways of pooling image features. This team revives classic pooling methods and trains them well, in a suite they call SuperPlace.

Three pieces do the work. A label alignment step lets one model train across many place data sets at once. A compact pooling design uses two generalized mean steps, one of which tunes the other, and reaches strong results with a tenth of the feature size of recent rivals. A second fine-tuning stage for the classic NetVLAD method, after a shrinking layer, tops a major leaderboard for the MSLS benchmark. The authors argue that good training of simple parts can beat added complexity.

Catalog record

CREATORBingxi Liu, Pengju Zhang, Li He, Hao Chen, Shiyi Guo, Yihong Wu, Jinqiang Cui, Hong Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-13073

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SuperPlace: The Renaissance of Classical Feature Aggregation for Visual Place Recognition in the Era of Foundation Models Bingxi Liu, Pengju Zhang, Li He, Hao Chen, Shiyi Guo, Yihong Wu, Jinqiang Cui, Hong Zhang Abstract Recent visual place recognition (VPR) approaches have leveraged foundation models (FM) and introduced novel aggregation techniques. However, these methods have failed to fully exploit key concepts of FM, such as the effective utilization of extensive training sets, and they have overlooked the potential of classical aggregation methods, such as GeM and NetVLAD. Building on these insights, we revive classical feature aggregation methods and develop more fundamental VPR models, collectively termed SuperPlace. First, we introduce a supervised label alignment method that enables training across various VPR datasets within a unified framework. Second, we propose G 2 M, a compact feature aggregation method utilizing two GeMs, where one GeM learns the principal components of feature maps along the channel dimension and calibrates the output of the other. Third, we propose the secondary fine-tuning (FT 2 ) strategy for NetVLAD-Linear (NVL). NetVLAD first learns feature vectors in a high-dimensional space and then compresses them into a lower-dimensional space via a single linear layer. Extensive experiments highlight our contributions and demonstrate the superiority of SuperPlace. Specifically, G 2 M achieves promising results with only one-tenth of the feature dimensions compared to recent methods. Moreover, NVL-FT 2 ranks first on the MSLS leaderboard. 1 Introduction Figure 1 : The Recall@1 and descriptor dimensionality comparison of different methods on MSLS-Val (left) and Pitts-30k (right). Visual Place Recognition (VPR) involves identifying the image most similar to a given query image within a large-scale geographic image database [ 10 ] . VPR has been extensively studied in computer vision [ 41 ] and robotics [ 32 ] due to its broad applications in augmented reality and robot navigation. Previous research has identified several challenges in VPR, including large database sizes [ 9 ] , viewpoint shifts [ 8 ] , repeated structures [ 44 ] , structural modifications [ 6 ] , occlusions [ 29 ] , visual scale differences [ 14 ] , illumination changes [ 30 ] , and seasonal transitions [ 43 ] . Early VPR research aggregated hand-crafted local features such as SURF [ 7 ] into global features through algorithms like Bag-of-Words (BoW) [ 4 ] or Vector of Locally Aggregated Descriptors (VLAD) [ 25 ] . However, many of these challenging problems remain difficult to solve within frameworks based on hand-crafted features. In the past decade , VPR primarily leveraged location datasets and neural networks with differentiable aggregation/pooling to map images into an embedding space, effectively distinguishing images from different locations [ 6 ] . New VPR datasets have been continually proposed to address challenging problems, such as generalization [ 1 ] , training scale [ 9 ] , and cross-domain differences [ 50 ] . However, these datasets do not fully encompass the characteristics of previous datasets and introduce a new issue: inconsistent supervised label formats [ 9 ] . At the same time, different methods have also been proposed to aggregate multi-channel feature maps into global feature vectors. Generalized Mean Pooling (GeM) and NetVLAD [ 6 ] were proposed, which achieved good results in different dimension ranges (less than 4k dimensions or larger than 30k dimensions). The feature dimension strongly correlates with the retrieval speed and recall of VPR. Table 1 : Comparison of various VPR training sets. Dataset # Img # Img Source Supervision Loss Related Work (SLA) Function Pittsburgh 250k 2k GSV UTM Triplet Loss NetVLAD (CVPR16), DHEVPR (AAAI24), SelaVPR (ICLR24) MSLS 1.68M 820k Mapillary UTM Triplet Loss TransVPR (CVPR22), R2Former (CVPR23), SALAD-CM (ECCV24) SF-XL 5.6M 180k GSV UTM & Orient. LMC-Loss CosPlace (CVPR22), EigenPlaces (ICCV23), NocPlace (arXiv24) GSV-Cities 530k 530k GSV Place ID MS-Loss MixVPR (WACV23), CricaVPR (CVPR24), SALAD (CVPR24) In the past year , Visual Foundation Models (VFMs) [ 36 , 27 , 53 , 48 ] have developed rapidly, and DINOv2 has been widely used in VPR [ 26 , 34 ] . VFMs have utilized multiple large-scale visual datasets, including knowledge distillation [ 19 ] , and other techniques to provide powerful feature representation capabilities. However, these VPR studies have only used a VFM as a pre-trained model on a single dataset and have not embraced the core principles of VFMs, such as aligning multiple datasets for model training. Additionally, these studies also proposed some novel feature aggregation methods: BoQ [ 3 ] , SALAD [ 23 ] , and SPGM [ 33 ] . The feature dimensions of these methods were approximately 4k-12k. They were expected to perform better than GeM, and these works claimed to produce better results with lower feature dimensions than NetVLAD. However, through preliminary experiments, we found that classic methods from a decade ago remain competitive. This prompted us to improve these classic methods instead of following recent aggregations introduced in the past year. In this paper , we not only utilize VFMs as pre-trained models but also train on multiple datasets, mirroring their training approach through a novel supervised alignment method. In particular, we transform the distance metric into class labels through a grid partition in the Universal Transverse Mercator (UTM) coordinate and check the similarity within the labels using local feature matching. Beyond staying updated with the latest techniques, we also improve two feature aggregations from over a decade ago to revive their superiority in the era of VFMs. Specifically, we propose a generalized channel attention module for GeM and the secondary fine-tuning (FT 2 ) for NetVLAD-Linear (NVL). With the same training set , these improved aggregations achieve comparable or even superior results to recent approaches while requiring lower dimensions and fewer parameters . Our contributions are highlighted as follows: 1) We propose a supervised label alignment method to train VPR models using multiple datasets like other foundation models. Specifically, coarse classification labels are first determined by a grid partition in the UTM coordinate, and then fine labels are selected by local feature matching. 2) We propose a compact feature aggregation with two GeM pooling layers, G 2 M, in which one GeM learns the principal components of feature maps along the channel direction and calibrates the output of the other GeM. 3) We propose the secondary fine-tuning method for NetVLAD-Linear, called NVL-FT 2 , which first learns feature representations in a high-dimensional space and then compresses the representations into a low-dimensional space using a single linear layer. 4) Extensive comparative and univariate experiments demonstrate our contributions and the excellence of SuperPlace. SuperPlace-G 2 M achieves state-of-the-art (SOTA) results using only one-tenth of the feature dimensions of recent methods. SuperPlace-NVL-FT 2 holds the top rank on the MSLS Challenge leaderboard, significantly outperforming recent methods. 2 Related Work Early VPR research primarily relied on hand-crafted features, including global features extracted directly (like GIST [ 35 ] ) and features derived from clustering local descriptors. Clustering algorithms such as BoW [ 4 ] , Fisher Vector (FV) [ 13 ] , and VLAD [ 25 ] were used in conjunction with local feature extraction algorithms like SIFT [ 31 ] , SURF [ 7 ] , and ORB [ 39 ] . With the

Read the complete text