KappaPlace: Learning Hyperspherical Uncertainty for Visual Place Recognition via Prototype-Anchored Supervision
Maya Yanko, Yoli Shavit · 2026
Read KappaPlace: Learning Hyperspherical Uncertainty for Visual Place Recognition via Prototype-Anchored Supervision by Maya Yanko, Yoli Shavit (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19435.txt.
Introduction
Yanko and Shavit tackle unreliable confidence in visual place recognition, where robots cannot tell when a match is likely wrong. Their KappaPlace method learns uncertainty-aware descriptors by modeling image features as von Mises-Fisher variables and predicting a concentration value as a proxy for doubt. A prototype-anchored training scheme uses latent class examples as targets, and a match-level formula scores single query-reference pairs. Across five benchmarks it cuts calibration error by up to half while holding or improving retrieval recall.
Catalog record
| CREATOR | Maya Yanko, Yoli Shavit |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47294 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.19435
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
KappaPlace: Learning Hyperspherical Uncertainty for Visual Place Recognition via Prototype-Anchored Supervision Maya Yanko, Yoli Shavit Abstract Visual Place Recognition (VPR) is critical for autonomous navigation, yet state-of-the-art methods lack well-calibrated uncertainty estimation. Standard pipelines cannot reliably signal when a query is ambiguous or a match is likely incorrect, posing risks in safety-critical robotics. We propose KappaPlace, a principled framework for learning uncertainty-aware VPR representations. Our core contribution is a Prototype-Anchored supervision strategy that leverages latent class representatives as targets for a probabilistic objective. By modeling image descriptors as von Mises-Fisher (vMF) variables, we learn a lightweight module to predict the concentration parameter κ \kappa as a direct proxy for aleatoric uncertainty. While existing VPR uncertainty methods are typically restricted to a query-centric view, we derive a novel match-level formulation to quantify the reliability of specific query-reference pairs. Across five diverse benchmarks, KappaPlace reduces Expected Calibration Error (ECE@K) by up to 50% compared to existing methods while maintaining or improving retrieval recall. We provide both a joint-training variant and a post-training extension for frozen backbones. Our results demonstrate that KappaPlace provides a robust, stable, and well-calibrated signal that enables reliable decision-making within the VPR pipeline. Our code is available at: https://github.com/mayayank95/UncertaintyAwareVPR . 1 Introduction Visual Place Recognition (VPR) provides the critical global localization required for autonomous navigation. Conventionally framed as a large-scale image retrieval task, VPR requires mapping a query image to a geographically tagged counterpart in a reference database. Driven by deep metric learning, contemporary pipelines achieve remarkable discriminative power by embedding images into high-dimensional latent manifolds 2 ; 5 ; 6 . However, while these models excel at identifying the "nearest neighbor" in feature space, they remain essentially deterministic. They provide point-estimates in embedding space but lack a native mechanism to express the certainty of those estimates. Beyond the lack of query-level uncertainty estimation, the match scores themselves (typically derived from cosine similarity or Euclidean distance) are uncalibrated; they represent relative proximity rather than likelihood of match validity. Current attempts to bridge this gap suffer from several distinct limitations. Some frameworks are strictly coupled to specific training objectives, such as contrastive triplet losses 23 , which restricts their utility in contemporary, scalable VPR paradigms like classification-based learning 5 or multi-similarity objectives 1 . Crucially, these probabilistic adaptations often incur a measurable degradation in retrieval accuracy compared to their deterministic counterparts 23 . Other approaches rely on restrictive score or pose distribution priors 15 ; 26 . While effective for filtering, these methods output-score heuristics or characterize external environmental geometry rather than the aleatoric uncertainty inherent in the visual input itself. High-performing "post-hoc" solutions, such as geometric verification, offer reliability only at the cost of prohibitive computational burdens 26 . Furthermore, techniques such as multi-pass Monte Carlo sampling primarily capture epistemic (model) uncertainty, failing to isolate data-dependent noise in a single forward pass and often yielding inferior calibration compared to specialized aleatoric models 7 ; 23 . Finally, even recent self-teaching uncertainty networks (STUN) 7 , though theoretically architecture-agnostic, consistently degrade the performance of state-of-the-art VPR backbones, as shown in Table 1 . In this work, we present KappaPlace, a framework that provides well-calibrated uncertainty for both the query image and individual query-reference matches without compromising retrieval performance. The core of our approach is a Prototype-Anchored supervision strategy, which leverages stable latent cluster representatives as canonical targets for a probabilistic objective. We primarily demonstrate this strategy within classification-based VPR, where learned class embeddings serve as these anchoring targets. However, we show that this principle is fundamentally extensible to contrastive-based VPR by utilizing dynamic batch-level centroids. By anchoring uncertainty to these prototypes rather than noisy image-level pairs, KappaPlace achieves a more stable estimation of aleatoric noise. We model descriptors as von Mises-Fisher (vMF) variables on the unit hypersphere and optimize a lightweight auxiliary module to estimate the concentration parameter ( \kappa ) with a numerically stable bounding and approximation of the vMF loss 3 ; 17 . This enables the quantification of query-level uncertainty in a single forward pass, from which we further derive a novel match-level uncertainty score based on the \kappa -weighted resultant vector of the query and reference embeddings 11 . We evaluate KappaPlace across diverse VPR benchmarks, demonstrating that it provides well-calibrated uncertainty estimates while maintaining or enhancing retrieval performance. We introduce two variants: KappaPlace-JT , a Joint-Training variant for concurrent optimization of retrieval and uncertainty estimation and KappaPlace-PT , a Post-Training variant, where the uncertainty module is trained on top of the frozen pretrained VPR backbone. Our results show that KappaPlace consistently achieves superior Expected Calibration Error ( ECE@K ), with KappaPlace-PT reducing ECE@1 of state-of-the-art baselines by approximately 50%, while maintaining high stability across random seeds. Furthermore, KappaPlace provides a principled match-level uncertainty estimate that reduces calibration error ( ECE@K ) across all benchmarks. Finally, detailed ablations justify our key design choices, namely the use of hyperspherical vMF statistics, the uncertainty head architecture and the formulation of query-level In summary, our contributions are as follows: • We introduce a prototype-anchored supervision strategy that leverages stable latent cluster representatives as ground-truth targets, enabling aleatoric uncertainty learning while preserving VPR recall and achieving state-of-the-art ECE@K . • We design a lightweight uncertainty module that estimates the von Mises-Fisher concentration parameter ( \kappa ) in a single forward pass, supporting both joint-training and efficient post-training for frozen VPR backbones. • We derive a novel match-level uncertainty formulation from the \kappa -weighted resultant vector of query and reference embeddings, providing a principled pairwise metric to quantify the reliability of specific VPR matches. 2 Related Work 2.1 Visual Place Recognition Visual Place Recognition (VPR) identifies a query image via retrieval from a geo-tagged database. Global descriptors are typically formed using aggregation layers like NetVLAD 4 or GeM pooling 16 . Recent work enhances discriminative power through optimal transport 10 , multi-feature and multi-view fusion 2 ; 13 , and foundation model adaptation 14 ; 19 . Training objectives generally follow two paths: contrastive learning (triplet losses 9 and, more recently, multi-similarity 1 ; 21 losses) which enforce condition invariance, and classification-based proxies 5 ; 6 . Classification-based VPR scales to city-scale benchmarks by partitioning environments into discrete classes supervised by the large-margin cosine loss 5 ; 20 , where labels may be ’hard’ or ’soft’ 12 . KappaPlace leverages these classification prototypes as ground-truth mean directions to supervise our probabilistic objective. 2.2 Uncertainty Estimation in VPR Uncertainty is categorized as epistemic (model-based) or aleatoric (data-dependent). While MC Dropout 8 captures epistemic uncertainty, its multiple forward passes are computationally prohibitive for VPR. Probabilistic Aleatoric Modeling. Aleatoric methods model visual ambiguity through stochastic embeddings. The Bayesian Triplet Loss (BTL) represents images as isotropic Gaussians 23 to derive uncertainty, but it is strictly coupled to triplet-loss and standard contrastive objectives. Consequently, BTL has not been demonstrated for contemporary multi-similarity losses and is inherently incompatible with scalable classification-based VPR. Furthermore, such BTL often incurs a measurable degradation in retrieval recall. STUN 7 employs teacher-student distillation to estimate uncertainty; however, it lacks an objective target and risks mimicking the latent biases of the teacher network. In contrast, we anchor uncertainty to latent prototypes (e.g., class embeddings), providing explicit supervision relative to canonical geographic representatives rather