Beyond Paired Data: Self-Supervised UAV Geo-Localization from Reference Imagery Alone
Tristan Amadei Enric Meinhardt-Llopis Benedicte Bascle Corentin Abgrall Gabriele Facciolo, [1em] Thales LAS, France · 2025
Read Beyond Paired Data: Self-Supervised UAV Geo-Localization from Reference Imagery Alone by Tristan Amadei Enric Meinhardt-Llopis Benedicte Bascle Corentin Abgrall Gabriele Facciolo, [1em] Thales LAS, France (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-02737.txt.
Introduction
Tristan Amadei and co-authors locate drones from their camera view alone, without paired training data. In places where satellite navigation is denied, image based localization keeps unmanned aircraft on course. Standard methods match drone images to geo referenced satellite views.
Training those methods needs large paired drone and satellite datasets, which are costly and often unavailable. The team's self supervised approach learns from reference imagery alone. Cheaper training could bring reliable visual navigation to more regions and missions, from rescue work to inspection flights. Less gear on the ground means more flights can be run by small teams with small funds and short lead times.
Catalog record
| CREATOR | Tristan Amadei Enric Meinhardt-Llopis Benedicte Bascle Corentin Abgrall Gabriele Facciolo, [1em] Thales LAS, France |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-02737
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Paired Data: Self-Supervised UAV Geo-Localization from Reference Imagery Alone Tristan Amadei Enric Meinhardt-Llopis Benedicte Bascle Corentin Abgrall Gabriele Facciolo, [1em] Thales LAS, France Abstract Image-based localization in GNSS-denied environments is critical for UAV autonomy. Existing state-of-the-art approaches rely on matching UAV images to geo-referenced satellite images; however, they typically require large-scale, paired UAV–satellite datasets for training. Such data are costly to acquire and often unavailable, limiting their applicability. To address this challenge, we adopt a training paradigm that removes the need for UAV imagery during training by learning directly from satellite-view reference images. This is achieved through a dedicated augmentation strategy that simulates the visual domain shift between satellite and real-world UAV views. We introduce CAEVL , an efficient model designed to exploit this paradigm, and validate it on ViLD , a new and challenging dataset of real-world UAV images that we release to the community. Our method achieves competitive performance compared to approaches trained with paired data, demonstrating its effectiveness and strong generalization capabilities. 1 Introduction Vision-based localization is critical for Unmanned Aerial Vehicles (UAVs) when Global Navigation Satellite Systems (GNSS) are compromised by signal loss or jamming. While techniques like Visual Odometry [ 25 ] suffer from cumulative drift and Visual SLAM [ 10 ] is often limited to small-scale environments, matching UAV images against a pre-existing database of geo-referenced imagery offers a robust path to absolute positioning. Approaches to this problem can be broadly categorized. Feature-based matching methods, from traditional SIFT [ 46 ] to modern deep learning models [ 57 , 30 , 69 ] , often face computational bottlenecks when scaling to large databases. Consequently, image embedding techniques, which encode images into compact descriptors for efficient comparison, have become the dominant paradigm [ 37 , 7 , 33 , 48 , 2 , 47 ] . However, these state-of-the-art methods share a critical dependency: they require large-scale, paired training data where query images are matched with reference images. This data requirement presents a major bottleneck for deployment, as collecting extensive, geo-registered UAV imagery for every new flight scenario is often infeasible. Figure 1 : Recall@1 at 100m and 150m for CAEVL and other SOTA methods on the ViLD dataset. CAEVL achieves high accuracy while requiring fewer GFLOPs per query and without using labeled paired data during training. A more comprehensive set of results can be found in Table 1 . Lighter alternatives, such as training an autoencoder on reference images of a specific flight area [ 9 , 50 ] , have been proposed but have only been demonstrated on small-scale, ground-level scenes. Furthermore, a simple pixel-wise reconstruction loss is insufficient to create a latent space robust enough to bridge the significant visual discrepancies between satellite and real-world UAV imagery. To address these challenges, we introduce a novel, data-efficient training paradigm that learns to localize from reference images exclusively, eliminating the need for any paired UAV data during training ( Figure 1 ). Our approach structures the autoencoder’s latent space to be resilient to the cross-domain visual shift. This is achieved through two key technical contributions: the integration of a perceptual loss [ 36 ] during initial training, and a subsequent non-contrastive fine-tuning stage that regularizes the embedding space to align semantically similar views. To validate our approach, we introduce ViLD, a new and challenging dataset of real-world UAV images captured during high-altitude flights, which presents conditions such as vignetting and non-nadir orientations that are absent in many existing benchmarks (see Figure 3 ). Our main contributions are: 1. We introduce a data-efficient training paradigm for UAV localization that requires only satellite-view reference images , eliminating the need for paired UAV training data. 2. We present CAEVL , an efficient and lightweight model architecture designed to implement this paradigm, which combines a perceptual loss with a non-contrastive regularization of the latent space. 3. We release ViLD , a new large-scale dataset of real-world UAV images captured under challenging, high-altitude conditions, to validate our approach and facilitate future research in this area. 2 Related Work Cross-View Geo-Localization Paradigms. Visual Geo-Localization aims to find a camera’s position by matching a query image against a geo-referenced database. The task becomes Cross-View Geo-Localization (CVGL) when matching images from different perspectives, such as a UAV against a satellite map [ 17 , 60 , 22 ] . This is inherently challenging due to a domain gap caused by viewpoint, scale, and temporal variations. Two paradigms dominate the field: image retrieval via metric learning, and direct matching for fine-grained localization. Image Retrieval-Based Geo-Localization. The most common approach treats CVGL as an image retrieval task, learning a shared embedding space where feature distance corresponds to geographic proximity [ 42 , 40 ] . Ground-Level and General VPR. Early work in Visual Place Recognition (VPR) and ground-to-satellite matching focused on global descriptors, with NetVLAD [ 3 ] introducing trainable aggregation layers. Later methods improved robustness to viewpoint changes, such as EigenPlaces [ 8 ] , which clusters training data to embed viewpoint invariance, and MixVPR [ 2 ] , which mixes features via MLPs for compact descriptors. However, these approaches are tailored to ground-level imagery and do not fully address the top-down perspective of UAVs. UAV-to-Satellite Retrieval. In UAV-to-satellite matching, research has evolved from CNNs to Transformers. While CNN-based methods like MCCG [ 54 ] remain relevant, Vision Transformers (ViTs) [ 21 ] dominate due to their ability to model global dependencies and reduce cross-view variance [ 31 , 18 ] . Some works leverage adversarial learning to produce view-invariant features [ 42 ] , while others address real-world challenges. For instance, AGEN [ 65 ] combines a DINOv2 [ 49 ] backbone with a Local Pattern Network [ 59 ] and an Adaptive Error Control module to maintain accuracy under extreme conditions. Direct Matching and Fine-Grained Localization. An alternative paradigm formulates geo-localization as direct matching or heatmap regression [ 67 , 14 ] . Early GAN-based methods tackled modality gaps via generative translation: LocGAN [ 29 ] converts UAV images to LiDAR grids for pose estimation, while [ 53 ] translates UAV imagery into street-map–like views for accurate GNSS-denied localization. Recent supervised GANs, such as SAM-GAN [ 64 ] and [ 55 ] , enhance translation through style/content disentanglement, topological consistency, and edge-aware generation. PVDA [ 43 ] instead aligns UAV and satellite features using progressive adversarial learning. Non-GAN alternatives include BRM localization [ 15 ] , that matches building area ratios to maps, and orthophoto-based Monte Carlo localization for probabilistic GNSS-free matching [ 38 ] . Transformer-based models like MLPCAN [ 39 ] , SSPT [ 23 ] , and VRLM [ 67 ] leverage cross-attention and multi-scale fusion to produce precise location heatmaps. These are often paired with robust matchers: learned methods such as LoFTR [ 57 ] and SuperPoint/SuperGlue [ 20 , 51 ] achieve strong performance [ 44 , 45 , 74 ] , though their reliance on repeatable keypoints limits standalone use in extreme cross-view settings. Emerging Trends and Learning Strategies. To improve reliability, recent research moves beyond single-image queries, using either unordered sets of images (Set-CVGL [ 61 ] ) or ordered video sequences [ 71 ] to aggregate spatial and temporal information. The training