Metadata-free Georegistration of Ground and Airborne Imagery

Adam Bredvik, Scott Richardson, Daniel Crispell · 2025

Read Metadata-free Georegistration of Ground and Airborne Imagery by Adam Bredvik, Scott Richardson, Daniel Crispell (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04927.txt.

Introduction

Adam Bredvik, Scott Richardson, and Daniel Crispell set out a way to place ground and air photos on the true map of the earth, with no tags on the photos. Their paper is from two thousand twenty-five.

Mixed photo sets can build fine three-dim models of a scene. But plain pipelines put those models in a made-up frame, not on the earth. That blocks uses that need true place, and makes it hard to join models from split sets. The team's way leans on satellite images, a matched surface model, and new view-making tools. It places air sets on the earth in a firm way. A kin way ties ground sets to the air-built model. Tests span many sites.

Catalog record

CREATORAdam Bredvik, Scott Richardson, Daniel Crispell
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-04927

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Metadata-free Georegistration of Ground and Airborne Imagery Adam Bredvik, Scott Richardson, Daniel Crispell Abstract Heterogeneous collections of ground and airborne imagery can readily be used to create high-quality 3D models and novel viewpoint renderings of the observed scene. Standard photogrammetry pipelines generate models in arbitrary coordinate systems, which is problematic for applications that require georegistered models. Even for applications that do not require georegistered models, georegistration is useful as a mechanism for aligning multiple disconnected models generated from non-overlapping data. The proposed method leverages satellite imagery, an associated digital surface model (DSM), and the novel view generation capabilities of modern 3D modeling techniques ( e.g . neural radiance fields) to provide a robust method for georegistering airborne imagery, and a related technique for registering ground-based imagery to models created from airborne imagery. Experiments demonstrate successful georegistration of airborne and ground-based photogrammetric models across a variety of distinct sites. The proposed method does not require use of any metadata other than a satellite-based reference product and therefore has general applicability. Figure 1 : The proposed georegistration method uses synthetic NeRF renderings generated from airborne imagery to bridge the gap between ground-level and satellite imagery. NeRF rendering allows the control necessary to produce images suitable for 2D matching to both satellite and ground-level imagery, allowing the transfer of satellite geopositioning to ground level images without metadata. Satellite imagery (C) 2025 Maxar 1 Introduction Standard photogrammetic toolchains can create 3D models from collections of 2D images, but without prior knowledge of the sensor positions the generated 3D models are ambiguous up to a scale, translation, and rotation in the best case [ 14 ] . The primary goal of georegistration is to estimate and apply a transform to a 3D model that brings it into a coordinate system with known absolute position, orientation, and scale. The absolute positioning of each individual model also provides relative positioning of individual models that are independently georegistered, which is critical when models are built from non-overlapping sets of input imagery. Finally, georegistration of 3D models also provides precise positioning of the sensors used to capture the imagery used to create the photogrammetric models. The proposed method leverages the novel-view generation capability of neural radiance fields (NeRFs) to create synthetic viewpoints of the modeled region that are more readily matched across domains ( e.g . airborne to satellite/ground-level imagery) and include per-pixel estimates of 3D location, which is used to convert the 2D matches to a 3D alignment. The proposed method assumes the availability of a satellite orthophoto and digital surface model (DSM) overlapping the reconstructed area of interest. The remainder of the paper is laid out as follows. Related methods are discussed in Section 2 . The proposed method is described in detail in Section 3 , and experimental results are presented in Section 4 . Final conclusions and identification of future improvements to the methods are discussed in Section 5 . 2 Related work 2.1 Airborne to satellite registration Georegistration of airborne imagery by identifying correspondences in the collection of images with a satellite-centric view has been studied in various forms for over 20 years [ 35 , 39 , 26 ] . In 2010, for example, Jaehong, et al . [ 26 ] used SIFT keypoint matching [ 22 ] to georegister airborne imagery to satellite stereo pairs. Because keypoint matching is the cornerstone of georegistration, SIFT’s limited robustness to changes in appearance and viewpoint between images restricts the range of airborne images that can be georegistered. In 2023, Liu et al . [ 21 ] adapted the traditional pipeline to georegister airborne images from unmanned aerial vehicles (UAVs) using SuperPoint/SuperGlue [ 31 ] , a trained feature detector and matcher. Berton et al . [ 2 ] used the detector-free dense matcher, RoMa [ 9 ] , and Bokman et al . used a rotation equivariant version of DeDoDe [ 7 ] keypoint matching to find correspondences between satellite images with impressive results. Similar to this work, Krock et al . [ 18 ] map an airborne structure from motion (SfM) reconstruction from relative to world coordinates. Their pipeline depends on matches between a satellite image and the orthorectified ground plane of an airborne image – which can induce significant distortion, making matching harder. To facilitate matching, we instead render a synthetic (nadir) view of the airborne model. While this rendered image has less distortion, a synthetic image can, nonetheless, be difficult to match due to scale, appearance differences, and artifacts due to the modeling and rendering pipeline. For this reason, we follow Berton et al . [ 2 ] and use RoMa to identify matches between the satellite and rendered airborne image. Finally, in contrast to the approaches of Krock et al . [ 18 ] and Zhuo et al . [ 45 ] , our proposed method is metadata-free and does not rely on measurements from onboard sensors such as from inertial measurement units (IMU) or GPS for georegistration. In fact, Krock et al . assume they already have precomputed cameras and 3D model (in a local coordinate system). Instead, we generate a 3D model and associated cameras given only the airborne imagery. 2.2 Ground to airborne registration Several existing approaches [ 29 , 20 , 38 , 44 , 5 , 10 ] attempt to directly match overhead and ground-level views via descriptors learned from many paired overhead/ground training examples. We instead focus on leveraging 3D modeling and rendering to bridge the domain gap, which does not require any domain-specific training data. MeshLoc [ 28 ] replaces the typical sparse feature-based approach to visual localization with image-based matching between real and rendered imagery. Unlike the proposed appraoch, Meshloc is focused on matching within a single domain. Other previous approaches to geometry-aided cross-domain matching rely on approximate geolocation metadata to form initial matches. Shan et al . [ 34 ] warp ground views using depth maps to facilitate direct matching to airborne imagery using approximate position and orientation information from both images. Zhu et al . [ 43 ] leverage rendered 3D models to aid airborne to ground matching, but assume an initial rough registration using metadata. Yan et al . [ 40 ] propose an iterative “render and compare” approach to cross-domain image matching, initialized with coarse geolocation from GPS. The proposed approach assumes that the input imagery is localized to a coarse area of interest, but makes no assumption about metadata in the ground or airborne imagery. 3 Metadata-free georegistration The following section covers our metadata-free method for georegistering airborne and ground-based imagery which, by rendering novel views of the airborne model ( 3.1 ), establishes robust correspondences ( 3.2 ) that bring (first) the airborne ( 3.4 ) and then the ground-level imagery ( 3.5 ) into alignment with the satellite imagery. 3.1 Novel view rendering The proposed georegistration pipeline leverages the ability of NeRF [ 23 ] reconstruction methods to generate photorealistic novel view renderings to “bridge the gap” between dominant viewpoints in different domains (ground, airborne, and satellite), making the 2D matching problem easier and more robust. The following subsection describes the pipeline used to reconstruct 3D models and render novel views given a set of unposed

Read the complete text