Construction of Digital Terrain Maps from Multi-view Satellite Imagery using Neural Volume Rendering
Josef X. Biberstein, Guilherme Cavalheiro, Juyeop Han, Sertac Karaman · 2025
Read Construction of Digital Terrain Maps from Multi-view Satellite Imagery using Neural Volume Rendering by Josef X. Biberstein, Guilherme Cavalheiro, Juyeop Han, Sertac Karaman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01386.txt.
Introduction
Josef Biberstein and co-authors build terrain maps from satellite photos using a neural rendering method, in this 2025 paper. Terrain maps guide spacecraft as they descend and land, and help robots plan paths on the ground. The standard way to make them matches features across many photos by hand-tuned steps, which is slow and fiddly. The team sought a method that learns the terrain directly.
Their approach adapts neural volume rendering, a technique first built to render scenes from photos. It learns a textured height map of the ground from several satellite views at once. That skips much of the manual prep the older pipeline needs. Better maps matter more as landing missions aim for rougher, less known ground.
Catalog record
| CREATOR | Josef X. Biberstein, Guilherme Cavalheiro, Juyeop Han, Sertac Karaman |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-01386
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Construction of Digital Terrain Maps from Multi-view Satellite Imagery using Neural Volume Rendering Josef X. Biberstein, Guilherme Cavalheiro, Juyeop Han, Sertac Karaman Abstract Digital terrain maps (DTMs) are an important part of planetary exploration, enabling operations such as terrain relative navigation during entry, descent, and landing for spacecraft and aiding in navigation on the ground. As robotic exploration missions become more ambitious, the need for high quality DTMs will only increase. However, producing DTMs via multi-view stereo pipelines for satellite imagery, the current state-of-the-art, can be cumbersome and require significant manual image preprocessing to produce satisfactory results. In this work, we seek to address these shortcomings by adapting neural volume rendering techniques to learn textured digital terrain maps directly from satellite imagery. Our method, neural terrain maps (NTM), only requires the locus for each image pixel and does not rely on depth or any other structural priors. We demonstrate our method on both synthetic and real satellite data from Earth and Mars encompassing scenes on the order of 100 km 2 100\text{\,}{\mathrm{km}}^{2} . We evaluate the accuracy of our output terrain maps by comparing with existing high-quality DTMs produced using traditional multi-view stereo pipelines. Our method shows promising results, with the precision of terrain prediction almost equal to the resolution of the satellite images even in the presence of imperfect camera intrinsics and extrinsics. \member Member, IEEE † † received: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. This work was supported in part by the Defense Science and Technology Agency (DSTA) of Singapore. † † corresponding: (Corresponding author: Josef X. Biberstein.) † † address: Authors’ addresses: Josef X. Biberstein is with Massachusetts Institute of Technology, Cambridge, MA 02139, USA (e-mail: [email protected] ). Guilherme Cavalheiro is with Massachusetts Institute of Technology, Cambridge, MA 02139, USA (e-mail: [email protected] ). Juyeop Han is with Massachusetts Institute of Technology, Cambridge, MA 02139, USA (e-mail: [email protected] ). Sertac Karaman is with Massachusetts Institute of Technology, Cambridge, MA 02139, USA (e-mail: [email protected] ). keywords Image synthesis, Neural networks, Satellite images, Terrain mapping I INTRODUCTION Recent and near future planetary exploration missions are pushing new bounds in terms of their scale and complexity. For example, the Perseverance rover, launched in 2020, carried with it the Ingenuity helicopter [ 1 ] , which demonstrated the first powered flight on another planet. Following on, the upcoming Dragonfly mission [ 2 ] to Titan seeks to conduct long, autonomous flights during its exploration of the moon. Missions are also embracing more unconventional designs, such as EELS [ 3 ] , and architectures, such as CADRE [ 4 ] . Additionally, the entry of commercial companies into space exploration [ 5 ] is set to drastically increase the number of missions launched in the coming decades. For all of these missions, access to high quality digital terrain maps (DTMs) is key for success. Whether for terrain relative navigation during entry, descent, and landing [ 6 , 7 ] or for aiding navigation while traversing a planetary surface [ 8 ] , high quality DTMs enable missions when other methods of precise localization, such as GPS, are unavailable. However, current methods of producing DTMs from satellite imagery with multi-view stereo (MVS) reconstruction can be cumbersome to use, requiring significant image preprocessing to get high quality results and lacking the ability to utilize the gamut of satellite imagery available due to struggling with effects such as differing scene illumination, presence of transient phenomena, or differing camera models between images. Therefore, there is a desire to explore alternate DTM construction methods to support the increased need for these products in future space missions. Recently, neural volume rendering methods, such as neural radiance fields (NeRFs) [ 9 ] , have become a popular method for scene representation and novel view reconstruction tasks. These methods excel at fusing large amounts of data from various sources into high quality representations but, as demonstrated in Fig. 1 , struggle with planar image distributions with low disparity as often seen in satellite imagery of terrain. Therefore, in this work, we explore how neural volume rendering can be adapted to address this issue and to provide a new way of generating DTMs while avoiding the pitfalls of typical MVS pipelines. Out contributions are threefold: 1. We introduce Neural Terrain Maps (NTM), a volume rendering procedure that can be used to directly optimize textured DTMs from multi-view satellite imagery. 2. We integrate NTM into the popular Nerfstudio framework [ 10 ] to enable rapid experimentation and development. 3. We demonstrate the effectiveness of NTM by creating DTMs using datasets from two different orbital imaging instruments and compare the results against simulated imagery and existing high quality reference DTMs. The rest of this article is organized as follows. In Section II , we review related work in terrain mapping and neural volume rendering. In Section III , we describe the rendering procedure for NTM. In Section IV , we provide the implementation details of the networks used in NTM, and also describe the datasets used and how they are processed. In Section V , we present quantitative and qualitative results of our method on both synthetic and real satellite imagery datasets, including renderings of novel views and georeferenced DTM outputs. Finally, in Section VI , we conclude and outline future work. (a) Nerfacto [ 10 ] (b) NeuS [ 11 ] (c) NEMo [ 12 ] (d) NTM (ours) Fig. 1 : A comparison of different neural volume rendering methods visual (left) and normalized depth (right) reconstruction on a closeup of a small crater in the Gale Crater CTX scene. The view is a nadir perspective view at approximately 19\text{\,}\mathrm{km} altitude with a 20\text{\,}\mathrm{\SIUnitSymbolDegree} field of view. Previous methods fail to produce a coherent reconstruction of the terrain due to the low disparity signal in the scene, while NTM succeeds. II RELATED WORK II-A Terrain Mapping with Multi-view Stereo The use of traditional MVS techniques to produce DTMs from satellite imagery has been extensively studied. Some established software solutions have emerged such as the Ames Stereo Pipeline [ 13 ] , the satellite stereo pipeline (S2P) [ 14 ] , and COLMAP [ 15 , 16 ] . One significant challenge that arises with these methods is that satellite imagery is not typically provided with a perspective camera model as it is usually acquired from linescan cameras, which capture images in a series of lines as the satellite moves along its orbit. Therefore, either a linescan model is used or a rational polynomial coefficient (RPC) model is used to abstract away the camera model by fitting a rational polynomial function from latitude and longitude points to pixel coordinates or vice versa. Because of this, MVS on satellite imagery cannot rely on the standard epipolar geometry assumptions that are typically used in stereo matching. This can be solved by trying to match directly with non-linear epipolar curves in linescan image pairs [ 17 ] , approximating the linescan camera model with a perspective camera model locally and proceeding with normal stereo rectification and matching [ 18 ] , or constructing epipolar curves for each