The Landform Contextual Mesh: Automatically Fusing Surface and Orbital Terrain for Mars 2020
Marsette Vona · 2025
Read The Landform Contextual Mesh: Automatically Fusing Surface and Orbital Terrain for Mars 2020 by Marsette Vona (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-18330.txt.
Introduction
Mars rovers send home thousands of images, but flat photos hide the shape of the land. Marsette Vona describes a system that builds a 3D terrain mesh for each Mars 2020 rover stop. His 2025 paper explains the Landform contextual mesh. It blends rover photos with height and color maps from the Mars Reconnaissance Orbiter, a spacecraft in orbit.
The meshes are built on their own during ground processing, with no hand work per site. Mission scientists open them in a planning tool called ASTTRO to pick targets and plan drives. A subset also appears on the public Explore with Perseverance website, where anyone can view the same terrain. The result links close-up ground detail with the wide view from orbit. That link helps teams read the land around the rover fast.
Catalog record
| CREATOR | Marsette Vona |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-18330
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Landform Contextual Mesh: Automatically Fusing Surface and Orbital Terrain for Mars 2020 Thanks: ©2025 California Institute of Technology. Government sponsorship acknowledged. Marsette Vona Abstract The Landform contextual mesh fuses 2D and 3D data from up to thousands of Mars 2020 rover images, along with orbital elevation and color maps from Mars Reconnaissance Orbiter, into an interactive 3D terrain visualization. Contextual meshes are built automatically for each rover location during mission ground data system processing, and are made available to mission scientists for tactical and strategic planning in the Advanced Science Targeting Tool for Robotic Operations (ASTTRO). A subset of them are also deployed to the ”Explore with Perseverance” public access website. I Introduction Like its predecessors including Spirit, Opportunity, and Curiosity, the Mars 2020 Perseverance rover carries a suite of stereo cameras to image the surrounding terrain [ 1 , 2 , 3 ] . Data from those instruments is used for multiple purposes including both on-board and ground-based navigation, engineering operations, and science analysis. An important use case is tactical and strategic science planning, where teams of mission scientists use the imagery to select areas of interest and plan subsequent observations. Stereo vision produces a “tactical wedge” 3D terrain mesh for each stereo image pair, so-called because often a radial panorama of such wedges is acquired from a single rover location using the pan/tilt mast. Of course, only a fraction of nearby terrain is included since the cameras have limited fields of view, effective resolution decreases with distance, the rover occludes areas underneath itself, nearby rocks and hills create self-occlusions in the terrain, and stereo reconstruction fails in areas with insufficient texture. Nevertheless, viewing such panoramas of tactical wedges in 2D and 3D (latter also called the tactical mesh ) has been a standard approach for science planning on Mars 2020 and its predecessors. Figure 1(a) shows such a view for site 40, drive 132 of the Perseverance rover, acquired on sols 821--832 1 1 1 One sol is the equivalent of a day on Mars. . (a) Tactical mesh from in-situ stereo vision only. (b) Orbital digital elevation mesh from Mars Reconnaissance Orbiter HiRISE data. (c) Landform contextual mesh fusing in-situ and orbital data. Fig. 1 : Reconstructed 3D terrain surrounding the Perseverance rover at site 40, drive 132 (sols 821–832). This viewpoint spans about 15m horizontally in the foreground and about 1km from foreground to background terrain. More distant hills are also visible in the sky sphere. An alternative to the tactical mesh is to use a portion of a digital elevation map (DEM) derived from orbital observations, as shown in Figure 1(b) . The Mars 2020 mission typically uses colored DEM data from the HiRISE instrument on the Mars Reconnaissance Orbiter [ 4 ] . This orbital mesh can cover a much larger extent—up to 10s of km—and typically has no gaps in its coverage. However, at a typical resolution of 1 elevation sample (and 16 color samples) per square meter, it’s much coarser than the tactical mesh, which can have sub-millimeter resolution near the rover. In this paper we introduce the contextual mesh , which we have developed to fuse up to thousands of images from in-situ stereo cameras together with orbital DEM data into a single 3D scene, shown in Figure 1(c) and Figure 2 . The contextual mesh is produced by Landform, a subsystem within the Mars 2020 ground data system (M20 GDS), and typically viewed in the Advanced Science Targeting Tool for Robotic Operations (ASTTRO) collaborative web application [ 5 , 6 ] , also part of the M20 GDS [ 7 ] . Fig. 2 : Landform contextual mesh viewed in the Mars 2020 ASTTRO tool for science planning (same viewpoint as Figure 1 ). Named targets are typically defined on the tactical mesh for accuracy but can be viewed relative to the contextual mesh for additional spatial awareness. Whereas the tactical mesh offers the highest fidelity local terrain reconstruction, and the orbital mesh the longest range reconstruction, the intention of the contextual mesh is to provide spatial awareness. It is typically visualized from a first-person navigable 3D point of view in ASTTRO, showing not only local terrain features such as sand, pebbles, rocks, ridges, and hills, but also distant landmarks on the horizon. ASTTRO also displays a 3D model of the Perseverance rover on the terrain as it was posed at the corresponding time in the mission. Each contextual mesh is comprised of two tilesets in the open-standard 3DTiles format [ 8 ] . One tileset contains the terrain itself, typically extending to a 1km square with a 100m square central detail area. The other tileset is a hemispherical representation of the surrounding horizon and sky, enabling visualization of distant features potentially many kilometers away. ASTTRO displays both of these simultaneously so that users can see the context of local terrain features relative to both nearby hills and to the horizon. The 3DTiles format enables data to be progressively streamed to distributed users in the web-based ASTTRO client. Only the subset of tile data required depending on the user’s current viewpoint is transferred and rendered, enabling dynamic level-of-detail, fast load times, and deployment to resource limited clients. Like the products of many data fusion and reconstruction algorithms, e.g. computed tomography, and considering that the input data contains noise and outliers, the contextual mesh may contain some artifacts. For example • boundaries between areas reconstructed primarily from surface vs orbital data may have some discontinuities • outlier images with extreme brightness variations may not be completely blended • reconstructed geometry may have “island” topological artifacts due to noise and residual misalignment in the input data. Spatial awareness can generally still be gained even in the presence of such artifacts. The tactical or orbital mesh can be used for other tasks, and ASTTRO makes it easy to change to the tactical, orbital, or contextual mesh at any time. The Landform contextual mesh differs from many other photogrammetry and terrain fusion systems not only because it combines both surface and orbital data and has a sky sphere, but also in that it is entirely automated, whereas most other systems require some human intervention. It heavily leverages properties of Mars mission datasets, including pose priors from rover navigation, calibrated stereo camera data, and co-registered orbital data. These enable automated processing while maintaining reasonable quality relative to manual and semi-manual approaches. The Landform codebase will soon be released as open source. And, throughout the mission, a selection of contextual meshes have been made publicly available for interactive viewing at the “Explore with Perseverance” website [ 9 ] . In this paper we summarize the research context of related terrain fusion approaches, describe the novel algorithms we developed to implement the contextual mesh system in Landform, and present examples of contextual mesh data products. II Related Work The Landform contextual mesh is effectively a stereo-vision based simultaneous localization and mapping (SLAM) system which operates on data from stereo cameras 2 2 2 Even the orbital DEM data is based on stereo vision processing of image pairs from the MRO HiRISE camera [ 4 ] . and which produces a dense reconstruction of the 3D scene.