Uncertainty-aware Accurate Elevation Modeling for Off-road Navigation via Neural Processes

Sanghun Jung, Daehoon Gwak, Byron Boots, James Hays · 2025

Read Uncertainty-aware Accurate Elevation Modeling for Off-road Navigation via Neural Processes by Sanghun Jung, Daehoon Gwak, Byron Boots, James Hays (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03890.txt.

Introduction

Sanghun Jung and co-authors build a terrain mapping method for off-road driving, in this 2025 paper. A vehicle crossing trails or desert must guess the ground height ahead and know how unsure that guess is. Older methods are either too slow for real time or smooth over sharp dips and ridges.

Their method, based on neural processes, blends Bayesian care with neural speed. It reads both laser and camera cues to fill gaps in unseen ground, and a local attention scheme cuts compute while keeping fine detail. On trail, desert, and hill data, it beat rival methods at both accuracy and honesty about its own uncertainty.

Catalog record

CREATORSanghun Jung, Daehoon Gwak, Byron Boots, James Hays
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-03890

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Uncertainty-aware Accurate Elevation Modeling for Off-road Navigation via Neural Processes Sanghun Jung, Daehoon Gwak, Byron Boots, James Hays Abstract Terrain elevation modeling for off-road navigation aims to accurately estimate changes in terrain geometry in real-time and quantify the corresponding uncertainties. Having precise estimations and uncertainties plays a crucial role in planning and control algorithms to explore safe and reliable maneuver strategies. However, existing approaches, such as Gaussian Processes (GPs) and neural network-based methods, often fail to meet these needs. They are either unable to perform in real-time due to high computational demands, underestimating sharp geometry changes, or harming elevation accuracy when learned with uncertainties. Recently, Neural Processes (NPs) have emerged as a promising approach that integrates the Bayesian uncertainty estimation of GPs with the efficiency and flexibility of neural networks. Inspired by NPs, we propose an effective NP-based method that precisely estimates sharp elevation changes and quantifies the corresponding predictive uncertainty without losing elevation accuracy. Our method leverages semantic features from LiDAR and camera sensors to improve interpolation and extrapolation accuracy in unobserved regions. Also, we introduce a local ball-query attention mechanism to effectively reduce the computational complexity of global attention by 17% while preserving crucial local and spatial information. We evaluate our method on off-road datasets having interesting geometric features, collected from trails, deserts, and hills. Our results demonstrate superior performance over baselines and showcase the potential of neural processes for effective and expressive terrain modeling in complex off-road environments. Keywords: Terrain elevation modeling, Robot perception, Off-road navigation 1 Introduction Accurate terrain elevation modeling is a long-standing problem in robotics [ 1 , 2 , 3 , 4 , 5 , 6 , 7 ] . Reliable ground estimations play a crucial role in determining a vehicle’s maneuvering strategies [ 8 , 9 , 10 , 11 ] for off-road navigation. For example, negative obstacles (e.g., ditches or craters) are best avoided, but when they must be traversed, the vehicle needs accurate elevation estimates to align itself and plan a trajectory that negotiates the terrain safely. However, such negative obstacles are often not visible in LiDAR and camera sensors, especially when observed from a distance due to limited viewing angles. Instead, they appear as a ‘narrow gap’ between LiDAR rays in point clouds or as ‘continuous ground’ in images, as illustrated in Fig. 1 . This invisible nature complicates their prediction and frequently leads to underestimation, such as misinterpreting ditches as shallower depressions or cliffs as downhill slopes. We aim to accurately estimate the predictive distribution of ground elevation in each cell within bird’s-eye-view (BEV) grids while addressing challenging cases such as negative obstacles, which require extrapolation beyond direct observations. Figure 1: (Left group) An example of LiDAR points on a ditch and its ground truth and predicted elevations from our model. (Right) An example image from a forward-facing camera looking downhill. The terrain looks continuous, but there is a significant downhill slope in front of the vehicle. From LiDAR observations at each timestep, ground elevations can be estimated by taking the minimum height value in each BEV cell. However, given the sparse nature of LiDAR sensors and their limited viewing angles, there is a crucial need to effectively interpolate and extrapolate these observed ‘context’ points to unobserved ‘target’ points. Early research predominantly utilized Gaussian Processes (GPs) [ 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 ] and Bayesian Generalized Kernels (BGKs) [ 20 , 21 , 22 , 23 ] to address this task. They provide a solid mathematical foundation for making predictions and understanding their associated uncertainties. Nevertheless, their flexibility is restricted due to predefined kernel functions and fixed prior distributions. Moreover, their computational demands often prevent the use of real-time applications, which are crucial for agile, high-speed off-road autonomy. More recently, deep neural network-based methods [ 24 , 25 , 2 , 5 , 4 , 26 ] have emerged, exhibiting strong learning capabilities from extensive datasets and thus better generalization across varied terrain characteristics. Although some methods [ 24 , 25 ] produce promising predictions on relatively flat terrains, they often underestimate sharp geometric features and inadequately model negative obstacles. This shortcoming leads to overly optimistic planning and control strategies, which can potentially cause vehicle rollovers or falls from cliffs. Additionally, accurate uncertainty estimations are essential for identifying and avoiding regions where predictions are less confident. However, we observe that training these models to estimate uncertainty often accompanies degradation in elevation accuracy. To overcome the limitations, we propose leveraging Neural Processes (NPs) [ 27 , 28 , 29 , 30 ] , which learn adaptive, data-driven representations without relying on predefined kernels or fixed priors, thereby enhancing flexibility in modeling diverse terrain features. NPs inherently provide accurate uncertainty estimation without compromising prediction accuracy, and they exhibit strong capability for capturing sharp changes in elevation. Also, NPs scale effectively for real-time deployment due to their computational efficiency compared to GPs. In this paper, we aim to address the following major challenges: 1) precisely estimating sharp elevation changes, 2) improving interpolation and extrapolation accuracy in unobserved regions, and 3) quantifying associated uncertainty. While the associated uncertainties are inherently learned through NP frameworks, the remaining challenges require special attention. Improving Inter-/Extrapolation. Analogous to existing literature [ 27 , 28 , 13 , 14 ] , ‘context points’ (i.e., estimated ground height from LiDAR) can be the sole basis for elevation prediction at any other unobserved target point. However, they can be sparse and lack semantic information. Therefore, context-point-only methods struggle with extrapolating context points, often failing significantly in unobserved regions. Thus, we incorporate additional semantically informative features from both the camera and LiDAR sensors and condition the context and target points on them. This semantic-conditioned NP enables the prediction of reasonable elevations beyond the observed areas. Estimation of Sharp Elevation Changes. An attention mechanism [ 31 ] is an effective solution to preserve sharpness in predictions [ 28 ] since it promotes models to learn self-correlations among observations. However, our observations cover regions larger than 100 m × 100 m. Thus, using global attention requires a significant memory, which is often unfeasible for onboard computing in robots. To address this, we propose a ball-query attention mechanism where only observations within a local \epsilon -ball are considered for attention operations. Applying it reduces the number of floating-point operations (FLOPS) and inference time by 17% and 36%, while preserving crucial local and spatial information. To preserve temporal consistency, we aggregate LiDAR points and update image features using non-parametric Bayesian updates without requiring additional training. We validate our method on off-road datasets collected from grassy hills in California (i.e., CA Hills), the Mojave Desert with on- and off-trail runs (i.e., Mojave Desert), and dirt and grassy terrain with diverse negative obstacles in Ellensburg, Washington (i.e., Ellensburg). Our method outperforms existing approaches in terms of elevation, slope, and curvature accuracy, while also providing meaningful uncertainty estimates. To summarize, our contributions are: • We present precise elevation estimates with associated uncertainties by introducing a novel semantic-conditioned Neural Processes with temporal aggregation. • We introduce a ball-query attention mechanism that effectively reduces computational demands while maintaining necessary local, spatial information. • We demonstrate the effectiveness of our

Read the complete text