SPADE: Sparsity Adaptive Depth Estimator for Zero-Shot, Real-Time, Monocular Depth Estimation in Underwater Environments

Hongjie Zhang, Gideon Billings, Stefan B. Williams · 2025

Read SPADE: Sparsity Adaptive Depth Estimator for Zero-Shot, Real-Time, Monocular Depth Estimation in Underwater Environments by Hongjie Zhang, Gideon Billings, Stefan B. Williams (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-25463.txt.

Introduction

Hongjie Zhang, Gideon Billings, and Stefan B Williams present SPADE. Their 2025 paper values depth underwater from one camera. Underwater infrastructure needs frequent inspection and maintenance. Harsh marine settings damage forms over time. Human divers and remotely operated vehicles face limits. Turbid water and complex forms challenge perception greatly.

SPADE stands for Sparsity Changing Depth Estimator here. It mixes a pretrained relative depth estimator first. Sparse depth priors supply metric scale information. A two-stage method scales the relative map first. Cascade transformer blocks then refine the final prediction. Those blocks use convolution and deformable attention ideas. The system produces dense, metric-scale depth maps. Quality and generalization beat leading rivals, they report. It runs over fifteen frames per second quickly. Embedded hardware can run it in real time. Useful underwater inspection and intervention may benefit. Greater vehicle autonomy could reduce piloting risks.

Catalog record

CREATORHongjie Zhang, Gideon Billings, Stefan B. Williams
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-25463

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SPADE: Sparsity Adaptive Depth Estimator for Zero-Shot, Real-Time, Monocular Depth Estimation in Underwater Environments Thanks: This work has been submitted to IEEE Journal of Oceanic Engineering Special Issue of AUV 2026 Hongjie Zhang, Gideon Billings, Stefan B. Williams Abstract Underwater infrastructure requires frequent inspection and maintenance due to harsh marine conditions. Current reliance on human divers or remotely operated vehicles is limited by perceptual and operational challenges, especially around complex structures or in turbid water. Enhancing the spatial awareness of underwater vehicles is key to reducing piloting risks and enabling greater autonomy. To address these challenges, we present SPADE: SParsity Adaptive Depth Estimator, a monocular depth estimation pipeline that combines pre-trained relative depth estimator with sparse depth priors to produce dense, metric scale depth maps. Our two-stage approach first scales the relative depth map with the sparse depth points, then refines the final metric prediction with our proposed Cascade Conv-Deformable Transformer blocks. Our approach achieves improved accuracy and generalisation over state-of-the-art baselines and runs efficiently at over 15 FPS on embedded hardware, promising to support practical underwater inspection and intervention. I Introduction For both Remotely Operated Vehicles (ROVs) and Autonomous Underwater Vehicles (AUVs), situational awareness is critical for the execution of complex intervention tasks, such as ship hull inspection, infrastructure maintenance, cleaning, or sample collection. While remote ROV pilots often operate using monocular RGB camera streams, online 3D reconstruction of the vehicle workspace has been shown to reduce risks and increase operational tempo for piloted control [ 1 ] . For autonomous systems, online 3D scene reconstruction is critical for safely and accurately executing intervention tasks. Active range sensing techniques, including LiDAR, Time-of-Flight (ToF), and RGB-D cameras are extensively used in terrestrial applications for depth estimation and scene reconstruction. However, the effectiveness of these active sensors is reduced underwater, due to inherent attenuation and back-scattering effects [ 2 ] . Acoustic sensing, particularly forward-looking 2D imaging sonar, serves as an alternative underwater range sensor but provides only a top-down, 2D view, introducing elevation ambiguity. Recent developments in 3D imaging sonar show potential for operating similar to LiDAR in providing sparse point clouds. However, sonar sensors in general are limited in resolution and signal to noise ratio compared to their optical sensor counterparts. While previous studies [ 3 , 4 ] explored dense depth perception using imaging sonar, effectively utilising this sensing modality in online scene reconstruction remains an ongoing research challenge. RGB cameras with artificial lighting systems are widely employed underwater due to their simplicity and low cost relative to active sensors. Stereo camera systems provide strong feature matches and can efficiently estimate depth through stereo correlation, but their performance underwater is frequently compromised by poor textures, strong lighting effects, and low illumination. Additionally, the quality of stereo depth is sensitive to the chosen stereo baseline, which is subject to hardware and space constraints. Monocular cameras offer an alternative solution, being low-cost, compact, and easily integrated into various underwater robotic platforms, but they inherently lack scale information. Recent advancements in deep learning have driven substantial progress in monocular metric depth estimation [ 5 ] [ 6 ] , which motivates this work. Fig. 1 : Our proposed monocular depth estimation pipeline takes RGB images and sparse depth points as input and predicts dense metric depth maps. It shows great generalisation on underwater data and strong robustness against varying sparsity of the depth points. To address the challenges of underwater spatial perception, we propose SPADE : SP arsity A daptive D epth E stimator, a robust, compact, monocular depth estimation pipeline for underwater robotic applications. As illustrated in Fig. 1 , our approach demonstrates strong zero-shot generalization in underwater scenes and remains robust to varying levels of depth prior sparsity. The contributions in this paper include: • The development of a monocular underwater depth estimation pipeline that integrates a relative depth estimator with sparse depth priors to produce dense metric depth. • The introduction of the Cascade Conv-Deformable Transformer (CCDT) block, which combines convolutional and transformer modules for improved scale refinement. • The implementation of an efficient, real-time system achieving over 15 FPS on Jetson Orin NX. • The demonstration of improved performance on diverse underwater datasets relative to other state-of-the-art methods, especially when sparse depth measurements are limited. Our evaluation is available at: https:/github.com/Jayzhang2333/Sparsity-Adaptive-Depth-Estimator . II Related Work II-A Monocular Depth Estimation Supervised deep learning approaches have effectively learned to estimate relative depth maps by leveraging colour and geometric cues from images [ 6 , 5 , 7 ] . Current state-of-the-art monocular relative depth estimation models utilise transformer-based architectures, such as Vision Transformers (ViTs), coupled with specialized loss functions such as scale-invariant and scale-shift-invariant losses [ 5 ] . These models predict affine-invariant depth maps, which can be transformed into metric measurements if appropriate scaling information is available. These state-of-the-art models have been shown to generalise well across diverse scenes and varying environmental conditions through training on large scale mixed datasets [ 5 ] . More recently, a method based on stable diffusion also leverages latent encoders pre-trained on large-scale datasets to enhance generalisation performance [ 7 ] . While supervised relative depth estimation methods have achieved impressive zero-shot performance on underwater imagery, where training data is scarce [ 8 ] , naive metric scaling results in limited accuracy. Model performance in unseen environments can be substantially improved through transfer learning techniques that fine-tune on small, specialised datasets. However, this approach can lead to overfitting and reduced generalisation of the relative depth model [ 9 ] , particularly in underwater environments where variability is high. Nonetheless, these state-of-the-art relative models still encode strong knowledge of the general 3D scene structure, which can be leveraged for fine-grained depth prediction. II-B Depth Estimation with Sparse Measurements To resolve scale ambiguity, sparse depth priors from LiDAR measurements, stereo matching or visual-inertial odometry, are often projected into the camera frame and fused with RGB images to predict dense metric depth. Early fusion combines RGB images and sparse depth maps at the input, enabling the encoder to extract integrated features. State-of-the-art methods use both transformer and convolutional blocks to capture spatial detail and global context [ 10 ] . The approach proposed in [ 11 ] employs gated convolutions to transform the combined RGB and sparse depth input into rich feature representations. Alternatively, some approaches fuse sparse depth maps during the decoder stage by integrating enriched metric features into decoder feature maps at each stage [ 12 , 13 ] . Both fusion strategies frequently use refinement modules such as Spatial Propagation Networks (SPNs) [ 14 ] before the final output depth, which iteratively improve depth estimates based on pixel affinity maps from specialized decoder outputs. Although these approaches achieve good accuracy, they often overfit to specific scenarios, such as depth ranges, environments, or sensor-specific biases related to the distribution and range of sparse depth points [ 15 ] . Recent work has improved generalisation across range and environments by combining sparse depth measurements with vision backbones, relative depth estimators, or foundation models pretrained on large datasets [ 16 , 9 , 17 , 18 ] . The method most similar to ours is VI-Depth [ 9 ] , which uses a two-stage process:

Read the complete text