Depth Jitter: Seeing through the Depth
Md Sazidur Rahman, David Cabecinhas, Ricard Marxer · 2025
Read Depth Jitter: Seeing through the Depth by Md Sazidur Rahman, David Cabecinhas, Ricard Marxer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06227.txt.
Introduction
Md Sazidur Rahman, David Cabecinhas, and Ricard Marxer propose a new training trick that teaches vision models to cope with depth shifts. Their paper appeared in two thousand twenty-five. Depth maps guide robots, subsea cameras, and self-driving cars. Yet common training tricks only shuffle color or shape, not depth.
Their method, Depth Jitter, nudges the depth values in training images by small, smart amounts. The size of each nudge follows how much the depth already varies in the scene. The shape of the scene stays intact while the depths feel new. Tests on two sea-image data sets show steadier models under changed depth. The trick did not always top color tricks on raw scores, but it held up better where depth rules. The code is shared in public for others to build on.
Catalog record
| CREATOR | Md Sazidur Rahman, David Cabecinhas, Ricard Marxer |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-06227
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Depth Jitter: Seeing through the Depth Md Sazidur Rahman, David Cabecinhas, Ricard Marxer Abstract Depth information is essential in computer vision, particularly in underwater imaging, robotics, and autonomous navigation. However, conventional augmentation techniques overlook depth aware transformations, limiting model robustness in real world depth variations. In this paper, we introduce Depth-Jitter, a novel depth-based augmentation technique that simulates natural depth variations to improve generalization. Our approach applies adaptive depth offsetting, guided by depth variance thresholds, to generate synthetic depth perturbations while preserving structural integrity. We evaluate Depth-Jitter on two benchmark datasets, FathomNet and UTDAC2020 demonstrating its impact on model stability under diverse depth conditions. Extensive experiments compare Depth-Jitter against traditional augmentation strategies such as ColorJitter, analyzing performance across varying learning rates, encoders, and loss functions. While Depth-Jitter does not always outperform conventional methods in absolute performance, it consistently enhances model stability and generalization in depth-sensitive environments. These findings highlight the potential of depth-aware augmentation for real-world applications and provide a foundation for further research into depth-based learning strategies. The proposed technique is publicly available to support advancements in depth-aware augmentation. The code is publicly available on github . I Introduction Marine life significantly predates terrestrial life, with evidence suggesting its origins approximately 3.7 billion years ago [ 1 ] , while terrestrial life emerged around 3.1 billion years ago [ 2 ] . The fossil record further indicates that marine biodiversity has outpaced terrestrial diversity for most of Earth’s history [ 3 ] . Covering 71% of the planet, oceans serve as vast ecosystems that support immense species richness, aligning with biogeographic theories linking habitat size to biodiversity [ 4 ] . Despite its ecological significance, deep-sea research is hindered by extreme conditions, high costs, and technological limitations. Traditional exploration relies on resource-intensive submersibles and remotely operated vehicles (ROVs), but recent advancements in Autonomous Underwater Vehicles (AUVs) and submarine gliders, equipped with acoustic sensors and high-resolution imaging, have greatly expanded deep-sea mapping capabilities [ 5 , 6 , 7 , 8 ] . The integration of deep learning has further enhanced underwater research, automating species identification, debris classification, and habitat assessment. Convolutional Neural Networks (CNNs) enable AUVs to autonomously analyze marine environments, streamlining biodiversity monitoring and conservation efforts by reducing the need for manual analysis. This study is motivated by the vast, unexplored deep ocean, which harbors rare species and plays a vital role in global ecological processes. Traditional marine observation methods are constrained by human accessibility, environmental factors, and financial constraints. To address these challenges, we propose integrating deep learning with depth-aware image augmentation techniques, enhancing underwater image analysis and classification. Ultimately, this research seeks to advance deep-sea exploration by leveraging AI-driven methodologies. By improving species recognition and underwater scene interpretation, our approach contributes to marine biodiversity research, conservation, and a deeper understanding of Earth’s least explored frontier. I-A Contribution This research explores techniques to enhance underwater object classification by leveraging multilabel classification and depth-aware augmentation. The key contributions of this work are as follows: • We propose a novel depth-based augmentation technique tailored for underwater datasets, designed to improve the robustness and accuracy of object classification and detection in varying underwater conditions. • We establish a comprehensive benchmark on two diverse underwater datasets, demonstrating the effectiveness of our proposed augmentation method. This benchmark serves as a foundation for future research in depth-aware learning for underwater computer vision. • We analyze the impact of depth-aware transformations on multilabel classification performance, providing valuable insights into augmentation strategies for deep-sea imaging and marine biodiversity monitoring. II Background II-A Multi-label Classification Multi-label classification assigns more than one label to an image, making it particularly useful for underwater environments where multiple species or objects may coexist within a scene. Early approaches, such as Binary Relevance (BR) [ 9 ] , treated each label as an independent classification task. While simple, this method ignored label correlations, limiting its effectiveness. Classifier Chains (CC) [ 10 ] addressed this limitation by modeling dependencies between labels, whereas RAkEL [ 11 ] introduced a randomized ensemble approach to improve label correlation modeling. Recent advancements have integrated deep learning with label dependency structures. The CNN-RNN framework [ 12 ] combines convolutional neural networks (CNNs) for feature extraction with recurrent neural networks (RNNs) to capture label dependencies. Feng Zhu et al. [ 13 ] proposed a Spatial Regularization Network, which models spatial relationships among labels, enhancing classification performance. Renchun You et al. [ 14 ] introduced a framework utilizing cross-modality attention and semantic graph embeddings to improve multi-label classification, demonstrating state-of-the-art results in complex environments. II-B Underwater Object Detection and Classification Object detection in underwater environments presents unique challenges due to variable lighting, visibility degradation, and the dynamic movement of marine organisms. Traditional techniques relied on manually engineered features [ 15 ] , but these approaches struggled with real-world adaptability due to their dependence on domain-specific heuristics. The advent of deep learning has significantly improved underwater object detection by enabling models to learn data-driven feature representations. Wu et al. [ 16 ] investigated the impact of illumination on underwater detection performance, revealing that light variations significantly affect model accuracy. Peng et al. [ 17 ] reviewed deep learning-based preprocessing techniques, highlighting that while they enhance visibility, architectural advancements and domain-specific integration remain key areas for improvement. Recently, Jian et al. [ 18 ] conducted a comprehensive survey on object detection and tracking techniques in underwater imaging, providing a comparative analysis of existing methodologies. II-C Improving Model Robustness through Data Augmentation Data augmentation plays a crucial role in enhancing model robustness, particularly in challenging underwater environments where data collection is expensive and logistically complex. Augmentation techniques artificially expand datasets, improving generalization to unseen conditions. Geometric transformations such as rotation, scaling, and flipping help models learn invariance to different perspectives. Color transformations (e.g., brightness, contrast, hue adjustments) simulate underwater lighting variations, a key challenge in marine imaging. Cutout techniques, where random portions of an image are obscured, improve robustness to occlusion caused by marine organisms or vegetation. Additionally, Generative Adversarial Networks (GANs) have been explored for generating synthetic underwater imagery, augmenting training datasets where real-world data is scarce. Such approaches, when integrated with traditional augmentations, significantly enhance the robustness, adaptability, and classification performance of models in complex underwater conditions. III Methodology Underwater imagery poses challenges due to light absorption and scattering, leading to inconsistent colors and degraded object visibility. This variability complicates object classification in marine environments.To enhance model robustness, we introduce a depth-aware augmentation technique based on underwater image formation models. Our method estimates scene depth and extracts key imaging parameters, applying depth offsets to re-render images with realistic underwater variability. This augmentation enriches the training set, improving species classification by increasing resilience to domain shifts. Additionally, we implement stratified sampling to address class imbalance in multi-label classification, ensuring better representation of underrepresented species and reducing bias toward dominant classes. III-A Underwater Image Formation Model Underwater imaging is affected by light absorption and scattering , which distort colors based on object distance and water properties. To correct these distortions, we utilize the Underwater Image Formation Model (UIFM) [ 19 ] , which describes how light interacts with the medium. The observed underwater image intensity is given by: I_{c,p}=J_{c,p}e^{-\beta_{c}z_{p}}+B_{c}(1-e^{-\gamma_{c}z_{p}}), (1) where: •