Multi-Modal Robust Enhancement for Coastal Water Segmentation: A Systematic HSV-Guided Framework
Zhen Tian, Christos Anagnostopoulos, Qiyuan Wang, Zhiwei Gao · 2025
Read Multi-Modal Robust Enhancement for Coastal Water Segmentation: A Systematic HSV-Guided Framework by Zhen Tian, Christos Anagnostopoulos, Qiyuan Wang, Zhiwei Gao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-08694.txt.
Introduction
Drawing the line between land and coastal water in satellite images sounds easy until tides, mud, and glare confuse the colors. Zhen Tian and 3 co-authors present a robust segmentation framework in a 2025 research paper. Standard red-green-blue approaches train unstably and generalize poorly across maritime settings. Their Robust U-Net supervises learning in HSV color space, which separates color from brightness.
Five components work together: color supervision, gradient-based coastline refinement, shape cleanup, sea area cleanup, and connectivity control. Careful ablation tests show the color supervision contributes the most. The full framework cut training variance dramatically and improved segmentation quality across metrics, while staying computationally light. Code and configurations are public. Reliable coastal maps feed flood planning, habitat monitoring, and navigation chart updates, so steadier training is a practical win.
Catalog record
| CREATOR | Zhen Tian, Christos Anagnostopoulos, Qiyuan Wang, Zhiwei Gao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-08694
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-Modal Robust Enhancement for Coastal Water Segmentation: A Systematic HSV-Guided Framework Zhen Tian, Christos Anagnostopoulos, Qiyuan Wang, Zhiwei Gao Abstract Coastal water segmentation from satellite imagery presents unique challenges due to complex spectral characteristics and irregular boundary patterns. Traditional RGB-based approaches often suffer from training instability and poor generalization in diverse maritime environments. This paper introduces a systematic robust enhancement framework, referred to as Robust U-Net, that leverages HSV color space supervision and multi-modal constraints for improved coastal water segmentation. Our approach integrates five synergistic components: HSV-guided color supervision, gradient-based coastline optimization, morphological post-processing, sea area cleanup, and connectivity control. Through comprehensive ablation studies, we demonstrate that HSV supervision provides the highest impact (0.85 influence score), while the complete framework achieves superior training stability (84% variance reduction) and enhanced segmentation quality. Our method shows consistent improvements across multiple evaluation metrics while maintaining computational efficiency. For reproducibility, our training configurations and code are available here 1 1 1 https://github.com/UofgCoastline/ICASSP-2026-Robust-Unet . † † address: 1 School of Computing Science, University of Glasgow 2 School of Computing Engineering, University of Glasgow 1 Introduction Coastal water segmentation from satellite and aerial imagery is a core task in remote sensing, with applications in environmental monitoring, climate studies, and coastal management [ 1 ] . Traditional RGB-based methods struggle in maritime scenes due to spectral variability, atmospheric effects, and complex shorelines [ 2 , 3 , 4 ] . Deep learning methods, especially U-Net variants, achieve strong results in semantic segmentation [ 5 ] . However, for coastal waters, they face several issues: (1) unstable training from class imbalance and spectral similarity, (2) weak boundary detection in complex coasts, (3) false positives in deep sea, and (4) unrealistic coastline connectivity [ 6 , 7 , 8 , 9 , 10 , 11 ] . Our key idea is that water bodies show clear patterns in the HSV color space [ 12 ] , with lower saturation and stable hue ranges across lighting and water types. In addition, coastal boundaries follow geometric rules that can guide segmentation. Our contribution is summarized as follows: • We prove that each loss component is Lipschitz continuous, and that the composite objective ensures convergence of gradient descent (Theorem 1 in Section 3.2), thereby guaranteeing reliable optimization. • We show that these spectral–geometric constraints shrink the effective hypothesis space (Theorem 2 in Section 3.2), providing theoretical support for their stabilizing role in water–land separation. • We provide comprehensive experiments that demonstrate clear performance gains over state-of-the-art baselines in both stability and boundary accuracy. 2 Related Work 2.1 Deep Learning for Water Segmentation Traditional water segmentation methods relied on spectral indices such as NDWI and MNDWI [ 13 , 14 ] . With the advent of deep learning, convolutional neural networks have become the dominant approach. U-Net [ 15 ] and its variants have shown particular success in biomedical and remote sensing applications. Recent works have explored various architectural improvements including attention mechanisms [ 16 ] , multi-scale fusion [ 17 ] , and encoder-decoder enhancements. However, most approaches ignore addressing the fundamental challenges of color space representation and training stability. 2.2 Color Space Utilization While RGB remains the standard representation, alternative color spaces have demonstrated advantages in specific applications. HSV color space has been successfully applied in object tracking [ 18 ] , and agricultural monitoring [ 19 ] . However, its systematic integration into deep learning frameworks for water segmentation remains underexplored. 2.3 Robust Training in Semantic Segmentation Training stability in semantic segmentation has gained attention due to gradient instability and convergence issues. Various regularization techniques including label smoothing, focal loss, and consistency training have been proposed. Our work differs in that we explicitly integrate spectral priors using HSV-based supervision and geometric constraints into the training objective. Unlike generic regularization, these domain-informed components reduce the effective hypothesis space and enforce spatial coherence, leading to more stable and interpretable convergence, as will be shown in our evaluation. 3 Methodology We introduce a novel framework, coined Robust U-Net, for robust coastline delineation that integrates physics-informed supervision, geometric regularization, and regional consistency enforcement. Robust U-Net is grounded in two fundamental theoretical properties that ensure convergence guarantees and hypothesis space reduction, providing both theoretical rigor and practical effectiveness for coastal boundary extraction in satellite imagery. 3.1 Overview Let \mathbf{I}\in\mathbb{R}^{H\times W\times 3} be an input satellite image of dimensions H\times W with three RGB channels. Our objective is to learn a mapping f_{\theta}:\mathbb{R}^{H\times W\times 3}\rightarrow[0,1]^{H\times W} parameterized by \theta , which produces a water probability mask \mathbf{M}=f_{\theta}(\mathbf{I}) , where M_{ij} represents the probability that pixel (i,j) belongs to a water region. Our methodology achieves robust coastline delineation through a synergistic design of multiple loss components and post-processing, formulated as a unified optimization problem that balances semantic accuracy, spectral consistency, geometric regularity, and spatial coherence. 3.2 Theoretical Guarantees We provide two theoretical results that formalize the robustness of our framework. The first establishes the convergence properties of our composite loss, while the second demonstrates how spectral and geometric priors reduce the effective hypothesis space. Proof sketches are provided below; full technical details of the proofs are omitted due to space limitations. Theorem 1 (Convergence Guarantee) . Each component loss \mathcal{L}_{i} in our framework is Lipschitz continuous with constant L_{i} , ensuring that the composite objective satisfies \|\mathcal{L}_{Robust}(\mathbf{M}_{1})-\mathcal{L}_{Robust}(\mathbf{M}_{2})\|\leq L\|\mathbf{M}_{1}-\mathbf{M}_{2}\| (1) where L=\max_{i}\lambda_{i}L_{i} and \lambda_{i} are the loss balancing coefficients. This guarantees convergence of gradient descent to a stationary point at rate O(1/\sqrt{T}) , for T iterations. Sketch of Proof. The result follows from the Lipschitz continuity of each \mathcal{L}_{i} , which ensures bounded gradient differences. The composite objective inherits Lipschitz continuity with constant L=\max_{i}\lambda_{i}L_{i} . By standard convergence analysis of stochastic gradient descent on Lipschitz-continuous nonconvex objectives [ 20 ] , this leads to O(1/\sqrt{T}) convergence to a stationary point. Due to space limitations, we omit the full technical details. ∎ Theorem 2 (Hypothesis Space Reduction) . The combined influence of spectral priors and geometric regularizers reduces the effective hypothesis space according to \mathcal{H}_{\text{Reduced}}\approx\rho\cdot\mathcal{H}_{\text{Full}} (2) where \rho\propto\operatorname{Corr}(\text{HSV features},\text{true water labels}) quantifies the correlation between HSV-based indicators and ground truth water labels, and \operatorname{Corr}(\cdot) denotes statistical correlation. Sketch of Proof. Domain-informed priors act as additional inductive bias, constraining the hypothesis space to models consistent with spectral and geometric properties. Formally, introducing constraints K yields a reduced space H^{\prime}=\{h\in H:h\models K\} with H^{\prime}\subseteq H . Hence, the effective complexity scales with the strength of correlation \rho between priors and ground-truth labels. This parallels results on hypothesis space reduction via domain knowledge [ 21 ] . We omit the full proofs because of space limitations. ∎ 3.3 Physics-Informed HSV Supervision We incorporate domain-specific color priors through HSV color space analysis, thus, leveraging the physical properties of water spectral signatures. For each pixel (i,j) , we convert the RGB values to HSV representation (H_{ij},S_{ij},V_{ij}) and compute a physics-informed water likelihood: P_{HSV}(i,j)=\sigma\!\left(\alpha_{H}H_{ij}+\alpha_{S}S_{ij}+\alpha_{V}V_{ij}+\beta\right) (3) where \sigma(\cdot) is the sigmoid function, \{\alpha_{H},\alpha_{S},\alpha_{V},\beta\} are learnable coefficients that capture the statistical relationship between HSV values and water presence, and P_{HSV}(i,j)\in[0,1] represents the HSV-based water probability. The HSV-guided supervision loss is then formulated as: \mathcal{L}_{HSV}=\frac{1}{HW}\sum_{i=1}^{H}\sum_{j=1}^{W}\left|m_{ij}-P_{HSV}(i,j)\right|^{2}\cdot w_{ij} (4) where m_{ij}=M_{ij} is the predicted water probability at pixel (i,j) , and w_{ij} is an adaptive confidence weight defined as: w_{ij}=\exp\!\left(-\frac{d_{HSV}(i,j)^{2}}{2\sigma^{2}}\right)