SAIP-Net: Enhancing Remote Sensing Image Segmentation via Spectral Adaptive Information Propagation
Zhongtao Wang, Xizhe Cao, Yisong Chen, Guoping Wang · 2025
Read SAIP-Net: Enhancing Remote Sensing Image Segmentation via Spectral Adaptive Information Propagation by Zhongtao Wang, Xizhe Cao, Yisong Chen, Guoping Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-16564.txt.
Introduction
Zhongtao Wang and three co-authors present a study from twenty twenty-five on labeling each pixel in satellite images by land type. Crisp edges and even traits in each class are both a must. Standard layered models blur edges and mix class traits. Their network, SAIP-Net, works in the wave band domain to sharpen both.
The net filters wave bands in a way that adapts to the image. It also widens the span each part of the net can see. Those two moves curb clashes in class traits and firm up edge lines. Tests show clear gains over the best known methods. The authors say wave aware design is a sound path for remote sensing labels.
Catalog record
| CREATOR | Zhongtao Wang, Xizhe Cao, Yisong Chen, Guoping Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-16564
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SAIP-Net: Enhancing Remote Sensing Image Segmentation via Spectral Adaptive Information Propagation Zhongtao Wang, Xizhe Cao, Yisong Chen, Guoping Wang Abstract Semantic segmentation of remote sensing imagery demands precise spatial boundaries and robust intra-class consistency, challenging conventional hierarchical models. To address limitations arising from spatial domain feature fusion and insufficient receptive fields, this paper introduces SAIP-Net, a novel frequency-aware segmentation framework that leverages Spectral Adaptive Information Propagation. SAIP-Net employs adaptive frequency filtering and multi-scale receptive field enhancement to effectively suppress intra-class feature inconsistencies and sharpen boundary lines. Comprehensive experiments demonstrate significant performance improvements over state-of-the-art methods, highlighting the effectiveness of spectral-adaptive strategies combined with expanded receptive fields for remote sensing image segmentation. Our code is available at https://github.com/ZhongtaoWang/SAIP-Net. Journal: Pattern Recognition Figure 1: Overview of the challenges and motivations behind SAIP-Net. Remote sensing images often exhibit large intra-class variance, small inter-class differences, and irregular class layouts. To address these challenges, SAIP-Net uses the combination of four modules to improve intra-class consistency and enhance boundary accuracy, significantly improving the segmentation of complex structures in remote sensing images. 1 Introduction Semantic segmentation of remote sensing images is a fundamental yet challenging task with profound implications in numerous critical applications, such as land-use classification, urban planning, agriculture monitoring, environmental assessment, and disaster management. Despite significant advances achieved through deep learning techniques, remote sensing imagery continues to pose distinct challenges that conventional hierarchical deep neural networks struggle to address adequately. Such challenges include diverse and complex textural features, significant variations in object scales, intricate boundaries, and the coexistence of highly structured urban areas alongside irregular natural landscapes. Existing segmentation approaches typically rely on hierarchical feature fusion methods operating primarily within the spatial domain. These conventional fusion methods often directly combine multi-scale feature representations obtained from various hierarchical levels through simple addition or concatenation. However, this spatial-domain fusion frequently leads to significant intra-class inconsistencies, primarily due to disturbances caused by unregulated high-frequency information. Moreover, such methods are typically hindered by boundary ambiguities and inaccuracies arising from blurred details and insufficient contextual information captured by limited receptive fields. To overcome these limitations, this paper introduces SAIP-Net, an innovative frequency-aware segmentation framework explicitly designed for remote sensing image analysis. At the core of our method is the novel concept of Spectral Adaptive Information Propagation, a mechanism that dynamically manipulates frequency-domain characteristics of image features. As shown in Figure 1 , SAIP-Net systematically employs adaptive spectral filtering techniques to mitigate disruptive high-frequency noise within semantic object regions, thereby significantly enhancing intra-class consistency. Simultaneously, our method incorporates frequency-aware processes to recover and sharpen high-frequency boundary details typically diminished during conventional downsampling and upsampling operations. Beyond frequency-domain enhancements, SAIP-Net also introduces strategies to substantially enlarge the receptive fields of feature extraction modules. Enlarged receptive fields facilitate more comprehensive contextual understanding by capturing extensive spatial interactions and dependencies, crucial for correctly identifying semantic classes at varying scales. By integrating frequency-domain processing and spatial contextual awareness, SAIP-Net significantly improves both feature representation consistency and boundary delineation accuracy. In conclusion, our contributions can be summarized as: 1. We introduced SAIP-Net, a frequency-aware segmentation framework that incorporates the novel Spectral Adaptive Information Propagation mechanism to address the inherent challenges of remote sensing image analysis. 2. By adaptively propagating spectral information and enlarging the receptive fields, our approach effectively eliminates disruptive high-frequency information within intra-class regions while preserving essential frequency-domain features along class boundaries, which results in substantially improved intra-class consistency and enhanced boundary accuracy. 3. Experimental results demonstrate that our proposed method significantly outperforms the baseline in semantic segmentation task on remote sensing images. 2 Related Work Semantic segmentation assigns semantic labels to each pixel and is widely applied in both natural and remote sensing images. While the two domains share foundational techniques, their data characteristics and task constraints differ significantly. Natural image segmentation focuses on perspective-view scenes with diverse objects and consistent contexts [ 41 ] , while remote sensing imagery features large-scale, top-down views with high intra-class variability, inter-class similarity, which requires domain-specific solutions [ 42 ] . 2.1 Semantic Segmentation in Natural Images Early methods, such as thresholding and region growing, were limited by image quality and computational constraints. The advent of deep learning, particularly Convolutional Neural Networks (CNNs) [ 3 ] and Fully Convolutional Networks (FCNs) [ 41 ] , enabled end-to-end pixel-level prediction, forming the basis for encoder-decoder architectures like U-Net [ 35 ] and SegNet [ 36 ] . These models extract high-level semantic features while preserving spatial resolution. Subsequent research addressed challenges such as class imbalance, small object detection, and complex backgrounds. Dilated convolutions [ 8 ] expanded receptive fields, while PSPNet [ 9 ] introduced pyramid pooling to aggregate multi-scale contextual information. Attention mechanisms, such as Coordinate Attention [ 7 ] , further refine segmentation, especially for small or complex objects. Additionally, unsupervised and semi-supervised approaches [ 4 , 5 ] have been explored to reduce reliance on large annotated datasets. 2.2 Semantic Segmentation in Remote Sensing Images Remote sensing segmentation faces unique challenges, including large-scale scenes, spectral diversity, and subtle intra-class variation. While FCN-based methods [ 11 , 12 , 13 , 14 , 15 , 16 ] remain prevalent, additional modules have been developed to enhance spatial and contextual feature extraction. Techniques like channel attention [ 17 ] and region-aware methods, such as S-RA-FCN [ 18 ] and HMANet [ 19 ] , address feature redundancy and spatial dependencies. Edge-aware strategies, like Edge-FCN [ 6 ] , improve boundary precision by incorporating edge detection. Recently, Transformer-based models [ 20 , 21 , 22 , 23 , 24 , 25 ] have gained attention for their ability to model long-range dependencies via self-attention. For instance, RSSFormer [ 21 ] introduces adaptive feature fusion to reduce background noise and enhance object saliency. However, Transformers still face challenges in capturing fine local details and accurately delineating object boundaries. 2.3 Frequency-domain Methods for Semantic Segmentation Frequency-domain feature processing has emerged as a promising direction in semantic segmentation. Shan et al. decomposed images via the Fourier transform into high and low frequency components [ 26 ] , which capture edge and body information respectively, ensuring object consistency and edge supervision through deep fusion. Zhang et al. proposed FsaNet [ 27 ] , leveraging a frequency self-attention mechanism on low-frequency components to drastically reduce computational costs. Chen et al. introduced Frequency-Adaptive Dilated Convolution (FADC) [ 28 ] , dynamically adjusting dilation rates by local frequency patterns and enhancing feature bandwidth/receptive fields via adaptive kernels and frequency selection. Their FreqFusion [ 1 ] further improves boundary sharpness and feature coherence for dense prediction tasks. Ma et al. developed AFANet [ 29 ] , optimizing semantic structures with a CLIP-guided spatial adapter to boost weakly-supervised few-shot segmentation. These advances underscore the transformative potential of frequency-aware strategies in semantic segmentation. Building on these works, our work proposes a novel approach named SAIP-Net. By adaptively propagating spectral information and enlarging the receptive fields, our approach substantially improved intra-class consistency and enhanced boundary accuracy, thereby significantly improving the segmentation of complex structures in remote sensing images. 3 Methods Figure 2: Overview of the proposed SAIP-Net architecture. The network combines: a Learnable High-Pass Filter Stem to enhance edge details, a Transformer Encoder that extracts global context via