Axial-Relation Guided Fusion State Space Model for Optical-Elevation Sensing Image Segmentation
Feng Gao, Member, IEEE, Zhilin Jin, Yanhai Gan, Junyu Dong, Member, IEEE · 2026
Read Axial-Relation Guided Fusion State Space Model for Optical-Elevation Sensing Image Segmentation by Feng Gao, Member, IEEE, Zhilin Jin, Yanhai Gan, Junyu Dong, Member, IEEE (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16768.txt.
Introduction
Gao and colleagues propose ARG-Mamba, a state-space framework for segmenting optical-elevation remote-sensing images. Existing methods struggle with multi-scale context and cross-modal fusion in complex high-resolution scenes. A multi-scale state-space module captures fine local detail and global context with linear complexity, while an axial-relation fusion module models cross-modal correlations along horizontal and vertical axes. On the ISPRS Vaihingen and Potsdam datasets, ARG-Mamba beats state-of-the-art methods while keeping computation favorable.
Catalog record
| CREATOR | Feng Gao, Member, IEEE, Zhilin Jin, Yanhai Gan, Junyu Dong, Member, IEEE |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22998 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.16768
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Axial-Relation Guided Fusion State Space Model for Optical-Elevation Sensing Image Segmentation Thanks: This work was supported in part by Key R & D Program of Shandong Province under Grant 2025CXPT185, and in part by the Natural Science Foundation of Shandong Province under Grant ZR2024MF020. ( Corresponding author: Yanhai Gan ) Feng Gao, Zhilin Jin, Yanhai Gan and Junyu Dong are with the State Key Laboratory of Physical Oceanography, Ocean University of China, Qingdao 266100, China. (email: [email protected]) Qian Du is with the Department of Electrical and Computer Engineering, Mississippi State University, Starkville, MS 39762 USA. Feng Gao, Member, IEEE, Zhilin Jin, Yanhai Gan, Junyu Dong, Member, IEEE Abstract Semantic segmentation of multi-source remote sensing images is a fundamental task for Earth observation applications. Existing methods often struggle with insufficient multi-scale context modeling and suboptimal cross-modal feature fusion, limiting their performance in complex high-resolution scenes. To this end, we propose Axial-Relation Guided Fusion Mamba (ARG-Mamba), a state space model–based framework for optical-elevation remote sensing image segmentation. Specifically, we introduce a Multi-Scale State Space Module to capture both fine-grained local details and global contextual dependencies with linear computational complexity. Moreover, an Axial-Relation Guided Fusion Module is designed to explicitly model global cross-modal correlations along horizontal and vertical axes, enabling efficient feature fusion between optical and elevation modalities. Extensive experiments conducted on the ISPRS Vaihingen and Potsdam datasets demonstrate that our ARG-Mamba consistently outperforms state-of-the-art methods while maintaining favorable computational efficiency. The code will be made publicly available at https://github.com/oucailab/ARG-Mamba . I Introduction Semantic segmentation of high-resolution remote sensing imagery plays a critical role in numerous Earth observation applications, such as urban planning, land cover mapping, and disaster management [ 9 ] . Most existing semantic segmentation methods are primarily developed based on optical remote sensing images, which mainly capture spectral and textural information of surface materials [ 3 ] . However, relying solely on optical imagery often leads to limited segmentation performance in complex scenes. In contrast, elevation data from digital surface model (DSM) provide complementary geometric and structural cues, which are highly discriminative for distinguishing land-cover categories [ 2 ] . Therefore, in this letter, we mainly focus on optical-elevation remote sensing image segmentation. Fig. 1: The overall architecture of ARG-Mamba . It is a dual-stream encoder–decoder framework for optical-elevation semantic segmentation. It processes optical and DSM inputs in parallel using hierarchical Visual State Space Blocks (VSSBs) and Multi-Scale State Space Modules (MS-SSMs) to efficiently capture long-range dependencies with linear complexity. At each encoder stage, an Axial-Relation Guided Fusion Module (ARGFM) explicitly models global cross-modal correlations via axial relations, enabling progressive interaction between modalities. Numerous remote sensing image semantic segmentation models have been proposed based on convolutional neural networks (CNNs) and Transformer architectures [ 11 ] . In terms of multi-modal interaction, fusion strategies vary from early concatenation [ 13 ] to complex feature-level integration. Edge-guided convolution [ 6 ] , multi-scale modeling [ 14 ] , and attentive frequency decoupling [ 7 ] have been employed for complex contextual feature modeling. Recently, newly emerged state space models (SSMs), particularly Mamba [ 5 ] , have demonstrated strong capability in capturing long-range dependencies with linear computational complexity. SSMs have achieved competitive performance while offering excellent efficiency advantages across a wide range of remote sensing data interpretation tasks [ 4 ] . Leveraging SSMs for optical-elevation remote sensing image segmentation is a non-trivial task due to the following two challenges: (1) Insufficient exploitation of multi-scale spatial information. Remote sensing images inherently exhibit strong multi-scale characteristics. While most SSM-based methods typically operate on a single-scale token sequence, making it difficult to simultaneously capture fine-grained local details and coarse global contextual cues. (2) Cross-modal complementarity between optical and elevation data needs to be enhanced. Optical images capture rich spectral and texture cues, while elevation data encode critical geometric and structural characteristics. The semantic relevance of optical and elevation features varies across object categories, requiring adaptive and context-aware fusion. To address the abovementioned challenges, we propose A xial- R elation G uided Fusion Mamba ( ARG-Mamba ) network for optical-elevation remote sensing image segmentation. First, to enhance multi-scale feature representation, we propose the Multi-Scale State Space Module (MS-SSM) . By performing state space modeling at different spatial scales, MS-SSM captures both long-range global dependencies and fine-grained local structures. Second, to enhance cross-modal complementarity, we present the Axial-Relation Guided Fusion Module (ARGFM) . It models contextual relations along horizontal and vertical axes to fuse heterogeneous features. By leveraging axial relations, ARGFM effectively captures long-range structural dependencies across modalities. The contributions of our ARG-Mamba are threefold: • We propose ARG-Mamba framework for multi-source remote sensing image segmentation, which integrates state space models with explicit axial-relation guided fusion to efficiently capture long-range dependencies. • MS-SSM is introduced to address the scale variation in high-resolution remote sensing images, enabling joint modeling of fine-grained local details and global contextual information in a unified framework. • Extensive experiments are conducted on two widely used benchmark optical-elevation datasets. The results demonstrate that our ARG-Mamba outperforms state-of-the-art methods. II Methodology The framework of Axial-Relation Guided Fusion Mamba (ARG-Mamba) network is shown in Fig. 1 . It is a dual-stream encoder-decoder network designed for optical-elevation semantic segmentation. It integrates SSM with explicit axial-relation guided fusion, enabling efficient long-range dependency modeling and effective cross-modal interaction throughout the network hierarchy. Specifically, the encoder adopts a two-branch architecture, and each branch consists of four hierarchical stages with progressively reduced spatial resolution. Each stage is composed of a Visual State Space Block (VSSB) [ 8 ] and a Multi-Scale State Space Module (MS-SSM), which jointly capture both local context and long-range dependencies with linear computational complexity. To enable effective cross-modal interaction, an Axial-Relation Guided Fusion Module (ARGFM) is inserted between corresponding stages of the encoders. ARGFM explicitly models global cross-modal correlations by decomposing dense relations into axial (row-wise and column-wise) interactions, allowing optical and elevation features to be mutually enhanced in a structured and efficient manner. In the decoder, high-level fused features are gradually upsampled and refined through a sequence of decoder blocks. Deep supervision is applied by attaching auxiliary prediction heads at multiple decoder stages. Fig. 2: Illustration of the Multi-Scale State Space Module (MS-SSM). II-A Multi-Scale State Space Module (MS-SSM) Details of the MS-SSM is shown in Fig. 2 . It has similar architecture of VSSB in VMamba [ 8 ] . Meanwhile, the S6 block in Mamba is substituted with the newly proposed multi-scale selective scan (MS-SS2D). To be specific, we employ multiple scanning scales, denoted as \{s_{i}\}^{N}_{i=1} . Given an input feature map x\in\mathbb{R}^{C\times H\times W} , we split the x into N sub-features \{x_{i}\}^{N}_{i=1} along the channel dimension. For the sub-feature x_{i} with scan scale s_{i} , we divide x_{i} into \frac{H}{s_{i}}\times\frac{W}{s_{i}} non-overlapping windows. Then, the SSM scanning is performed within the windows, resulting in the scan input \bar{x}_{i} . The local window scan restricts scanning distance to minimize attenuation and noise between tokens. For all sub-features, we utilize the two-way scanning method to generate features at the specified scale. Although employing more scanning directions could potentially capture richer spatial relations, we restrict it to two-way scanning to minimize computational redundancy across multiple scales, ensuring the efficiency of MS-SSM. This method generates two