Multitask GLocal OBIA-Mamba for Sentinel-2 Landcover Mapping

Zack Dewis, Yimin Zhu, Zhengsen Xu, Mabel Heffring, Saeid Taleghanidoozdoozan, Kaylee Xiao, Motasem Alkayid, Lincoln Linlin Xu · 2025

Read Multitask GLocal OBIA-Mamba for Sentinel-2 Landcover Mapping by Zack Dewis, Yimin Zhu, Zhengsen Xu, Mabel Heffring, Saeid Taleghanidoozdoozan, Kaylee Xiao, Motasem Alkayid, Lincoln Linlin Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-10604.txt.

Introduction

Zack Dewis and seven co-authors present a land cover mapping system for Sentinel-2 satellite imagery, where classification is hampered by spatial heterogeneity, ambiguous spectral signatures, and the need for context. Their model, called MSOM, combines object-based image analysis with a Mamba sequence architecture in a multitask design.

Superpixels serve as the model's tokens, cutting redundant computation while preserving fine detail. A dual-branch design pairs convolutional layers for local detail with Mamba blocks for global context, and a multitask loss balances local precision against global consistency. Tested on imagery from Alberta, Canada, against several advanced methods, the system achieved higher classification accuracy and finer detail than the state-of-the-art alternatives it was compared with.

Catalog record

CREATORZack Dewis, Yimin Zhu, Zhengsen Xu, Mabel Heffring, Saeid Taleghanidoozdoozan, Kaylee Xiao, Motasem Alkayid, Lincoln Linlin Xu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-10604

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multitask GLocal OBIA-Mamba for Sentinel-2 Landcover Mapping Zack Dewis, Yimin Zhu, Zhengsen Xu, Mabel Heffring, Saeid Taleghanidoozdoozan, Kaylee Xiao, Motasem Alkayid, Lincoln Linlin Xu Abstract Although Sentinel-2 based land use and land cover (LULC) classification is critical for various environmental monitoring applications, it is a very difficult task due to some key data challenges (e.g., spatial heterogeneity, context information, signature ambiguity). This paper presents a novel Multitask Glocal OBIA-Mamba (MSOM) for enhanced Sentinel-2 classification with the following contributions. First, an object-based image analysis (OBIA) Mamba model (OBIA-Mamba) is designed to reduce redundant computation without compromising fine-grained details by using superpixels as Mamba tokens. Second, a global-local (GLocal) dual-branch convolutional neural network (CNN)-mamba architecture is designed to jointly model local spatial detail and global contextual information. Third, a multitask optimization framework is designed to employ dual loss functions to balance local precision with global consistency. The proposed approach is tested on Sentinel-2 imagery in Alberta, Canada, in comparison with several advanced classification approaches, and the results demonstrate that the proposed approach achieves higher classification accuracy and finer details that the other state-of-the-art methods. Fig. 1: Traditional Mamba approaches (Top) treat each pixel as a token, and scan the tokens in a fixed, predefined, dense and rigid manner, whereas our OBIA-Mamba approach (bottom) treat superpixels/objects as tokens, and builds token sequence in a dynamic, learnable, sparse and adaptable manner, leading to reduced computational cost, improved edge preservation and enhanced longer-range, larger-scale modelling capabilities. I Introduction The classification of satellite images into accurate pixel-level land use and land cover (LULC) maps is essential for various key applications, such as biodiversity monitoring, urban planning, and environmental management. Nevertheless, accurate and efficient extraction of precise LULC information is challenging due to some key sentinel-2 data characteristics (e.g., spatial heterogeneity, context information, signature ambiguity). Addressing these challenges requires advanced machine learning (ML) and deep learning (DL) models that can accurately learn the most discriminative features for improving classification performances [ 10 ] Traditional feature extraction methods like Random Forest (RF) and XGBoost have been widely used in LULC classification, relying on engineered features and statistical correlations derived from spectral profiles [ 9 ] . However, such approaches are fundamentally knowledge-driven and often lack the flexibility for adaptive feature learning, limiting their performance in diverse geographical contexts [ 1 ] . This limitation has prompted a shift towards more sophisticated feature learning frameworks utilizing ML & DL techniques better suited to handle the intricate and multi-dimensional nature of Sentinel-2 remote sensing data. Recent advances in deep learning, particularly through the adoption of Convolutional Neural Networks (CNNs), have significantly enhanced the feature extraction capabilities of LULC characteristics. CNNs can effectively capture local spatial patterns due to their hierarchical structure and shared weights for convolutional operations. Fully convolutional networks, such as U-Net, have demonstrated accurate results, especially in complex classification tasks [ 7 ] . However, the inherent locality bias of CNNs can limit their ability to capture longer-range spatial dependencies, essential for accurate LULC mapping [ 5 ] . To address the challenges posed by local context limitations, transformer architectures have emerged as a viable alternative. They take advantage of self-attention mechanisms that allow models to focus on global features across entire images, which can significantly enhance the learning of large-scale spatial relationships within LULC classification tasks [ 3 ] . However, transformer models have large computational cost, especially in large-scale applications with long input sequence [ 6 ] . The Mamba models, as a state space approach, are gaining popularity for their ability to maintain high computational efficiency while effectively modeling long-range dependencies, which is crucial in remote sensing analysis [ 4 ] . Nonetheless, optimally constructing token sequences that balance efficiency with the completeness of semantic information remains a significant challenge for Mamba models. Traditional Mamba methods often utilize predetermined scanning systems, which leads to inadequate representation of spatial structures [ 8 ] . Although pixel-level Mamba can better preserve local details, it requires large computational cost. In contrast, patch-based Mamba methods, although have less computational costs, tend to erase critical local detail information (e.g., edges, boundaries and small features) [ 2 ] . Given the drawbacks of pixel Mamba and patch Mamba, how to use superpixel-based Mamba to strike a good balance between computational efficiency and detail preservation is a critical research topic [ 11 ] . The integration of superpixels with Mamba can also revolutionize the traditional object-based image analysis (OBIA) techniques, which are widely used in remote sensing image analysis [ 9 ] . Although traditional OBIA can better capture local structure information, they are inefficient in terms of (1) learning the features to represent the objects/superpixels, and (2) use global attention models (e.g., transformers and mamba) to model the global correlation among the objects/superpixels [ 12 ] . The integration of OBIA with Mamba models in a CNN-Mamba GLocal framework can better address these two challenges and thereby greatly improve the traditional OBIA approach using modern deep learning architectures. Fig. 2: The proposed OBIA Mamba is a GLocal dual branch architecture that features a local resnet branch and a global OBIA-Mamba. The OBIA-Mamba branch leverages superpixels, which reduces redundant computation by replacing pixel scanning with superpixel scanning. The GLocal architecture is joined together to produce a map that jointly models local spatial details and global contextual information. A multitask loss guides both the local and global branches to balance the local precision and global consistency. This paper presents a novel Multitask Glocal OBIA-Mamba (MSOM) for enhanced Sentinel-2 classification with the following contributions. • First, an OBIA Mamba model (OBIA-Mamba) is designed to reduce redundant computation without compromising fine-grained details by using superpixels as Mamba tokens, seen in Figure 1 . • Second, a global-local (GLocal) dual-branch CNN-mamba architecture is designed to jointly model local spatial detail and global contextual information. • Third, a multitask optimization framework is designed to employ dual loss functions to balance local precision with global consistency. The proposed approach is tested on Sentinel-2 imagery in Alberta, Canada, in comparison with several advanced classification approaches, and the results demonstrate that the proposed approach achieves higher classification accuracy and finer details that the other state-of-the-art methods. The remainder of the paper is organized as follows. Section II illustrates the details of the proposed MSOM approach. Section III presents the experimental design and results. Section IV concludes this study. II Methodology II-A Model Overview Figure 2 shows that proposed model is a dual branch Global-Local (GLocal) architecture, with a local resnet branch and a global OBIA-Mamba branch, and a feature fusion module at the last stage to produce a final output. A multi-task loss is designed to supervise both the output from local branch and the output from the global branch. The input Y is a sentinel-2 patch denoted by \mathbf{x}\in\mathbb{R}^{B\times C\times H\times W} , with the output map of size H\times W\times K , where K is the number of classes. II-B Global OBIA-Mamba Module The OBIA-Mamba module begins with object-based segmentation to change input images into homogeneous regions. We extract the first 3 principal components (PC) of the Sentinel-2 image, which are used as input to the Simple Linear Iterative Clustering (SLIC) algorithm to generate superpixels. The resulting superpixels

Read the complete text