Center-guided Classifier for Semantic Segmentation of Remote Sensing Images
Wei Zhang, Mengting Ma, Yizhen Jiang, Rongrong Lian, Zhenkai Wu, Kangning Cui, Xiaowen Ma · 2025
Read Center-guided Classifier for Semantic Segmentation of Remote Sensing Images by Wei Zhang, Mengting Ma, Yizhen Jiang, Rongrong Lian, Zhenkai Wu, Kangning Cui, Xiaowen Ma (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-16963.txt.
Introduction
Zhang and six co-authors set out CenterSeg, a label tool guided by class centers, for pixel-by-pixel labeling of satellite shots, in work from twenty twenty-five. Shots from space swing a lot inside a single land class, so tagging each pixel is hard. The usual softmax label tool teaches pixels by a side path and picks in a fog. CenterSeg builds a set of prototypes for each class, from local pixel centers.
The prototypes update by hard picks and momentum, fed by the true masks. A Grassmann manifold rule, with two extra checks, shapes the space of pixel traits and prototypes. At run time, a prototype can be held to a real training shot, so a human can read the choice. Tests on three data sets back the top scores. A plain build, a light frame, and a fit with other tools add to its draw.
Catalog record
| CREATOR | Wei Zhang, Mengting Ma, Yizhen Jiang, Rongrong Lian, Zhenkai Wu, Kangning Cui, Xiaowen Ma |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-16963
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Center-guided Classifier for Semantic Segmentation of Remote Sensing Images Wei Zhang, Mengting Ma, Yizhen Jiang, Rongrong Lian, Zhenkai Wu, Kangning Cui, Xiaowen Ma Abstract Compared with natural images, remote sensing images (RSIs) have the unique characteristic. i.e., larger intraclass variance, which makes semantic segmentation for remote sensing images more challenging. Moreover, existing semantic segmentation models for remote sensing images usually employ a vanilla softmax classifier, which has three drawbacks: (1) non-direct supervision for the pixel representations during training; (2) inadequate modeling ability of parametric softmax classifiers under large intraclass variance; and (3) opaque process of classification decision. In this paper, we propose a novel classifier (called CenterSeg) customized for RSI semantic segmentation, which solves the abovementioned problems with multiple prototypes , direct supervision under Grassmann manifold , and interpretability strategy . Specifically, for each class, our CenterSeg obtains local class centers by aggregating corresponding pixel features based on ground-truth masks, and generates multiple prototypes through hard attention assignment and momentum updating. In addition, we introduce the Grassmann manifold and constrain the joint embedding space of pixel features and prototypes based on two additional regularization terms. Especially, during the inference, CenterSeg can further provide interpretability to the model by restricting the prototype as a sample of the training set. Experimental results on three remote sensing segmentation datasets validate the effectiveness of the model. Besides the superior performance, CenterSeg has the advantages of simplicity, lightweight, compatibility, and interpretability. Code is available at https://github.com/xwmaxwma/rssegmentation . I Introduction Semantic segmentation of remote sensing images (RSIs) is a fundamental task in the remote sensing community for parsing and understanding RSIs obtained from satellite or aerial photography [ 1 ] , which benefits various real-world applications including environmental monitoring [ 2 ] , urban planning [ 3 ] and agricultural management [ 4 ] . The key objective of RSI semantic segmentation is to segment the RSI into different regions/objects and assign each of them with a specific category (e.g., water, forests, and buildings) [ 5 , 6 ] . In the early days, some RSI segmentation methods based on specific scenes (e.g., road/building segmentation [ 7 , 8 ] ) follow the traditional segmentation framework [ 9 , 10 , 11 , 12 , 13 ] . They mainly focus on improving special application scenarios but frequently ignore the characteristics of RSI themselves, which limits their application scopes. Recently, generic RSI semantic segmentation methods have been widely investigated, which aim to segment multiple land cover classes [ 14 , 15 , 16 ] . Compared to images captured in natural scenes [ 17 ] , the unique characteristic of remote sensing image makes accurate segmentation difficult, i.e., different scenes and different areas of the same scene, have significant intraclass variance due to complex spatial distributions. As illustrated in Fig. 1 , the red boxes in Scene 1 , the yellow boxes in Scene 2 , and the red and yellow boxes between the two scenes exhibit diverse colors and morphologies among themselves, yet share the same semantic (i.e., building), underscoring large intraclass variance. Fig. 1: Display of the remote sensing image characteristic. Images are selected from the LoveDA dataset. For example, the color and shape of the building class are significantly different between Scene 1 and Scene 2 , as well as between region and region of the same scene, underscoring the characteristic of remote sensing images, i.e., large intraclass variance. A series of effective approaches have been successively proposed to mitigate the intraclass variance by optimizing backbone’s design [ 14 ] and context modeling [ 18 , 19 , 20 , 21 ] . However, these RSI semantic segmentation models commonly use parametric softmax classifiers, making these approaches frequently face the following limitations: (1) parametric softmax classifiers use only one weight vector with bias to represent a specific class, which usually has large intraclass variance, which limits the performance of parametric softmax classifiers; (2) the parametric softmax classifier’s cross-entropy loss function optimizes the parameters by supervising the classification probability of each pixel instead of directly supervising the pixel representation, which prevents the pixel representation from being well-trained; and (3) the weight matrix and the bias vector are both learnable parameters, where the decision-making process of their classifications is not transparent, which makes it difficult to provide interpretability for these models. Although some strategies [ 22 , 23 , 24 ] have been used to improve softmax classifiers on semantic segmentation for natural images, the use of external memory and large-scale online clustering causes additional memory and computational consumption, which is suboptimal for high-resolution remote sensing images. In this paper, we propose the a center-guided classifier, called CenterSeg, customized for RSI semantic segmentation. Technically, local clustering strategy is innovatively introduced to generate representative feature samples, i.e., class centers, which can be used to accelerate model training and reduce the memory. Specifically, CenterSeg applies the ground-truth to guide feature aggregation during training, enforcing the network to generate local class centers, which are used to generate multiple semantically accurate prototypes based on hard attention assignments and momentum updates. At the inference stage, our CenterSeg directly applies these prototypes to perform classification decisions. Furthermore, To optimize the generation of prototypes, we introduce the Grassmann manifold and propose two additional regular terms to constrain the joint embedding space of pixel features and prototypes. To the best of our knowledge, our CenterSeg is the first approach to design a new classifier to improve the RSI semantic segmentation task with the following advantages: • Effectiveness. Due to the introduction of multiple prototypes and regularization constraints, CenterSeg is able to cope well with the large within-class variance challenge and has a good embedding space of pixel features with prototypes. We conducted extensive experiments on three RSI semantic segmentation datasets. The results show that CenterSeg can significantly improve the segmentation performance of various baseline models. • Simple. CenterSeg does not require a lot of extra storage and computation consumption during training, which makes it easy to be applied and practically deployed. • Lightweight. CenterSeg is tested based on the prototypes obtained during the training process, without introducing additional parameters, and the increase in computational resources is negligible. • Compatible. CenterSeg is compatible with existing RSI semantic segmentation methods, and only needs to replace the vanilla softmax classifier. • Interpretable. If the prototype is restricted to samples (images) from the training set, CenterSeg can apply this looks like that rule [ 25 ] to interpret its predictions, which promotes the interpretability of the model. Fig. 2: Architecture of the proposed CenterSeg, which consists of two key components: prototype generation and regularizer terms. At the training stage, the input image is firstly projected to a high-dimensional space after the encoder and decoder (ED) to obtain the pixel features \mathcal{F} . Next, we aggregate the features based on the ground-truth mask to obtain the class centers \mathcal{S} , i.e., the representative features of each class. Then, we generate the prototype \mathcal{P} based on hard attention assignment and momentum update. In addition, two regularizer terms \mathcal{L}_{pp} and \mathcal{L}_{fp} are proposed to optimize the prototype generation. At the inference stage, classification decisions are performed directly based on the similarity of the pixel features to the prototype. II Related