Integrating Semi-Supervised and Active Learning for Semantic Segmentation
Wanli Ma 1,2 , Oktay Karakuş 2 , Paul L. Rosin 2 1 Department of Engineering, University of Cambridge, Cambridge CB2 1TN, U.K. 2 School of Computer Science and Informatics, Cardiff University, Cardiff CF24 4AG, U.K · 2025
Read Integrating Semi-Supervised and Active Learning for Semantic Segmentation by Wanli Ma 1,2 , Oktay Karakuş 2 , Paul L. Rosin 2 1 Department of Engineering, University of Cambridge, Cambridge CB2 1TN, U.K. 2 School of Computer Science and Informatics, Cardiff University, Cardiff CF24 4AG, U.K (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-19227.txt.
Introduction
Wanli Ma, Oktay Karakus, and Paul L Rosin join two learning tricks to cut the cost of image part maps in a 2025 paper. Maps that label each pixel are dear to make by hand. Their frame picks the hardest zones for hand work and learns the rest from raw images.
A fix module mends shaky auto labels by matching pixel traits to known zones, at no extra hand cost. Hand work then goes only to zones too thin for the fix to call. Tests on street and sky image sets beat top rivals, the team reports.
Catalog record
| CREATOR | Wanli Ma 1,2 , Oktay Karakuş 2 , Paul L. Rosin 2 1 Department of Engineering, University of Cambridge, Cambridge CB2 1TN, U.K. 2 School of Computer Science and Informatics, Cardiff University, Cardiff CF24 4AG, U.K |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-19227
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Integrating Semi-Supervised and Active Learning for Semantic Segmentation Wanli Ma 1,2 , Oktay Karakuş 2 , Paul L. Rosin 2 1 Department of Engineering, University of Cambridge, Cambridge CB2 1TN, U.K. 2 School of Computer Science and Informatics, Cardiff University, Cardiff CF24 4AG, U.K Abstract Pixel-level annotation for image segmentation tasks is both time-consuming and expensive, particularly in the context of remote sensing. To mitigate this challenge, semi-supervised learning and active learning offer effective solutions, although they are typically employed independently. In this paper, we propose a novel hybrid learning framework that integrates active learning with an enhanced semi-supervised learning strategy, tailored to reduce annotation costs and improve semantic segmentation performance, particularly in the domain of remote sensing, where dense pixel-level annotation is expensive and labour-intensive. Our method leverages both the labelled samples selected via active learning and the unlabelled data excluded from selection by incorporating a pseudo-label auto-refinement (PLAR) mechanism. This module identifies potentially inaccurate pseudo-labels and automatically refines them based on the cluster assumption that similar features in high-density regions of the feature space correspond to the same class. Importantly, manual annotation is limited to only the most uncertain regions, while less ambiguous areas are refined without consuming labelling budget. We evaluate our proposed framework on multiple benchmark datasets covering both natural and remote sensing imagery. The results demonstrate that our method consistently outperforms state-of-the-art baselines in image segmentation tasks, confirming its effectiveness and generalisation capability across different domains. 1 Introduction Image segmentation plays an important role in earth observation applications, including land cover classification, urban monitoring, and crop type mapping [ 18 , 34 , 22 ] . Deep learning networks have shown great success in this domain, yet their performance is critically dependent on the availability of large-scale, high-quality annotated datasets. This requirement is especially burdensome in remote sensing, where pixel-level annotation of satellite or aerial imagery is both time-consuming and costly. Compared to natural images, remote sensing imagery introduces further complexity due to spectral variability, large spatial scales, and the need for expert knowledge in labelling [ 42 ] . Consequently, strategies that reduce annotation burden while maintaining segmentation quality are vital for advancing automated interpretation of remote sensing data. Semi-supervised learning (SSL) is one such approach, aiming to leverage a small amount of labelled data in combination with abundant unlabelled data. SSL methods help reduce the dependence on large annotated corpora, making them highly appealing for remote sensing applications where exhaustive labelling is impractical. Among these, Teacher-Student frameworks and Cross Pseudo Supervision (CPS) have shown promise in fusing labelled and unlabelled information to boost performance. However, limitations remain: Teacher-Student frameworks often suffer from over-reliance on the teacher, while CPS-based methods can collapse as model weights converge during training, diminishing the benefits of dual-network interaction. To address these challenges, we propose a novel hybrid framework, Teacher-Student-Friend (TSF), which incorporates an auxiliary “friend” model into the learning loop, unifying the strengths of both paradigms and offering greater resilience during training. In parallel, active learning (AL) has emerged as a principled way to prioritise the most informative samples for annotation. While SSL and AL are often treated independently, their combination is particularly advantageous for remote sensing. In this work, we advocate a unified strategy that blends SSL and AL: while SSL exploits the bulk of unlabelled data, AL strategically selects samples for labelling based on their uncertainty or diversity. Notably, existing AL approaches often discard unlabelled samples not selected for annotation. We argue this does not fully leverage data; those unselected samples still contain exploitable structure that can assist learning when pseudo-labelled properly. To bridge this gap, we introduce an active learning strategy designed to refine pseudo-labels. It identifies label inconsistencies by examining feature similarity between labelled and unlabelled regions within the same image. Grounded in the assumption that spatially or spectrally similar regions in remote sensing images are likely to belong to the same class [ 2 ] , we propose an efficient pseudo-label auto-refinement mechanism. This mechanism operates in feature space and enables automatic correction of unlabelled pixel predictions by referencing the surrounding context of known labels, as shown in Figure 1 . It provides a form of soft supervision without additional manual annotation, further conserving the labelling budget. Figure 1: Pseudo-label auto-refinement based on similarity in feature space. The key contributions of this work are summarised below: • We propose a novel integration of active learning and semi-supervised learning for semantic segmentation, validated across both natural and remote sensing imagery. • We develop a robust hybrid framework, Teacher-Student-Friend (TSF), that combines the strengths of Student-Teacher models and Cross Pseudo Supervision to improve learning from limited labels. • We introduce a pseudo-label auto-refinement strategy using feature similarity within images, enabling the correction of noisy pseudo-labels in unlabelled regions with minimal cost. • We present a dedicated module for identifying high-value samples in the active learning process, using both prediction uncertainty and multi-level feature representations. 2 Related Work 2.1 Semi-supervised semantic segmentation In the field of semi-supervised learning, consistency regularisation is widely explored and primarily aims to enforce neural networks to produce consistent predictions by incorporating various types of perturbations. The strategies for the said perturbations can be categorised into input [ 7 , 20 , 48 ] , feature [ 21 ] , network [ 3 ] and hybrid . Specifically, the Mean Teacher (MT) [ 32 ] and Cross Pseudo Supervision (CPS) [ 3 ] are two well-known fundamental consistency learning frameworks. The former, MT, employs a teacher model whose parameters are the exponential moving average (EMA) of a student model’s parameters. A few variations of this approach can be found in the literature (See e.g., [ 38 , 10 ] ). AEL [ 10 ] introduces an adaptive CutMix and sampling strategy for unlabelled data, designed to enhance learning for underperforming classes based on the evaluation of the current model. U2PL [ 35 ] leverages not only highly confident predictions for unlabelled data as pseudo-labels for training the networks but also utilises ambiguous predictions as negative samples, helping the network learn by contrasting them with the corresponding positive samples. Dual Student [ 13 ] argued that the EMA-based Teacher-Student leads to a performance bottleneck due to the tight coupling between the two roles, with this interdependence intensifying as training progresses. On the other hand, the latter, CPS, leverages unlabelled data differently from the Teacher-Student structures by enforcing consistency between two models of the same architecture with different initialisation. Some other hybrid SSL approaches include ST++ [ 40 ] , ReCo [ 14 ] , and S4AL+ [ 23 ] , integrating self-training, contrastive, or representation learning. Recently, PEFAT, a semi-supervised framework, was proposed to leverage pseudo-loss estimation and feature-level adversarial training to improve multi-class and multi-label medical image classification [ 47 ] . LeFeD was proposed to leverage feature-level discrepancies from dual decoders to improve volumetric medical image segmentation [ 46 ] . VerSemi, a versatile semi-supervised framework, was proposed to unify multiple SSL tasks with dynamic task prompts and synthetic augmentation to improve medical image segmentation [ 45 ] . PICK combines pseudo-label-guided masking, reconstruction, and multi-decoder learning to improve medical image segmentation [ 44 ] . It is important to note