FARCLUSS: Fuzzy Adaptive Rebalancing and Contrastive Uncertainty Learning for Semi-Supervised Semantic Segmentation Journal: Neural Networks
Ebenezer Tarubinga, Jenifer Kalafatovich, Seong-Whan Lee · 2025
Read FARCLUSS: Fuzzy Adaptive Rebalancing and Contrastive Uncertainty Learning for Semi-Supervised Semantic Segmentation Journal: Neural Networks by Ebenezer Tarubinga, Jenifer Kalafatovich, Seong-Whan Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-11142.txt.
Introduction
Ebenezer Tarubinga, Jenifer Kalafatovich, and Seong-Whan Lee present a 2025 method for image labeling. The task is to mark each pixel in an image with the class it belongs to. Labeled images are scarce, so methods must learn from many unlabeled ones too. Guessed labels for those images are often wrong for rare classes.
Their method, FARCLUSS, keeps soft guesses instead of hard ones. It weights each pixel by how sure the model is of its guess. Losses shift over time to give rare classes a fairer share. A light contrast step keeps features for each class tight and distinct. Tests on standard sets beat earlier methods, with the largest gains on rare classes. Gains also showed in blurry regions where class borders are unclear.
Catalog record
| CREATOR | Ebenezer Tarubinga, Jenifer Kalafatovich, Seong-Whan Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-11142
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FARCLUSS: Fuzzy Adaptive Rebalancing and Contrastive Uncertainty Learning for Semi-Supervised Semantic Segmentation Journal: Neural Networks Ebenezer Tarubinga, Jenifer Kalafatovich, Seong-Whan Lee Abstract Semi-supervised semantic segmentation (SSSS) faces persistent challenges in effectively leveraging unlabeled data, such as ineffective utilization of pseudo-labels, exacerbation of class imbalance biases, and neglect of prediction uncertainty. Moreover, current approaches often discard uncertain regions through strict thresholding favouring dominant classes. To address these limitations, we introduce a holistic framework that transforms uncertainty into a learning asset through four principal components: (1) fuzzy pseudo-labeling, which preserves soft class distributions from top-K predictions to enrich supervision; (2) uncertainty-aware dynamic weighting, that modulate pixel-wise contributions via entropy-based reliability scores; (3) adaptive class rebalancing, which dynamically adjust losses to counteract long-tailed class distributions; and (4) lightweight contrastive regularization, that encourage compact and discriminative feature embeddings. Extensive experiments on benchmarks demonstrate that our method outperforms current state-of-the-art approaches, achieving significant improvements in the segmentation of under-represented classes and ambiguous regions. 1 Introduction Semantic segmentation, defined as the process of assigning class labels to every pixel in an image, supports a range of critical applications, including autonomous driving and medical diagnostics. By facilitating pixel-level scene analysis, it supports systems that demand fine-grained environmental understanding [ 5 ] . Nonetheless, fully supervised segmentation techniques usually depend on extensive datasets with detailed annotations; making it costly in fields like urban scene analysis or healthcare, where manual labelling is both expensive and time-consuming [ 1 ] . To mitigate this dependency on labeled data, semi-supervised semantic segmentation (SSSS) has emerged as a promising alternative. By leveraging a modest set of labeled images alongside abundant unlabeled data, SSSS frameworks strive to achieve performance comparable to fully supervised models while substantially reducing annotation requirements. Early work in this area centered on pseudo-labeling [ 12 ] , wherein a teacher model generates approximate labels for unlabeled data that a student model subsequently learns from. Later research introduced consistency regularization [ 13 ] , enforcing prediction invariance under various geometric or photometric transformations. Although these techniques have shown improvements, they remain constrained by three principal issues: suboptimal use of pseudo-labels, class imbalance in long-tailed datasets, and inadequate handling of prediction uncertainty. Although recent approaches attempt to address these issues, they often lack comprehensive solutions. Most methods treat pseudo-label uncertainty as a liability. They discard low-confidence predictions via strict thresholding, overlooking subtle probabilistic relationships among plausible classes. For instance, a pixel at the boundary of ’sidewalk’ and ’road’ may carry near-equal probabilities for both classes, yet is often removed, forfeiting valuable supervisory signals. UniMatch [ 3 ] combines feature- and output-level consistency but relies on fixed confidence thresholds to generate hard pseudo-labels. As a result, ambiguous predictions are eliminated, especially near object boundaries or occluded regions,leading to loss of information. Class imbalance remains inadequately addressed. Although some methods adjust global thresholds, they fail to rebalance losses based on per-batch class distributions, perpetuating bias toward majority classes. PS-MT [ 2 ] employs progressive self-training with momentum teachers and adaptive thresholds but lacks explicit mechanisms for class rebalancing. Consequently, dominant categories (e.g., "road" or "sky" in urban scenes) are over-represented in pseudo-labels. Methods that use contrastive learning to address previous mentioned limitations often incur high computational cost due to extensive feature alignments, limiting scalability on large datasets. ReCo [ 4 ] improves feature discriminability using region-level contrastive learning, but its pairwise embedding comparisons introduce considerable overhead. Cross-pseudo supervision (CPS) [ 6 ] trains dual networks that supervise each other, yet applies uniform weighting to pseudo-labels, neglecting the need to treat uncertain regions differently. This work proposes a unified framework that systematically addresses common challenges in semi-supervised segmentation, including pseudo-label noise, class imbalance, and computational overhead. First, we introduce fuzzy pseudo-labeling, which derives soft label distributions from the top-K class probabilities at each pixel. By preserving uncertainty (unlike previous methods’ strict thresholding), our method treats ambiguity as a constructive supervisory cue. This enables the model to learn from regions like unclear boundaries (e.g., pavement edges between "car" and "road") instead of discarding them. Second, we implement uncertainty-aware dynamic weighting, assigning pixel-wise weights based on normalized entropy to modulate pseudo-label influence during training. This mechanism curbs the impact of noisy high-entropy regions (e.g., overlapping objects) while amplifying the contribution of confident predictions. This mechanism improves upon CPS by replacing uniform weighting with a more discriminative strategy [ 6 ] . Third, we propose adaptive class rebalancing to mitigate class imbalance by dynamically adjusting loss weights according to batch-level pseudo-label frequencies. This ensures under-represented categories like "traffic sign" receive adequate optimization focus without manual tuning. Finally, we introduce lightweight contrastive regularization based on a prototype-centric design. By computing class-specific centroids from confidently labeled pixels, our approach promotes discriminative feature clustering while avoiding the computational burden of exhaustive pairwise comparisons as in ReCo [ 4 ] . While existing methods have tackled individual challenges such as ineffective pseudo-label utilization, class imbalance, and high computational cost, they often fall short of addressing these issues simultaneously within a unified framework. The main contributions of this work are summarized as follows: 1. Fuzzy Pseudo-Labeling: Constructs soft label distributions from top-K class probabilities, preserving ambiguity as a learning signal rather than discarding uncertain pixels. 2. Uncertainty-Aware Dynamic Weighting: Modulates pixel-wise pseudo-label impact using normalized entropy, reducing noise from ambiguous regions and enhancing learning from confident predictions. 3. Adaptive Rebalancing: Dynamically scales losses based on pseudo-label frequencies per batch, improving learning for minority classes without manual heuristics. 4. Lightweight Contrastive Regularization Prototype-based Contrastive learning via class centroids avoids costly pairwise operations while promoting feature compactness. 2 Related Works 2.1 Teacher-Student Frameworks and Pseudo-Label Refinement Semi-supervised semantic segmentation (SSSS) has progressed remarkably through teacher-student paradigms, wherein models generate pseudo-labels from unlabeled data to guide training. Early work such as FixMatch [ 7 ] employed confidence thresholding to filter pseudo-labels, leading to high-confidence yet inaccurate predictions reinforced model errors (confirmation bias). Cross Pseudo Supervision (CPS) [ 6 ] mitigated this issue by training two networks jointly in a supervised manner using each other’s pseudo-labels, thereby diversifying the learning signal. PseudoSeg [ 8 ] enhanced reliability through augmented prediction fusion, while Directional Context-Aware Consistency (DC-Loss) [ 9 ] encouraged alignment of class-specific features in differing contexts. More recent approaches, including the Error Localization Network (ELN) [ 10 ] and U^{2}\mathrm{PL} [ 11 ] , introduced modules to detect, filter, or reinterpret uncertain predictions as negative supervision. However, most of these methods still rely on strict thresholding, discarding ambiguous pixels and thereby limiting data usage. By contrast, our framework employs fuzzy pseudo-labeling to retain the top-K class probabilities for each pixel, preserving nuanced inter-class relationships and providing richer supervision even in low-confidence regions. 2.2 Uncertainty-Aware Confidence Calibration Uncertainty estimation has become central to improving pseudo-label quality. For example, RePU [ 16 ] refined pseudo-labels using entropy-based uncertainty scores, and Bayesian Uncertainty Calibration [ 17 ] leveraged Monte Carlo dropout to identify unreliable predictions. Despite their effectiveness, these methods generally adopt uncertainty as a binary filter rather than as a learning signal. By contrast, our approach incorporates uncertainty-aware dynamic weighting, wherein normalized entropy modulates the contribution of each pseudo-label. High-entropy areas, such as boundaries or overlapping objects, are downweighted proportionately to their uncertainty, reducing noise while preserving