Learning Disentangled Stain and Structural Representations for Semi-Supervised Histopathology Segmentation
Ha-Hieu Pham [email protected], Nguyen Lan Vi Vu [email protected], Thanh-Huy Nguyen [email protected], Ulas Bagci [email protected], Min Xu [email protected], Trung-Nghia Le [email protected], Huy-Hieu Pham [email protected] · 2025
Read Learning Disentangled Stain and Structural Representations for Semi-Supervised Histopathology Segmentation by Ha-Hieu Pham [email protected], Nguyen Lan Vi Vu [email protected], Thanh-Huy Nguyen [email protected], Ulas Bagci [email protected], Min Xu [email protected], Trung-Nghia Le [email protected], Huy-Hieu Pham [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03923.txt.
Introduction
Outlining glands in tissue slides is slow expert work, and labeled examples are scarce because staining varies so much. Pham and co-authors split the problem in two in this 2025 paper: one student network learns stain appearance, the other learns tissue structure. A shared teacher, updated as a slow average, feeds both students guessed labels for unlabeled slides.
Uncertainty modules tuned to stain and structure weigh how much each student trusts each guess. On two gland data sets the system set new best marks when only five or ten percent of slides were labeled. Gains ran about one point on the overlap score. The authors argue separating color from shape is what makes few labels go far.
Catalog record
| CREATOR | Ha-Hieu Pham [email protected], Nguyen Lan Vi Vu [email protected], Thanh-Huy Nguyen [email protected], Ulas Bagci [email protected], Min Xu [email protected], Trung-Nghia Le [email protected], Huy-Hieu Pham [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-03923
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Disentangled Stain and Structural Representations for Semi-Supervised Histopathology Segmentation Ha-Hieu Pham [email protected], Nguyen Lan Vi Vu [email protected], Thanh-Huy Nguyen [email protected], Ulas Bagci [email protected], Min Xu [email protected], Trung-Nghia Le [email protected], Huy-Hieu Pham [email protected] Abstract Accurate gland segmentation in histopathology images is essential for cancer diagnosis and prognosis. However, significant variability in Hematoxylin and Eosin (H&E) staining and tissue morphology, combined with limited annotated data, poses major challenges for automated segmentation. To address this, we propose Color-Structure Dual-Student (CSDS), a novel semi-supervised segmentation framework designed to learn disentangled representations of stain appearance and tissue structure. CSDS comprises two specialized student networks: one trained on stain-augmented inputs to model chromatic variation, and the other on structure-augmented inputs to capture morphological cues. A shared teacher network, updated via Exponential Moving Average (EMA), supervises both students through pseudo-labels. To further improve label reliability, we introduce stain-aware and structure-aware uncertainty estimation modules that adaptively modulate the contribution of each student during training. Experiments on the GlaS and CRAG datasets show that CSDS achieves state-of-the-art performance in low-label settings, with Dice score improvements of up to 1.2% on GlaS and 0.7% on CRAG at 5% labeled data, and 0.7% and 1.4% at 10%. Our code and pre-trained models are available at https://github.com/hieuphamha19/CSDS . Ha-Hieu Pham and Nguyen Lan Vi Vu † † heading: 23 2025 1- 1/21; Revised 5/22 9/22 21-0000 † † shortheadings: Color-Structure Dual Students for Semi-Supervised Histopathology Segmentation / Ha-Hieu Pham, Nguyen Lan Vi Vu, et al. † † firstpage: 1 keywords Histopathology Imaging, Semi-Supervised Learning, Semantic Segmentation. 1 Introduction Histopathological image analysis is of paramount importance in cancer diagnosis and prognosis, especially in tasks such as gland segmentation for colorectal cancer. Images are usually stained with Hematoxylin and Eosin (H&E). This staining can create significant color differences due to variations in staining methods, slide preparation, and scanning equipment used. The differences in color and structure of tissue images create considerable obstacles for automated segmentation systems, especially when there is a lack of labeled data. In medical imaging, however, obtaining such labels is expensive, time-consuming, and subject to inter-observer variability. Semi-supervised learning (SSL) offers an effective strategy to improve segmentation performance by leveraging a small amount of labeled data alongside a larger pool of unlabeled samples. However, existing SSL methods often overlook the unique visual complexity of histopathological images, which arises from two entangled yet semantically distinct sources: staining variations and tissue morphology. In particular, Hematoxylin and Eosin (H&E) staining introduces substantial inter-sample color variation due to inconsistencies in staining protocols and scanning devices, while structural variations reflect biologically meaningful changes in tissue architecture, including malignant progression. Prior works in semi-supervised segmentation, such as pseudo-labeling, consistency regularization Sohn et al. 2020 ; Le et al. 2025 , and teacher-student frameworks Tarvainen and Valpola 2017 ; Yu et al. 2019 ; Pham et al. 2025 , generally process the image holistically and fail to disentangle stain and structure cues. This lack of targeted representation learning can limit their effectiveness in histopathology, where isolating stain-specific and structure-specific information is crucial for robust and interpretable segmentation. To overcome the limitations of existing semi-supervised segmentation approaches, we propose in this work a novel framework termed Color-Structure Dual-Student (CSDS) . The key innovation of CSDS lies in its explicit decoupling of color and structural information through the use of two specialized student networks. One student is trained with color-augmented images to effectively model chromatic variations, while the other is trained with geometrically transformed images to emphasize structural cues. A shared teacher model, updated using an Exponential Moving Average (EMA) of the student weights, then serves as a pseudo-label generator and provides supervision in an uncertainty-aware manner. To further enhance pseudo-label reliability, we introduce color-aware and structure-aware uncertainty estimation strategies. These mechanisms leverage prediction entropy and domain-specific priors to adaptively weight the contributions of each student during training, thereby improving the quality and robustness of the supervision signal. We validate the effectiveness of CSDS through comprehensive experiments conducted on two histopathological image segmentation benchmarks, GlaS Sirinukunwattana et al. 2017 and CRAG Graham et al. 2019 , under low-label regimes. The results demonstrate that CSDS consistently outperforms existing state-of-the-art methods, establishing a new benchmark for semi-supervised medical image segmentation. 2 Methodology 2.1 Preliminary Problem Settings. Following standard semi-supervised segmentation settings, we denote the labeled set as \mathcal{D}_{l}=\{(x_{i}^{l},y_{i}^{l})\}_{i=1}^{N} , and a larger unlabeled set as \mathcal{D}_{u}=\{(x_{k}^{u})\}_{k=1}^{M} ( N : labeled samples, M : unlabeled samples, M\gg N ). Here, x_{i}^{l} and x_{k}^{u} are input images from the labeled and unlabeled sets, respectively, and y_{i}^{l} is the corresponding one-hot groundtruth for labeled sample x_{i}^{l} . This setup formalizes the standard semi-supervised segmentation problem under a limited-label regime. Overall Pipeline. We propose a Color-Structure Dual-Student (CSDS) framework, an extension of the Mean Teacher paradigm Tarvainen and Valpola 2017 . Our framework is built upon the intuition that color and structure represent two complementary sources of variation in histological data: while color distributions often shift across staining protocols, structural patterns exhibit large inter-sample variability due to tissue deformation and cancer heterogeneity. CSDS comprises two student networks with shared architecture: the color student, trained on inputs augmented by histogram matching and color jittering to capture both in-distribution and out-of-distribution color shifts; and the structure student, optimized on elastically deformed images to model structural variability. A shared teacher network is updated via Exponential Moving Average (EMA) of the mean weights from both students. In Section 2.2 we introduce two complementary uncertainty estimation modules: Color uncertainty and structure uncertainty, which quantify prediction confidence via entropy in color-ambiguous and structurally-uncertain regions, respectively. These uncertainty maps are subsequently used to modulate the teacher’s supervision signals during the pseudo-labeling process. The overall pipeline of our method is illustrated in Figure 1 . Figure 1: Overview of our Color-Structure Dual-Student (CSDS) framework with dual students for color and structure, and a shared EMA-updated teacher. Output uncertainty maps are used to adaptively weight pseudo-labels during training. 2.2 Uncertainty Estimation for Color-Structure Uncertainty Module In this section, we present the detailed design of the Color Uncertainty and Structure Uncertainty modules. Uncertainty map is initially computed from the teacher’s predictions using Shannon entropy Shannon 1948 and is further refined by incorporating visual features extracted from input images, guided by color and structural indicators Zou et al. 2023 . 2.2.1 Entropy-Based Uncertainty Estimation Given the teacher’s output logits \mathbf{z}\in\mathbb{R}^{C\times H\times W} , we compute per-pixel softmax probabilities: \mathbf{p}(x)=\operatorname{softmax}(\mathbf{z}(x)), (1) where z(x) denotes the logit at pixel x . Uncertainty is then estimated as: U(x)=-\sum_{c=1}^{C}p_{c}(x)\log(p_{c}(x)+\varepsilon), (2) where \varepsilon is a small constant added for numerical stability. This produces a dense uncertainty map that reflects the teacher’s predictive confidence. 2.2.2 Color-Aware Uncertainty Modulation Within the domain of pathology imaging, local color diversity often reflects meaningful semantic variation Xia et al. 2024 . Given the input RGB image I\in\mathbb{R}^{3\times H\times W} , we estimate chromatic complexity by computing the per-pixel inter-channel variance: \sigma^{2}(x)=\operatorname{Var}_{c\in\{R,G,B\}}[I_{c}(x)]. (3) To enforce spatial coherence, the variance map is smoothed using a Gaussian filter \mathcal{G}_{3\times 3} , or approximated via average pooling for computational efficiency: V(x)=\mathcal{G}_{3\times 3}(\sigma^{2}(x)),\quad\hat{V}(x)=\frac{V(x)}{\max_{x\in\Omega}V(x)+\varepsilon}. (4) A binary mask highlights regions with high color diversity: M_{\mathcal{C}}(x)=\mathbb{I}[\hat{V}(x)>\tau_{\text{color}}]. (5) We then modulate the base uncertainty map U(x) by amplifying values in chromatically distinctive regions: \widetilde{U}_{\mathcal{C}}(x)=U(x)\cdot\left(1+\lambda_{\mathcal{C}}\cdot