C 2 RM-Seg: Causal Counterfactual Reasoning with Structural-Semantic Priors for Weakly Supervised Histopathological Tissue Segmentation

Hualong Zhang, Siyang Feng, Zihan Huan, Yi Qian, Zhenbing Liu, Rushi Lan, Xipeng Pan · 2026

Read C 2 RM-Seg: Causal Counterfactual Reasoning with Structural-Semantic Priors for Weakly Supervised Histopathological Tissue Segmentation by Hualong Zhang, Siyang Feng, Zihan Huan, Yi Qian, Zhenbing Liu, Rushi Lan, Xipeng Pan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-25508.txt.

Introduction

Pathology slides are huge, and labelling every pixel of tissue type needs scarce expert time, so weak labels are attractive. Hualong Zhang and colleagues present a segmentation framework in 2026 that learns from image level labels only. Standard heat map seeds follow stain appearance instead of true tissue shape, so a causal module intervenes counterfactually on feature factors to suppress misleading context. A second stage then merges fine structural detail with global meaning from a frozen foundation model.

Cross path gating lets local structure decide how much global meaning enters, protecting boundary sharpness. A further loss term adjusts its pressure according to prediction uncertainty, softening the effect of noisy seed labels. On two public tissue datasets the combined system reached state of the art weakly supervised results, according to the authors' experiments.

Catalog record

CREATORHualong Zhang, Siyang Feng, Zihan Huan, Yi Qian, Zhenbing Liu, Rushi Lan, Xipeng Pan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.25508

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

C 2 RM-Seg: Causal Counterfactual Reasoning with Structural-Semantic Priors for Weakly Supervised Histopathological Tissue Segmentation Hualong Zhang, Siyang Feng, Zihan Huan, Yi Qian, Zhenbing Liu, Rushi Lan, Xipeng Pan Abstract Histopathological tissue segmentation is essential for computer-aided diagnosis, yet weakly supervised methods often suffer from noisy pseudo-labels generated by Class Activation Mapping (CAM). Existing CAM approaches tend to focus on staining-driven appearance cues rather than true causal tissue morphology, resulting in spurious localization and poor structural consistency. To address this issue, we propose C 2 RM-Seg, a two-stage framework that integrates causal pseudo-label refinement with structure-aware semantic enhancement. For classification, we introduce a Causal Counterfactual Reasoning Module (C 2 RM) that decomposes features into latent factors and performs counterfactual intervention via a learned causal structure matrix, suppressing confounding context and producing morphology-aligned CAMs. For segmentation, we design a Dual-Path Structural–Semantic Architecture that combines fine-grained structural features from ResNeSt with global semantic priors from frozen DINOV3 foundation model. A cross-path gating mechanism adaptively regulates semantic injection using local structural cues to preserve boundary fidelity. To further mitigate residual pseudo-label noise, we propose an Uncertainty-Gated Margin (UGM) loss, which dynamically balances margin enforcement and confidence learning based on prediction uncertainty. Extensive experiments on two public histopathological tissue datasets show that C 2 RM-Seg achieves state-of-the-art performance. Code is available at https://github.com/OceanPetal/C2AM-Seg . 1 Introduction Histopathological tissue segmentation plays an important role in computer-aided diagnosis, enabling quantitative analysis for cancer staging and prognosis assessment [ 3 , 26 , 11 , 2 ] . Accurate delineation of pathological regions provides structured representations that facilitate downstream clinical interpretation [ 25 , 5 , 22 ] . However, fully supervised segmentation requires dense pixel-level annotations, which are costly and highly dependent on expert knowledge, especially for large and heterogeneous whole-slide images [ 6 , 19 ] . Weakly Supervised Semantic Segmentation (WSSS) alleviates this burden by learning dense predictions from only image-level labels, offering a scalable alternative for histopathology analysis [ 7 , 28 , 16 ] . Most WSSS methods adopt Class Activation Mapping (CAM) to generate coarse seeds and then train a segmentation model with the resulting pseudo-masks [ 17 , 13 , 9 , 10 ] . Recent efforts refine CAMs through activation enhancement and uncertainty modeling. Representative approaches include Wave-aware CAM [ 12 ] , UAM [ 17 ] , and UM-CAM [ 13 ] , as well as histopathology-oriented variants such as ARML [ 8 ] and HAMIL [ 30 ] . Despite improved localization, existing CAM-based refinements often conflate causal morphology with confounded cues (e.g., stain variations and background tissue patterns). Without explicitly modeling latent confounders or performing causal intervention, CAM responses can be systematically skewed toward context, leading to biased pseudo-masks. Beyond CAM refinement, structural modeling strategies such as MLPS [ 14 ] , ESFAN [ 28 ] , and expert-guided multi-granularity fusion [ 15 ] aim to better preserve fine-grained morphology and boundary consistency. Noise-aware optimization techniques like OEEM [ 20 ] further attempt to mitigate pseudo-label noise. However, when pseudo-labels are systematically biased by uncontrolled confounding factors, architectural refinement or loss reweighting alone may be insufficient to resolve the underlying causal misalignment. To address these challenges, we propose C 2 RM-Seg , a framework that combines causal deconfounding with foundation model priors for robust weakly supervised histopathology segmentation. We introduce a Causal Counterfactual Reasoning Module (C 2 RM) that formulates CAM generation under a Structural Causal Model (SCM) and performs counterfactual intervention to subtract confounding effects, producing cleaner seeds. We further design a Dual-Path Structural–Semantic Architecture that integrates a ResNeSt [ 27 ] branch for local morphology and a frozen DINOV3 [ 24 ] branch for global semantic priors, coupled with a cross-path gating mechanism for adaptive fusion. Finally, an Uncertainty-Gated Margin (UGM) loss enables noise-tolerant optimization from imperfect pseudo-labels. Our main contributions are summarized as follows: \bullet We identify that CAM-based methods are biased toward staining-driven appearance rather than causal tissue morphology, and propose C 2 RM, a counterfactual causal module that removes confounding context to produce high-fidelity pseudo-labels. \bullet We propose a Dual-Path Structural–Semantic segmentation framework where morphological structure guides foundation semantic injection via cross-path gating, integrating ResNeSt with a frozen DINOV3 for boundary-preserving global semantics, together with an Uncertainty-Gated Margin (UGM) loss for noise-tolerant optimization. \bullet Extensive experiments on public histopathology benchmarks demonstrate that C 2 RM-Seg outperforms state-of-the-art WSSS methods in both segmentation accuracy and boundary quality. 2 Method 2.1 Overview As shown in Fig. 1 , given a histopathology image I with an image-level label y , C 2 RM-Seg adopts a two-stage weakly supervised pipeline. First, we generate pseudo-masks by producing CAMs with the proposed C 2 RM, which reduces spurious contextual bias via counterfactual de-confounding. Second, we train a segmentation network with a Dual-Path Structural–Semantic Architecture that fuses local morphological cues and global foundation priors through cross-path gating. Finally, a UGM loss is used to alleviate residual noise in pseudo-masks during optimization. Figure 1 : Overview of C 2 RM-Seg. (a) Pseudo-Mask Generation: The C 2 RM rectifies CAMs by performing counterfactual intervention Z^{cf}=Z-E on latent factors Z using a learnable causal matrix A . (b) Segmentation Training: A Dual-Path Structural-Semantic Architecture synergizes ResNeSt [ 27 ] features with frozen DINOV3 [ 24 ] priors via cross-path gating. The model is optimized using a UGM loss that dynamically re-weights supervision based on prediction uncertainty to mitigate label noise. 2.2 Causal Counterfactual Reasoning Module Spurious correlations are prevalent in histopathological images, where label-relevant tissue morphology, such as tumor, necrotic, lymphocyte-rich, and stromal regions, is often entangled with label-irrelevant acquisition and style factors, including staining variability, scanner-specific responses, tissue-processing artifacts, and co-occurring background textures. We regard these style-related variations as latent confounders and introduce C 2 RM, an SCM-inspired counterfactual reasoning module that mitigates their influence by performing de-confounding through counterfactual feature correction. Let X\in\mathbb{R}^{C\times H\times W} be encoder features. We assume latent morphology causes M and latent style/acquisition variables S jointly affect the learned factors \mathbf{Z} , and \mathbf{Z} determines the prediction \hat{Y} (i.e., S\rightarrow\mathbf{Z}\rightarrow\hat{Y} and M\rightarrow\mathbf{Z}\rightarrow\hat{Y} ). Our goal is to estimate counterfactual factors where incoming confounding influences are removed. We project channels into K factor subspaces ( D=C/K ) with a learnable 1\times 1 projection \Phi(\cdot) and compute global factor statistics by average pooling: \mathbf{z}_{k}=\frac{1}{HW}\sum_{h=1}^{H}\sum_{w=1}^{W}\Phi_{k}(X_{h,w}),\quad k\in\{1,\dots,K\},\ \mathbf{z}_{k}\in\mathbb{R}^{D}. (1) We learn a directed factor graph with adjacency A_{c}\in\mathbb{R}^{K\times K} , where A_{c,i,j} represents the influence of factor j on factor i . To avoid self-loops, we mask the diagonal and apply row-wise softmax: \mathbf{A}=\text{softmax}\!\big(A_{c}\odot(\mathbf{1}-I)\big),\quad A_{i,i}=0. (2) The confounding contribution to factor i is estimated by aggregating its parents: \mathbf{E}_{i}=\sum_{j\neq i}A_{i,j}\mathbf{z}_{j}. (3) Under a linear additive SCM approximation for factor interactions, removing incoming confounding edges yields a counterfactual factor that subtracts the estimated parental contribution: \mathbf{z}_{i}^{cf}\approx\mathbf{z}_{i}-\mathbf{E}_{i},\qquad\mathbf{Z}^{cf}=\mathbf{Z}-\mathbf{A}\mathbf{Z}, (4) where \mathbf{Z}\in\mathbb{R}^{K\times D} stacks \{\mathbf{z}_{k}\}_{k=1}^{K} . This operation suppresses components explainable by co-varying style/background factors (e.g., stain-driven textures) and preserves morphology-dominant signals. Finally, we inject \mathbf{Z}^{cf} back to recalibrate spatial features via a gated residual correction: \mathbf{G}=\sigma\!\left(\mathcal{R}\big(\text{Broadcast}(\mathbf{Z}^{cf})\big)\right),\qquad\hat{X}=X+\gamma\cdot(\mathbf{G}\odot X), (5) where \mathcal{R}(\cdot) is a 1\times 1 bottleneck block, \sigma is Sigmoid, \text{Broadcast}(\mathbf{Z}^{cf})\in\mathbb{R}^{C\times H\times W} replicates the channel-wise counterfactual factors along spatial dimensions, and \gamma is a learnable scalar. 2.3 Dual-Path Structural-Semantic Architecture To bridge

Read the complete text