USIGAN: U nbalanced S elf- I nformation Feature Transport for Weakly Paired Image IHC Virtual Staining

Yue Peng, Bing Xiong, Fuqiang Chen, Deboch Eybo Abera, RanRan Zhang, Wanming Hu, Jing Cai, Wenjian Qin · 2025

Read USIGAN: U nbalanced S elf- I nformation Feature Transport for Weakly Paired Image IHC Virtual Staining by Yue Peng, Bing Xiong, Fuqiang Chen, Deboch Eybo Abera, RanRan Zhang, Wanming Hu, Jing Cai, Wenjian Qin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05843.txt.

Introduction

Yue Peng and co-authors present an AI method that fakes a lab stain on tissue images, in a 2025 paper. Pathologists stain tissue to reveal key proteins, but the process is slow and costly. Virtual staining aims to turn a standard image into the stained one. When the paired images come from nearby slices, their shapes differ, which breaks simple mapping.

Their method, USIGAN, moves features between image types without needing exact position matches. It draws out the overall shape meaning of the tissue first. That avoids forced one-to-many links between slices. The result should keep the medical meaning of the real stain. Faster, cheaper virtual stains could widen access to advanced tissue tests.

Catalog record

CREATORYue Peng, Bing Xiong, Fuqiang Chen, Deboch Eybo Abera, RanRan Zhang, Wanming Hu, Jing Cai, Wenjian Qin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-05843

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

USIGAN: U nbalanced S elf- I nformation Feature Transport for Weakly Paired Image IHC Virtual Staining Yue Peng, Bing Xiong, Fuqiang Chen, Deboch Eybo Abera, RanRan Zhang, Wanming Hu, Jing Cai, Wenjian Qin Abstract Immunohistochemical (IHC) virtual staining is a task that generates virtual IHC images from H&E images while maintaining pathological semantic consistency with adjacent slices. This task aims to achieve cross-domain mapping between morphological structures and staining patterns through generative models, providing an efficient and cost-effective solution for pathological analysis. However, under weakly paired conditions, spatial heterogeneity between adjacent slices presents significant challenges. This can lead to inaccurate one-to-many mappings and generate results that are inconsistent with the pathological semantics of adjacent slices. To address this issue, we propose a novel unbalanced self-information feature transport for IHC virtual staining, named USIGAN, which extracts global morphological semantics without relying on positional correspondence.By removing weakly paired terms in the joint marginal distribution, we effectively mitigate the impact of weak pairing on joint distributions, thereby significantly improving the content consistency and pathological semantic consistency of the generated results. Moreover, we design the Unbalanced Optimal Transport Consistency (UOT-CTM) mechanism and the Pathology Self-Correspondence (PC-SCM) mechanism to construct correlation matrices between H&E and generated IHC in image-level and real IHC and generated IHC image sets in intra-group level.. Experiments conducted on two publicly available datasets demonstrate that our method achieves superior performance across multiple clinically significant metrics, such as IoD and Pearson-R correlation, demonstrating better clinical relevance. The code is available at: https://github.com/MIXAILAB/USIGAN I Introduction Immunohistochemistry(IHC) virtual staining is a task that aims to generate virtual IHC images consistent with the pathological semantics of adjacent reference IHC-stained slices while preserving the content consistency of H&E images. However, spatial heterogeneity between adjacent slices makes it challenging to directly establish a mapping between H&E and IHC images. In previous studies, most researchers adopted contrastive learning approaches, which maximize mutual information in the corresponding regions to establish cross-domain correlations between the morphological information in H&E images and the staining styles in IHC images. However, this approach still fails to address the issue of spatial heterogeneity, which can lead to misalignment of morphological information from H&E images to incorrect IHC staining patterns, affecting the extraction and accurate mapping of key information in generative models [ 21 , 13 , 25 ] . Therefore, we focus on a previously overlooked concept in information theory—self-information, which quantifies the information content of a single event. Specifically, self-information reflects the rarity of a pixel. For example, when rare structures or patterns appear in pathological images, the corresponding regions exhibit higher self-information, indicating that they contain more valuable diagnostic information and biological significance. In summary, self-information quantifies the model’s prioritization of information needs for critical pathological features. Our goal is to transform self-information from a previously passive learning paradigm into an active focus, further uncovering the process by which generative models establish cross-domain correlations in virtual staining. Self-information represents critical regions in the mapping process, and constructing a correlation matrix allows different feature regions to be assigned higher weights, which is the essence of self-information mining. As illustrated in Figure 1 , IHC virtual staining faces two main challenges: (1) spatial heterogeneity and (2) erroneous pathological semantic correlations caused by incorrect one-to-many mappings between morphological features and staining patterns. Self-information mining addresses these challenges by prioritizing key information. We leverage two types of priors in virtual staining to incorporate corresponding self-information and establish correlations: 1)Explicit Prior: Pathological semantic consistency between adjacent slices. By evaluating staining intensity through clinical optical density metrics, we construct a correlation matrix between generated IHC and real IHC image groups to mine pathological semantic self-information. 2)Implicit Prior: Morphological structures and cellular atypia in H&E images correspond to different disease subtypes and their respective IHC staining patterns [ 14 ] . Through optimal transport theory, we optimize the expectation of self-information, explicitly introducing self-information to strengthen critical regions and penalizing the effects of erroneous one-to-many mappings. Fig. 1: Spatial heterogeneity between adjacent slices poses a major challenge in virtual staining. This heterogeneity manifests as misalignment of tissue structures and pathological semantics across slices, making it difficult to directly establish cross-domain mappings between morphology and staining styles. In previous studies on IHC virtual staining, two paradigms: fully supervised and unsupervised—have been primarily used to passively construct cross-domain correlations. Pix2Pix and its variants attempt to establish cross-domain correlations at the pixel level by leveraging weakly paired IHC data [ 8 , 19 , 6 , 23 ] . However, these methods struggle to effectively learn mapping relationships between tissue regions. Cycle consistency-based methods implicitly construct mappings between morphology and staining styles by allowing two models to map between two domains [ 31 ] . However, the assumption of reciprocal mappings between staining domains is often violated for weakly paired data, resulting in low pathological semantic consistency in the generated results. To address these issues, some researchers have adopted contrastive learning approaches that maximize mutual information between patches to explicitly construct mapping relationships [ 8 , 19 , 6 , 23 ] . While this non-pixel-level approach alleviates the impact of weakly paired data to some extent, its performance remains constrained by the degree of pairing. These methods overlook the critical role of self-information in pathological images. Passively summarizing mapping relationships from image collections is inherently challenging, whereas self-information, by emphasizing features with high diagnostic value, can guide the model to correctly focus on key regions, thereby improving the performance and consistency of virtual staining results. In this paper, we propose a novel method for mining self-information at both the image and group levels by eliminating weakly paired terms in the joint marginal distribution, effectively mitigating their impact and significantly enhancing the content and pathological semantic consistency of generated results. Specifically, for image-level self-information mining, we introduce Unbalanced Optimal Transport Consistency Mining (UOT-CTM), a method that preserves geometric structures of high self-information regions to reduce transport costs during optimal transport minimization. Although previous attempts using optimal transport explicitly constrained transport plans from H&E to weakly paired IHC and from generated IHC to weakly paired IHC in feature space—thus aligning morphological and staining style features—these approaches suffer from three primary limitations: 1) Neglecting incompatibility in weakly paired data, leading to forced, low-similarity feature matching. 2) Ignoring inherent semantic differences between morphological and staining-style imitation tasks, resulting in undesirable trade-offs. 3) Overlooking semantic inconsistencies and distributional differences by directly constraining joint marginal distributions involving weakly paired terms. To address these issues, UOT-CTM employs a cyclic consistent transport strategy to explicitly constrain transport plans along paths from H&E to generated IHC, effectively capturing image-level self-information. Additionally, we propose a marginally relaxed unbalanced optimal transport strategy to alleviate the one-to-many mapping issue and construct more accurate correlation matrices, transforming the constraint objective from directly matching P(x,y) and P(y,z) distributions to matching P(x,z) and P(x,y)\cdot P(y,z) , thus eliminating weakly paired terms. For group-level self-information mining, we design the Pathology-Consistent Self-Correspondence Mining (PC-SCM) mechanism, which leverages optical density—rare but indicative of high self-information—as a “self-information anchor,” establishing correlation matrices between generated and real IHC based on optical density. This ensures prioritization of high-optical-density regions, maintains consistent correlation matrices within batches, avoids negative impacts from directly using weakly

Read the complete text