HASD: Hierarchical Adaption for pathology Slide-level Domain-shift

Jingsong Liu ‡, Han Li ‡, Chen Yang, Michael Deutges, Ario Sadafi, Xin You, Katharina Breininger, Nassir Navab, Peter J. Schüffler · 2025

Read HASD: Hierarchical Adaption for pathology Slide-level Domain-shift by Jingsong Liu ‡, Han Li ‡, Chen Yang, Michael Deutges, Ario Sadafi, Xin You, Katharina Breininger, Nassir Navab, Peter J. Schüffler (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-23673.txt.

Introduction

Jingsong Liu and co-authors present HASD in 2025, a method to help AI read pathology slides across hospitals. Slides scanned at different centers differ in stain and scanner quirks, a shift that can throw off AI diagnosis. Most fixes work on small patches, yet doctors judge whole slides, so patch fixes miss the big picture.

HASD adapts models at three levels at once: whole data set, whole slide, and patch. It keeps the slide's shape structure true and guards the local details that drive diagnosis. A prototype trick cuts the computing cost. On breast cancer grading and survival prediction tasks, it beat prior methods by clear margins. The authors offer it as a practical fix for multi-center pathology.

Catalog record

CREATORJingsong Liu ‡, Han Li ‡, Chen Yang, Michael Deutges, Ario Sadafi, Xin You, Katharina Breininger, Nassir Navab, Peter J. Schüffler
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-23673

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HASD: Hierarchical Adaption for pathology Slide-level Domain-shift Jingsong Liu ‡, Han Li ‡, Chen Yang, Michael Deutges, Ario Sadafi, Xin You, Katharina Breininger, Nassir Navab, Peter J. Schüffler Abstract Domain shift is a critical problem for pathology AI as pathology data is heavily influenced by center-specific conditions. Current pathology domain adaptation methods focus on image patches rather than WSI, thus failing to capture global WSI features required in typical clinical scenarios. In this work, we address the challenges of slide-level domain shift by proposing a Hierarchical Adaptation framework for Slide-level Domain-shift (HASD). HASD achieves multi-scale feature consistency and computationally efficient slide-level domain adaptation through two key components: (1) a hierarchical adaptation framework that integrates a Domain-level Alignment Solver for feature alignment, a Slide-level Geometric Invariance Regularization to preserve the morphological structure, and a Patch-level Attention Consistency Regularization to maintain local critical diagnostic cues; and (2) a prototype selection mechanism that reduces computational overhead. We validate our method on two slide-level tasks across five datasets, achieving a 4.1% AUROC improvement in a Breast Cancer HER2 Grading cohort and a 3.9% C-index gain in a UCEC survival prediction cohort. Our method provides a practical and reliable slide-level domain adaption solution for pathology institutions, minimizing both computational and annotation costs. 1 1 footnotetext: ‡ These authors contributed equally to this work. 1 Introduction Figure 1: (a)(b): Existing methods rely on patch-level labels from the source domain and pseudo labels from the target domain for patch-level domain adaptation. (c)(d): In slide-level tasks, patches lack individual labels. We propose a hierarchical adaption framework that leverages domain-level alignment solver with slide-level structure and patch-level diagnostic features preserved. Digital pathology has experienced significant attention in recent years, driven by the widespread adoption of whole-slide imaging (WSI) scanners and rapid progress in artificial intelligence (AI) research [ 15 ] . This trend has facilitated notable advancements in many AI-based pathology tasks [ 25 , 6 ] . However, a major challenge in pathology is domain shift , arising from differences in pathology centers, including imaging variances (varying staining protocols, digitization procedures), label discrepancies (patient populations), and other factors. Domain shift can downgrade model performances when transferring a model to a different clinical site, potentially compromising patient safety [ 11 , 13 ] . Domain adaptation (DA) is a method to mitigate domain shift commonly used in histology image analysis, leveraging adversarial training or generative models [ 8 , 9 , 13 , 17 , 18 , 22 , 5 ] . By extracting domain-invariant features or synthesizing target-like samples, DA helps to align distributions between different datasets, improving model robustness and generalization. However, most methods focus on patch-level adaption , making them misaligned with real-world applications where clinical decisions require a global understanding of the slide (e.g., cancer grading or survival prediction) that patch-level adaptation methods fail to capture. An intuitive approach to extend patch-level DA methods to the slides-level is by decomposing slide-level tasks into many patch-level predictions [ 21 , 7 ] , applying DA at the patch level, and then aggregating the slides-level results. However, this often requires extensive patch-level annotations from pathologists, which is very time-consuming. Another naive approach aggregates patch embeddings via simple integration techniques (e.g., mean pooling) [ 1 ] . However, this treats all patches equally, failing to emphasize diagnostically relevant regions. Instead, we propose to realize slide-level pathology DA by adopting the more adaptive attention-based aggregation (ABMIL). This presents two major challenges: (1) The distortion of multi-scale feature distributions : The success of ABMIL relies on the domain-level feature distributions, intra-slide patch relations, and patch-level attention patterns. Without a structured adaptation framework, DA can distort slide morphology and misalign critical diagnostic features. (2) Computational and structural challenges: The large number of patches per slide, varying across different slides, introduces significant computational overhead, necessitating an efficient adaptation strategy. To solve these problems, we propose in this work an efficient Hierarchical Adaption framework for Slide-level Domain-shift (HASD). Specifically, HASD achieves multi-scale feature consistency and computationally efficient DA through two key components (Fig. 1 ): (1) Hierarchical Adaptation Framework : Domain-level Alignment Solver, where an entropic Sinkhorn-Knopp solver [ 3 ] ensures effective alignment of feature distributions between domains; Slide-level Geometric Invariance Regularization, ensuring that slides are adapted as a whole without structural distortions; Patch-level Attention Consistency Regularization, which stabilizes domain adaptation by ensuring critical diagnostic features remain consistently focused across domains. (2) Efficient Prototype Selection : To mitigate the computational burden of the HASD, we select the K most informative prototypes per slide, reducing redundancy while preserving essential slide-level information. Patch-level features are extracted using a pre-trained foundation model (UNI) [ 2 ] , ensuring robust representation learning. We demonstrate our method’s DA capabilities in addressing imaging variances and label discrepancies with two slide-level tasks across five datasets. Compared to SOTA methods, our hierarchy adaption framework achieves an average 4.1% AUROC gain for Breast Cancer Grading and a 3.9% C-index gain in UCEC Survival Prediction task, without requiring additional pathologist annotations. As such, our method provides a practical solution for pathology institutions seeking to transfer models from a source center to a target center while addressing domain shift, ensuring reliable adaptation with minimal computational overhead and annotation costs for slide-level tasks. 2 Methods Figure 2: HASD is designed for scenarios where UNI model extracts the patch features from both centers, and the attention aggregation with the MLP classifier are trained on the source domain. (a): The training process of HASD includes the selection of label-free prototypes in each slide and domain adaption in the hierarchical framework, including domain-, slide- and patch-level regularization. (b): Inference with or without HASD. 2.1 Problem Definition Multiple Instance Learning. In a slide-level task with a cohort of N slides, each slide is treated as a bag B containing a different number of P patches extracted by a pretrained encoder into vectors \{r_{1},r_{2},...,r_{p}\}\in\mathbb{R}^{M} . Under the MIL assumption, each slide B carries a single label y (e.g., a cancer diagnosis), while individual patches lack direct labels. ABMIL [ 10 ] learns an attention mechanism Atten(\cdot) to aggregate the set of patch features into a slide-level prediction \hat{y} . Slide-Level Domain Shift. We consider two domains: a source domain \mathbf{R}^{src} where the model is trained, and a target domain \mathbf{R}^{tgt} where the model is tested. Slide-level domain shift cause the distribution of features in \mathbf{R}^{src} to differ from that in \mathbf{R}^{tgt} . Formally, we represent the source and target domains as: \mathbf{R}^{src}=\{\mathbf{r}_{1,1}^{src},\,\mathbf{r}_{1,2}^{src},\ldots,\,\mathbf{r}_{n,p}^{src}\},\quad\mathbf{R}^{tgt}=\{\mathbf{r}_{1,1}^{tgt},\,\mathbf{r}_{1,2}^{tgt},\ldots,\,\mathbf{r}_{n,p}^{tgt}\}, where \mathbf{r}_{n,p}^{src} denotes the p^{th} patch vector of the n^{th} slide. Optimal Transport (OT) [ 20 ] provides a solution for learning a mapping between \mathbf{R}^{src} and \mathbf{R}^{tgt} while minimizing the overall cost: \gamma\,c~\!(\mathbf{R}^{src},\,{\mathbf{R}^{tgt}}), with c(\cdot,\cdot) measures the feature distance (e.g., cosine similarity) and \gamma matches samples from source to target. Traditional OT is not well-suited for pathology slide-level domain adaptation, as it incurs significant computational overhead [ 24 ] and treats each patch as an isolated point, thereby ignoring the structured slide morphology and failing to preserve multi-scale feature consistency [ 14 ] . In the following section, we introduce our method to address these challenges. 2.2 Hierarchical Alignment Framework Domain-level Alignment Solver (DAS). Instead of directly using OT for domain adaptation, we propose optimizing a

Read the complete text