Domain Adaptation Without the Compute Burden for Efficient Whole Slide Image Analysis
Umar Marikkar 1, Muhammad Awais 1,2, Sara Atito 1,2 · 2026
Read Domain Adaptation Without the Compute Burden for Efficient Whole Slide Image Analysis by Umar Marikkar 1, Muhammad Awais 1,2, Sara Atito 1,2 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-15774.txt.
Introduction
Marikkar, Awais, and Atito cut the compute cost of whole slide image analysis. Giant slide scans make end-to-end training impractical in pathology. Standard pipelines freeze feature extractors trained on natural images. In-domain pretraining helps but costs heavily and stays task-blind. Their eWSI method joins light fine-tuning with multiple instance learning. End-to-end training then runs on slide-level tasks directly. Tests span seven tasks on Camelyon16, TCGA, and BRACS data. eWSI matched or beat frozen in-domain extractors at lower cost.
Catalog record
| CREATOR | Umar Marikkar 1, Muhammad Awais 1,2, Sara Atito 1,2 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43046 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.15774
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Domain Adaptation Without the Compute Burden for Efficient Whole Slide Image Analysis Umar Marikkar 1, Muhammad Awais 1,2, Sara Atito 1,2 Abstract Computational methods on analyzing Whole Slide Images (WSIs) enable early diagnosis and treatments by supporting pathologists in detection and classification of tumors. However, the extremely high resolution of WSIs makes end-to-end training impractical compared to typical image analysis tasks. To address this, most approaches use pre-trained feature extractors to obtain fixed representations of whole slides, which are then combined with Multiple Instance Learning (MIL) for downstream tasks. These feature extractors are typically pre-trained on natural image datasets such as ImageNet, which fail to capture domain-specific characteristics. Although domain-specific pre-training on histopathology data yields more relevant feature representations, it remains computationally expensive and fail to capture task-specific characteristics within the domain. To address the computational cost and lack of task-specificity in domain-specific pre-training, we propose EfficientWSI (eWSI), a careful integration of Parameter-Efficient-Fine-Tuning (PEFT) and Multiple Instance Learning (MIL) that enables end-to-end training on WSI tasks. We evaluate eWSI on seven WSI-level tasks over Camelyon16, TCGA and BRACS datasets. Our results show that eWSI when applied with ImageNet feature extractors yields strong classification performance, matching or outperforming MILs with in-domain feature extractors, alleviating the need for extensive in-domain pre-training. Furthermore, when eWSI is applied with in-domain feature extractors, it further improves classification performance in most cases, demonstrating its ability to capture task-specific information where beneficial. Our findings suggest that eWSI provides a task-targeted, computationally efficient path for WSI tasks, offering a promising direction for task-specific learning in computational pathology. \midlauthor 1 Institute for People-Centered AI, University of Surrey 2 Centre of Vision, Speech and Signal Processing, University of Surrey † † year: 2026 † † workshop: Full Paper – MIDL 2026 † † volume: – nnn † † editors: Accepted for publication at MIDL 2026 keywords Histopathology, Multiple Instance Learning, Domain adaptation, Parameter-efficient fine-tuning Figure 1: Moving from ImageNet to domain specific encoders, an easy path through eWSI (radial axis is %AUC). 1 Introduction Computational pathology has gained prominence in assisting pathologists by automating routine observational and analytical tasks in histopathology, thereby facilitating early diagnosis, prognosis assessment, and clinical decision-making. In particular, computational methods using deep learning for Whole Slide Image (WSI) analysis have been developed to automatically detect malignant tumor regions, classify cancer subtypes, and identify molecular properties of tissue, augmenting traditional pathology workflows that rely on manual examination. However, traditional deep learning methods for image processing cannot directly be applied on WSIs due to memory constraints. WSIs are extremely large, and high-magnification WSIs can reach sizes on the order of gigapixels 3 . Therefore, the common approach is to tile WSIs into a large collection of smaller patches (e.g.: \approx 10\mathrm{k} at a tiling resolution of 224\times 224 pixels), pre-compute patch representations through image encoders ahead of time, and perform learning on these fixed patch representations. The latter process of learning from frozen patch representations is typically carried out using Multiple Instance Learning (MIL) methods. In the context of WSI analysis, MIL methods are designed to learn a global slide-level WSI representation by aggregating the collection of individual patch representations using lightweight architectures. Since MIL methods rely on fixed patch representations, downstream task performance is heavily dependent on the quality of those representations. In spite of that, MIL studies 11 ; 37 ; 6 ; 27 typically rely on features obtained from image encoder models pre-trained on ImageNet ( 5 ) , hence their performance on WSI tasks is bottlenecked. While applying MIL methods with in-domain pretrained image encoders ( 33 ; 13 ; 9 ; 21 ; 26 ) improves downstream performance, such pretraining is computationally expensive. Moreover, even with the use of publicly available in-domain pre-trained encoders, the reliance on fixed patch representations prevents the model from learning task-specific characteristics directly from raw WSI data. This motivates the exploration of learning protocols that are not bottle-necked by patch representations, while remaining computationally efficient to train. We first build on the observation that existing ImageNet pre-trained encoders already capture low-level features such as intensity levels and texture patterns, which are also relevant in WSI data. Based on this, we investigate an end-to-end framework that reduces reliance on extensive pretraining while allowing task-specific characteristics to be learned directly from raw data. We refer to this framework as EfficientWSI (eWSI) . eWSI combines parameter-efficient fine-tuning (PEFT) with a tailored MIL architecture. In eWSI, the PEFT component adapts encoder weights minimally yet effectively to capture task-specific information at the patch-level. In turn, the MIL architecture is able to leverage the enriched patch-level information to construct a stronger task-specific slide-level representation. We evaluate eWSI on seven downstream tasks over Camelyon16 1 , TCGA 30 , and BRACS 2 datasets. When applied with ImageNet encoders, eWSI outperforms standard MIL-only methods that rely on frozen patch representations extracted from ImageNet encoders, and achieves performance comparable to MIL methods using in-domain patch representations (see fig:abstract). Moreover, applying eWSI with in-domain encoders yields further gains on most tasks, indicating that the framework effectively leverages task information from low-level data where beneficial. 2 Prior Works We review existing studies on Multiple Instance Learning, the predominant paradigm for solving WSI tasks; end-to-end learning for WSIs, which is the primary aim of this work; and the emergence of PEFT methods based on low-rank adaptation, which we leverage to enable end-to-end learning. Multiple Instance Learning. A significant body of research exists on MIL methods, particularly for histopathology and standard MIL benchmarks. 11 introduce attention-based MIL (ABMIL), using a learned weight vector to aggregate input features. TransMIL ( 27 ) replaces ABMIL’s attention-pooling with a Vision Transformer (ViT) ( 8 ) variant and Nyström based self attention approximation. Recent advancements include ACMIL ( 37 ) , which mitigates overfitting in ABMIL, and AEM ( 38 ) , which incorporates a loss for attention values itself. IBMIL ( 19 ) addresses contextual bias using backdoor adjustment, while Snuffy ( 12 ) combines patch prediction with multi-headed attention. Multi-magnification methods ( 17 ; 6 ; 23 ; 29 ) show slight improvements but are excluded here. This study focuses on single magnification encoder training, leaving multi-magnification approaches for future work. End-to-end processing for WSIs. End-to-end WSI training research is limited due to the computational constraints caused by WSI size. Early works by 4 propose Convolutional Neural Networks (CNNs) for joint patch and slide-level classification, selecting top-k patches per epoch for end-to-end training, which is reliant on the pre-computation of all patches at the start of an epoch. Similarly, EPL ( 34 ) and C2C ( 28 ) both leverage patch clustering and use cluster centroid patches to perform end-to-end training. However, they rely on expensive pre-computation—either by clustering all features or per epoch, which incurs significant computational overhead. In contrast, we implement data-efficient patch sampling during training. GIGA-SSL ( 15 ) pre-trains WSIs using self-supervised using contrastive learning but freezes slide representations during fine-tuning, limiting task-specific adaptation capabilities. Snuffy ( 12 ) applies PEFT as pre-training step, but similarly lacks end-to-end learning. Streaming-CLAM ( 7 ) combines streaming with CLAM ( 22 ) for end-to-end training, achieving high AUC on Camelyon16 but with significant computational overhead (165 seconds per forward pass and