From Traditional to Deep Learning Approaches in Whole Slide Image Registration: A Methodological Review
Behnaz Elhaminia, Abdullah Alsalemi, Esha Nasir, Mostafa Jahanifar, Ruqayya Awan, Lawrence S. Young, Nasir M. Rajpoot, Fayyaz Minhas, Shan E Ahmed Raza · 2025
Read From Traditional to Deep Learning Approaches in Whole Slide Image Registration: A Methodological Review by Behnaz Elhaminia, Abdullah Alsalemi, Esha Nasir, Mostafa Jahanifar, Ruqayya Awan, Lawrence S. Young, Nasir M. Rajpoot, Fayyaz Minhas, Shan E Ahmed Raza (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-19123.txt.
Introduction
Behnaz Elhaminia and co-authors review methods for aligning whole slide images of tissue, a key step in cancer microscopy. Their 2025 review spans classic image methods through deep learning. Alignment matters because one tissue slice is stained and scanned in several versions, and matching them lets analysts stack cells into three-dimensional views of the tumor's neighborhood.
The task is far harder than aligning medical scans. The images are gigantic, stains change how tissue looks, and cuts warp shape from slice to slice. The authors sort the methods by approach and weigh their strengths on these challenges. Their map is meant to guide labs picking or building registration tools.
Catalog record
| CREATOR | Behnaz Elhaminia, Abdullah Alsalemi, Esha Nasir, Mostafa Jahanifar, Ruqayya Awan, Lawrence S. Young, Nasir M. Rajpoot, Fayyaz Minhas, Shan E Ahmed Raza |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 101 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-19123
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Traditional to Deep Learning Approaches in Whole Slide Image Registration: A Methodological Review Behnaz Elhaminia, Abdullah Alsalemi, Esha Nasir, Mostafa Jahanifar, Ruqayya Awan, Lawrence S. Young, Nasir M. Rajpoot, Fayyaz Minhas, Shan E Ahmed Raza Abstract Whole slide image (WSI) registration is an essential task for analysing the tumour microenvironment (TME) in histopathology. It involves the alignment of spatial information between WSIs of the same section or serial sections of a tissue sample. The tissue sections are usually stained with single or multiple biomarkers before imaging, and the goal is to identify neighbouring nuclei along the Z-axis for creating a 3D image or identifying subclasses of cells in the TME. This task is considerably more challenging compared to radiology image registration, such as magnetic resonance imaging or computed tomography, due to various factors. These include gigapixel size of images, variations in appearance between differently stained tissues, changes in structure and morphology between non-consecutive sections, and the presence of artefacts, tears, and deformations. Currently, there is a noticeable gap in the literature regarding a review of the current approaches and their limitations, as well as the challenges and opportunities they present. We aim to provide a comprehensive understanding of the available approaches and their application for various purposes. Furthermore, we investigate current deep learning methods used for WSI registration, emphasising their diverse methodologies. We examine the available datasets and explore tools and software employed in the field. Finally, we identify open challenges and potential future trends in this area of research. 1 Introduction Image registration, also known as image alignment, is a technique to find a spatial transformation for aligning two or more images. This transformation brings the images into a common coordinate system, making them directly comparable. For various tasks, when working with images of the same object or a scene, acquired at different times, from different sensors, or under different conditions, it is necessary to register them on the same coordinate system as they would in a physical space. In the field of medicine, image analysis plays a pivotal role in diagnosis, prognosis, treatment planning, and follow-up monitoring. However, in the majority of the cases, the images are acquired using multiple modalities, markers or techniques which vary in terms of temporal, spatial and dimensional aspects which necessitates the need to align the images for appropriate diagnosis and downstream analysis. Consequently, image registration has emerged as an indispensable tool for medical image analysis and has been used in many applications [ 1 ] . Figure 1: Overview of a general pipeline for WSI registration and downstream analysis. After biopsy collection and digitization, the registration algorithm matches two images. The resulting registered images are then used for further analysis. In this figure, the downstream analysis is adopted from the work of Westein et al. [ 2 ] , which focuses on the analysis of survival rates. In pathology, analysing multi-gigapixel images of serial and differently stained histology sections provides valuable insights into the spatial heterogeneity of various molecular markers and the distribution of various kinds of cells. For example, the distribution of tumour cells in relation to immune cell subtypes in the TME can be highly informative for understanding disease dynamics and guiding treatment strategies. Additionally, the quantification of various critical factors, such as the extent of lymphocytic infiltration, aids in understanding disease progression, treatment response, and potential therapeutic strategies. Furthermore, multi-stained tissue slide analysis can help predict responses to immunotherapy using immune markers [ 3 ] . Generating a histology WSI includes slicing a tissue sample into thin layers (typically 2-5 \mu m thick [ 4 ] ) and then staining them using various markers to visualise different cellular components. Fig. 1 illustrates the slide preparation. The most common stain is Haematoxylin and Eosin (HE) stain which is commonly used in routine pathology practice [ 5 ] . The stained slides serve as a crucial tool for diverse analyses in pathology. In several tasks, other stains in addition to HE such as immunohistochemical (IHC) stains like Ki67 or Estrogen Receptor (ER), may be required for a comprehensive analysis e.g., for ER scoring in breast cancer [ 6 ] . Fluorescence imaging further adds strength to these techniques [ 7 ] . There are emerging technologies for multiplexed imaging such as CODEX [ 8 ] , which provide a deep view of spatial relationships at the single-cell level within tissues. However, combining information from distinct images such as multiplexed immunofluorescence (mIF) images, serial section images, serially stained images, and other diverse forms of data with routine HE WSIs requires precise multimodal image registration. To meet this demand, numerous researchers have proposed various registration methods, leading to a growing number of papers focusing on this aspect. On the other hand, deep learning has gained considerable attention in recent years for medical image registration [ 9 ] , consequently prompting researchers to employ it for WSI registration. Fig. 2 summarises the breakdown of papers published in the area of WSI registration over the past years and included in this review. The chart shows a rise in the utilisation of deep learning for WSI registration. Figure 2: Breakdown of papers proposed for histology image registration (included in this review) in the year of publication. The chart depicts rising trends in the utilisation of deep learning for WSI registration. While numerous surveys have exhaustively covered medical image registration [ 10 , 11 , 1 , 12 ] , there is a notable gap in the domain of WSI registration. Since digital pathology has become more prevalent, it is crucial to address this research gap, and hence a detailed review of state-of-the-art approaches along with the challenges and opportunities presented by WSI registration, needs to be documented. In this work, we aim to review state-of-the-art research on WSI registration, with a focus on methods using deep learning. We categorise the methods into two distinct approaches: conventional methods and deep learning models. Fig. 3 shows the classification of the methods along with their common subcategory models for each. Reviewed literature is investigated from various perspectives such as techniques, evaluation metrics, datasets, and modalities. Deep learning-based methods are grouped into three categories based on their network approaches. Finally, we explore the available datasets, software, and tools, and discuss various challenges, open problems, and possible future directions. This review provides a thorough understanding for readers in the field who are exploring the latest advancements and aiming to contribute to future research. Figure 3: Taxonomy of registration methods reviewed in this study. The methods are categorised based on their approach into two main groups: deep learning models and conventional approaches. General models used for each category and reviewed in this work are depicted in pink. 2 WSI Registration 2.1 Problem Formulation WSI registration is a process that involves aligning and merging multiple WSI scans obtained from different slides, scanners, or time points. In a conventional setting, the pathologists perform WSI registration manually or semi-automatically. The process involves visually aligning multiple WSIs using specialised software or viewer tools. This requires expert execution and supervision, and it is a time-consuming task that demands meticulous attention to detail and expertise in identifying reference points for alignment. However, with advances in digital pathology