Is Complete Labeling Necessary? Understanding Active Learning in Longitudinal Medical Imaging
Siteng Ma, Honghui Du, Prateek Mathur, Brendan S. Kelly, Ronan P. Killeen, Aonghus Lawlor, Ruihai Dong · 2025
Read Is Complete Labeling Necessary? Understanding Active Learning in Longitudinal Medical Imaging by Siteng Ma, Honghui Du, Prateek Mathur, Brendan S. Kelly, Ronan P. Killeen, Aonghus Lawlor, Ruihai Dong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-18007.txt.
Introduction
Siteng Ma, Honghui Du, Prateek Mathur, Brendan S Kelly, Ronan P Killeen, Aonghus Lawlor, and Ruihai Dong ask whether full labelling is needed for change detection on medical scans taken over time. Labelling such series is slow and costly, since new lesions can be tiny and easy to miss across visits. Active learning, which asks experts to label only the most useful cases, has mostly been tested on still tasks, not on change over time.
The team builds a framework shaped for longitudinal imaging, pairing and differencing two-dimensional slices so change itself becomes the signal the learner queries. The aim is to reach strong detection with far fewer expert labels. For hospitals sitting on large unlabelled scan archives, a method of this kind could cut the cost of building monitoring tools sharply.
Catalog record
| CREATOR | Siteng Ma, Honghui Du, Prateek Mathur, Brendan S. Kelly, Ronan P. Killeen, Aonghus Lawlor, Ruihai Dong |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-18007
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Is Complete Labeling Necessary? Understanding Active Learning in Longitudinal Medical Imaging Siteng Ma, Honghui Du, Prateek Mathur, Brendan S. Kelly, Ronan P. Killeen, Aonghus Lawlor, Ruihai Dong Abstract Detecting changes in longitudinal medical imaging using deep learning requires a substantial amount of accurately labeled data. However, labeling these images is notably more costly and time-consuming than labeling other image types, as it requires labeling across various time points, where new lesions can be minor, and subtle changes are easily missed. Deep Active Learning (DAL) has shown promise in minimizing labeling costs by selectively querying the most informative samples, but existing studies have primarily focused on static tasks like classification and segmentation. Consequently, the conventional DAL approach cannot be directly applied to change detection tasks, which involve identifying subtle differences across multiple images. In this study, we propose a novel DAL framework, named Longitudinal Medical Imaging Active Learning (LMI-AL), tailored specifically for longitudinal medical imaging. By pairing and differencing all 2D slices from baseline and follow-up 3D images, LMI-AL iteratively selects the most informative pairs for labeling using DAL, training a deep learning model with minimal manual annotation. Experimental results demonstrate that, with less than 8% of the data labeled, LMI-AL can achieve performance comparable to models trained on fully labeled datasets. We also provide a detailed analysis of the method’s performance, as guidance for future research. The code is publicly available at https://github.com/HelenMa9998/Longitudinal_AL. I Introduction A longitudinal study in medical image analysis involves tracking and analysing a series of medical images over time to observe and measure subject-specific changes in a patient’s condition. This plays a pivotal role in managing chronic and progressive diseases (e.g., tracking tumor growth and shrinkage, assessing the progression of Multiple Sclerosis) [ 43 ] . Recently, supervised deep learning (DL) approaches that train the deep model using a fully labeled dataset have become well known for effectively identifying and extracting meaningful information in computer vision and medical image analysis [ 7 ] . However, their effectiveness is heavily dependent on the availability of extensive datasets with accurate labels [ 4 ] , which poses a major challenge in the context of longitudinal medical imaging [ 43 ] . Labeling longitudinal medical images is notably more laborious, costly, and time-consuming [ 10 ] compared to other scenarios. It requires experienced experts to label the data across multiple time points [ 25 ] . Moreover, given that the changes in the images can be minute (3-10 voxels in size on MRI images) and may present with subtle appearances [ 38 ] , it is easy to fail in annotating minor abnormalities or changes, leading to inaccuracies and inconsistencies in labeling [ 38 , 12 ] . Therefore, this demands experts label the data very carefully and sometimes repeatedly to ensure all possible changes are annotated, making the process of labeling large longitudinal medical image datasets impractical. Deep Active Learning (DAL) is a machine learning approach where the algorithm selectively queries the most valuable data examples for training deep learning models. Oracles (e.g., radiologists) label these examples to minimize the overall labeling effort and maintain or enhance the model’s predictive performance [ 39 ] . Recent research [ 27 , 40 , 26 , 24 ] has demonstrated that DAL can effectively reduce labeling costs in 2D/3D medical image analysis. As noted, labeling and training with longitudinal medical images can be much more challenging than with standard medical images. However, no studies have been conducted to explore the effectiveness of DAL with longitudinal medical imaging data. Consequently, it remains unclear what an effective query strategy would be for selecting images in pairs to train a DL model for change detection effectively. Simply applying existing DAL methods to longitudinal medical images may result in poor performance. Therefore, this paper aims to answer the following research question: How can DAL be used to reduce the labeling effort in longitudinal medical imaging while maintaining the model’s performance? To answer this question, we propose a novel approach named Longitudinal Medical Imaging Active Learning (LMI-AL). LMI-AL is the first framework specifically designed to adapt DAL approaches to change detection in longitudinal medical imaging, significantly reducing labeling efforts by enhancing the efficiency of DL model training. Initially, LMI-AL transforms 3D images into 2D slices. Each pair of slices (baseline and follow-up scans) and their differences are grouped together. To ensure the model learns from all potential variations, LMI-AL creates the initial slice pool using all possible pairwise combinations of slices. LMI-AL then iteratively selects slice pairs and their corresponding differences based on the selected AL query strategy for labeling and trains the DL model accordingly. Through extensive experiments, we demonstrate that LMI-AL achieves comparable performance to fully supervised methods while requiring less than 8% of labels, significantly decreasing the annotated image slices. We also provide detailed analysis based on the result to give guidance for future researchers. The rest of the paper is organized as follows: we present a survey of related research in Section II , the proposed LMI-AL framework is detailed in Section III . Then Section IV and Section V present the experiment setup, results, and corresponding analysis of our empirical studies. The conclusion can be found in Section VI . Fig. 1 : The overall process of applying active learning in longitudinal medical image analysis. II Related Work In this section, we present an overview of DL change detection models and methods in longitudinal medical settings. Then Deep Active Learning (DAL) methods in general scenarios are given. II-A Change Detection in Longitudinal Medical Imaging A majority of literatures [ 7 , 14 , 2 ] have focused on leveraging fully supervised learning for solving problems in longitudinal medical image analysis. Initially, Recurrent Neural Network (RNN)-based models (e.g., LSTM [ 16 ] and GRU [ 13 ] ) are extensively used to capture temporal relationships in longitudinal medical imaging data. These approaches typically involve using convolutional neural networks (CNNs) to extract features from images, which are then processed by RNN-based models to learn temporal dependencies [ 7 , 42 ] . However, RNN-based models are difficult to train and prone to the exploding gradient problem [ 30 ] . Recent studies have integrated LSTM layers into CNNs to better model temporal images [ 8 , 14 ] . CNN models have proven effective in image analysis [ 20 ] , are frequently used for change detection [ 2 , 1 , 38 ] . For instance, UNet [ 31 ] , a popular CNN-based segmentation architecture, concatenates baseline and follow-up images as 2-channel inputs to enhance model performance [ 2 , 1 , 38 ] , where [ 38 ] further involves the difference between baseline and follow-up images to help the model concentrate on the potential change areas. Moreover, UNet remains the core model and employs multiple views, such as coronal, axial, and sagittal planes in 3D medical imaging (e.g., MRI or CT scans) by concatenating adjacent temporal sequences as inputs and averaging the outputs, which can further improve the results [ 15 ] . Recent innovations have incorporated attention mechanisms into UNet to better focus the model on target regions [ 33 ] , maintaining the basic framework described