Evaluating unsupervised contrastive learning framework for MRI sequences classification

2025

Read Evaluating unsupervised contrastive learning framework for MRI sequences classification (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-06938.txt.

Introduction

Yuli Wang, Kritika Iyer, Sep Farhand, and Yoshihisa Shinagawa evaluate a learning system that sorts MRI scans by type, in two thousand twenty-five. Radiologists now sort scan sequences by hand, which slows diagnosis and planning. Scan settings also lack a standard, so data sets are hard to build and use.

Their system trains a neural network without labeled examples, by contrasting like and unlike images. It sorts nine common sequence types as a nine-way choice. It was trained on an in-house set and checked on several public sets, using only flat slices. Accuracy topped ninety-five percent across the nine types, despite varied scanning methods in the test sets.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-06938

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evaluating unsupervised contrastive learning framework for MRI sequences classification Abstract The automatic identification of Magnetic Resonance Imaging (MRI) sequences can streamline clinical workflows by reducing the time radiologists spend manually sorting and identifying sequences, thereby enabling faster diagnosis and treatment planning for patients. However, the lack of standardization in the parameters of MRI scans poses challenges for automated systems and complicates the generation and utilization of datasets for machine learning research. To address this issue, we propose a system for MRI sequence identification using an unsupervised contrastive deep learning framework. By training a convolutional neural network based on the ResNet-18 architecture, our system classifies nine common MRI sequence types as a 9-class classification problem. The network was trained using an in-house internal dataset and validated on several public datasets, including BraTS, ADNI, Fused Radiology-Pathology Prostate Dataset, the Breast Cancer Dataset (ACRIN), among others, encompassing diverse acquisition protocols and requiring only 2D slices for training. Our system achieves a classification accuracy of over 0.95 across the nine most common MRI sequence types. † † address: 1 Department of Biomedical Engineering, Johns Hopkins School of Medicine, USA 2 Siemens Healthineers, Malvern, PA, USA 1 Introduction Magnetic Resonance Imaging (MRI) provides clinical experts with detailed 3D visualization and analysis of a patient’s organ tissues, enabling the detection of abnormalities [ 7 , 15 , 4 ] . MR images are generated by recording the signal intensities emitted by water protons in tissue when excited by a resonant electromagnetic radio-frequency field. This process produces images with visible contrast between tissue elements (e.g., fat, fluids) by exploiting their varying characteristics, such as proton density and relaxation times. Typically, a comprehensive understanding of abnormalities is achieved by analyzing multiple MRI sequences, including T1-weighted, T2-weighted, FLAIR, Diffusion-Weighted Imaging (DWI), and derived Apparent Diffusion Coefficient (ADC) maps, among others. Certain MRI sequences are often reviewed together by radiologists because they provide complementary diagnostic information [ 6 , 14 ] . For example, T2-weighted MRI and DWI are frequently used in tandem for diagnosing lymphoma [ 5 , 16 ] . During the acquisition of these sequences, relevant patient and imaging information is stored in the DICOM header, including fields such as “Body Part Examined,” “Procedure Step Description,” “Series Description,” and “Protocol Name.” However, these fields often lack informative descriptions specific to sequence types, and discrepancies may arise. Such discrepancies occur frequently, especially when default scanner protocol information is used, and technologists do not have sufficient time to update every DICOM field accurately during a busy clinical day. This issue is further compounded by the diversity of MRI protocols and parametric sequences across different institutions globally. Additionally, the use of multiple MRI scanners from various manufacturers introduces extensive variations in voxel intensity distributions across sequences, as illustrated in Fig. 1 (a). Consequently, radiologists and referring physicians must navigate these inconsistencies while performing thorough evaluations of disease status. Such variations can also disrupt radiologists’ hanging protocols for reading images in PACS, often necessitating manual intervention to correct discrepancies. These inconsistencies present significant challenges when constructing large-scale clinical cohorts for patients who have undergone specific MRI imaging types or when developing artificial intelligence (AI) algorithms tailored for medical imaging. Figure 1: The pipeline of our framework includes (a) unlabeled data from various MRI sequences; (b) an unsupervised pre-training stage using either the SimCLR or SimSiam framework; and (c) a fine-tuning stage applied to downstream tasks on different datasets, including BraTS, ADNI, and the Multi-Organs dataset. An automated method for classifying MRI sequences can significantly reduce the need for radiologists to manually oversee them, enhancing efficiency and accuracy. To address this need, Mello et al., [ 3 ] achieved a classification accuracy of 99.27% with the ResNet-18 architecture trained on 3D brain MRI volumes. [ 8 ] proposed a method for automatic MRI sequence annotation by training a convolutional neural network (CNN) to classify sequence types, utilizing a 2D perspective to minimize the high memory and computational demands associated with 3D convolutions. However, this approach relies heavily on DICOM header data for accurate categorization and supervision. Moreover, achieving high classification accuracy and model generalizability demands a large quantity of labeled data, which may not always be readily available and requires time-consuming manual verification to ensure label accuracy. To date, there is no existing literature on unsupervised methods for MRI sequence classification applied to different anatomical regions such as the brain, chest, and abdomen. This paper aims to bridge this gap by proposing an automated framework for the classification of multi-parametric MRI sequences acquired at the chest, abdomen, and pelvis levels, as detailed in Fig. 1 . The proposed algorithm distinguishes between different MRI sequence types, specifically T1w, T2w, Fluid-Attenuated Inversion Recovery (FLAIR), Time-of-Flight (TOF), Trace-Weighted Imaging (TraceW), Diffusion-Weighted Imaging (DWI), ADC, Gradient Echo Imaging (GRE), and Perfusion. We validate our model’s effectiveness through consistent accuracy (ACC) metrics across two unsupervised contrastive learning architectures: SimCLR and SimSiam, applied to MRI sequences of both the body organs and brain. The structure of this paper is as follows: Section 2 outlines the dataset curation and the proposed method, while Section 3 details the experimental methodology and results. Section 4 provides the conclusions and discusses future perspectives. 2 Dataset and Methods 2.1 Dataset Curation For the in-house internal dataset, a total of 72,188 Brain MRI studies from over 25 distinct sequences were collected, with each series within a study manually verified. The majority of patients were imaged using the nine most common specific MRI sequences: T1, T2, FLAIR, TOF, TraceW, DWI, ADC, GRE, and Perfusion. To create the final cohort, we randomly selected images from 220 studies per sequence, retaining only the central 30% of images in the sagittal, coronal, and axial planes. Empty sequences contained errors or displayed repeated regions were excluded. Data from the 1,980 patients were then randomly partitioned at the patient level into training (70%, 864 studies or 23,568 images), validation (10%, 123 studies or 6,843 images), and test (20%, 247 studies or 3,568 images) sets, ensuring that all studies from the same study remained in the same subset. To reduce computational load during training, each MRI series was resampled to 84 × 84 pixels. To assess the model’s performance and generalizability across various anatomical regions and MRI sequences, we also incorporated two publicly available brain image datasets: the Brain Tumor Segmentation (BraTS) dataset [ 10 ] and the Alzheimer’s Disease Neuroimaging Initiative (ADNI) dataset [ 13 ] . Additionally, we utilized three organ-specific datasets, including the Fused Radiology-Pathology Prostate Dataset [ 9 ] , the Lausanne TOF Aneurysm Cohort [ 12 ] , and the Breast Cancer Dataset (ACRIN) [ 11 ] . These images were uniformly resampled to 80 × 80 pixels. Given the variation in available sequence types across these datasets, the model was retrained for each dataset separately. 2.2 Pre-training: Unsupervised Contrastive Learning Contrastive self-supervised methods assume that image transformations do not change an image’s semantic meaning. Consequently, different augmentations (including flip, rotation, and elastic transformations in this paper) of the same image form a ”positive pair,” while other images and their augmentations are ”negative pairs” relative to the instance. The model is trained to minimize the distance between positive pairs in latent space while maximizing the separation

Read the complete text