Segmentation of Gray Matters and White Matters from Brain MRI data

Chang Sun 1, Rui Shi 1, Tsukasa Koike 2, Tetsuro Sekine 3, Akio Morita 4, and Tetsuya Sakai 1 1 Department of Computer Science and Engineering, Waseda University, Shinjuku, Tokyo, Japan 2 Department of Radiology, Nippon Medical School Hospital, Tokyo, Japan 3 Department of Radiology, Nippon Medical School Musashi Kosugi Hospital, Kawasaki, Kanagawa, Japan 4 Tokyo Rosai Hospital, Ota, Tokyo, Japan · 2026

Read Segmentation of Gray Matters and White Matters from Brain MRI data by Chang Sun 1, Rui Shi 1, Tsukasa Koike 2, Tetsuro Sekine 3, Akio Morita 4, and Tetsuya Sakai 1 1 Department of Computer Science and Engineering, Waseda University, Shinjuku, Tokyo, Japan 2 Department of Radiology, Nippon Medical School Hospital, Tokyo, Japan 3 Department of Radiology, Nippon Medical School Musashi Kosugi Hospital, Kawasaki, Kanagawa, Japan 4 Tokyo Rosai Hospital, Ota, Tokyo, Japan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29171.txt.

Introduction

Sun and co-authors adapt the MedSAM foundation model to segment brain MRI scans. Their target tissues are gray matter and white matter. The pipeline first strips the skull and builds tissue probability maps. Scans are then cut into slices in three planes with class labels. The team extends the mask decoder to three classes. They freeze the image encoder and fine-tune the rest. On the IXI dataset, Dice scores reached up to 0.8751.

Catalog record

CREATORChang Sun 1, Rui Shi 1, Tsukasa Koike 2, Tetsuro Sekine 3, Akio Morita 4, and Tetsuya Sakai 1 1 Department of Computer Science and Engineering, Waseda University, Shinjuku, Tokyo, Japan 2 Department of Radiology, Nippon Medical School Hospital, Tokyo, Japan 3 Department of Radiology, Nippon Medical School Musashi Kosugi Hospital, Kawasaki, Kanagawa, Japan 4 Tokyo Rosai Hospital, Ota, Tokyo, Japan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25681
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.29171

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Segmentation of Gray Matters and White Matters from Brain MRI data Chang Sun 1, Rui Shi 1, Tsukasa Koike 2, Tetsuro Sekine 3, Akio Morita 4, and Tetsuya Sakai 1 1 Department of Computer Science and Engineering, Waseda University, Shinjuku, Tokyo, Japan 2 Department of Radiology, Nippon Medical School Hospital, Tokyo, Japan 3 Department of Radiology, Nippon Medical School Musashi Kosugi Hospital, Kawasaki, Kanagawa, Japan 4 Tokyo Rosai Hospital, Ota, Tokyo, Japan Abstract Accurate segmentation of brain tissues such as gray matter and white matter from magnetic resonance imaging is essential for studying brain anatomy, diagnosing neurological disorders, and monitoring disease progression. Traditional methods, such as FSL FAST, produce tissue probability maps but often require task-specific adjustments and face challenges with diverse imaging conditions. Recent foundation models, such as MedSAM, offer a prompt-based approach that leverages large-scale pretraining. In this paper, 1 1 1 This is the full-length version of a paper accepted for ICMIP 2026. we propose a modified MedSAM model designed for multi-class brain tissue segmentation. Our preprocessing pipeline includes skull stripping with FSL BET, tissue probability mapping with FSL FAST, and converting these into 2D axial, sagittal, coronal slices with multi-class labels (background, gray matter, and white matter). We extend MedSAM’s mask decoder to three classes, freezing the pre-trained image encoder and fine-tuning the prompt encoder and decoder. Experiments on the IXI dataset achieve Dice scores up to 0.8751. This work demonstrates that foundation models like MedSAM can be adapted for multi-class medical image segmentation with minimal architectural modifications. Our findings suggest that such models can be extended to more diverse medical imaging scenarios in future work. keywords White Matter and Gray Matter Segmentation, Human Brain MRI Images, MedSAM, Fine-Tuning 1 INTRODUCTION Magnetic Resonance Imaging (MRI) is a non-invasive, high-resolution method of visualizing the internal structure and certain aspects of function within the body. A major advantage is that the MRI scanner is able to differentiate between tissues with subtle signal intensity differences [ 1 ] . Gray matter and white matter play important roles in brain function [ 2 ] . Gray matter consists of neuronal cell bodies, dendrites, and synapses. White matter is composed of myelinated axons. White matter develops more slowly than gray matter, but also shows more rapid loss in older age [ 3 , 4 ] . The change in gray matter and white matter also affects human health. For example, heart failure is associated with localized gray matter deterioration. Loss of gray matter can also cause autonomic disturbances, memory deficits, and sleep-disordered breathing [ 5 ] . Aging can cause a reduced volume, compromised structural integrity of myelinated axons and an increase in white matter hyperintensities in white matter. These changes are closely linked to cognitive decline and neurological disabilities [ 6 ] . Therefore, white matter and gray matter segmentation are crucial for monitoring human health welfare. There are different methods designed for segmentation: Traditional methods include thresholding, region growing, and K-means. Deep learning models have also been developed over the years for the segmentation of brain MRI images, such as the U-Net architecture [ 7 ] . Building on the U-Net architecture, nnU-Net framework was proposed [ 8 ] . More recently, foundation models such as MedSAM offer flexible, prompt-based segmentation [ 9 ] . Although MedSAM works well for binary segmentation (foreground vs background), its application to multi-class tasks like gray matter and white matter segmentation remains underexplored. In this paper, we propose a modified MedSAM model tailored for multi-class tissue segmentation of brain MRI. We extend the original mask decoder to output three classes (background, gray matter, and white matter), while freezing the encoder and fine-tuning the prompt decoder. We evaluate whether this minimally modified architecture can achieve accurate segmentation on T1-weighted MRI slices from different anatomical orientations. 2 BACKGROUND AND RELATED WORK In this section, we provide the background relevant to brain MRI segmentation, including skull stripping with FSL BET, tissue segmentation with FSL FAST, and fine-tuning approaches in medical imaging. 2.1 Brain Extraction with FSL BET The Brain Extraction Tool (BET), part of the FMRIB (Functional MRI of the Brain) Software Library, is widely used for removing non-brain tissue (e.g., skull, scalp) from T1-weighted MRI volumes. BET uses a deformable surface model to estimate the brain boundary. It has become a standard preprocessing step in many neuroimaging workflows. This helps improve the accuracy of downstream tasks such as segmentation and registration [ 10 ] . 2.2 Tissue Segmentation with FSL Fast FSL FAST segments brain tissue into gray matter, white matter, and cerebrospinal fluid by modeling voxel intensities with a hidden Markov random field and applying the Expectation-Maximization (EM) algorithm. It produces probabilistic maps for each of the gray matter, white matter and cerebrospinal fluid. The probabilistic maps are used in many research pipelines as pseudo ground truth [ 11 ] . 2.3 Fine-Tuning in Medical Imaging Fine-tuning adapts a pre-trained model to a target task by continuing training on domain-specific data. In medical imaging, this is critical due to the limited availability of labeled data. Tajbakhsh et al. (2016) demonstrated that fine-tuned models consistently outperform training-from-scratch models when data is limited, especially in classification and segmentation tasks [ 12 ] . 2.4 Traditional Methods There are traditional MRI segmentation methods, such as thresholding, region growing, and K-means. Thresholding is one of the oldest techniques [ 13 ] . It assumes that images are composed of regions with different gray level ranges. A thresholding procedure determines an intensity value (threshold) that separates the desired classes. Grouping all pixels with intensities between two thresholds into one class completes the segmentation process. Region growing is a technique for extracting a region of an image that is connected based on some predefined criteria [ 14 ] . This criterion is determined based on the edges and/or intensities in the image. This requires an operator to select a seed point manually and extract all pixels connected to the initial seed with the same intensity value. As its name suggests, region growing iteratively expands the segmented area. In the next step, we examine the pixels in a small neighborhood region and add them to the growing regions. K-means clustering algorithm is an unsupervised method that classifies input data points into multiple classes based on their inherent distance from each other [ 15 , 16 ] . The k-means algorithm assumes that the data features form a vector space. Then it tries to find natural clustering in them. Additional traditional approaches include boundary-based models, such as the parametric/nonparametric deformable model, which are boundary-based methods, and level set methods, which are hybrid methods [ 17 ] . 2.5 Deep Learning Methods Apart from the traditional methods that have been mentioned above, this section shares related works of segmentation using different deep learning model structures and training methods [ 18 ] . One of the early model architectures introduced is the U-Net architecture by Ronneberger et al. (2015) [ 7 ] . This is a CNN architecture that employs a symmetric encoder-decoder structure with skip connections. The contracting path in this structure is used for capturing context, and the symmetric expanding path is used for precise localization. Different model architectures have also been

Read the complete text