Automatic Landmark-Based Segmentation of Human Subcortical Structures in MRI

Ahmed Rekik, R. Jarrett Rushmore, Sylvain Bouix, Linda Marrakchi-Kacem, [10pt] École de technologie supérieure (ÉTS), Montréal, Canada · 2026

Read Automatic Landmark-Based Segmentation of Human Subcortical Structures in MRI by Ahmed Rekik, R. Jarrett Rushmore, Sylvain Bouix, Linda Marrakchi-Kacem, [10pt] École de technologie supérieure (ÉTS), Montréal, Canada (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14221.txt.

Introduction

Rekik and three co-authors propose landmark-guided 3D brain segmentation for human subcortical structures in MRI. Precise segmentation underpins reliable neuroimaging, yet voxel-wise deep models often produce anatomically inconsistent results that stray from expert boundaries. Their approach mimics the manual Harvard-Oxford Atlas protocol: a Global-to-Local network first detects sixteen landmarks marking key subcortical reference points. A semantic segmentation model then yields a coarse map of twelve anatomical labels, and landmark-driven post-processing splits those labels into twenty-six distinct structures under local anatomical constraints.

Catalog record

CREATORAhmed Rekik, R. Jarrett Rushmore, Sylvain Bouix, Linda Marrakchi-Kacem, [10pt] École de technologie supérieure (ÉTS), Montréal, Canada
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25479
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14221

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Automatic Landmark-Based Segmentation of Human Subcortical Structures in MRI Thanks: ∗ Equal senior author contribution. Ahmed Rekik, R. Jarrett Rushmore, Sylvain Bouix, Linda Marrakchi-Kacem, [10pt] École de technologie supérieure (ÉTS), Montréal, Canada Abstract Precise segmentation of brain structures in magnetic resonance imaging (MRI) is essential for reliable neuroimaging analysis, yet voxel-wise deep models often yield anatomically inconsistent results that diverge from expert-defined boundaries. In this research, we propose a landmark-guided 3D brain segmentation approach that explicitly mimics the manual segmentation protocol of the Harvard–Oxford Atlas. A Global-to-Local network automatically detects 16 landmarks representing key subcortical reference points. Then, a semantic segmentation model produces a coarse segmentation of 12 anatomical labels, each grouping multiple subcortical regions. Finally, a landmark-driven post-processing step separates these 12 labels into 26 distinct structures by enforcing local anatomical constraints. Experimental results demonstrate consistent improvements in boundary accuracy. Overall, integrating learned landmarks aligns segmentations more closely with manual protocols. I Introduction Accurate segmentation of subcortical structures in MRI is essential for neuroimaging research, clinical assessment, and neurosurgical planning [ 1 ] . Classical atlas-based methods, such as FSL-FIRST [ 2 ] and multi-atlas label fusion approaches [ 3 ] , incorporate anatomical priors through template registration and label propagation. Although these methods can provide anatomically consistent segmentations, they depend heavily on registration quality and may be limited in capturing subject-specific anatomical variability. Deep learning models such as U–Net [ 4 ] and transformer–based networks [ 5 , 6 ] have significantly advanced automated segmentation. However, they may still produce anatomically inconsistent results – for example, boundary leakage, fused neighboring structures, or deviations from expert neuroanatomical definitions [ 7 ] . A major reason is that conventional neural networks rely primarily on voxel appearance (intensity, texture) without incorporating anatomical reference points [ 8 ] . In contrast, expert neuroanatomists rely on specific landmarks – such as the anterior commissure (AC) or mammillary bodies – to define where a structure begins, ends, or divides. These landmarks are essential for accurately and reliably segmenting complex regions that lie in close spatial proximity and often have no intensity difference in T1-weighted (T1w) MRI. In the Harvard–Oxford Atlas (HOA) manual curation protocol [ 9 , 10 ] , each subcortical structure is delineated according to such landmarks and plane-based rules. This ensures consistent annotation across raters and datasets. However, manual annotation remains time-consuming and does not scale to large datasets. In this paper, we translate this anatomical rigor into an automated framework by combining landmark detection with protocol-driven segmentation. This approach allows us to leverage the power of deep learning methods for automated semantic segmentation in areas where contrast and intensity patterns are informative, and also separate two or more structures using anatomical rules defined by external landmarks. First, a Global-to-Local network detects 16 landmarks, following the HOA protocol. Second, a UNesT model [ 6 ] predicts a coarse segmentation with 12 merged labels. Finally, the coarse output is refined into 26 regions using landmark-defined planes that separate fused structures and enforce neuroanatomical protocol constraints. Experiments show that the landmark-guided segmentation yields marginal global gains but achieves higher boundary accuracy and closer alignment with manual protocols. II Methods II-A Codifying the HOA procedure In accordance with the HOA protocols, 16 anatomical landmarks (Table I ) are defined to assist the manual delineation of 26 subcortical structures [ 10 , 9 ] . For example, the anterior commissure (AC), posterior commissure (PC), and prepontine fissure (PPF) form a plane used to separate the left and right hemispheres. This novel approach bridges the gap between anatomical protocols defined by human experts and “blind”, protocol-unaware semantic segmentation. TABLE I: Summary of the 16 anatomical landmarks Region Landmark(s) ID Putamen First anterior appearance (L/R) 1, 2 Nucleus accumbens–putamen interface Anterior contact (L/R) 3, 4 Nucleus accumbens–putamen interface Posterior contact (L/R) 5, 6 Nubbins Last anterior appearance of nucleus accumbens (L/R) 7, 8 Third ventricle First anterior appearance 9 Commissures Anterior / Posterior commissure 10, 15 Ventral Diencephalon Mammillary bodies (L/R) 11, 12 Continuity of atrium First posterior appearance of inferior horn (L/R) 13, 14 Brainstem limit Prepontine fissure 16 After reviewing this protocol, we observed that the process can be reproduced using a simplified formulation. Given 12 fused anatomical regions and 16 landmarks, the original 26-label ground truth can be reconstructed through deterministic post-processing rules (Table II ). TABLE II: Mapping from 26 to 12 fused anatomical labels Anatomical Structures (IDs; Abbreviations) Fused Label (1, 2) Lateral Ventricle (LV_L / LV_R); (17, 18) Inferior Horn (IH_L / IH_R) (1) LV + IH (3) Cerebrospinal Fluid (CSF) (2) CSF (4) Third Ventricle (3V) (3) 3V (5) Fourth Ventricle (4V) (4) 4V (6, 7) Nucleus Accumbens (NAcc_L / NAcc_R); (10, 11) Putamen (Put_L / Put_R) (5) NAcc + Put (8, 9) Caudate (CAU_L / CAU_R) (6) CAU (12, 13) Globus Pallidus (GP_L / GP_R) (7) GP (14) Brainstem (8) Brainstem (15, 16) Thalamus (TH_L / TH_R) (9) TH (19, 20) Hippocampal Formation (HF_L / HF_R) (10) HF (21, 22) Amygdala (AMY_L / AMY_R) (11) AMY (23–26) Ventral Diencephalon (VDC_A_L/R, VDC_P_L/R) (12) VDC Midline splitting. A midsagittal plane defined by the AC, PC, and PPF splits each coronal slice into left and right hemispheres (Figure 1 ). For subsequent slices, the plane is slightly adjusted using the previous segmentation to correct interhemispheric misassignments. Fig. 1: Left/right separation using the midsagittal plane defined by AC, PC, and PPF. SEG_A corresponds to the coarse segmentation produced by UNesT, while SEG_B denotes the refined segmentation after landmark-guided post-processing using the AC–PC–PPF plane. NAcc–Put separation. The fused NAcc–Put label is split using vertical slice-wise separators defined by the contact landmarks (#3–#6), yielding distinct NAcc and Putamen regions, as illustrated in Fig. 5 (top). Coronal extents. Protocol-aligned boundaries are enforced using landmark-defined planes: (i) the putamen is truncated anteriorly at landmarks #1–#2; (ii) the NAcc is truncated posteriorly at landmarks #7–#8; (iii) the third ventricle is excluded anterior to landmark #9; (iv) the VDC is divided into anterior and posterior parts by landmarks #11–#12; and (v) the inferior horn is separated from the lateral ventricle up to landmarks #13–#14. II-B Dataset We used the HOA subcortical dataset, consisting of 100 T1-weighted MRI volumes from the Human Connectome Project Young Adult cohort with manual voxel-wise segmentations of 26 subcortical brain structures [ 9 ] . The corresponding 16 anatomical landmarks were manually annotated in this study following the HOA protocol. All scans have isotropic resolution of 0.7 mm with matrix size 260\times 311\times 260 . The dataset was split into 80 subjects for training, 10 for validation, and 10 for testing. Preprocessing. All MRI volumes were skull-stripped using SynthStrip [ 11 ] to remove non-brain tissue while preserving deep brain structures, followed by per-volume z -score intensity normalization, yielding consistent 3D inputs for both landmark detection and segmentation. II-C Automated segmentation procedure Our method, illustrated in Figure 2 , consists of three stages. We first detect 16 anatomical landmarks using a global-to-local network. Next, UNesT [ 6 ] , a 3D hierarchical transformer model, predicts a coarse 12-label segmentation. Finally, landmark-guided rules refine this output into 26 anatomically consistent regions (see Sec. II-A ). Fig. 2: Overall pipeline. Step 1 – Landmark detection. Accurate localization

Read the complete text