A large-scale heterogeneous 3D magnetic resonance brain imaging dataset for self-supervised learning Asbjørn Munk, Stefano Cerri, Jakob Ambsdorf, Julia Machnio, Sebastian Nørgaard Llambias, Vardan Nersesjan, Christian Hedeager Krag, Peirong Liu, Pablo Rocamora García, Mostafa Mehdipour Ghazi, Mikael Boesen, Michael Eriksen Benros, Juan Eugenio Iglesias, Mads Nielsen Abstract We present FOMO60K, a large-scale, heterogeneous dataset of 60,529 brain Magnetic Resonance Imaging (MRI) scans from 13,900 sessions and 11,187 subjects, aggregated from 16 publicly available sources. The dataset includes both clinical- and research-grade images, multiple MRI sequences, and a wide range of anatomical and pathological variability, including scans with large brain anomalies. Minimal preprocessing was applied to preserve the original image characteristics while reducing barriers to entry for new users. Accompanying code for self-supervised pretraining and finetuning is provided. FOMO60K is intended to support the development and benchmarking of self-supervised learning methods in medical imaging at scale. Background & Summary Self-supervised learning (SSL) has led to major breakthroughs in computer vision and natural language processing, largely driven by the availability of large-scale public datasets such as ImageNet [ 1 ] , Places365 [ 2 ] , and OpenWebText [ 3 ] . These resources have enabled the development, benchmarking, and rapid iteration of powerful SSL methods under standardized settings. In neuroimaging, however, the lack of comparably large and diverse public datasets has slowed the adoption and evaluation of SSL approaches. Existing resources such as ADNI [ 4 ] , UK Biobank [ 5 ] , PPMI [ 6 ] , and ABCD [ 7 ] , while valuable, are often curated for specific diseases or patient populations, and typically follow homogeneous imaging protocols with limited pathological variability. Access is often restricted by formal applications, data use agreements, and institutional approvals, and data are commonly distributed in formats that require domain-specific preprocessing. These challenges raise the barrier to entry and hinder the scalability of SSL pretraining. The recent release of OpenMind [ 8 ] is a welcome step forward, reflecting the field’s growing momentum toward more diverse and accessible neuroimaging datasets. To address these limitations, we introduce FOMO60K, a large-scale, heterogeneous dataset of 60,529 brain MRI scans from 13,900 sessions and 11,187 subjects, aggregated from 16 publicly available sources. FOMO60K spans both clinical- and research-grade imaging, includes multiple MRI sequences, and captures anatomical and pathological diversity, including scans with large brain anomalies, bringing it closer to real-world population-level data. Minimal preprocessing was applied to retain the raw characteristics of the original images while improving usability. We also release code for self-supervised pretraining and fine-tuning to facilitate benchmarking, method development, and broader adoption of SSL in medical imaging. FOMO60K was developed in parallel with the FOMO25 challenge at MICCAI 2025 [ 9 ] , which aims to catalyze progress in self-supervised learning for medical imaging. The dataset will continue to grow in future releases as additional cohorts and modalities become available. Figure 1: Representative examples from the FOMO60K dataset, illustrating the heterogeneity in image quality, MRI sequences, and the presence of brain anomalies. Methods FOMO60K is derived from 16 publicly available datasets. Table 1 summarizes the source datasets, listing the number of subjects, sessions, scans, MRI sequence types, and applied preprocessing steps. MRI sequence types include T1-weighted (T1), T2-weighted (T2), Fluid-Attenuated Inversion Recovery (FLAIR), and Diffusion-Weighted Imaging (DWI), among others. Most datasets include at least T1-weighted scans, with many also providing T2, FLAIR, and DWI scans; less common modalities include contrast-enhanced T1 (T1ce), Proton Density (PD), Susceptibility-Weighted Imaging (SWI), and Gradient Echo (GRE). A visual overview of the dataset’s heterogeneity—in terms of image quality, modality, and pathology—is provided in Fig. 1 . Dataset Subjects MRI sessions MRI scans MRI sequences Skull-stripped/ Defaced MGH Wild [ 10 ] 1135 1135 11366 Unknown Skull-stripped SOOP [ 11 ] 1715 1715 6508 T1, FLAIR, DWI Defaced BraTS-GEN [ 12 , 13 , 14 , 15 , 16 ] 2251 2251 9004 T1, T2, FLAIR, T1ce Skull-stripped OASIS1 [ 17 ] 416 436 1688 T1 Skull-stripped OASIS2 [ 18 ] 146 362 1326 T1 Skull-stripped MSD Braintumor [ 19 ] 484 484 1936 T1, T2, FLAIR, T1ce Skull-stripped IXI [ 20 ] 584 584 2530 T1, T2, PD, DWI Skull-stripped NIMH [ 21 ] 249 252 2089 T1, T2, T2*, DWI Skull-stripped DLBS [ 22 ] 464 957 3845 T1, T2, DWI Skull-stripped IDEAS [ 23 ] 542 542 1035 T1, FLAIR Defaced ARC [ 24 ] 230 741 2029 T1, T2, DWI Defaced MBSR [ 25 ] 147 348 1023 T1, DWI Defaced UCLA [ 26 ] 265 265 789 T1, DWI Defaced QTAB [ 27 ] 417 721 6760 minIP, GRE, SWI Defaced NKI [ 28 ] 1316 2281 4502 T1, T2, DWI Defaced AOMIC ID1000 [ 29 ] 826 826 4099 T1, DWI Defaced Total 11187 13900 60529 Table 1: Overview of the current datasets in FOMO60K. For each dataset, we summarize the number of subjects, MRI sessions, scans, available sequence types, and whether the images were skull-stripped or defaced. See Methods for full preprocessing details. Sequences are abbreviated as follows: T1 = T1-weighted, T2 = T2-weighted, T2* = T2*-weighted, T1ce = T1-weighted contrast-enhanced, FLAIR = Fluid-Attenuated Inversion Recovery, DWI = Diffusion-Weighted Imaging, PD = Proton Density, SWI = Susceptibility Weighted Imaging, GRE = Gradient Echo, miniP = minimum intensity projection. "Unknown" indicates that scan sequence metadata was not available or could not be reliably identified. MRI preprocessing MRI preprocessing comprised three main steps: reorienting images to RAS (Right–Anterior–Superior) orientation, affine co-registration, and skull-stripping. All scans were first reoriented to RAS and affinely co-registered using the mri_coreg command from FreeSurfer 7.4.1 [ 30 ] , with default parameters. Within each MRI session, scans were aligned to the image with the highest spatial resolution to preserve anatomical detail. For diffusion-weighted imaging (DWI) scans stored in 4D format, additional steps were applied. If a b=0 (non-diffusion-weighted) volume was available, it was extracted and saved separately. For the b=1000 shell, three diffusion-weighted volumes were selected based on their gradient directions being most closely aligned with the canonical x, y, and z axes. Alignment was determined by computing the cosine similarity between each gradient vector (bvec) and the orthogonal unit vectors. The corresponding volumes were averaged to produce a single representative 3D image. Skull-stripping was performed using SynthSeg [ 31 ] (FreeSurfer 7.4.1), which outputs segmentation masks of brain structures. These masks were used to define the brain extraction region. Skull-stripping was only applied when the images were not already defaced or skull-stripped by the dataset provider, or when visual inspection identified residual cranial features that could compromise anonymization. Data Record The FOMO60K dataset is publicly available at https://huggingface.co/datasets/FOMO25/FOMO-MRI . All MRI scans are stored in NIfTI-compressed format and organized using a standardized directory structure. Each subject is assigned a unique identifier ( sub_X ), and each session is labeled as ses_Y . Scans within a session are named according to their sequence type (e.g., t1 , flair ). If multiple scans of the same sequence are present, they are enumerated (e.g., t1_1 , t1_2 ). In cases where sequence information is unavailable, scans are generically named scan_X . To protect privacy and prevent easy identification of dataset sources, subjects have been shuffled. Usage Notes The dataset can be used with no further pre-processing for pre-training. To ensure proper attribution and recognition of the source datasets we kindly ask all users to cite the following papers: OASIS1 [ 17 ] , OASIS2 [ 18 ] , BraTS24 [ 12 , 13 , 32 , 15 , 16 ] , MSD Braintumor [ 19 ] , IXI [ 20 ] , MGH Wild [ 10 ] , NKI [ 28 ] . Code Availability All preprocessing scripts are publicly available at https://github.com/fomo25/fomo60k-preprocessing to ensure reproducibility and facilitate application to new datasets.