Mapping minds not averages: a scalable subject-specific manifold learning framework for neuroimaging data

Eloy Geenjaar · 2025

Read Mapping minds not averages: a scalable subject-specific manifold learning framework for neuroimaging data by Eloy Geenjaar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00196.txt.

Introduction

Eloy Geenjaar and Vince Calhoun map brain patterns one person at a time in a 2025 paper. Thought is thought to live on curved, low size surfaces inside vast brain activity, but most tools align all brains to a group map and blur the person.

Their method learns a surface per person, with no need for shared timing across people. On fake data and two film watching brain sets, it beats group tools at recovering true personal patterns. It also scales to large sets and holds up on new people. In rest scans, its maps split patients with schizophrenia from controls in telling zones.

Catalog record

CREATOREloy Geenjaar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-00196

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Mapping minds not averages: a scalable subject-specific manifold learning framework for neuroimaging data Eloy Geenjaar Abstract Abstract Mental and cognitive representations are believed to reside on low-dimensional, non-linear manifolds embedded within high-dimensional brain activity. Uncovering these manifolds is key to understanding individual differences in brain function, yet most existing machine learning methods either rely on population-level spatial alignment or assume data that is temporally structured, either because data is aligned among subjects or because event timings are known. We introduce a manifold learning framework that can capture subject-specific spatial variations across both structured and temporally unstructured neuroimaging data. On simulated data and two naturalistic fMRI datasets (Sherlock and Forrest Gump), our framework outperforms group-based baselines by recovering more accurate and individualized representations. We further show that the framework scales efficiently to large datasets and generalizes well to new subjects. To test this, we apply the framework to temporally unstructured resting-state fMRI data from individuals with schizophrenia and healthy controls. We further apply our method to a large resting-state fMRI dataset comprising individuals with schizophrenia and controls. In this setting, we demonstrate that the framework scales efficiently to large populations and generalizes robustly to unseen subjects. The learned subject-specific spatial maps our model finds reveal clinically relevant patterns, including increased activation in the basal ganglia, visual, auditory, and somatosensory regions, and decreased activation in the insula, inferior frontal gyrus, and angular gyrus. These findings suggest that our framework can uncover clinically relevant subject-specific brain activity patterns. Our approach thus provides a scalable and individualized framework for modeling brain activity, with applications in computational neuroscience and clinical research. 1 Introduction Despite the universal nature of human brain function, brain dynamics that underpin cognition are uniquely expressed in each person’s brain. It has become increasingly clear that the brain activity that generates these cognitive functions can be expressed on a low-dimensional manifold [ 26 ] . Neuroimaging studies have highlighted that although functional magnetic resonance imaging (fMRI) data can be expressed in a low-dimensional manifold [ 19 , 42 , 5 ] , its representational geometry varies between subjects [ 12 , 13 ] due to differences in functional activation maps. Existing methods such as shared response modeling (SRM) [ 15 , 33 , 39 , 38 ] and hyperalignment (HA) [ 22 ] address variation in individual functional activation maps by allowing subject-specific spatial variability while assuming consistent temporal dynamics or shared information, respectively. In contrast, atlas/region of interest (ROI)-based approaches assume consistent group-level regions across subjects, but allow subject-specific temporal variations. Data-driven approaches such as group independent component analysis (ICA) focus on capturing spatio-temporal variation by fitting a group model and estimating subject-specific maps and timecourses via back-reconstruction [ 9 ] . Such models have been shown to capture subject-specific variability well in both spatial and temporal dimensions [ 2 ] while allowing for correspondences among subjects within the context of a linear mixing model. Motivated by this, our framework focuses on learning non-linear temporal manifolds, while capturing both subject-specific and correspondences among subjects’ spatial and temporal information. Using machine learning to find low-dimensional manifolds from fMRI data has improved the quality of those manifolds. In fact, recent work has shown that subject-specific manifolds can greatly improve the prediction performance of events in a movie [ 5 ] . It is, however, harder to compare subjects when each is projected onto their own manifold, instead of a shared group manifold. Moreover, it is challenging to project unseen timepoints onto the learned manifold with the proposed method. On the other hand, neural network approaches, which can generalize to new timepoints and subjects rather well, require a larger amount of training data. Neural networks are thus often trained on datasets with many subjects, and it is implicitly assumed that spatial variations across subjects can be captured by the non-linearities in the neural networks [ 23 , 20 , 30 ] . To force the encoder to capture subject-specific features, a recent approach uses subject-specific decoders to learn a latent manifold [ 24 ] . Training these separate subject-specific decoders is computationally expensive, making it hard to scale to a large number of subjects. A more efficient method, which only uses a separate linear layer for each subject, was used to train a shared visual decoding model from fMRI data [ 41 ] . It is not clear whether this type of approach works well for low-dimensional manifold learning, and although it is more efficient, it still does not scale well to a large input size and a large number of subjects, see Appendix A . In this work, we therefore look at incorporating subject-specific spatial variation for non-linear manifold learning. We both propose a model that uses a separate linear layer for each subject, and a parameter-efficient model that scales to a large input size and number of subjects. First, we show that linear subject-specific maps improve non-linear manifold learning in Section 2.2 . Second, we show that our parameter-efficient model can be trained on a large number of subjects, and generalize to unseen subjects in Section 2.3 . Moreover, we find that subject-specific weights are different for control subjects than for schizophrenia subjects, and that these differences also generalize to a group of unseen subjects. Lastly, we find interpretable spatial group differences between control subjects and subjects diagnosed with schizophrenia in Section 2.4 . Figure 1: Subfigure a : The three main models tested in our framework, subject-specific parameters have different colors across subjects, and parameters shared across subjects are gray. The Group model assumes the same spatial weights and neural network for all subjects in a dataset, and requires the smallest number of parameters. This is currently the most common way neural networks are applied to neuroimaging data. The Subject model assumes a different spatial weights matrix for each subject, but shares the same neural network across the subjects in the dataset. This model requires the largest number of parameters, especially with many subjects or large spatial inputs. The Decomposed model assumes a matrix decomposition, and assumes that only the singular values are different for each subject. This greatly reduces the number of parameters used compared with the Subject model, and allows it to both capture subject-specific spatial maps and scale to a large number of subjects or large spatial maps. Subfigure b : The simulated data experiment. Each simulated subject is a randomly rotated version of the half moon dataset. We train a multi-layer perceptron (MLP) using the three different models, and show that the Group model can not capture the subject differences, even when a neural network is used. The Subject and Decomposed models achieve almost perfect performance, and the singular values of the Decomposed model projected onto the first two principal components form a circle. This circle corresponds to the different subjects, and clearly captures the rotational generation process (the unit circle). Figure 2: The classification results in this figure are calculated with a radial basis function (RBF) support vector machine (SVM) for auto-encoder models that have embedded an unseen 50% of the timeseries. The top row shows performance for the auditory, early visual, posteromedial cortex regions of interest (ROIs), and whole-brain data from the Sherlock dataset [

Read the complete text