PRISM: Exploring Heterogeneous Pretrained EEG Foundation Model Transfer to Clinical Differential Diagnosis

Jeet Bandhu Lahiri, Parshva Runwal, Arvasu Kulkarni, Mahir Jain, Aditya Ray Mishra, Siddharth Panwar, Sandeep Singh · 2026

Read PRISM: Exploring Heterogeneous Pretrained EEG Foundation Model Transfer to Clinical Differential Diagnosis by Jeet Bandhu Lahiri, Parshva Runwal, Arvasu Kulkarni, Mahir Jain, Aditya Ray Mishra, Siddharth Panwar, Sandeep Singh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02268.txt.

Introduction

Jeet Bandhu Lahiri, Parshva Runwal, Arvasu Kulkarni, and colleagues test brain-wave models across hospitals in this 2026 study. Foundation models for EEG, the brain's electrical signals, often train on narrow hospital archives. Strong scores on like data may reflect the recording setup, not the brain. Their model, PRISM, varies training mix and tuning style while holding the rest fixed.

Narrow training won on matched tests, while diverse training adapted better to new data. On a hard new task, telling epilepsy apart from look-alike conditions, diverse training won by a wide margin. The diverse model also matched a far larger rival trained on many more hours. The team further shows that two benchmarks rank the same models very differently, and explains why.

Catalog record

CREATORJeet Bandhu Lahiri, Parshva Runwal, Arvasu Kulkarni, Mahir Jain, Aditya Ray Mishra, Siddharth Panwar, Sandeep Singh
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34897
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.02268

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PRISM: Exploring Heterogeneous Pretrained EEG Foundation Model Transfer to Clinical Differential Diagnosis Jeet Bandhu Lahiri, Parshva Runwal, Arvasu Kulkarni, Mahir Jain, Aditya Ray Mishra, Siddharth Panwar, Sandeep Singh Abstract EEG foundation models are typically pretrained on narrow-source clinical archives and evaluated on benchmarks from the same ecosystem, leaving unclear whether representations encode neural physiology or recording-distribution artifacts. We introduce PRISM ( P opulation- R epresentative I nvariant S ignal M odel), a masked autoencoder ablated along two axes—pretraining population and downstream adaptation—with architecture and preprocessing fixed. We compare a narrow-source EU/US corpus (TUH + PhysioNet) against a geographically diverse pool augmented with multi-center South Asian clinical recordings across multiple EEG systems. Three findings emerge. First, narrow-source pretraining yields stronger linear probes on distribution-matched benchmarks, while diverse pretraining produces more adaptable representations under fine-tuning—a trade-off invisible under single-protocol evaluation. Trained on three source corpora, PRISM matches or outperforms REVE (92 datasets, 60,000+ hours) on the majority of tasks, demonstrating that targeted diversity can substitute for indiscriminate scale and that dataset count is a confounding variable in model comparison. Second, on a clinically challenging and previously untested task—distinguishing epilepsy from diagnostic mimickers via interictal EEG—the diverse checkpoint outperforms the narrow-source checkpoint by +12.3 pp balanced accuracy, the largest gap across all evaluations. Third, systematic inconsistencies between EEG-Bench and EEG-FM-Bench reverse model rankings on identical datasets by up to 24 pp; we identify six concrete sources including split construction, checkpoint selection, segment length, and normalization, showing these factors compound non-additively. † † footnotetext: Jeet Bandhu Lahiri, Parshva Runwal, and Arvasu Kulkarni contributed equally as first authors. Mahir Jain and Aditya Ray Misra contributed equally as second authors. 1 Introduction EEG foundation models—self-supervised models pretrained on scalp EEG—have produced strong transfer results across motor imagery, sleep staging, and abnormality detection [ 1 , 2 , 3 , 4 ] . Yet two fundamental questions remain unaddressed. First, what do these representations encode? Pretraining corpora are drawn overwhelmingly from TUH, PhysioNet, and MOABB—repositories predominantly from Europe and North America where recording conditions, amplifier characteristics, and population physiology are confounded within a narrow distribution [ 4 ] . A model that achieves low reconstruction error on such data may have memorized recording-environment regularities rather than neural dynamics, and standard benchmarks from the same ecosystem cannot distinguish these explanations. Second, can we trust existing benchmark rankings? EEG-Bench [ 5 ] and EEG-FM-Bench [ 6 ] are the two most widely used standardized evaluation frameworks for EEG foundation models, yet they make different methodological choices in ways that produce not merely quantitative discrepancies but outright ranking reversals on the same models and datasets. We investigate both questions through controlled ablations with PRISM, a masked autoencoder inspired from the REVE architecture [ 4 ] . Three findings emerge. First, population heterogeneity does not uniformly improve downstream accuracy—it changes what representations are good for . We construct a narrow-source pool (TUH + PhysioNet) and a geographically diverse pool adding multi-center South Asian clinical recordings. Under linear probing, the narrow-source checkpoint leads on distribution-matched benchmarks; under fine-tuning, the diverse checkpoint matches or exceeds it on most tasks. Notably, PRISM trained on three source corpora matches or outperforms REVE trained on 92 datasets, demonstrating that targeted data diversity can substitute for indiscriminate data scale—and that dataset count is a confounding variable in EEG foundation model comparison. Second, we provide a concrete analysis of six specific methodological differences between EEG-Bench and EEG-FM-Bench that produce divergent results: train/validation split construction, checkpoint selection strategy, input segment length, preprocessing normalization, classification head selection, and self-reported versus standardized evaluation. We show that correcting individual factors resolves discrepancies for some models but not others, revealing compounding interactions. These inconsistencies underscore the urgent need for a community consensus on evaluation methodology—without which model comparisons are unreliable. Third, we introduce the first evaluation of an EEG foundation model on distinguishing epilepsy from its diagnostic mimickers—including psychogenic non-epileptic seizures (PNES), syncope, and other paroxysmal disorders—using routine interictal EEG, a clinically relevant task that has not previously been addressed by any foundation model. This task is substantially harder than existing benchmarks: up to 25% of patients with refractory epilepsy diagnoses are later found to have been misdiagnosed [ 7 ] , and the mean diagnostic delay for PNES alone exceeds five years [ 8 ] . On this task, the diverse checkpoint significantly outperforms the narrow-source checkpoint, providing direct evidence that pretraining population composition impacts clinically meaningful downstream performance. 2 Related Work EEG foundation models. Self-supervised pretraining for EEG has advanced through BIOT [ 1 ] (cross-data transformer on TUH), LaBraM [ 2 ] (vector-quantized codebook across TUH and MOABB), CBraMod [ 3 ] (criss-cross attention), and REVE [ 4 ] (92 datasets, 25,000 subjects, 4D Fourier positional encoding enabling transfer across arbitrary montages—an architectural innovation we adopt). All share a limitation: pretraining data originates predominantly from EU/US repositories, and no prior work has tested whether broadening the population changes what the model learns. Pretraining data scale as a confounding variable. A prevailing assumption in EEG foundation model development is that larger pretraining corpora yield better downstream representations, mirroring scaling intuitions from language modeling. This has driven a progression from single-corpus models trained on TUH alone to REVE’s corpus spanning 92 datasets, 25,000 subjects, and over 60,000 hours. However, dataset quantity and representation quality are not equivalent, and the EEG domain has not validated that scaling laws from language transfer to neural signals. EEG-FM-Bench itself observes that “scaling data often fails to yield proportional gains in downstream tasks” [ 6 ] , and empirical work on EEG pathology classification has found ceiling effects when scaling labeled data beyond moderate corpus sizes [ 29 ] . Critically, when models differ simultaneously in architecture, pretraining objective, corpus size, and corpus composition, it is impossible to attribute performance differences to any single factor. No prior work has performed controlled dataset ablations—varying corpus composition while holding architecture, objective, and evaluation protocol fixed—to establish what data actually contributes. This confound renders published dataset-count comparisons between models largely uninterpretable as evidence of model quality. Evaluation inconsistencies. EEG-Bench [ 5 ] and EEG-FM-Bench [ 6 ] each provide standardized evaluation protocols but make different choices in preprocessing, segmentation, checkpoint selection, and classifier heads. As we show in Section 4.5 , these choices can reverse model rankings on the same dataset, with discrepancies exceeding 24 percentage points. This mirrors findings in medical imaging, where evaluation methodology determines whether a model appears to generalize [ 15 ] . We provide the first systematic decomposition of the specific sources of these inconsistencies and their interactions. Demographic bias in medical AI. Chest X-ray models exhibit systematic underdiagnosis of marginalized subgroups [ 13 ] , and most clinical AI algorithms train on data from only three geographic regions [ 14 ] . These failures arise from distributional shortcuts—models encode hospital site rather than pathology [ 15 , 16 ] . The analogous concern for EEG has not been tested until this work. Epilepsy vs. mimickers. Distinguishing epilepsy from its mimickers is among the hardest problems in clinical neurophysiology. PNES accounts for 20–30% of epilepsy monitoring unit admissions [ 9 ] , with diagnostic delays exceeding five years [ 8 ] and misdiagnosis rates of

Read the complete text