Beyond Accuracy: Robustness, Interpretability and Expressiveness of EEG Foundation Models

Urban Širca, Maryam Alimardani, Stefanos Zafeiriou, Konstantinos Barmpas · 2026

Read Beyond Accuracy: Robustness, Interpretability and Expressiveness of EEG Foundation Models by Urban Širca, Maryam Alimardani, Stefanos Zafeiriou, Konstantinos Barmpas (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17562.txt.

Introduction

Širca and colleagues evaluate EEG foundation models beyond clean accuracy. They test six models plus a supervised baseline on ten datasets across robustness, interpretability and expressiveness. No model dominates every failure mode. The most noise-robust proves fragile under channel dropout, though much dropout weakness vanishes when channels are removed rather than zero-filled. Attribution concentrates on task-right brain regions. Poor head-only performance traces largely to pooling choice rather than weak codes.

Catalog record

CREATORUrban Širca, Maryam Alimardani, Stefanos Zafeiriou, Konstantinos Barmpas
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82778
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17562

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond Accuracy: Robustness, Interpretability and Expressiveness of EEG Foundation Models Urban Širca, Maryam Alimardani, Stefanos Zafeiriou, Konstantinos Barmpas Abstract EEG foundation models (EEG-FMs) have been evaluated predominantly on clean, in-distribution accuracy, leaving their robustness, interpretability and representational quality largely unexamined. This study addresses these gaps by benchmarking six EEG-FMs against a baseline deep learning model across eight datasets. Beyond clean accuracy, we conduct three layers of analysis: (i) Robustness: we apply test-time perturbations including additive noise, random and region-based channel dropout and region-specific noise injection. Our analyses show that no single model dominates all failure modes. The most noise-robust model is among the most fragile under channel dropout and much of the dropout fragility disappears when channels are removed rather than zero-padded. (ii) Interpretability: we present the first application of Attention-Aware Layer-Wise Relevance Propagation (AttnLRP) to EEG-FMs and show that models broadly concentrate relevance on task-appropriate brain regions consistent with known neurophysiology. However, attribution maps remain spatially stable under perturbation while predictions degrade, suggesting that the models attend to the correct brain regions but decode corrupted content. (iii) Expressiveness: With block-wise probing we show that late blocks are repurposed during fine-tuning, while early blocks already hold task-related information. Furthermore, we demonstrate that the poor head-only performance previously attributed to low-quality pre-trained representations is largely explained by pooling and that EEG-FMs possess sufficient representational capacity when their token-level embeddings are preserved. Together, these findings provide the first systematic assessment of robustness, interpretability and expressiveness for EEG-FMs and highlight critical considerations for their development. 1 Introduction Brain-Computer Interfaces (BCIs) translate neural activity into control signals for communication, rehabilitation and clinical monitoring 31 . Electroencephalography (EEG) is the most practical neuroimaging modality for BCIs: it is non-invasive, portable, inexpensive and offers millisecond temporal resolution ( 35 ) . However, EEG signals have a low signal-to-noise ratio due to muscular and environmental artefacts and vary across subjects, sessions and recording devices ( 42 ) . To address these challenges, various methods and techniques have been deployed over the years for EEG decoding. Traditional BCI systems relied on hand-crafted features and machine learning algorithms to perform EEG classification ( 38 ; 30 ; 10 ; 16 ; 39 ; 33 ) . The advent of deep learning reduced the reliance on manual feature selection ( 23 ; 45 ; 22 ; 43 ; 6 ; 50 ) , with neural networks learning spatial and temporal representations end-to-end from raw or lightly preprocessed EEG data. Although these deep models achieve competitive performance across diverse BCI paradigms, they require large labelled datasets (a persistent bottleneck in EEG research) and often lose performance when applied across cohorts or recording conditions ( 29 ) . Inspired by the success of foundation models in natural language processing and computer vision ( 11 ; 51 ) , researchers have begun pre-training large models on EEG data with the goal of learning general-purpose representations. These EEG foundation models (EEG-FMs) pre-train on large unlabelled corpora via self-supervision, aiming to generalise across users, tasks and conditions with minimal labelled fine-tuning data. Although several EEG-FMs (e.g, ( 18 ; 53 ; 36 ; 55 ) ) have been proposed that claim competitive downstream task performance, multiple independent studies converge on the same finding: EEG-FM downstream task performance gains over supervised baselines are modest. For example, 25 introduced a benchmarking protocol for evaluation of the performance and generalisation capabilities of EEG-FMs grounded in causal reasoning that controls for task-discriminative artefacts and spurious correlations. Under subject-independent cross-validation, they found that EEG-FMs achieve marginal advantage over supervised baselines such as EEGNet, a finding later corroborated through systematic fine-tuning ( 26 ) and few-shot calibration ( 48 ) . Another large-scale study by 27 , covering twelve models and thirteen datasets, reached a similar conclusion: specialist architectures trained from scratch sometimes outperformed EEG-FMs. Furthermore, linear probing of pre-trained models underperformed full fine-tuning across all models, but the study did not investigate the root cause. These benchmarks, thorough as they are, share a common limitation: they evaluate EEG-FMs on clean, in-distribution data only . In practice, EEG recordings are inherently noisy due to electrode impedance drifts, gel dry-out, subject movements, and channel failures, leading to substantial variability across sessions and users ( 42 ) . Consequently, models that perform well on curated laboratory data may significantly degrade under these conditions, limiting their value in clinical or real-world BCI settings ( 57 ; 21 ) . Several works ( 8 ; 7 ) formalise this concern from a causal perspective, showing that data distribution shifts, arising from inter-subject variability but also sensor noise or electrode displacement, are the primary factors limiting generalisation in BCI systems. Yet, such conditions remain largely unexamined in current EEG-FM benchmarks. Among other concerns, 21 highlights three gaps relevant to our study: (i) robustness of EEG-FMs under simulated signal corruption has not been demonstrated, (ii) interpretability remains unaddressed despite being necessary in high-risk domains such as healthcare and (iii) linear probing of pre-trained EEG-FMs consistently underperforms fine-tuning across all reviewed models, raising questions about the quality of pre-trained representations. In short, our review of the current literature indicates that while clean accuracy has been extensively benchmarked, robustness, interpretability, and expressiveness remain underexplored. We address these gaps by adopting the benchmarking protocol of 25 . We expanded the model set with state-of-the-art EEG-FMs: REVE ( 36 ) , BrainOmni ( 55 ) , NeuroRVQ ( 5 ) , LaBraM ( 18 ) , CBraMod ( 53 ) , and BIOT ( 56 ) ), and EEGNet ( 22 ) as the baseline. We also added four benchmark datasets to the original set, totalling eight datasets spanning motor imagery, motor execution, event-related potentials, working memory, sleep staging, and eyes-open versus eyes-closed classification. We conducted three layers of analysis to extract: (i) Robustness: how stable is task performance when the input signal is perturbed in ways that mimic realistic recording conditions, such as sensor noise, electrode failure and localised signal degradation. (ii) Interpretability: what features and brain regions does each model rely on and how they change under perturbation. (iii) Expressiveness: via linear probing, whether and where pre-trained representations carry the information needed for the task or whether performance depends on adapting the backbone during fine-tuning. Consequently, our research questions were formulated as: (1) Are EEG foundation models robust to signal and sensor perturbations across a diverse set of tasks? (2) Do EEG foundation models learn features that align with known neurophysiology, attending to brain regions expected for each task under both normal and perturbed conditions? (3) Do EEG foundation models have good representational quality? 2 Related Work While clean accuracy has been extensively benchmarked for EEG-FMs, robustness, interpretability and expressiveness remain underexplored. This section reviews related work along these axes. 2.1 Robustness and Expressiveness of EEG Foundation Models EEG signals are inherently noisy due to electrode artefacts and channel failures ( 42 ) . While additive noise and channel dropout have been used as augmentation techniques during training ( 13 ) , no study has systematically evaluated existing EEG-FMs under test-time signal corruption. Separately, linear probing consistently underperforms full fine-tuning across all reviewed EEG-FMs ( 27 ; 21 ) , typically interpreted as evidence of low-quality representations. However, this

Read the complete text