Zero-Shot Neural Priors for Generalizable Cross-Subject and Cross-Task EEG Decoding

Baimam Boukar Jean Jacques, Brandone Fonya, Nchofon Tagha Ghogomu, Pauline Nyaboe, Kipngeno Koech · 2026

Read Zero-Shot Neural Priors for Generalizable Cross-Subject and Cross-Task EEG Decoding by Baimam Boukar Jean Jacques, Brandone Fonya, Nchofon Tagha Ghogomu, Pauline Nyaboe, Kipngeno Koech (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-23706.txt.

Introduction

Jean Jacques and colleagues test whether brain signal decoding can transfer to new people and new tasks with no calibration, in a 2026 paper on brain computer interfaces. Electroencephalography, or EEG, records electrical activity from the scalp, and decoders turn it into predictions about behavior or mental state. Models usually fail on unseen subjects because brain signals vary widely between people and drift over time. Per subject calibration is costly and blocks wide deployment in clinics and psychiatry.

On the large Healthy Brain Network dataset, the team benchmarks three models: a convolutional network, a hybrid recurrent model, and a transformer foundation model. Progressive unfreezing adapts the transformer to regression while protecting its pretrained knowledge. The plain baseline scores a normalized error just below one, no better than predicting the mean. The fine tuned transformer does better on unseen subjects, supporting calibration free decoding.

Catalog record

CREATORBaimam Boukar Jean Jacques, Brandone Fonya, Nchofon Tagha Ghogomu, Pauline Nyaboe, Kipngeno Koech
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.23706

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Zero-Shot Neural Priors for Generalizable Cross-Subject and Cross-Task EEG Decoding Baimam Boukar Jean Jacques, Brandone Fonya, Nchofon Tagha Ghogomu, Pauline Nyaboe, Kipngeno Koech Abstract The development of generalizable electroencephalography (EEG) decoding models is essential for robust brain-computer interfaces (BCI) and objective neural biomarkers in mental health. Conventional approaches have been hindered by poor cross-subject and cross-task generalization, owing to high inter-subject variability and non-stationary neural signals. We address this challenge with a zero-shot cross-subject decoding framework on the large-scale Healthy Brain Network dataset, benchmarking a convolutional neural network baseline, a hybrid LSTM, and a Transformer-based foundation model. To adapt the Transformer for regression while averting catastrophic forgetting, we propose a novel progressive unfreezing strategy. The baseline yielded an n ​ RMSE n\mathrm{RMSE} of 0.9991 0.9991 , whereas our fine-tuned Transformer achieved 0.9799 0.9799 on unseen subjects.This work establishes scalable, calibration-free EEG decoding for computational psychiatry and behavioral prediction. 1 Introduction Decoding mental states from EEG signals promises transformative applications in non-invasive BCIs and objective medical diagnostics. However, the field faces a fundamental generalization gap; models trained on specific subjects or limited tasks rarely perform well on unseen subjects due to the non-stationarity of brain signals, significant noise sensitivity, and inherent biological variability between individuals 2 . Consequently, prevailing approaches are constrained by sparse data and narrow task scopes, necessitating costly per-subject calibration that impedes scalable real-world deployment. We hypothesize that training on passive visual stimulation and testing on an active Contrast Change Detection task forces the model to encode task-invariant ‘neural efficiency’ markers—such as visual processing latency and baseline signal-to-noise ratio—that reflect stable individual traits rather than transient task demands. This work advances generalizable neural representations for EEG that are robust to domain shifts. Specifically, we aim to predict behavioral performance metrics particularly reaction time in a held-out active task (Contrast Change Detection, CCD) We hypothesize that Transformer-based architectures, which capture long-range temporal dependencies and global context, will outperform convolutional neural network baselines in zero-shot cross-subject settings. Our quantitative goal is to reduce the normalized root mean square error (nRMSE) below the baseline floor of \sim 1.0, evidencing true signal decoding rather than mean regression. 2 Related Work Prior work in EEG decoding has centered on specialized convolutional neural networks. EEGNet 4 revolutionized the field by introducing depthwise separable convolutions,enabling compact models for efficient decoding with minimal parameters. Building on this foundation, EEGNeX 1 incorporated dilated convolutions and inverted bottleneck blocks to capture broader temporal contexts and improve feature extraction efficiency. Despite their success in intra-subject classification, these models often struggle in "calibration-free" settings where the test subject is unknown during training. Recent advances in machine learning have favored the rise of Foundation Models. The BENDR framework 3 adapted the Wav2Vec 2.0 architecture to EEG data, employing a transformer encoder to learn contextualized representations directly from raw signals. Similarly, prior transfer learning benchmarks 7 highlighted the critical importance of pre-training for biosignals.We extend these efforts through a rigorous benchmark of robust CNNs against modern transformers on the large-scale HBN, targeting regression over conventional classification. 3 Methodology 3.1 Dataset: The Healthy Brain Network (HBN) We employed the Healthy Brain Network (HBN) EEG dataset 5 ; 6 , which represents one of the largest and most diverse collections of EEG data available. The dataset contains high-density (128-channel) recordings from over 3,000 subjects aged 5 to 21. This specific age range is particularly valuable as it captures a period of high neural plasticity and diverse signal patterns, providing a rigorous testbed for training generalizable models. To ensure strict zero-shot evaluation and prevent data leakage, we adopted a rigorous subject-disjoint splitting protocol. We designated Releases 1 through 11 (excluding Release 5) for training to learn general neural representations. Release 5 was set aside exclusively for validation and hyperparameter sweeping. Finally, Release 12 was maintained as a strictly held-out test set comprising entirely unseen subjects. This separation guarantees that there is zero subject overlap between sets, forcing the model to learn universal brain patterns instead of memorizing subject-specific EEG fingerprints. Figure 1 : Overview of the dataset structure: EEG signals \mathbf{X}\in\mathbb{R}^{t\times c} recorded across multiple channels, paired with corresponding label sequences \mathbf{Y}\in\mathbb{R}^{t\times d} . 3.2 Preprocessing and Signal Conditioning The raw EEG data requires careful cleaning to remove physiological artifacts and instrumental noise. We employed a standardized preprocessing pipeline where data underwent band pass filtering between 0.5 Hz and 50 Hz, effectively removing low frequency DC drift and high-frequency muscular artifacts. Subsequently, the data was down-sampled to 100 Hz. This reduction significantly lowers the computational load for training large models while retaining the relevant cognitive frequencies needed for reaction time prediction. Finally, epochs were extracted around stimulus onset events defined by the Hierarchical Event Descriptors (HED) tags to create the training samples. Figure 2 : BENDR architecture for EEG-to-behavior regression with progressive unfreezing strategy. The model processes (128 + 1) channel EEG input through three main components: (1) a Convolutional Encoder for multi-scale feature extraction, (2) a Transformer Contextualizer for temporal dependency modeling, and (3) a Regression Head for behavioral score prediction. 3.3 Experimented Frameworks and Training Flow Our core methodological contribution lies in the adaptation of foundation models for regression. We implemented a suite of architectures ranging from standard CNNs to advanced Transformers. 1. Convolutional Baselines (EEGNeX & EEGNetv4): We selected EEGNeX and EEGNetv4 as our primary baselines. These models feature specialized convolutional structures (depthwise separable and dilated convolutions) designed to extract spatial and temporal features efficiently. They represent the current state-of-the-art (SOTA) for pure CNN-based EEG decoding. 2. Multi-Scale Vision Transformer (MSVTNet): We explored a hybrid architecture combining multi-scale temporal-spatial convolutions with a Transformer encoder. This model (ModuleList mstsconv + TransformerEncoder ) aims to capture features at varying temporal resolutions before contextualizing them with self-attention. 3. BENDR (Brain Embedding with Neural Data Representation): Our primary and main architecture employs a fine-tuned BENDR model. BENDR is a transformer-based foundation model originally pretrained on large-scale multi-subject EEG datasets for self supervised representation learning. The BENDR architecture consists of three sequential components: (1) a Convolutional Encoder (ConvEncoderBENDR) that processes raw (128 + 1) channel EEG signals through multiple 1D convolution blocks with batch normalization and GELU activations, progressively downsampling the temporal dimension while extracting multiscale spectro-temporal features into 512-dimensional latent representations; (2) a Transformer Contextualizer (BENDRContextualizer) comprising 8 transformer encoder layers with 8 attention heads per layer, which models long-range temporal dependencies through multi-head self-attention mechanisms to capture complex contextual relationships in the encoded EEG features; and (3) a task-specific Regression Head that employs multi-head attention pooling with a learnable classification (CLS) token for temporal aggregation, followed by a deep feedforward network (512 \rightarrow 256 \rightarrow 128 \rightarrow 1 neurons) with layer normalization and dropout ( p=0.4 ) to map the contextualized representations to continuous behavioral performance scores for CCD and SuS tasks. Algorithm 1 Progressive Unfreezing Fine-tuning for BENDR 1: Inputs: EEG data X\in\mathbb{R}^{B\times C\times T} , behavioral labels y\in\mathbb{R}^{B} , pre-trained encoder \mathcal{E}_{\theta_{e}} , contextualizer \mathcal{C}_{\theta_{c}} , unfreezing schedule \{s_{1},s_{2},s_{3}\} , learning rates \{\eta_{h},\eta_{c},\eta_{e}\} 2: Outputs: Fine-tuned model parameters \{\theta_{e},\theta_{c},\theta_{h}\} 3: Initialize regression head \mathcal{H}_{\theta_{h}} randomly 4: Freeze \theta_{e} and \theta_{c} \triangleright Phase 1: Head Only 5: for epoch=1 to s_{1} do 6: z\leftarrow\mathcal{E}_{\theta_{e}}(X) \triangleright Extract features 7: h\leftarrow\mathcal{C}_{\theta_{c}}(z) \triangleright Contextualize 8: \hat{y}\leftarrow\mathcal{H}_{\theta_{h}}(h) \triangleright

Read the complete text