ALFEE: Adaptive Large Foundation Model for EEG Representation
Wei Xiong, Junming Lin, Jiangtong Li, Jie Li, Changjun Jiang · 2025
Read ALFEE: Adaptive Large Foundation Model for EEG Representation by Wei Xiong, Junming Lin, Jiangtong Li, Jie Li, Changjun Jiang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06291.txt.
Introduction
Wei Xiong and four co-authors build a foundation model for brain wave recordings, in this 2025 paper. Electroencephalography is cheap, safe, and fast, but noisy, and every person's signals differ, which has kept general purpose models out of reach. Their model, ALFEE, first learns from twenty-five thousand hours of recordings, then adapts to specific tasks.
Its transformer splits attention between the skull's channels and the signal's time course, so any electrode layout works. Pretraining mixes task prediction, masked reconstruction across channels and time, and forecasting. Fine tuning adds a dictionary of task tokens and full model adaptation. Across six downstream tasks, from sleep staging to seizure related work, the model beat existing approaches. The authors release it as a base for biological signal analysis.
Catalog record
| CREATOR | Wei Xiong, Junming Lin, Jiangtong Li, Jie Li, Changjun Jiang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-06291
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ALFEE: Adaptive Large Foundation Model for EEG Representation Wei Xiong, Junming Lin, Jiangtong Li, Jie Li, Changjun Jiang Abstract . While foundation models excel in text, image, and video domains, the critical biological signals, particularly electroencephalography (EEG), remain underexplored. EEG benefits neurological research with its high temporal resolution, operational practicality, and safety profile. However, low signal-to-noise ratio, inter-subject variability, and cross-paradigm differences hinder the generalization of current models. Existing methods often employ simplified strategies, such as a single loss function or a channel-temporal joint representation module, and suffer from a domain gap between pretraining and evaluation tasks that compromises efficiency and adaptability. To address these limitations, we propose the A daptive L arge F oundation model for EE G signal representation ( ALFEE ) framework, a novel hybrid transformer architecture with two learning stages for robust EEG representation learning. ALFEE employs a hybrid attention that separates channel-wise feature aggregation from temporal dynamics modeling, enabling robust EEG representation with variable channel configurations. A channel encoder adaptively compresses variable channel information, a temporal encoder captures task-guided evolution, and a hybrid decoder reconstructs signals in both temporal and frequency domains. During pretraining, ALFEE optimizes task prediction, channel and temporal mask reconstruction, and temporal forecasting to enhance multi-scale and multi-channel representation. During fine-tuning, a full-model adaptation with a task-specific token dictionary and a cross-attention layer boosts performance across multiple tasks. After 25,000 hours of pretraining, extensive experimental results on six downstream EEG tasks demonstrate the superior performance of ALFEE over existing models. Our ALFEE framework establishes a scalable foundation for biological signal analysis with implementation available at https://github.com/xw1216/ALFEE . CCS: Computing methodologies Artificial intelligence CCS: Computing methodologies Cognitive science CCS: Human-centered computing HCI design and evaluation methods 1. Introduction The emergence of foundation models and their evolution into multimodal systems ( Devlin et al., 2019 ; Achiam et al., 2023 ; Girdhar et al., 2023 ; Betker et al., 2023 ; Pagnoni et al., 2024 ; Rasul et al., 2023 ) has transformed the artificial intelligence to process and integrate diverse information modalities. Specifically, multimodal foundation models exhibit strong capabilities in knowledge integration and data analysis while narrowing the gap between computational systems and real-world understanding, thereby driving advances in human productivity. Pioneering frameworks such as CLIP ( Radford et al., 2021 ) and MAE ( He et al., 2022 ) have set new benchmarks in visual-semantic understanding, while BEATs ( Chen et al., 2023 ) has emerged as a paradigm-shifting approach for music audio feature extraction. Despite these achievements, current foundation models primarily focus on conventional modalities ( e.g. , text, image, video) ( Dosovitskiy et al., 2020 ; Alayrac et al., 2022 ; Rombach et al., 2022 ; Wu et al., 2024 ) , with their architectural derivatives largely confined to these domains. This leaves critical biological signal modalities, i.e. , electroencephalography (EEG), significantly underexplored in the era of foundation models. In particular, multi-channel time-series data like EEG offers vital insights into brain function and structure, which is essential in cognitive science. Figure 1 . Balanced accuracy performance on six datasets. EEG, as a widely adopted non-invasive neural recording modality, offers unique advantages for both neurological research and medical applications ( Song et al., 2024 ; Gong et al., 2023 ; Li et al., 2022b ; Demir et al., 2021 ; Xu et al., 2024 ) . Specifically, EEG exhibits high temporal resolution (superior to Near-Infrared Spectroscopy), operational practicality (more cost-effective than functional Magnetic Resonance Imaging), and safety profile (non-invasive compared to Positron Emission Tomography). These advantages render EEG indispensable for detecting neurological anomalies, such as epileptic seizures, sleep disorders, and traumatic brain injuries ( Kumari and Dutta, 2024 ) . Recent advances in EEG signal modeling have introduced several innovative pretraining frameworks with distinct methodological contributions. LaBraM ( Jiang et al., 2024b ) utilizes vector-quantized neural spectrum prediction to establish a comprehensive semantic tokenization system during the pretraining phase, while its neural transformer architecture facilitates simultaneous learning of spatiotemporal characteristics inherent in EEG signals. The EEGPT framework ( Wang et al., 2024 ) introduces a dual self-supervised paradigm combining spatiotemporal representation alignment with mask-based reconstruction. This hierarchical architecture initially derives stable spatial features from short-term EEG segments, subsequently modeling temporal dependencies across extended EEG signal sequences. Notably, NeuroLM ( Jiang et al., 2025 ) presents an integrated approach by combining the LaBraM encoder with the GPT-2 architecture ( Radford et al., 2019 ) , effectively harnessing the representational capacity of large-scale language models. This hybrid architecture demonstrates enhanced performance in multimodal learning scenarios, particularly in tasks requiring simultaneous processing of multiple cognitive objectives. Despite significant advancements in EEG signal representation, EEG foundation models continue to encounter several critical challenges. First, variations in channel counts across different datasets pose challenges in efficiently learning channel representations, as they must adhere to varying standards within a unified framework. Second, EEG signals are characterized by two primary dimensions: the channel dimension, which reflects the activity of various brain regions at a specific moment, and the temporal dimension, which captures the evolution of these signals over time. Current methods typically rely on either a single loss function or a joint representation module, which limits their capability to fully capture the complex, dimension-specific features. Third, a significant domain gap persists between upstream pretraining tasks and downstream evaluation tasks. Existing methods either employ single-task fine-tuning for specific applications or freeze pretrained parameters while incorporating additional modules for downstream tasks, which reduces adaptability and impairs generalization and robustness. In this work, we present the A daptive L arge F oundation model for EE G signal representation ( ALFEE ) framework, which is built on a hybrid attention architecture and employs two optimization stages to address the above issues. From the framework perspective, our ALFEE separates channel-wise feature aggregation from temporal dynamics modeling by first employing a channel encoder that adaptively compresses variable channel information to accommodate diverse channel counts. Subsequently, a temporal encoder captures task-guided temporal evolution. Finally, a decoder using hybrid attention with a learnable recovery query reconstructs the EEG signal in both the temporal domain and the frequency domain. From the training perspective, our framework optimizes four tasks during the pretraining stage: task prediction, channel mask reconstruction, temporal mask reconstruction, and temporal forecasting, effectively enhancing its multi-channel and multi-scale representation capabilities. In the fine-tuning stage, a full-model fine-tuning strategy is employed, utilizing a task-specific token dictionary augmented by a cross-attention layer, and comprehensively improving performance in multi-task scenarios. To validate the effectiveness of our framework, we pretrain ALFEE with four model sizes on a large-scale EEG dataset, comprising over 25,000 hours and 15 datasets spanning 8 tasks ( Jiang et al., 2025 ) . Next, we finetune ALFEE with different model sizes on 6 downstream tasks, including TUAB ( López et al., 2015 ) , TUEV ( Harati et al., 2015 ) , TUSL ( von Weltin et al., 2017 ) , SEED ( Zheng and Lu, 2015 ) , HMC ( Alvarez-Estevez and Rijsman, 2021 ) , and Workload ( Zyma et al., 2019 ) . Extensive experimental results (Figure 1 ) demonstrate the superior performance of ALFEE over existing multi-task state-of-the-art (SOTA) EEG foundation models ( i.e. , NeurLM and EEGPT), showcasing its advanced capability