Large Language Models for EEG: A Comprehensive Survey and Taxonomy
Naseem Babu, Jimson Mathew, and A. P. Vinod · 2025
Read Large Language Models for EEG: A Comprehensive Survey and Taxonomy by Naseem Babu, Jimson Mathew, and A. P. Vinod (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06353.txt.
Introduction
Brain waves recorded by EEG carry rich signals, and large language models are now being turned loose on them. Naseem Babu, Jimson Mathew, and Vinod survey this fast-growing meeting point. They organize recent work into four domains, from foundation models that learn EEG representations to systems that decode brain signals into language.
The other domains cover cross-modal generation, turning EEG into images or 3D objects, and clinical tools plus dataset management. Transformer models tuned by fine-tuning or few-shot methods now generate text, interpret meaning, and assist diagnosis from brain data. The authors offer their taxonomy as a map for researchers entering the field, and a base for future brain-computer interface work.
Catalog record
| CREATOR | Naseem Babu, Jimson Mathew, and A. P. Vinod |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-06353
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Large Language Models for EEG: A Comprehensive Survey and Taxonomy Naseem Babu, Jimson Mathew, and A. P. Vinod Abstract The growing convergence between Large Language Models (LLMs) and electroencephalography (EEG) research is enabling new directions in neural decoding, brain-computer interfaces (BCIs), and affective computing. This survey offers a systematic review and structured taxonomy of recent advancements that utilize LLMs for EEG-based analysis and applications. We organize the recent studies into four categories: (1) LLM-inspired foundation models for EEG analysis, (2) EEG-to-language decoding, (3) cross-modal generation including image and 3D object synthesis, and (4) clinical applications and dataset management tools. The survey highlights how transformer-based architectures adapted through fine-tuning, few-shot, and zero-shot learning have enabled EEG-based models to perform complex tasks such as natural language generation, semantic interpretation, and diagnostic assistance. By presenting a structured overview of the employed models and application domains, this survey establishes a comprehensive framework to advance neural signal analysis through the application of language models. TABLE I: Acronyms and abbreviations used in this survey Acronym Full Form LLM Large Language Model EEG Electroencephalography BCI Brain-Computer Interface MI Motor Imagery BERT Bidirectional Encoder Representations from Transformers BART Bidirectional and Auto-Regressive Transformers GPT Generative Pre-trained Transformer BELT Bridging Electroencephalogram with Language Transformers CET-MAE Contrastive EEG-Text Masked Autoencoder LLaMA Large Language Model Meta AI FLAN-T5 Fine-tuned Language Net T5 LaBraM Large Brain Model EEGPT Electroencephalography Pretrained Transformer LCM Large Cognition Model EEGFormer EEG Transformer Neuro-GPT Neurological Generative Pre-trained Transformer EEG2TEXT Electroencephalogram to Text SEE Semantically Aligned EEG-to-Text Translation EEGTrans Electroencephalogram Transformer ELM EEG-Language Model AdaCT Adapter for Converting Time Series E2T-PTR EEG-to-Text using Pretrained Transferable Representations EEG-CLIP EEG-based Contrastive Language-Image Pretraining HMLLM Hypergraph Multi-modal Large Language Model MLM Masked Language Modeling ALM Autoregressive Language Modeling NLP Natural Language Processing FCM Fuzzy C-Means FJM Fuzzy J-Means I Introduction The growing use of language models is shaping new developments in both neuroscience and artificial intelligence. Language models such as GPT, BERT [ 1 , 2 , 3 ] , and their multimodal variants have shown remarkable success across tasks involving natural language processing and understanding, generation, and even vision-language fusion. The transformer-based architecture enables these models to effectively process sequential data, contributing to their success across a range of domains beyond natural language processing. Alongside these developments, the field of electroencephalogram (EEG) [ 4 , 5 ] based brain signal processing has seen substantial growth, driven by its promising applications in brain-computer interfaces (BCIs) [ 6 , 7 , 8 ] , cognitive assessment, mental health monitoring, and neurological diagnostics. The convergence of large language models and EEG signals offers a unique opportunity to bridge artificial intelligence and neuroscience. Leveraging LLMs enables the translation of brain activity into meaningful outputs such as text, images, 3D objects, and diagnostic insights [ 9 , 10 , 11 , 12 ] , as illustrated in Fig. 1 . The acronyms used throughout this paper are summarized in TABLE I . Fig. 1: EEG signals are processed by a large language model that interprets the underlying neural patterns. Depending on the task, the system generates outputs such as text, images, 3D reconstructions, or diagnostic insights. I-A EEG and Language Models Despite recent advancements, EEG signal processing remains highly challenging due to the noisy nature of non-invasive recordings, which are often contaminated by artifacts such as eye movements, muscle activity, and external interference [ 13 , 14 , 15 ] . Additionally, these signals show inter-subject and intra-subject variability, complicating generalization across individuals and recording sessions [ 16 , 17 ] . Lack of datasets poses a challenge for effective model training and evaluation. As a result, many existing machine and deep learning approaches remain confined to single-task, single-dataset settings, limiting their scalability and robustness. To address these challenges, more flexible and scalable learning frameworks are needed, and language models [ 18 ] , with their ability to capture complex dependencies and adapt across modalities, offer promising capabilities to overcome these limitations. • Self-attention for spatiotemporal modeling: The self-attention mechanism in language models enables dynamic weighting of input features and effectively captures long-range dependencies, which are essential for modeling the spatiotemporal dynamics of signals [ 19 , 20 , 21 ] . • Transformer adaptability to neural signals: The flexibility of the transformer architecture allows it to effectively handle multichannel, multi-timescale inputs by learning embedding-based representations that capture both spatial and temporal characteristics of signals [ 22 , 23 ] . • Cross-modal generation capabilities: Combining EEG signals with multimodal language models enables novel applications such as EEG-to-text generation, brain-driven image synthesis, and exploratory 3D reconstruction. These advances expand the possibilities for interpreting and visualizing brain activity [ 24 , 10 , 11 ] . I-B Scope and Contributions This survey reviews recent advancements combining EEG signal processing and large language models (LLMs), focusing on applications such as EEG-to-text decoding, emotion recognition, multimodal generation, and mental health diagnostics. The main contributions of this work are as follows: 1. Introduces a structured taxonomy covering four domains: foundation models, decoding, cross-modal generation, and clinical applications. 2. Summarizes recent studies through comprehensive tables detailing the tasks, datasets, methods, and model types used. 3. Highlights how different LLM architectures have been adapted for EEG-related tasks and outlines their roles across various applications. 4. Identifies key challenges in this emerging field, including data scarcity, interpretability, and real-time deployment, and outlines directions for future work. The remainder of this paper is organized as follows: Section II provides background on electroencephalography (EEG) signals and large language models (LLMs); Section III presents a taxonomy of language models applications in EEG analysis; Section IV outlines model adaptation strategies in EEG analysis; Section V gives a detailed discussion on recent studies; Section VI discusses future research directions; and Section VII concludes the paper. II Background II-A Electroencephalography (EEG) Signals EEG is a non-invasive neuroimaging technique that records electrical activity in the brain with electrodes placed on the scalp [ 6 , 7 , 8 ] . These signals reflect the collective electrical activity of cortical neurons and are captured as voltage fluctuations over time. These signals are inherently multichannel time series, typically sampled at high frequencies (e.g., 128-1024 Hz) across arrays of electrodes arranged according to standardized systems such as the international 10-20 or 10-10 montage. Each electrode provides spatially localized insight into cortical function, supporting both region-specific and network-level analyses. These signals are often decomposed into frequency bands: delta (0.5-4 Hz), theta (4-8 Hz), alpha (8-13 Hz), beta (13-30 Hz), and gamma (30-100 Hz) [ 7 , 8 ] , where each band is associated with different cognitive or physiological states. For example, alpha waves are linked to relaxed wakefulness, while beta waves correspond to focused attention and active mental engagement. Despite their versatility, these signals are highly susceptible to various artifacts, such as those arising from eye blinks, facial muscle movements, and environmental interference, making preprocessing and artifact rejection essential before further analysis [ 13 , 14 , 15 ] . EEG is widely used across various domains, including Brain-Computer Interfaces (BCIs) [ 4 , 5 , 25 ] , where it enables direct communication between the brain and external devices using mental states such as motor imagery [ 26 , 27 ] or