Neurocognitive Modeling for Text Generation: Deep Learning Architecture for EEG Data

Khushiyant · 2025

Read Neurocognitive Modeling for Text Generation: Deep Learning Architecture for EEG Data by Khushiyant (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07202.txt.

Introduction

Khushiyant, in a solo 2025 paper, designs a system that turns brain signals into text. Electroencephalography, or EEG, records brain activity through scalp sensors, and decoding it into words could restore communication for people with severe motor limits. Past EEG text systems demanded huge data and computing power, which kept them out of reach for many labs.

The design joins a recurrent neural network encoder, a model that reads sequences step by step, with Gemma 2B, a compact large language model, in a classifier-plus-generator layout. Transfer learning, which reuses a model trained elsewhere, keeps data and compute needs low. The author reports performance close to leading methods and about ten percent better overall than current approaches. If the gains hold, EEG typing could become cheaper and more practical for assistive use.

Catalog record

CREATORKhushiyant
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-07202

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Neurocognitive Modeling for Text Generation: Deep Learning Architecture for EEG Data Khushiyant Abstract Text generating capabilities have undergone a substantial transformation with the introduction of large language models (LLMs). Electroencephalography (EEG)-based text production is still difficult, though, because it requires a lot of data and processing power. This paper introduces a new method that combines the use of the Gemma 2B LLM with a classifier-LLM architecture to incorporate a Recurrent Neural Network (RNN) encoder. Our approach drastically lowers the amount of data and compute power needed while achieving performance close to that of cutting-edge methods. Notably, compared to current methodologies, our methodology delivers an overall performance improvement of 10%. The suggested architecture demonstrates the possibility of effective transfer learning for EEG-based text production, remaining strong and functional even in the face of data limits. This work highlights the potential of integrating LLMs with EEG decoding to improve assistive technologies and improve independence and communication for those with severe motor limitations. Our method pushes the limits of present capabilities and opens new paths for research and application in brain-computer interfaces by efficiently using the strengths of pre-trained language models. This makes EEG-based text production more accessible and efficient. I Introduction Electroencephalography (EEG)-based brain-computer interfaces (BCIs) hold significant promise for decoding neural activity to drive various assistive technologies. By translating brain signals into control commands, BCIs aim to restore communication and independence for individuals with severe motor disabilities. However, existing systems predominantly focus on simple word spelling applications with limited vocabulary or sentence construction capabilities [ 1 , 2 ] . Progressing BCI technology towards generating freeform text could significantly expand the autonomy and self-expression currently afforded to users [ 3 ] . Recent advances in natural language processing (NLP), particularly the emergence of powerful large language models (LLMs) like GPT-3, present new opportunities for this endeavor. LLMs demonstrate an unprecedented capacity to produce human-like text based on a given prompt [ 4 ] . Their excellent language generation skills hold untapped potential when conditioned on additional modalities like EEG input. However, developing methods to effectively fuse LLM capabilities with EEG decoding remains an open research challenge [ 5 , 6 ] . Despite these advancements, EEG-based text generation remains challenging due to its data-intensive nature and the inherent variability of brain signals [ 7 ] . Current approaches often require extensive datasets and computational resources, limiting their practical applicability [ 8 ] . Additionally, there is a lack of efficient methods for leveraging pre-trained language models in the context of EEG-based text generation [ 9 ] . Towards this goal, this paper presents a novel framework utilizing a Recurrent Neural Network (RNN) encoder to extract features from raw EEG signals. These compact representations are then input to a classifier-LLM pipeline, with the Gemma 2B model serving as the LLM module [ 10 ] . This approach bypasses extensive end-to-end training to directly leverage the strengths of pre-trained language expertise. Evaluations demonstrate competitive text generation from EEG using orders of magnitude less data than existing methods. The proposed techniques exemplify efficient transfer learning, unlocking previously unsuitable datasets by targeted feature extraction and specialty model integration. II Recent Work II-A BCI Systems for Text Generation While directly decoding EEG signals for conditional text generation remains an emerging field, advancements in Brain-Computer Interface (BCI) systems offer promising pathways for exploration. A recent study in the Journal of Neural Engineering investigated utilizing a BCI speller to enable basic text generation process (depicted in Figure 1 ). The research developed a BCI system that decoded event-related potentials in the brain to identify letter selections on a virtual keyboard. Participants achieved an average spelling rate of 6.4 characters per minute with 81.3% accuracy. This demonstrates the feasibility of using BCIs for fundamental text generation capabilities [ 2 , 1 ] . Fig. 1 : BCI System Architecture for text generation using event-related potentials. However, limitations exist regarding spelling speed and sample size that warrant further investigation before translational viability. The study acknowledges that advancing decoder algorithms, integrating language models, and longitudinal assessments with larger groups will be critical future directions. II-B Neural-Symbolic Approaches A recently proposed novel framework called Neural-Symbolic Processor (NSP) is aimed at improving natural language understanding when logical reasoning is required (as seen in Figure 2 ). NSP employs both neural analogical reasoning using deep learning models like BERT and RoBERTa as well as logical reasoning by generating executable programs that are run in a symbolic system. This work establishes a foundation for integrating neural networks trained on brain data into symbolic AI systems [ 11 ] . Fig. 2 : Overview of the Neural-Symbolic Processor framework integrating neural and symbolic reasoning. However, some limitations exist regarding direct application to EEG domains. The current restricted program grammar may not readily capture the intricate neurocognitive relationships required in EEG classification tasks. Appropriately annotating logical reasoning chains for diverse EEG decoding problems poses additional challenges. Furthermore, the limited training data compared to scale of distribution shifts across users, sessions, and datasets is still likely insufficient to fully generalize the programmed logic across subjects or timescales [ 11 ] . Addressing such domain adaptation challenges associated with subject-specific personalized calibration, few-shot learning, and better handling naturally distributed shifts remains an open research problem even for state-of-the-art neural EEG classifiers. Integrating the loose programming constraints into the variability in brain dynamics adds substantial difficulty in immediately leveraging NSP out-of-box. Fusing interpretable features between the neurally learned representations and structured knowledge will likely require innovations tailored to EEG data properties along with a great resource intensive environment. III Forward Process Classifier-LLM Network Our proposed framework consists of three main components: an RNN encoder for EEG feature extraction, a classifier for EEG state identification, and the Gemma 2B language model for text generation. III-A RNN Encoder Model The proposed framework utilizes a specialized convolutional neural network architecture tailored for EEG data processing for feature extraction, surpassing EEGNet as the foundation for this task. While EEGNet has demonstrably achieved success in various EEG-based applications, it presents certain limitations in the context of this research: • Complexity: EEGNet boasts a deeper convolutional neural network architecture compared to the RNN encoder. This characteristic, while advantageous for extracting intricate features from larger datasets, can be a hindrance in scenarios with restricted data availability. The RNN encoder’s simpler design allows it to function more efficiently with the limited dataset used in this study. • Focus on Filter Design: EEGNet places a strong emphasis on incorporating specific filter configurations within its convolutional layers. While these filters are well-suited for extracting task-relevant information from EEG signals, they might not be universally adaptable to the broad spectrum of EEG patterns that influence text generation. The RNN encoder, in contrast, offers a more data-driven approach to feature extraction, potentially capturing a wider range of EEG features pertinent to text generation. • Black Box Nature: While EEGNet excels at classification tasks, its deeper architecture can make it challenging to interpret how it arrives at specific classifications. This characteristic becomes a roadblock in this instance, as understanding the relationship between extracted features and generated text is crucial for further refinement of the text generation process. The RNN encoder, with its simpler

Read the complete text