Neural Spelling: A Spell-Based BCI System for Language Neural Decoding
Xiaowei Jiang 1 † , Jinzhao Zhou 1 † , Yiqun Duan 1 , Ziyi Zhao 1 , Yu-Cheng Chang 1 , Thomas Do 1 , Chin-Teng Lin * 1 · 2025
Read Neural Spelling: A Spell-Based BCI System for Language Neural Decoding by Xiaowei Jiang 1 † , Jinzhao Zhou 1 † , Yiqun Duan 1 , Ziyi Zhao 1 , Yu-Cheng Chang 1 , Thomas Do 1 , Chin-Teng Lin * 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-17489.txt.
Introduction
Xiaowei Jiang and co-authors build a brain-based spelling system for people who cannot speak or move well, in work from 2025. Their system reads brain waves through the scalp, with no surgery. Past systems of this kind could not cover the full set of letters, which capped their use in daily life.
The new system first decodes the brain signs of handwriting, letter by letter, across all twenty-six letters. A large language model then cleans up and sharpens the spelled text. The team reports strong exactness in tests. They frame the tool as a broad, friendly path to plain speech for users with severe speech loss.
Catalog record
| CREATOR | Xiaowei Jiang 1 † , Jinzhao Zhou 1 † , Yiqun Duan 1 , Ziyi Zhao 1 , Yu-Cheng Chang 1 , Thomas Do 1 , Chin-Teng Lin * 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-17489
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Neural Spelling: A Spell-Based BCI System for Language Neural Decoding Thanks: † Xiaowei Jiang and Jinzhao Zhou contributed equally to this work. Thanks: * Corresponding author: Xiaowei Jiang. Email: [email protected] Xiaowei Jiang 1 † , Jinzhao Zhou 1 † , Yiqun Duan 1 , Ziyi Zhao 1 , Yu-Cheng Chang 1 , Thomas Do 1 , Chin-Teng Lin * 1 Abstract Objective: Brain–computer interfaces (BCIs) can support communication by translating neural activity into text, yet existing non-invasive systems rarely cover the full alphabet, limiting their practical use. Methods: We propose a novel non-invasive EEG-based BCI framework, Curriculum-based Neural Spelling (CNS), that decodes all 26 English letters by first learning neural patterns associated with handwriting trajectories. A Generative AI (GenAI) module based on large language models (LLMs) is then integrated to refine spell-based neural decoding and correct semantic errors. Results: The proposed system achieves robust letter-level decoding and accurate sentence reconstruction across users, outperforming conventional EEGNet and hybrid CNN–RNN baselines. GenAI correction further reduces word error rates and enhances decoding fluency. Conclusion: Combining EEG-based neural spelling with generative language modeling enables full-alphabet decoding and significantly improves linguistic accuracy in non-invasive BCIs. Significance: This work demonstrates how integrating GenAI with neural decoding can bridge the gap between noisy signal-level predictions and coherent language-level outputs, establishing a system-level framework for full-alphabet neural spelling and adaptive language-level correction under non-invasive EEG constraints. I Introduction Brain-computer interfaces (BCIs) have emerged as a pivotal area of research within human-computer interaction (HCI), distinguished by their capacity to seamlessly integrate neural signals with external systems. Pioneering studies such as those by Guo et al. [ 1 ] , Chen et al. [ 2 ] , Cao et al. [ 3 ] , Nguyen et al. [ 4 ] , and Lin et al. [ 5 ] underscore BCIs’ role in advancing neuroscience and technology. These interfaces create direct communication pathways that are especially beneficial for individuals with limited speech or motor functions. Language decoding represents a critical domain within BCI research, aimed at deciphering the neural correlates of speech and language processing. This capability not only enhances interaction paradigms but also opens new avenues for communication, offering significant improvements in quality of life for those with severe communicative impairments. Fig. 1: Demonstrations of four typical language decoding frameworks. (A) Direct speech synthesis approach. (B) Spelling-based approach using phonemes. (C) Direct text synthesis approach. (D) Spelling-based approach using letters. Initially, BCI research focused on visual-based decoding approaches, such as steady-state visually evoked potentials (SSVEP) [ 1 ] , which, despite their reliability, demand high cognitive effort and are unsuitable for prolonged use [ 2 ] . These methods often fail to align with natural human language patterns, posing significant usability challenges. The advent of invasive neural decoding technologies marked a significant advancement, allowing for direct interpretation of brain signals via electrocorticography (ECoG) or stereo-EEG (sEEG) [ 6 , 7 ] . These methods have demonstrated substantial improvements in user performance, significantly enhancing communicative capacities for patients with speech impairments. However, the invasive nature, high cost, and ethical concerns limit their general applicability [ 8 ] . In contrast, non-invasive BCIs, predominantly utilizing electroencephalography (EEG), offer a more accessible alternative. These systems are less obtrusive and more cost-effective, broadening potential user demographics [ 9 , 10 ] . Despite the challenges of signal noise and the extensive training required for users, recent studies have demonstrated EEG’s potential in effective language decoding [ 11 , 12 ] . With the rise of Generative AI (GenAI), the integration of large language models (LLMs) into BCI research has opened new avenues for enhancing language decoding [ 13 ] . This integration can be implemented within two distinct frameworks: directly synthesizing speech or text from brain signals using pre-trained LLMs, as illustrated in Fig. 1 (A) and Fig. 1 (C) respectively; and decoding brain signals into minimal language units such as phonemes, as shown in Fig. 1 (B), or letters, as depicted in Fig. 1 (D), followed by text generation through natural language processing (NLP) models. Fig. 2: (A): The experimental design. (B): The trajectory completion over time. (C): The power spectral density (PSD) features computed from raw EEG signals. (D): The structures of the Trajectory ResNet-18 encoder and the Convolutional EEG encoder. (E): The letter probability distribution at the classifier output. (F): The structure of the sentence generator. The first framework often faces limitations due to the disparity in data scales between brain data and text/image datasets, which can restrict the system to operating within predefined datasets, merely retrieving sentences rather than generating novel content. The second approach, known as the spell-based method [ 14 , 15 ] , operates by initially decoding neural signals into their minimal representational units, such as the 26 letters, or even nine-key input (T9) [ 16 ] . It subsequently employs GenAI to construct coherent text in a second stage. This technique is advantageous as it requires fewer categories for the neural decoding model, thereby reducing both the cognitive load on the user and the difficulty associated with model training. A significant benefit of this method is its utilization of extensive textual datasets in training GenAI, particularly for generative error correction (GEC) [ 17 ] , which enhances the accuracy and flexibility of the generated text. Moreover, this method is not constrained by the size of the neural training samples and can adapt swiftly to new linguistic content through fine-tuning of the GenAI, circumventing the need for extensive retraining on new brain data. The spell-based methods initially utilize N-gram models to calculate the probability of sequential letter occurrences. For instance, the ECoG study aimed at spelling imaged handwritten letters [ 15 ] , and the sEEG study focused on spelling the Pinyin representations of Chinese pronunciations [ 18 ] . Subsequently, GenAI technologies have been employed to enhance performance, as demonstrated in studies like [ 8 ] and [ 13 ] . These vocal-based methods underscore the potential of GenAI for neural language decoding. However, these approaches have limitations. For example, vocal-based methods require accurate pronunciation by subjects. Given the diversity in pronunciation—such as the thousands of syllables and 44 phonemes in English, including closely related sounds like \textipa / \textscripta / and \textipa /ae/, along with variations between short and long vowels—it becomes challenging to accurately generate complete sentences. Simultaneously, Mandarin Chinese combines 21 consonant phonemes, 7 vowel phonemes, and 4 tones to create over 400 distinct syllables [ 18 ] . This vast array of phonetic elements significantly complicates speech synthesis in both languages. The complexity is further exacerbated in non-invasive speech synthesis applications due to the signal-to-noise ratio (SNR) and the limitations of the training datasets available. These factors together pose substantial challenges in developing robust and accurate speech synthesis systems. Therefore, spelling letters, as opposed to using vocal-based features, presents a more effective option for language decoding. The classification of just 26 letters not only simplifies the process compared to pronunciation-based methods but also enhances performance and applicability, even facilitating cross-linguistic utility, such as seamlessly integrating English and Pinyin. Unlike prior EEG-based handwriting paradigms that typically focus on limited symbol sets or isolated character recognition, the present study systematically investigates full-alphabet (26-letter) decoding