Unlocking Non-Invasive Brain-to-Text
Dulhan Jayalath, Gilad Landau, Oiwi Parker Jones · 2025
Read Unlocking Non-Invasive Brain-to-Text by Dulhan Jayalath, Gilad Landau, Oiwi Parker Jones (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13446.txt.
Introduction
Dulhan Jayalath and co-authors achieve the first strong brain-to-text results without any surgery, in a 2025 paper. Brain-to-text systems transcribe intended speech from brain signals. Surgical implants have made real progress, but they carry obvious risks. Non-invasive methods had never beaten even chance on standard scoring. That failure blocked a safer path to communication aids.
Three advances drive the breakthrough. Word classifiers were extended with language model rescoring. A predictive in-filling method handles words outside the known vocabulary. Together they lift scores well above prior baselines. Paralyzed patients could one day communicate without implants. The work sets a new reference point for the field. It also invites replication on larger vocabularies.
Catalog record
| CREATOR | Dulhan Jayalath, Gilad Landau, Oiwi Parker Jones |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-13446
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Unlocking Non-Invasive Brain-to-Text Dulhan Jayalath, Gilad Landau, Oiwi Parker Jones Abstract Despite major advances in surgical brain-to-text (B2T), i.e. transcribing speech from invasive brain recordings, non-invasive alternatives have yet to surpass even chance on standard metrics. This remains a barrier to building a non-invasive brain-computer interface (BCI) capable of restoring communication in paralysed individuals without surgery. Here, we present the first non-invasive B2T result that significantly exceeds these critical baselines, raising BLEU by 1.4 − 2.6 × \mathbf{1.4\mathrm{-}2.6\times} over prior work. This result is driven by three contributions: (1) we extend recent word-classification models with LLM-based rescoring, transforming single-word predictors into closed-vocabulary B2T systems; (2) we introduce a predictive in-filling approach to handle out-of-vocabulary (OOV) words, substantially expanding the effective vocabulary; and (3) we demonstrate, for the first time, how to scale non-invasive B2T models across datasets, unlocking deep learning at scale and improving accuracy by 2.1 − 2.3 × \mathbf{2.1\mathrm{-}2.3\times} . Through these contributions, we offer new insights into the roles of data quality and vocabulary size. Together, our results remove a major obstacle to realising practical non-invasive B2T systems. Figure 1 : Our approach outperforms all non-invasive B2T methods. Ranks are calculated from absolute improvement over associated random baselines. 1 Introduction Transcribing natural language text directly from speech-related neural signals, known as brain-to-text decoding, remains one of neuroscience’s most challenging and clinically significant frontiers. Recent breakthroughs showing remarkable accuracy (e.g. [ 1 , 2 , 3 , 4 , 5 ] ) use surgical methods to measure brain activity, implanting electrodes on the surface of, or even inside, the brain. These neurosurgical interventions come with significant inherent risks, including brain infection, haemorrhages, and cognitive side effects, limiting adoption outside of research trials. Instead, safe non-invasive imaging methods, such as EEG and MEG, which measure neural activity with sensors on or around the head, could unlock widespread use. These methods trade surgical risk for lower signal quality as skull and tissue conductivity as well as sensor distance introduce attenuation of the underlying neural signals [ 6 ] . Despite advances in some classification tasks [ 7 , 8 , 9 ] , full brain-to-text reconstruction from non-invasive electrophysiological signals has remained elusive, in spite of numerous attempts [ 10 , 11 , 12 , 13 , 14 ] , with no method convincingly surpassing chance across a set of standard metrics [ 15 ] . We present the first non-invasive B2T method to surpass every critical chance baseline across all standard metrics ( p\ll.001 ), comprehensively exceeding all prior work (Figure 1 ) and improving over previous BLEU scores by up to 2.6\times . In reaching this milestone, we address some fundamental challenges. Firstly, we extend individual word prediction [ 9 ] to contextual sequence decoding, rescoring word predictions according to their surrounding context using a large language model. This enables word predictors to become viable B2T decoders, overcoming the low performance of prior sequence-to-sequence speech decoding strategies [ 12 , 13 , 14 ] . Secondly, word predictors are bound to small closed vocabularies that are hard to scale up, limiting B2T performance. Hence, we propose an in-filling strategy to detect and predict out-of-vocabulary words, enabling open vocabulary transcription from closed-vocabulary decoders. Although these techniques unlock non-invasive B2T, improving results further requires addressing a data bottleneck. Existing methods can not scale up data because individual speech datasets are small. Moreover, due to drastic differences across datasets, such as hardware, subject anatomy, and cognitive variation, they struggle to combine datasets to achieve meaningful performance improvements in complex tasks (e.g. [ 7 , 16 , 17 , 18 , 19 , 20 ] ). We resolve this fundamental bottleneck by defining standalone dataset performance as a measure of quality. By observing that high quality datasets combine well with other datasets, we selectively pool data to more than double word classification accuracy. In summary, our work makes three main contributions: (1) we advance non-invasive decoding from single-word prediction to full B2T through contextual LLM rescoring; (2) we transform closed-vocabulary B2T into open-vocabulary decoding with a predictive in-filling strategy; and (3) we enable scaling through our selective dataset pooling framework, improving word classification accuracy by up to 2.3\times . These advances bring about the first system that surpasses the prerequisite chance baselines for establishing non-invasive B2T and dominates prior work. Additionally, our ablation studies rigorously validate each component of our approach against controls that invalidated prior methods, establishing a new standard for validating B2T systems. By demonstrating that non-invasive methods achieve meaningful results, our work challenges the assumption that speech decoding requires surgical imaging, unlocking the path for advances in the years to come. 2 Related Work Speech decoding BCIs have progressed along divergent paths: surgical approaches with impressive performance but limited applicability, and non-invasive methods that are safe but must contend with lower signal to noise ratios. This tension between efficacy and accessibility defines the current landscape. In this section, we contextualise our non-invasive work within this rapidly evolving field. Over the past few years, several breakthroughs have been made in surgical speech BCIs. In 2021, Moses et al. 2021 developed a B2T neuroprosthesis for a paralysed patient with a 50-word vocabulary. Two years later, Willett et al. 2023 showed similar performance but with a 125,000-word vocabulary. The main innovations of these papers were the recording of high-resolution brain signals and the use of deep neural networks. Following these milestones, subsequent papers have introduced rapid calibration procedures to reduce degradation due to non-stationarities [ 4 ] and real-time voice synthesis [ 5 ] . While these developments are remarkable, surgical approaches carry significant risk of complications and are consequently limited in use outside of controlled clinical trials. Non-invasive approaches are safe but progress has been limited by noisier signal quality, constraining the most promising work to simpler tasks than B2T. Défossez et al. 2023 developed a contrastive learning method that matches pairs of audio and MEG data from speech perception. A preprint by d’Ascoli et al. 2024 extended this method to pairs of word embeddings and MEG data for word classification. While impressive, neither facilitate sequence-level brain-to-text as they either require paired audio [ 8 ] or are bound to small vocabularies and limited by greedy word prediction [ 9 ] . Despite the difficulty, there have been attempts at non-invasive B2T speech decoding. With fMRI, Tang et al. 2023 achieved significant results across three participants in speech perception. However, they are not able to decode at word-level granularity as the temporal resolution in fMRI is too low to resolve words, limiting it to a semantic paraphrasing method. With EEG, Wang and Ji 2022 and Duan et al. 2023 explored open-vocabulary B2T from participants reading text. Subsequent analysis by Jo et al. 2024 revealed that performance metrics in these studies were influenced by teacher-forcing during evaluation, and when addressed, performance was comparable to a baseline with random noise inputs. A series of recent MEG-based B2T preprints [ 12 , 13 , 14 ] represent promising directions, though current evaluations lack noise baselines and have not yet surpassed random word selection. Finally, a neighbouring subfield has attempted non-invasive character decoding from brain or muscular activity due to typing or handwriting [ 22