LibriBrain: Over 50 Hours of Within-Subject MEG to Improve Speech Decoding Methods at Scale
Miran Özdogan, Gilad Landau, Gereon Elvers, Dulhan Jayalath, Pratik Somaiya, Francesco Mantegna, Mark Woolrich, Oiwi Parker Jones · 2025
Read LibriBrain: Over 50 Hours of Within-Subject MEG to Improve Speech Decoding Methods at Scale by Miran Özdogan, Gilad Landau, Gereon Elvers, Dulhan Jayalath, Pratik Somaiya, Francesco Mantegna, Mark Woolrich, Oiwi Parker Jones (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-02098.txt.
Introduction
Miran Özdogan and seven co-authors present LibriBrain in a 2025 paper, a data set of brain waves for speech decoding from a single person. Magnetoencephalography, or MEG, reads the faint fields the brain makes as it works. To decode speech from those fields needs a lot of clean data from one mind.
One listener gave more than fifty hours of MEG while hearing natural spoken English, near the whole Sherlock Holmes set of tales. That depth is far past past sets of its kind. A code library and set splits ship with the data, to speed new decoding work.
Catalog record
| CREATOR | Miran Özdogan, Gilad Landau, Gereon Elvers, Dulhan Jayalath, Pratik Somaiya, Francesco Mantegna, Mark Woolrich, Oiwi Parker Jones |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 99 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-02098
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LibriBrain: Over 50 Hours of Within-Subject MEG to Improve Speech Decoding Methods at Scale Miran Özdogan, Gilad Landau, Gereon Elvers, Dulhan Jayalath, Pratik Somaiya, Francesco Mantegna, Mark Woolrich, Oiwi Parker Jones Abstract LibriBrain represents the largest single-subject MEG dataset to date for speech decoding, with over 50 hours of recordings—5 × \times larger than the next comparable dataset and 50 × \times larger than most. This unprecedented ‘depth’ of within-subject data enables exploration of neural representations at a scale previously unavailable with non-invasive methods. LibriBrain comprises high-quality MEG recordings together with detailed annotations from a single participant listening to naturalistic spoken English, covering nearly the full Sherlock Holmes canon. Designed to support advances in neural decoding, LibriBrain comes with a Python library for streamlined integration with deep learning frameworks, standard data splits for reproducibility, and baseline results for three foundational decoding tasks: speech detection, phoneme classification, and word classification. Baseline experiments demonstrate that increasing training data yields substantial improvements in decoding performance, highlighting the value of scaling up deep, within-subject datasets. By releasing this dataset, we aim to empower the research community to advance speech decoding methodologies and accelerate the development of safe, effective clinical brain-computer interfaces. Figure 1 : Comparison of within-subject data volume in non-invasive speech datasets. 1 Introduction Recent advances in deep learning have demonstrated the critical role of high-quality datasets in enabling robust and generalisable models — a principle that holds true not only in vision and language domains, but increasingly in the study of speech decoding from brain signals. In invasive brain-computer interface (BCI) research, large-scale datasets collected via electrocorticography (ECoG) or microelectrode arrays have made it possible to train models with dozens hours of data per subject, leading to remarkable performance in paralysed individuals ( Moses et al., 2016 ; Metzger et al., 2023 ; Willett et al., 2023 ) . Most notably, recent systems have achieved less than 5% word error rates (WER) for text decoding in paralysed patients ( Card et al., 2024 ) . However, these achievements come with a fundamental limitation: they rely on data obtained through brain surgery. While neural interfaces based on ECoG or microelectrode arrays are extremely powerful, the need for invasive recording presents a substantial barrier to deployment outside of clinical trials. This has placed renewed emphasis on the search for non-invasive alternatives, particularly those using EEG or MEG, to achieve high-quality speech decoding without requiring surgical intervention. Although full non-invasive brain-to-text systems have yet to achieve WERs below 100% ( Jo et al., 2024 ; Yang et al., 2024b ; Yang et al., 2024c ; Yang et al., 2024a ) , a growing body of work has shown strong results on intermediate tasks such as speech segment identification ( Défossez et al., 2023 ) , word-level classification ( d’Ascoli et al., 2024 ) , and feature decoding ( Jayalath et al., 2024 ; Jayalath et al., 2025b ) . Crucially, these advances have been enabled by the increasing availability of open EEG and MEG datasets, which have lowered the barrier to training powerful models across diverse tasks and conditions. Early studies focused on pooling data across subjects within a single dataset ( Défossez et al., 2023 ; d’Ascoli et al., 2024 ) , but recent work has begun to explore more ambitious scaling via cross-dataset pre-training ( Jayalath et al., 2024 ; Jayalath et al., 2025b ) and domain adaptation ( Ridge and Parker Jones, 2024 ) . These findings establish a basis for future research aimed at leveraging extensive pooled non-invasive datasets to develop general-purpose decoding models. However, an important insight has recently emerged: although training on broader datasets with more subjects tends to improves generalisation, models trained on ‘deep’ data from a single subject often outperform broader models when matched for total training hours ( d’Ascoli et al., 2024 ) . Most existing non-invasive datasets are ‘broad but shallow’, offering 1–2 hours per subject. The standout exception is the dataset by Armeni et al., 2022 , with over 10 hours per subject, which has underpinned some of the strongest decoding results to date ( d’Ascoli et al., 2024 ) . This highlights an important gap in available resources, as non-invasive speech datasets with substantial per-subject depth remain limited yet seem crucial for progress toward reliable brain-to-text decoding. Figure 2 : Overview of the LibriBrain dataset. (A) Illustration of the MEG scanner and sensor layout. (B) Example annotation of a sentence, showing phonemes and words aligned with the audio spectrogram and MEG time series. (C) Word frequency distribution and word cloud for the 250 most frequent words. (D) Vowel chart and (E) consonant chart depicting the linguistic properties of the phonemes. In this paper, we introduce LibriBrain, a new open-access magnetoencephalography (MEG) dataset recorded from a single healthy volunteer listening to naturalistic, connected speech. With over 50 hours of data, LibriBrain offers the deepest non-invasive speech brain recordings to date, being more than 5× larger than the previous largest within-subject MEG dataset ( Armeni et al., 2022 ) , and 50× larger than most datasets in this space (see Figure 1 ). Inspired by the LibriSpeech dataset for automatic speech recognition (ASR), LibriBrain includes excerpts from seven audiobooks. All source audio is from LibriVox, ensuring public-domain availability and full reproducibility. Speech decoding tasks can target overt, covert (inner), or heard speech. Of these, heard speech is the most tractable for large-scale non-invasive recording. It not only supports fundamental research in auditory representation and inner speech (e.g. as auditory imagery), but also aids in developing robust, transferable methods for speech BCIs. LibriBrain was designed to fill this methodological gap: enabling reproducible, scalable research on decoding speech from brain activity using naturalistic stimuli. LibriBrain makes the following contributions: • Largest within-subject MEG speech dataset to date : Over 50 hours of high-quality MEG data from a single participant, exceeding previous datasets by 5–50×. • Naturalistic, richly annotated stimuli : Recordings obtained while listening to full-length audiobooks, including six Sherlock Holmes books and a subset of LibriSpeech excerpts. • Designed for ML usability : Easily accessible via pip , with a simple-to-use Python API ( from pnpl.datasets import LibriBrain ) and standard train/val/test splits. • Benchmark-ready : Supports two initial benchmark tasks—speech detection and phoneme classification—and includes baseline models and code. • Community engagement : Supports open ML competitions and a public leaderboard to encourage community-driven progress and reproducibility. • Open and reproducible : All audio, transcripts, and metadata are shared under public-domain licenses, making the entire dataset freely usable and shareable. 2 Related Work A growing number of EEG and MEG datasets focus on language processing and can be leveraged to scale non-invasive speech decoding models (Table 1 ). These datasets vary widely across multiple dimensions, including sensor count, linguistic richness, recording duration, and the number of participants. In terms of sensor coverage, the largest are LibriBrain and the MEG datasets of d’Ascoli et al., 2024 , all recorded using 306-channel Elekta/MEGIN systems—matching the highest-density sensor arrays available for non-invasive human neuroimaging. When measured by total duration, the largest dataset is Nieuwland et al., 2018 with 171 hours of EEG. However, this dataset is very broad and shallow: its 334 participants each contributed on average only