Decoding Phone Pairs from MEG Signals Across Speech Modalities Journal: Computer Speech & Language
Xabier de Zuazo, Eva Navas, Ibon Saratxaga, Mathieu Bourguignon, Nicola Molinaro · 2025
Read Decoding Phone Pairs from MEG Signals Across Speech Modalities Journal: Computer Speech & Language by Xabier de Zuazo, Eva Navas, Ibon Saratxaga, Mathieu Bourguignon, Nicola Molinaro (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15355.txt.
Introduction
Xabier de Zuazo and four co-authors decode phone pairs from brain signals across speech modalities. Understanding the neural basis of speech production serves both theory and communication technology. Brain recordings during speaking, passive listening, and voice playback may carry very different amounts of phonetic detail.
Seventeen participants supply magnetoencephalography data, and pairwise classification covers fifteen phonetic pairs. Regularized linear models and neural networks compete on the decoding task. Accuracy reaches 76.6 percent during production against about 51 percent for listening and playback, which shows overt speech carries richer signal. An elastic net classifier beats the complex networks on this small, high dimensional data. Low frequency bands, delta and theta, contribute most to decoding.
Catalog record
| CREATOR | Xabier de Zuazo, Eva Navas, Ibon Saratxaga, Mathieu Bourguignon, Nicola Molinaro |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-15355
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Decoding Phone Pairs from MEG Signals Across Speech Modalities Journal: Computer Speech & Language Xabier de Zuazo, Eva Navas, Ibon Saratxaga, Mathieu Bourguignon, Nicola Molinaro Abstract Understanding the neural mechanisms underlying speech production is essential for both advancing cognitive neuroscience theory and developing practical communication technologies. In this study, we investigated magnetoencephalography (MEG) signals to decode phonetic units (phones) from brain activity during speech production and perception (passive listening and voice playback) tasks. Using a dataset comprising 17 participants, we performed pairwise phone classification, extending our analysis to 15 phonetic pairs. Multiple machine learning approaches, including regularized linear models and neural network architectures, were compared to determine their effectiveness in decoding phonetic information. Our results demonstrate significantly higher decoding accuracy during speech production (76.6%) compared to passive listening and playback modalities (approximately 51%), emphasizing the richer neural information available during overt speech. Among the models, the Elastic Net classifier consistently outperformed more complex neural networks, highlighting the effectiveness of traditional regularization techniques when applied to limited and high-dimensional MEG datasets. Besides, analysis of specific brain frequency bands revealed that low-frequency oscillations, particularly Delta ( 0.2 Hz to 3 Hz 0.2\text{\,}\mathrm{Hz}3\text{\,}\mathrm{Hz} ) and Theta ( 4 Hz to 7 Hz 4\text{\,}\mathrm{Hz}7\text{\,}\mathrm{Hz} ), contributed the most substantially to decoding accuracy, suggesting that these bands encode critical speech production-related neural processes. Despite using advanced denoising methods, it remains unclear whether decoding solely reflects neural activity or if residual muscular or movement artifacts also contributed, indicating the need for further methodological refinement. Overall, our findings underline the critical importance of examining overt speech production paradigms, which, despite their complexity, offer opportunities to improve brain-computer interfaces to help individuals with severe speech impairments. † † graphicalabstract: † † highlights: MEG decoding of 15 phonetic units during speech production. Higher decoding accuracy in speech production vs. perception. Linear models outperform neural networks on limited MEG data. Delta and Theta bands are essential for decoding speech production. 1 Introduction Brain-computer interfaces (BCIs) have emerged as essential technologies, facilitating direct interactions between neural activity and external devices. BCIs offer unique opportunities to improve the quality of life for individuals with severe communication impairments caused by conditions such as neurodegenerative diseases or paralysis [ 1 , 43 , 54 ] . Among various non-invasive neuroimaging methods employed for BCI development, functional Magnetic Resonance Imaging (fMRI) is a technique that tracks changes in cerebral blood flow, offering high spatial resolution but limited temporal resolution, thus restricting its application in real-time communication devices [ 36 ] . Electroencephalography (EEG), a non-invasive method widely employed due to its ease of use and high temporal resolution, captures electrical activity generated by neurons at the scalp level but has considerable spatial resolution limitations and signal-to-noise ratio challenges [ 6 , 51 ] . In contrast, magnetoencephalography (MEG), another non-invasive approach, measures magnetic fields generated by neuronal activity. MEG combines excellent temporal resolution with spatial accuracy superior to EEG, though it demands specialized infrastructure and has higher operational costs [ 7 , 14 ] . Speech production can be compromised by neurological conditions, such as Alzheimer’s disease or Primary Progressive Aphasia, which progressively deteriorate the complex neural networks governing spoken communication. Although addressing speech production impairments is very important, neuroscientific research has focused predominantly on passive speech perception paradigms, such as reading or listening tasks [ 52 , 44 , 24 ] , mainly due to the presence of motor artifacts during overt speech tasks. Consequently, studies on speech production have often relied on unnatural experimental paradigms, which raises concerns regarding their ecological validity. As a result, a significant gap persists in neural data acquisition and analytical methodologies for overt speech production. Public datasets containing audio synchronized with neural signals during speech production tasks are extremely limited. Yet, such datasets are essential for developing practical speech-based BCIs that aim to decode intended speech directly from neural signals rather than interpreting passive perception of speech [ 47 , 3 , 37 ] . Bridging this gap by intensifying research efforts in speech production can substantially improve technological support for individuals experiencing profound communication difficulties. Recent advances have substantially developed our understanding of how speech-related neural processes can be decoded into usable signals for communication. Studies employing invasive neural recordings have demonstrated the possibility of translating neural activity into comprehensible speech or text, improving BCI power for speech restoration [ 27 , 1 , 35 , 43 , 54 ] . In parallel, non-invasive techniques, particularly MEG, have been increasingly explored due to their ethical and safety advantages. Recent pioneering work by Kwon et al. [ 32 ] has shown the feasibility of synthesizing intelligible speech directly from MEG signals, highlighting an essential breakthrough for non-invasive BCIs. Furthermore, extensive research efforts have explored the use of EEG for open vocabulary speech decoding, emphasizing the importance of dataset size and representation learning in achieving reliable decoding performance [ 51 ] . Additional studies have demonstrated decoding capacity at word and phonetic levels using non-invasive recordings across large populations [ 9 ] , emphasizing the importance of considering factors like data quantity, modality (e.g., MEG versus EEG), and experimental paradigms (reading versus listening). Notably, previous studies by Dash et al. have demonstrated effective decoding of speech production at the word level from MEG signals using deep learning classification methods, achieving successful discrimination across five different classes [ 11 , 12 , 10 ] . Such studies underscore the feasibility of using MEG-based decoding approaches customized explicitly to overt speech production, an area still relatively underexplored compared to speech perception. Building upon our previous preliminary work [ 13 ] , the current study extends the scope by increasing the set of analyzed phonetic pairs from 10 to 15, providing a more complete phonetic decoding analysis using MEG data during speech production and perception tasks. We cover a broader family of models, including traditional machine learning and more recent neural networks. Moreover, we include a systematic analysis of classical brain frequency bands to assess the frequency ranges that carry phonetic information across tasks. This was performed to guide and justify the use of low-pass filtering during MEG preprocessing for model training. Prior work with the same dataset [ 5 ] emphasized the role of low-frequency neural oscillations, particularly Delta and Theta bands, in speech processing, and our frequency band analysis extends this to explicitly examine their contribution to decoding performance. In addition, we performed an ablation study to evaluate the individual contribution of each preprocessing component, helping to systematically justify the final decoding pipeline used across all model comparisons. Through this analysis, we aim to better understand how neural activity patterns vary between overt speech production and passive listening, revealing commonalities and distinctions that can guide future speech-BCI research. This extended work studies the possibilities of integrating non-invasive neuroimaging techniques with detailed phonetic-level analysis to improve communication aids for individuals with impaired speech. Besides, we share our fully reproducible pipeline source code 1 1 1 https://github.com/hitz-zentroa/meg-phone-decoding that other researchers can adapt for further research. 2 Materials and Methods 2.1 Dataset The current study employs the dataset previously described by Bourguignon et al. (2020) [ 5 ] . Initially, 18 healthy adult participants, all native Spanish speakers, participated in the MEG recordings.