Exploring Deep Learning Models for EEG Neural Decoding
Laurits Dixen, Stefan Heinrich, Paolo Burelli · 2025
Read Exploring Deep Learning Models for EEG Neural Decoding by Laurits Dixen, Stefan Heinrich, Paolo Burelli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-16567.txt.
Introduction
Laurits Dixen, Stefan Heinrich, and Paolo Burelli test deep learning models at reading object ideas from brain waves, in this 2025 paper. Neural decoding tries to recover what the brain represents from recorded activity. Their data set holds EEG recordings from forty-six people watching images flash by.
The decoding target was simple: living versus non-living things. Fifteen deep models across five designs were compared with a top linear method. The linear model failed the task, while nearly all deep models succeeded. Results split further by object category, showing where each design shines. The authors suggest such networks can double as tools for probing the brain itself.
Catalog record
| CREATOR | Laurits Dixen, Stefan Heinrich, Paolo Burelli |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-16567
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Exploring Deep Learning Models for EEG Neural Decoding Laurits Dixen, Stefan Heinrich, Paolo Burelli Abstract Neural decoding is an important method in cognitive neuroscience that aims to decode brain representations from recorded neural activity using a multivariate machine learning model. The THINGS initiative [ 11 ] provides a large EEG dataset of 46 subjects watching rapidly shown images. Here, we test the feasibility of using this method for decoding high-level object features using recent deep learning models. We create a derivative dataset from this of living vs non-living entities test 15 different deep learning models with 5 different architectures and compare to a SOTA linear model. We show that the linear model is not able to solve the decoding task, while almost all the deep learning models are successful, suggesting that in some cases non-linear models are needed to decode neural representations. We also run a comparative study of the models’ performance on individual object categories, and suggest how artificial neural networks can be used to study brain activity. 1 Introduction The human brain is still the most advanced information-processing entity we know of, with incredible efficiency, efficacy and adaptability. However, the details of how information is represented and processed in the brain at the algorithmic level are elusive to us. Furthering this understanding holds great potential for understanding intelligence at a deeper level. Neural decoding is a somewhat recent technique for studying neural representations. It consists of applying a machine learning (ML) model to recordings of brain activity, to decode representations in the brain [ 18 ] . Here decoding is finding dissociations in the neural activity associated with different stimuli or conditions. When dissociation is successful, that neural activity is taken to contain relevant information about the conditional difference, thereby giving scientists a clue on what information is present where and when in coganitive processing. Neural decoding, using multivariate statistical or ML approaches, has gained popularity among cognitive neuroscientists as a tool to analyse their experimental data, replacing, to some degree, the traditional approach of inferential statistics on univariate measures of individual voxels or electrodes using generalised linear models [ 8 ] . Recently, neural decoding has given great insight into among others vision science [ 23 ] , face processing [ 14 ] . The imaging technique focused on in this paper is electroencephalography (EEG). EEG offers a non-invasive way to measure neural activity with a very high sampling rate at the cost of a lower spatial resolution when compared to other popular imaging techniques. Whereas high accuracy in traditional neural decoding is not essential - if decoding happens reliably it is taken as such, other fields using similar techniques have great interest in creating models able to efficiently learn associations between brain patterns in EEG and behaviour, intention or cognitive state [ 23 ] . Among these fields is the study of brain-computer interfaces (BCI), where the aim is to allow interactions with a computer using only neural recordings. Medical fields are also starting to rely on using computational analysis of brain activity to diagnose neurological diseases such as depression [ 27 ] and dementia [ 15 ] . Other fields that also benefit from high-performing models on neural data are affective computing [ 16 ] , and stimulus reconstruction [ 3 ] . Therefore, developing models that can effectively learn the patterns in EEG signals is highly important. Even for traditional cognitive neural decoding, simpler models might not be able to successfully find some associations that only show in highly nonlinear relationships [ 10 ] . Deep learning (DL) models have, especially in the last 10 years, shown their power in modelling nonlinear relationships. Even so much that they have gotten to human or superhuman levels in some cognitively relevant tasks. This has caused interest from cognitive neuroscientists to figure out how to utilise these tools best in their work [ 6 ] . The main requirement for these models to work has been collecting enough high-quality data for training. Especially, scaling into very large models has required scaling the sample size as well. A few large EEG datasets exist in different domains, for example diagnosis [ 7 ] and BCI [ 13 ] . None of these holds as much potential for insight into cognition as the THINGS initiative [ 12 ] . THINGS contain 12 or more naturalistic images of 1,854 different objects with plenty of semantic details described for each object category including wordnet relationships and human-rated high-level categories. Crucially, recordings of humans watching these images now exist both for fMRI, MEG and EEG [ 9 ] . The EEG dataset by [ 11 ] has 46 subjects all viewing 22,248 images, resulting in 1,023,408 total trials, which we believe warrants an interest from the computational cognitive neuroscience community. Despite this, not much work has been done in trying to utilise the large dataset for bigger DL models. This is why we, in this work, aim to take the first steps in exploring and benchmarking a simple task derived from this dataset using different popular DL models and comparing them to the best linear modelling techniques. 2 Related works The THINGS EEG dataset presents a unique challenge in decoding because of its experimental constraints. To practically let each subject watch 22,248 images, they are shown in rapid succession. Specifically 50 ms stimulus time and 50 ms off duty. That means ten images are shown per second. This presumably limits the amount of information processing the subject is doing per image, which is part of why this work needs to be benchmarked. An important constraint then is the short time window of the relevant signal. Crucially, this makes a frequency representation of the data less feasible. Band power representation has otherwise shown to be greatly suited for DL on EEG [ 30 ] . Therefore, we are tasked with analysing the untransformed time representation, which limits the possible comparisons for this work. The closest work in this area, to our best knowledge, comes from the BCI community, where benchmarking model performance is important. The MOABB project [ 13 ] lays out a variety of BCI datasets of various sizes and collects them for standardised testing. Interestingly, according to their leaderboards, almost all BCI applications are best solved using a linear decoder pipeline. It is worth noting that BCI tasks are often chosen specifically because they are easily solved by a linear model. For example, a binary motor imagery task often consists of imagining moving either the right or the left arm. This should create a clear lateralisation in the signal, which is easily picked up by a linear model. We, therefore, should include a linear modelling approach in our study to compare deep learning models. Recently, the THINGS MEG dataset was used for real-time image reconstruction [ 3 ] . While MEG and EEG measure very similar signals, the MEG THINGS dataset did not have the ten images per second setup, making comparisons less easy. They used a convolutional model with residual connections introduced in [ 4 ] to get a 7X improvement to a linear baseline model, although their task included the original 1854 object categories, which is different to the task