Bi-Band ECoGNet for ECoG Decoding on Classification Task

Changqing JI 1 · 2024

Read Bi-Band ECoGNet for ECoG Decoding on Classification Task by Changqing JI 1 (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-00378.txt.

Introduction

Changqing Ji presents Bi-Band ECoGNet, a deep learning model for classifying brain signals from ECoG recordings, in work from 2024. Brain-computer interfaces need accurate decoding, and ECoG data carry both time redundancy and a clear spatial pattern from their two-dimensional electrode arrays. Older feature methods are slow and heavy, which limits their use.

A new module, Bi-BCWT, handles low- and high-frequency bands at once and replaces a costly transform, raising training speed a great deal. A two-dimensional spatial-temporal encoder draws more from the array layout. The full model is smaller than prior work, trains far faster and gains a modest accuracy edge, which suits interface use.

Catalog record

CREATORChangqing JI 1
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-00378

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bi-Band ECoGNet for ECoG Decoding on Classification Task Changqing JI 1 Abstract In the application of brain-computer interface (BCI), being able to accurately decode brain signals is a critical task. For the multi-class classification task of brain signal ECoG, how to improve the classification accuracy is one of the current research hotspots. ECoG acquisition uses a high-density electrode array and a high sampling frequency, which makes ECoG data have a certain high similarity and data redundancy in the temporal domain, and also unique spatial pattern in spatial domain. How to effectively extract features is both exciting and challenging. Previous work [ 1 ] found that visual-related ECoG can carry visual information via frequency and spatial domain. Based on this finding, we focused on using deep learning to design frequency and spatial feature extraction modules, and proposed a Bi-Band ECoGNet model based on deep learning. The main contributions of this paper are: 1) The Bi-BCWT (Bi-Band Channel-Wise Transform) neural network module is designed to replace the time-consume method MST [ 2 ] , this module greatly improves the model calculation and data storage efficiency, and effectively increases the training speed; 2) The Bi-BCWT module can effectively take into account the information both in low-frequency and high-frequency domain, which is more conducive to ECoG multi-classification tasks; 3) ECoG is acquired using 2D electrode array, the newly designed 2D Spatial-Temporal feature encoder can extract the 2D spatial feature better. Experiments have shown that the unique 2D spatial data structure can effectively improve classification accuracy; 3) Compared with [ 1 ] , the Bi-Band ECoGNet model is smaller and has higher performance, with an accuracy increase of 1.24%, and the model training speed is increased by 6 times, which is more suitable for BCI applications. I Introduction Brain science has been one of the hottest research areas, electroencephalography is one of the technologies that effectively records brain activity. According to the category of invasive and non-invasive, there are two types of methods: EEG (electroencephalography) and ECoG (electrocorticography). EEG measuring uses a group of electrodes which attached to the surface of the scalp. It has the advantages of low cost and non-invasiveness. However, the collected data is easily affected by noise, and the electrode layout is sparse in space. ECoG signal acquisition is to place the electrode array directly on the gray matter cortex of the brain, directly collect the electrical signals of the gray matter cortex. Compared with EEG, there is no attenuation from the skull, the signal has a higher signal-to-noise ratio, and the high density of electrodes gives us a high spatial resolution. This makes ECoG have a wide range of applications. For example, ECoG is used to assist neurological rehabilitation therapy [ 3 ] . The cortical temperature, and cerebral thermodynamics of ECoG signals can contribute to improving the assessment of epileptic seizures [ 4 ] , epileptic seizure detection [ 5 ] , mental fatigue detection [ 6 ] and ECoG signals are extensively used to find the focus of seizures in epilepsy [ 7 ] . ECoG signals have a strong signal-to-noise ratio, which is conducive to the extraction of signal features. However, due to the large channel number, data redundancy, and strong similarity between channel signals, decoding ECoG signals is very challenging. Currently, the processing method of ECoG signals can be roughly divided into two categories: traditional methods and deep learning method. Traditional methods tend to manually design feature extractor, focusing on brain signal statistical information. In multi-classification tasks, beside basic statistical features, such as signal average, peak value, STD, etc., there are also feature extraction methods that target at temporal-frequency domain [ 8 ] [ 9 ] . Short-time Fourier transform (STFT) is a commonly used temporal-frequency analysis method for time series signals, but the time window length is fixed and the resolution of the time domain is relatively low. S-Transform [ 10 ] and its derivative version Modified Stockwell Transform (MST) [ 2 ] [ 11 ] [ 12 ] effectively improve the resolution of the time domain and can effectively extract temporal-frequency features. Discrete Wavelet Transform [ 13 ] [ 14 ] , Relative Wavelet Energy (RWE) [ 15 ] [ 13 ] can control the scale by adjusting parameters, can also extract temporal-frequency features, and obtain good results in classification tasks. Those temporal-frequency analysis methods are widely used in ECoG signal processing. In addition, there are many other feature extraction methods, such as Autoregressive Coefficients (AR) [ 16 ] Petrotosian Fractal Dimension (PFD) [ 17 ] Hjorth Complexity (HC) Hjorth Activity, Mobility, Complexity [ 18 ] , common spatial patterns (CSP) [ 19 ] [ 20 ] [ 21 ] , Band Power [ 22 ] , conditional random fields (CRF) [ 23 ] . The features extracted by these methods are redundant, so the features need to be selected and reduced in size. Commonly used methods include genetic algorithm [ 24 ] and principal component analysis (PCA) [ 13 ] [ 14 ] . The optimized feature subset will be passed to the classifier for final classification. For classifier common methods include support vector machine (SVM), (logistic regression (LR), linear discriminant analysis (LDA) and k-nearest neighbor (kNN), probabilistic neural network (PNN), etc. Traditional methods require manual design the suitable feature extractor, which requires prior knowledge of the relevant parameters. For small data sets, when the similarity between different categories is low and the computational cost is not high, traditional methods can handle it well. However, for large data sets, especially the similarity between data or categories is high, the manually designed features will be not large enough for classification task. For example, the ECoG signal dataset related to visual classification [ 25 ] this data has multiple categories, with high similarity cross categories, big data diversity within category, complex visual information. It requires a larger dimensional feature vector to construct an effective feature space which can provide enough discrimination information. At this situation, deep learning methods can show their capability. For temporal series signal processing, LSTM [ 26 ] have its reputation, it can effectively extract long-term correlation information. [ 27 ] used LSTM to process ECoG signals related to Motion Imaginary and achieved good results in classification task. [ 28 ] combined 2D convolution modules with LSTM to prove that the exploited spatial correlation between neighboring electrodes will benefit to predication of the hand trajectory. [ 25 ] used vision-based ECoG signals which were collected from the brains of primates. The authors compared the processing capabilities of the convolutional neural network (CNN) and the Bi-LSTM [ 29 ] network. The convolutional neural network used two modules, channel-wise transform and channel-level self-attention. The experimental results show that the convolutional neural network effectively extracts the characteristics of the time series signal, which has 6% higher in the classification accuracy than it of the Bi-LSTM, reaching the SOTA level in the classification task of this vision-based ECoG signal dataset. However, the convolutional neural network and LSTM network in [ 25 ] only focus on information in time domain, does not consider the spatial information of the electrodes. In [ 1 ] , which uses the same data set, the authors used MST to perform time-frequency

Read the complete text