EEG-FuseFormer: A Transformer-Driven Feature Fusion Framework for Seizure Onset Prediction
Vigneshwar Hariharan 1∗ , Chithra Reghuvaran 2∗ , Arlene John 3 , Nhat Pham 4 , Omer Rana 4 , Deepu John 2 , Ganesh Neelakanta Iyer 1 · 2026
Read EEG-FuseFormer: A Transformer-Driven Feature Fusion Framework for Seizure Onset Prediction by Vigneshwar Hariharan 1∗ , Chithra Reghuvaran 2∗ , Arlene John 3 , Nhat Pham 4 , Omer Rana 4 , Deepu John 2 , Ganesh Neelakanta Iyer 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02166.txt.
Introduction
Hariharan and co-authors build a transformer based system that forecasts the onset of epileptic seizures from EEG data. Epilepsy is one of the most common neurological disorders in the world, marked by recurring seizures that strongly affect quality of life. The unpredictability of seizures is a core risk for patients, so an accurate forecast of onset can reduce harm. Their EEG-FuseFormer framework fuses features from two different network branches to make that forecast.
One branch pairs convolutional layers with LSTM layers and reads spatial and temporal features straight from the raw signal. The other branch uses ResNet-18 on a short time Fourier transform representation of the same signal. Fusing the intermediate features of both branches is the core design choice. The aim is a richer signal view than either branch gives alone.
Catalog record
| CREATOR | Vigneshwar Hariharan 1∗ , Chithra Reghuvaran 2∗ , Arlene John 3 , Nhat Pham 4 , Omer Rana 4 , Deepu John 2 , Ganesh Neelakanta Iyer 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.02166
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
EEG-FuseFormer: A Transformer-Driven Feature Fusion Framework for Seizure Onset Prediction Thanks: * Vigneshwar Hariharan and Chithra Reghuvaran are co-first authors. Vigneshwar Hariharan 1∗ , Chithra Reghuvaran 2∗ , Arlene John 3 , Nhat Pham 4 , Omer Rana 4 , Deepu John 2 , Ganesh Neelakanta Iyer 1 Abstract Epilepsy is one of the most common neurological disorders globally, characterized by recurring seizures and significantly impacting the quality of life. Despite advancements in diagnostic techniques, the mitigation of risks faced by epilepsy patients remains challenging due to the unpredictability of seizure events. An accurate forecast of seizure onset helps to reduce risks in epilepsy patients. In this paper, we propose EEG-FuseFormer, a transformer-based feature fusion framework for seizure-onset prediction that combines intermediate features extracted from Convolutional Neural Networks-Long Short-Term Memory (CNN–LSTM) and ResNet-18 networks. The CNN-LSTM architecture captures both spatial and temporal features directly from the raw signal, whereas the ResNet-18 extracts features from the Short-Time Fourier Transform (STFT) representation of the EEG signals. Fusion is carried out using a transformer encoder, and the final prediction is generated using fully connected dense layers. The CHB-MIT dataset was used to validate the proposed model. The results show that the proposed model achieves a mean recall of 98.85% and outperforms most of the state-of-the-art methods. This study evaluates the ability of the proposed feature fusion model to generalize in cross-patient testing scenarios. Fine-tuning pre-trained models on limited target patient data (target adaptation) within the cross-patient validation framework results in higher recall, precision, and F1-score metrics in comparison to the conventional cross-patient validation approach. Finally, the runtime‑based computational complexity of the model is assessed across diverse hardware platforms to highlight the performance–complexity trade‑off. 1 National University of Singapore, 2 University College Dublin, 3 University of Twente, 4 Cardiff University I Introduction Epilepsy is a brain condition that is characterized by recurring seizures, affecting nearly 50 million people around the world, making it one of the most common neurological disorders in the world [ 20 ] . An automated patient-specific seizure onset prediction approach could reduce the serious consequences of seizure by detecting the onset and raising an alarm. Electroencephalograms (EEG), which measure brain electrical activity, are commonly employed to diagnose seizure onset prediction [ 9 ] . In epileptic patients, brain activity typically consists of four phases: pre-ictal (just before a seizure), ictal (during a seizure), postictal (immediately after a seizure), and interictal (normal activity) [ 9 ] . The detection of pre-ictal and interictal states is the main task in seizure onset prediction. EEG signals are inherently complex and exhibit irregular variations over time. Moreover, pre-ictal and interictal EEG patterns differ significantly across individuals, making seizure prediction highly challenging [ 23 ] . Feature extraction from decomposed EEG signals across time, frequency, and time–frequency domains is a key process in many seizure onset prediction studies [ 8 ] . These extracted features are then utilized to develop automated seizure prediction models. With the rapid advancement of deep learning, Convolutional Neural Networks (CNN) [ 17 , 23 , 3 ] , Long Short-Term Memory (LSTM) [ 18 , 21 ] , CNN-Bidirectional-LSTM [ 2 ] , Residual network (ResNet)-LSTM [ 14 ] architectures among others have become the most popular methods for seizure prediction in the literature. A single EEG feature cannot comprehensively represent the EEG signals, leading to insufficient accuracy and reliability in the detection of epileptic seizures [ 22 ] . To address this, various studies fuse multiple features to further enhance detection performance [ 13 , 12 ] . Tsiouris et al. [ 18 ] fused both time and frequency domain features to select the optimal feature set for classification, to further improve classification accuracy. Zhang et al. in [ 22 ] proposed a Convolutional Neural Network-Gated Recurrent Unit-Attention mechanism (CNN-GRU-AM) model, where EEG signals are first decomposed using wavelet transform. Time–frequency domain and nonlinear features are then extracted, followed by further feature extraction and classification using the CNN-GRU-AM model. However, simply combining various features can significantly increase runtime and introduce irrelevant features that may impact the final results. Hence, we propose a transformer-driven feature fusion model, EEG-FuseFormer, for seizure onset prediction. The proposed model uses deep learning networks to extract spatial and temporal dynamic features from EEG data. A two-channel feature fusion model based on CNN-Bi-LSTM was proposed in [ 15 ] . In this approach, CNN was used to extract spatial features, Bi-LSTM captures temporal features, and an attention module assigns weights to the features from each module. The proposed EEG-FuseFormer aims to further enhance seizure prediction performance by incorporating a transformer encoder that can carry out self-attention to fuse the features from the ResNet-18 and 1D-CNN-LSTM architectures. Furthermore, most studies on seizure onset prediction in the literature have concentrated on patient-specific models aimed at predicting seizures for individual patients [ 18 , 4 , 14 , 3 ] . Seizure symptoms vary among patients, from brief interruptions in activity to severe convulsions [ 9 ] . The real-life use of seizure prediction methods would require the deployment of cross-patient evaluation methods, such as leave-one-patient-out validation schemes [ 9 ] . The ability of the proposed EEG-FuseFormer model to generalize in cross-patient testing scenarios is evaluated. The most common approach in the literature for addressing cross-patient evaluation challenges is the application of the adaptation technique [ 16 ] , which allows fine-tuning of pre-trained models using a limited amount of data from target patient. This paper evaluates the performance of the proposed model with and without adaptation under the cross-patient testing framework. The results show a significant improvement in recall, precision, and F1-score metrics with target adaptation in comparison to the conventional cross-patient validation approaches. Lastly, the runtime‑based computational complexity of the proposed model is evaluated across diverse hardware platforms, including GPUs such as NVIDIA L4 and NVIDIA A100 SXM4 as well as embedded devices like the NVIDIA Jetson Nano, to illustrate the performance–complexity trade‑off. The remainder of this paper is organized as follows: Section II details the proposed EEG-FuseFormer Feature Fusion model and the cross-patient testing framework. Section III outlines the experimental setup and presents the results. Finally, Section IV concludes the paper. II Methodology II-A Datasets The CHB-MIT Scalp EEG dataset [ 5 ] was used in this paper, which comprises of continuous scalp EEG recordings from 23 pediatric subjects with intractable seizures. The recordings were sampled at 256Hz and used the international 10-20 system for recordings using bipolar channels. To ensure consistency across all subjects, 18 channels were selected: FP1-F7, F7-T7, T7-P7, P7-O1, FP1-F3, F3-C3, C3-P3, P3-O1, FP2-F4, F4-C4, C4-P4, P4-O2, FP2-F8, F8-T8, T8-P8-0, P8-O2, FZ-CZ, and CZ-PZ. Seizure activity in this work is categorized according to the proximity of the signal sample to the seizure (ictal) event. The pre-ictal period refers to the 1 hour preceding a seizure, post-ictal period refers to the 30 minutes immediately following a seizure event [ 4 ] . The inter-ictal period refers to periods outside of the two previously defined intervals and the ictal interval. Due to the high irregularity of post-ictal brain activity and inter-patient variability, post-ictal segments were excluded from analysis in this work. Additionally, to ensure relevance of this study to real-world applications, cases with