Modified TSception for Analyzing Driver Drowsiness and Mental Workload from EEG
Gourav Siddhad, Anurag Singh, Rajkumar Saini, Partha Pratim Roy · 2025
Read Modified TSception for Analyzing Driver Drowsiness and Mental Workload from EEG by Gourav Siddhad, Anurag Singh, Rajkumar Saini, Partha Pratim Roy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-21747.txt.
Introduction
Gourav Siddhad, Rajkumar Saini, Partha Pratim Roy, and Anurag Singh adapt a neural network to detect drowsiness and mental workload from brain signals. Drowsiness is a leading cause of road accidents, so vehicles need reliable warning systems. Electroencephalography, recorded from scalp electrodes, offers a direct window on the driver's state.
Their modified TSception network reads the EEG with a five-layer refinement strategy, capturing brain dynamics at several time scales where the original design used three layers. Adaptive average pooling makes the network flexible across EEG layouts. A two-stage fusion mechanism combines spatial and temporal features more stably. On the SEED-VIG dataset, the model scored about eighty-three percent accuracy, matching the original, but with a much narrower confidence interval, meaning steadier performance. On the STEW dataset it reached state-of-the-art accuracy near ninety-six percent for both two-class and three-class judgments.
Catalog record
| CREATOR | Gourav Siddhad, Anurag Singh, Rajkumar Saini, Partha Pratim Roy |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-21747
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Modified TSception for Analyzing Driver Drowsiness and Mental Workload from EEG Gourav Siddhad, Anurag Singh, Rajkumar Saini, Partha Pratim Roy Abstract Driver drowsiness remains a primary cause of traffic accidents, necessitating the development of real-time, reliable detection systems to ensure road safety. This study presents a Modified TSception architecture designed for the robust assessment of driver fatigue using Electroencephalography (EEG). The model introduces a novel hierarchical architecture that surpasses the original TSception by implementing a five-layer temporal refinement strategy to capture multi-scale brain dynamics. A key innovation is the use of Adaptive Average Pooling, which provides the structural flexibility to handle varying EEG input dimensions, and a two-stage fusion mechanism that optimizes the integration of spatiotemporal features for improved stability. When evaluated on the SEED-VIG dataset and compared against established methods—including SVM, Transformer, EEGNet, ConvNeXt, LMDA-Net, and the original TSception—the Modified TSception achieves a comparable accuracy of 83.46% (vs. 83.15% for the original). Critically, the proposed model exhibits a substantially reduced confidence interval (0.24 vs. 0.36), signifying a marked improvement in performance stability. Furthermore, the architecture’s generalizability is validated on the STEW mental workload dataset, where it achieves state-of-the-art results with 95.93% and 95.35% accuracy for 2-class and 3-class classification, respectively. These improvements in consistency and cross-task generalizability underscore the effectiveness of the proposed modifications for reliable EEG-based monitoring of drowsiness and mental workload. \leadauthor Siddhad Modified TSception for Analyzing Driver Drowsiness and Mental Workload from EEG keywords Electroencephalography | Deep Learning | Driver Drowsiness | Mental Workload {corrauthor} g_siddhad and cs.iitr.ac.in 1 Introduction Electroencephalography (EEG) is a non-invasive technique for recording the brain’s electrical activity with significant applications across neuroscience, clinical diagnosis, and Brain-Computer Interfaces (BCIs). By capturing signals across distinct frequency bands—delta, theta, alpha, beta, and gamma – via scalp electrodes, EEG provides the high temporal resolution necessary to monitor rapid neural dynamics in real-time. Compared to other neuroimaging modalities, EEG is highly valued for its portability and cost-effectiveness, making it ideal for assessing cognitive states such as driver drowsiness and mental workload. In clinical practice, EEG serves as a cornerstone for diagnosing neurological conditions, including epilepsy, Alzheimer’s disease, and various sleep disorders ( 1 ) . Its capacity for real-time monitoring is particularly critical for conditions requiring precise temporal resolution ( 17 ) . Beyond clinical use, EEG is instrumental in BCIs ( 8 ) , neuromarketing, and psychology, where event-related potentials (ERPs) are used to characterize stimulus-driven brain processes. Furthermore, EEG provides an objective measure of cognitive load, making it a vital tool for assessing mental workload in high-demand environments. Driver drowsiness is a global contributor to road accidents, and its timely detection is pivotal for improving road safety. Unlike fatigue, which is a broader state, drowsiness represents a specific transition toward sleep that EEG can detect directly through brain activity. This allows for the identification of early neural markers, such as alpha spindles and theta bursts, before external physical signs become visible to behavioral or visual monitoring systems. Effective analysis of these complex signals requires sophisticated processing, including artifact removal, feature extraction, and classification. Recently, Deep Learning (DL) has emerged as a superior approach to traditional Machine Learning (ML) for EEG classification. Architectures such as Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) have demonstrated success in emotion recognition and seizure detection ( 8 ) . A primary advantage of DL is its ability to perform automated feature extraction directly from raw EEG data ( 23 ) . In the context of drowsiness, CNNs are particularly effective as they can learn biologically meaningful patterns that serve as reliable indicators of a subject’s state ( 9 ) . Despite this progress, challenges in EEG-based detection remain, particularly regarding inter-individual variability. The inherent differences in brain activity between subjects complicate the development of calibration-free systems. Current research aims to improve generalizability, minimize sensor requirements, and explore multi-modal integration with other physiological measures ( 27 ) . While EEG offers a direct and objective measure of brain activity, a critical gap remains: current DL models often exhibit high performance instability across subjects. Furthermore, the lack of a unified architecture capable of generalizing across different cognitive tasks, such as drowsiness and mental workload, limits real-world implementation. Consequently, this research aims to bridge these gaps by proposing a Modified TSception architecture. By enhancing temporal and spatial feature extraction, this study develops a robust system evaluated on the SEED-VIG (drowsiness) and STEW (mental workload) datasets. To address the limitations inherent in existing methodologies, three primary research objectives are pursued in this study, with a central focus on enhancing the reliability and versatility of EEG-based classification. First, stability enhancement is sought through the development of a robust architecture designed to minimize performance inconsistency and yield more reliable confidence intervals in comparison to current models. Second, cross-task generalizability is evaluated to determine the effectiveness of a modified spatiotemporal network in detecting both driver drowsiness and fluctuating levels of mental workload. Finally, architectural optimization is addressed by investigating the role of hierarchical temporal layers and adaptive pooling mechanisms in capturing the complex, non-linear patterns characteristic of multi-channel EEG signals. The contributions of this paper are as follows: • Introduction of a Modified TSception architecture, which incorporates additional temporal layers for richer hierarchical feature extraction. • Strategic implementation of Adaptive Average Pooling (ADP) within temporal and spatial pathways to maintain fixed output dimensions and mitigate overfitting. • Integration of a two-stage fusion mechanism designed to optimize the synergy between extracted spatiotemporal features. • Cross-domain evaluation of the proposed model using the SEED-VIG and STEW datasets to verify performance across different EEG-based tasks. • Validation of performance stability, demonstrating that the proposed model achieves accuracy comparable to the original TSception while significantly reducing the Confidence Interval (CI) for real-world reliability. The remainder of this paper is structured as follows: Section 2 reviews the literature on EEG-based drowsiness detection. Section 3 details the Modified TSception architecture and its design rationale. Section 4 presents the experimental results and comparative evaluation, and Section 5 concludes the paper with directions for future work. 2 Background This section reviews the existing literature on EEG-based drowsiness detection and mental workload assessment. The review encompasses fundamental signal processing concepts, traditional ML methodologies, and modern DL architectures, while also addressing critical challenges such as inter-subject variability and the development of portable, low-cost monitoring devices. Drowsiness detection remains a vital research area for enhancing road safety, as EEG signals provide a direct, objective measure of neurological transitions in alertness. Traditional ML approaches in this domain rely heavily on manual feature engineering. For instance, Tarafder et al. ( 28 ) utilized ocular indices derived from eye movements to classify drowsy and alert states with 91.10% accuracy using an ensemble-boosted trees model. Other researchers have integrated EEG with near-infrared spectroscopy (NIRS) to identify significant shifts in oxy-hemoglobin concentration and beta-band power during the onset of fatigue ( 18 ) . Furthermore, the combination of wavelet-based nonlinear features with eyelid movement data has demonstrated improved detection speed and accuracy ( 5 ) . To address inter-individual variability, studies have explored cross-subject systems and channel selection. Cui et al. ( 9 ) proposed a compact CNN to identify shared EEG features across subjects, achieving 73.22% accuracy and revealing