AI generalisation gap in comorbid sleep disorder staging

Saswata Bose ⋄∗ Suvadeep Maiti ♣⋄∗ Shivam Kumar Sharma ⋄∗ Mythirayee S ‡ Tapabrata Chakraborti † Srijitesh Rajendran ‡ Raju S. Bapi ⋄ · 2026

Read AI generalisation gap in comorbid sleep disorder staging by Saswata Bose ⋄∗ Suvadeep Maiti ♣⋄∗ Shivam Kumar Sharma ⋄∗ Mythirayee S ‡ Tapabrata Chakraborti † Srijitesh Rajendran ‡ Raju S. Bapi ⋄ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23582.txt.

Introduction

Bose and six co-authors show that sleep staging models trained on healthy people fail on stroke patients. Sleep staging guides care for apnea and hypopnea, yet lab scoring is slow and costly. Deep models stage sleep well from EEG in healthy subjects. On ischemic stroke data, the same models falter badly. The team release iSLEEPS, a fresh annotated stroke dataset, and test a hybrid network. Heat maps show the model stares at useless EEG zones in patients. Sleep structure itself differs sharply between the two groups.

Catalog record

CREATORSaswata Bose ⋄∗ Suvadeep Maiti ♣⋄∗ Shivam Kumar Sharma ⋄∗ Mythirayee S ‡ Tapabrata Chakraborti † Srijitesh Rajendran ‡ Raju S. Bapi ⋄
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17184
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.23582

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AI generalisation gap in comorbid sleep disorder staging Saswata Bose ⋄∗ Suvadeep Maiti ♣⋄∗ Shivam Kumar Sharma ⋄∗ Mythirayee S ‡ Tapabrata Chakraborti † Srijitesh Rajendran ‡ Raju S. Bapi ⋄ Abstract Accurate sleep staging is essential for diagnosing OSA and hypopnea in stroke patients. Although PSG is reliable, it is costly, labor-intensive, and manually scored. While deep learning enables automated EEG-based sleep staging in healthy subjects, our analysis shows poor generalization to clinical populations with disrupted sleep. Using Grad-CAM interpretations, we systematically demonstrate this limitation. We introduce iSLEEPS, a newly clinically annotated ischemic stroke dataset (to be publicly released), and evaluate a SE-ResNet plus bidirectional LSTM model for single-channel EEG sleep staging. As expected, cross-domain performance between healthy and diseased subjects is poor. Attention visualizations, supported by clinical expert feedback, show the model focuses on physiologically uninformative EEG regions in patient data. Statistical and computational analyses further confirm significant sleep architecture differences between healthy and ischemic stroke cohorts, highlighting the need for subject-aware or disease-specific models with clinical validation before deployment. A summary of the paper and the code is available at https://himalayansaswatabose.github.io/iSLEEPS_Explainability.github.io/ † † address: ⋄ International Institute of Information Technology (IIIT-H), Hyderabad, India † Alan Turing Institute, London and University College London, United Kingdom ♣ Queen Square Institute of Neurology, University College London, United Kingdom ‡ National Institute of Mental Health and Neuroscience (NIMHANS), Bangalore, India 1 Introduction Sleep staging is critical for diagnosing and managing sleep disorders such as obstructive sleep apnea (OSA) and hypopnea, which disrupt sleep and degrade cognition and quality of life [ 8 ] . Polysomnography (PSG), the clinical gold standard, uses EEG, EOG, and EMG to classify Wake, REM, and non-REM (N1–N3) stages, but it is costly, time-consuming, and prone to interscorer variability, especially for lighter stages like N1. Deep learning approaches provide automated and consistent alternatives with strong EEG-based performance [ 4 , 10 ] , yet they are trained almost exclusively on healthy data, leaving their generalization to clinical populations with disrupted sleep architecture unclear. This issue is exacerbated by the scarcity of labeled pathological data [ 1 ] , highlighting the need for population-representative models and for understanding model behavior under pathology. Although sleep stage definitions should be health independent, degraded clinical performance suggests reliance on pathology-influenced or noisy features. Prior work has not modeled or interpreted sleep architecture in stroke patients with multiple comorbid sleep disorders, a group marked by severe neurological and electrophysiological abnormalities, including epilepsy, altered thalamocortical coupling, and asymmetric cortical activity, which make healthy-trained models unreliable and clinically misleading [ 6 ] . The lack of public pathology-specific EEG datasets and tailored models creates a critical gap between computational advances and clinical practice. We bridge this gap by presenting the first stroke-specific sleep staging framework, combining deep learning with medically interpretable analysis and a newly curated PSG dataset of stroke patients with comorbid sleep disorders, enabling pathology-aware and clinically deployable sleep assessment for neurologically impaired populations. The contributions of this paper are: 1. Introduced iSLEEPS (which is accessible at https://tinyurl.com/iSLEEPSv1 ), a new PSG dataset of 100 ischemic stroke patients with severe sleep disorders. 2. Developed a benchmarking deep learning model for iSLEEPS that achieves state-of-the-art performance and reveals the limited generalization of models trained on healthy cohorts. 3. Statistical and explainability analyses, validated by clinician feedback, showed deep models do not generalise between healthy and comorbid cohorts, underscoring the need for subject-aware or disease-specific sleep staging models. 2 Methodology 2.1 Model Architecture The model (Fig. 1 ) uses a sliding window of consecutive 30 s EEG epochs to capture temporal context and predicts the sleep stage of the central epoch. A SE-ResNet block extracts discriminative spectral–temporal features by enhancing relevant frequency–amplitude patterns while suppressing noise, while stacked Bi-LSTM layers model bidirectional temporal dependencies and long-range stage transitions. The encoded features are then passed through fully connected layers, with the final layer producing sleep stage class probabilities. Figure 1 : Deep Model Architecture, with the n th epoch being input to the model, having a window size of w and a stride length of s . 2.2 Explainability Methods We used GradCAM [ 9 ] for explainability. Gradient-weighted Class Activation Mapping (Grad-CAM) generates class-specific heatmaps from the gradients of a target class with respect to the final convolutional layer. In signal classification, it highlights time or frequency regions most influential to the model’s decisions, enabling assessment of whether the model attends to meaningful physiological features (e.g., sleep spindles or alpha rhythms), thereby improving interpretability, supporting debugging, and ensuring alignment with domain knowledge. 3 Experiments We evaluated performance using raw single-channel EEG (C4:M1) from SleepEDF-20 [ 3 ] , SleepEDF-78, SHHS [ 12 ] , and our iSLEEPS dataset. SleepEDF-20 includes 39 PSG recordings from 20 healthy adults aged 25–34 with R&K staging (W, N1, N2, N3 [N3+N4], REM), excluding Movement and UNKNOWN stages. SleepEDF-78 extends this to 78 participants. SHHS provides full-night PSG data from 6,441 subjects scored under AASM guidelines, with analysis restricted to 329 typical sleepers. iSLEEPS comprises 100 ischemic stroke patients (mean age 50.52; 23 females, 77 males) recruited at NIMHANS, Bangalore, India. It shows a high rate of sleep apnea (38% severe, 23% moderate) with detailed obstructive/central apnea annotations Deep learning models were trained separately per dataset using Adam optimizer(learning rate 0.001), negative log-likelihood loss, batch size 128, and evaluated via leave-one-out cross-validation (20, 10, 5, and 10 folds for SleepEDF-20, SleepEDF-78, SHHS, and iSLEEPS, respectively). The architecture processes raw EEG with a window size 9, stride 4, and three stacked LSTM layers, with the best healthy-subject model tested on iSLEEPS to simulate clinical deployment, followed by GradCAM analysis on five randomly selected patients to assess errors and alignment with clinically relevant EEG patterns. 4 Results and Discussion 4.1 Model Performance Datasets Model Overall Results ACC MF1 \kappa SleepEDF-20 (Healthy Cohort) NAS [ 4 ] 82.7 75.9 0.76 DeepSleepNet [ 10 ] 82.0 76.9 0.76 XSleepNet2 [ 7 ] 83.9 78.7 0.77 SleepContextNet [ 13 ] 84.8 79.8 0.79 SEResnet-Transformer [ 5 ] 79.3 74.7 0.72 Ours 87.5 82.5 0.82 SleepEDF-78 (Healthy Cohort) NAS [ 4 ] 80.0 72.7 0.72 XSleepNet2 [ 7 ] 80.3 76.4 0.73 SleepContextNet [ 13 ] 82.7 77.2 0.76 SEResnet-Transformer [ 5 ] 73.6 70.6 0.68 Ours 83.8 78.9 0.77 SHHS (Healthy Cohort) NAS [ 4 ] 81.9 75.3 0.74 SleepContextNet [ 13 ] 86.4 80.5 0.81 SEResnet-Transformer [ 5 ] 79.0 69.3 0.71 Ours 87.8 81.9 0.83 iSLEEPS (Patient Cohort) ResNet [ 2 ] 61.6 54.4 0.48 SEResnet-Transformer [ 5 ] 67.4 59.3 0.54 Ours 74.7 67.7 0.64 Table 1 : Results comparison with different models, trained and tested on SleepEDF-20, SleepEDF-78, SHHS and iSLEEPS dataset, respectively. Performance of our model is shown in bold. The performance has been measured using Accuracy (ACC), Macro F1 Score (MF1) and Kappa Score ( \kappa ), which shows that the model predictions align substantially with respect to random chance. We provide a comprehensive comparison with the current literature in Table 1 and an overview of the model’s sleep stage-wise performance across four different datasets in Table 2 . This validates the fact the proposed benchmarking model on iSLEEPS is at par and, in fact, better than the

Read the complete text