PedSleepMAE: Generative Model for Multimodal Pediatric Sleep Signals

1 st Saurav Raj Pandey, 2 nd Aaqib Saeed, 3 rd Harlin Lee · 2024

Read PedSleepMAE: Generative Model for Multimodal Pediatric Sleep Signals by 1 st Saurav Raj Pandey, 2 nd Aaqib Saeed, 3 rd Harlin Lee (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-00718.txt.

Description

Abstract Pediatric sleep is an important but often overlooked area in health informatics. We present PedSleepMAE, a generative model that fully leverages multimodal pediatric sleep signals including multichannel EEGs, respiratory signals, EOGs and EMG. This masked autoencoder-based model performs comparably to supervised learning models in sleep scoring and in the detection of apnea, hypopnea, EEG arousal and oxygen desaturation.

Catalog record

CREATOR1 st Saurav Raj Pandey, 2 nd Aaqib Saeed, 3 rd Harlin Lee
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-00718

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PedSleepMAE: Generative Model for Multimodal Pediatric Sleep Signals 1 st Saurav Raj Pandey, 2 nd Aaqib Saeed, 3 rd Harlin Lee Abstract Pediatric sleep is an important but often overlooked area in health informatics. We present PedSleepMAE, a generative model that fully leverages multimodal pediatric sleep signals including multichannel EEGs, respiratory signals, EOGs and EMG. This masked autoencoder-based model performs comparably to supervised learning models in sleep scoring and in the detection of apnea, hypopnea, EEG arousal and oxygen desaturation. Its embeddings are also shown to capture subtle differences in sleep signals coming from a rare genetic disorder. Furthermore, PedSleepMAE generates realistic signals that can be used for sleep segment retrieval, outlier detection, and missing channel imputation. This is the first general-purpose generative model trained on multiple types of pediatric sleep signals. I Introduction Sleep is vital to the health and well-being of infants, children, and adolescents. Sleep disorders and disturbances can affect childhood neurobehavioral development and cognitive functions and even cause morbidity in severe cases of obstructive sleep apnea (OSA) [ 1 ] . However, pediatric sleep has been often overlooked in health informatics, partially due to underreporting, underdiagnosis [ 1 ] and lack of public datasets. Most importantly, there is a common misconception that pediatric sleep is not distinct from adult sleep, when in fact children have unique physiology and therefore must be studied separately from adults, including for computational models. For example, [ 2 ] found that popular sleep stage classification models based on adult data struggle to generalize well on patients younger than 10 years old. The clinical gold standard for sleep medicine is currently based on polysomnography (PSG) or an overnight sleep study. Since sleep is a complex process that involves multiple organ systems, PSG data encompass many channels and modalities, such as electroencephalography (EEG), respiratory signals and sometimes videos. During PSG, a sleep technician monitors the signals and manually annotates events such as movement, coughing, breathing changes and sleep stages (e.g. REM). Compared to adult counterparts, software for automated detection of such sleep events is not as widespread (or verified and trusted) in pediatric sleep clinics, making this a labor-intensive process. Combined with the rich PSG data, this strongly motivates the use of machine learning in pediatric sleep research. In the past few years, deep learning-based generative models and self-supervised learning (SSL) have come to the forefront of machine learning. Unlike supervised learning, SSL trains the model to do auxiliary tasks on unlabeled data (e.g. predict whether an image is rotated). Once informative embeddings or features are learned, SSL only then uses labeled data for downstream classification or regression tasks of interest. This approach can fully leverage large unlabeled datasets and have been shown to generalize well to unseen data, beating supervised models in some cases [ 3 ] . Considering the cost of acquiring gold standard labels in medicine, SSL is a particularly promising approach in health informatics [ 4 ] . Fig. 1 : An overview of PedSleepMAE framework. This work presents PedSleepMAE ( Ped iatric Sleep M asked A uto e ncoder), a generative model for multichannel pediatric PSGs. To our best knowledge, PedSleepMAE (Fig. 1 ) is the first to satisfy all of the following characteristics: • Explicitly focuses on pediatric sleep and leverages large public data collected in real clinical setting. • Handles multiple types and channels of PSG signals, e.g. beyond EEGs [ 5 , 6 ] and can be flexible with missing channels. • Trains a transformer-based model via SSL such that the model can be used for multiple tasks, e.g. beyond sleep scoring [ 5 ] or apnea detection [ 7 ] . Our experiments are carefully designed to demonstrate interesting potential use cases of the PedSleepMAE framework: • Automated sleep event detection and sleep scoring. • Generate hypotheses for sleep biomarkers in conjunction with the electronic health record (EHR). • Generate or retrieve representative examples per patient. Detect and flag outliers for clinicians or researchers. • Impute missing channels. In the rest of the paper, we will describe the dataset and deep learning model in Sec. II , evaluate diagnostic quality of model embeddings in Sec. III , evaluate accuracy of generated signals in Sec. IV and conclude in Sec. V . II Methodology We describe the dataset and PedSleepMAE. PedSleepMAE is open source and the full code is available at https://github.com/sauravpandey123/PedSleepMAE . II-A Polysomnography (PSG) Data We utilize the Nationwide Children’s Hospital (NCH) Sleep DataBank [ 8 ] , which is a large, public, and fairly recent pediatric PSG dataset collected in a real clinical setting. Within this dataset, we analyzed 2,379 PSGs that had 16 of the most common channels [ 8 , Table 2] . This includes 7 channels of EEG (C3-M2, O1-M2, O2-M1, CZ-O1, C4-M1, F4-M1, F3-M2), \text{CO}{\vphantom{\text{X}}}_{\smash[t]{\text{2}}} level (CAPNO), \text{O}{\vphantom{\text{X}}}_{\smash[t]{\text{2}}} level (SpO2), breathing effort (RESP Thoracic, RESP Abdominal), snoring (SNORE), CPAP airflow (C-FLOW), electrooculogram (EOG; LOC-M2, ROC-M1) and electromyogram (EMG; CHIN1-CHIN2). These PSGs are also accompanied by patients’ electronic health records (EHR) and annotations such as sleep stages (Wake, Non-REM 1, Non-REM 2, Non-REM 3, REM), EEG arousal, apnea, and hypopnea for every 30 seconds of sleep. PSG is considered in units of 30 seconds, recorded (or downsampled) at 128Hz across 16 channels. We normalize all channels to 0 mean and 1 standard deviation for stable model training. II-B Multichannel Masked Autoencoder (MAE) Masked autoencoder (MAE) [ 9 ] is a state-of-the-art deep-learning-based generative model. It is based on the transformer neural network architecture [ 10 ] and has a encoder-decoder structure. During SSL, input data is divided into small patches and then randomly masked, and the MAE is trained to reconstruct the masked patches. This is similar to masked language modeling in natural language processing, e.g. BERT [ 11 ] . During this reconstruction process, the encoder learns informative non-linear features or embeddings, and the decoder learns how to generate data back from the embeddings. MAEs are distinct from traditional autoencoders, which focus on data compression, and are much easier to train than variational autoencoders (VAEs) or generative adversarial networks (GANs) since there are no regularization terms. Although MAE is originally proposed for images and videos, we easily adapted it to a multichannel signal setting for PSGs. Both encoder and decoder module consist of three layers of Vision Transformer [ 12 ] attention blocks with four attention heads. The attention mechanism allows the model to capture both intra- and inter-channel relationships in PSG. We used a masking ratio of 50% for SSL, and the dimension of the embeddings used in our experiments is 7,680. Appendix A describes the model and pretraining strategy in greater detail. (a) (b) (c) Fig. 2 : UMAP visualizations suggest that PedSleepMAE embeddings are clustered by sleep events. Each point represents 30 seconds of sleep, and each plot corresponds to one PSG. PSGs are selected as follows: (a) one PSG chosen randomly from all patients, (b) one PSG from the top 5 with the highest apnea occurrences, and (c) one PSG from those with 5 to 30 cases of hypopnea. This was to avoid cherry-picking but still ensure there are enough sleep events and show some breadth. See more visualizations in Appendix B . III

Read the complete text