Self-Supervised Distillation of Legacy Rule-Based Methods for Enhanced EEG-Based Decision-Making

Yipeng Zhang, Yuanyi Ding, Chenda Duan, Atsuro Daida, Hiroki Nariai, Vwani Roychowdhury · 2025

Read Self-Supervised Distillation of Legacy Rule-Based Methods for Enhanced EEG-Based Decision-Making by Yipeng Zhang, Yuanyi Ding, Chenda Duan, Atsuro Daida, Hiroki Nariai, Vwani Roychowdhury (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-14542.txt.

Introduction

Yipeng Zhang and co-authors refine brain wave spike detection for epilepsy care without hand labels, in a 2025 paper. Brief fast oscillations in brain recordings mark the zone where seizures start, a key target for treatment. Rule based detectors catch the real events but also raise many false alarms that experts must sort by hand.

Labels are scarce, and experts often disagree on what counts as a harmful event. Their framework first learns the shapes of candidate events with an encoder trained on the events alone. Clustering those shapes yields weak labels for the harmful kind. A classifier then sharpens the boundary between real and false events. The legacy detector's recall is kept, while expert review load should fall.

Catalog record

CREATORYipeng Zhang, Yuanyi Ding, Chenda Duan, Atsuro Daida, Hiroki Nariai, Vwani Roychowdhury
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-14542

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Self-Supervised Distillation of Legacy Rule-Based Methods for Enhanced EEG-Based Decision-Making Yipeng Zhang, Yuanyi Ding, Chenda Duan, Atsuro Daida, Hiroki Nariai, Vwani Roychowdhury Abstract High-frequency oscillations (HFOs) in intracranial Electroencephalography (iEEG) are critical biomarkers for localizing the epileptogenic zone in epilepsy treatment. However, traditional rule-based detectors for HFOs suffer from unsatisfactory precision, producing false positives that require time-consuming manual review. Supervised machine learning approaches have been used to classify the detection results, yet they typically depend on labeled datasets, which are difficult to acquire due to the need for specialized expertise. Moreover, accurate labeling of HFOs is challenging due to low inter-rater reliability and inconsistent annotation practices across institutions. The lack of a clear consensus on what constitutes a pathological HFO further challenges supervised refinement approaches. To address this, we leverage the insight that legacy detectors reliably capture clinically relevant signals despite their relatively high false positive rates. We thus propose the Self-Supervised to Label Discovery (SS2LD) framework to refine the large set of candidate events generated by legacy detectors into a precise set of pathological HFOs. SS2LD employs a variational autoencoder (VAE) for morphological pre-training to learn meaningful latent representation of the detected events. These representations are clustered to derive weak supervision for pathological events. A classifier then uses this supervision to refine detection boundaries, trained on real and VAE-augmented data. Evaluated on large multi-institutional interictal iEEG datasets, SS2LD outperforms state-of-the-art methods. SS2LD offers a scalable, label-efficient, and clinically effective strategy to identify pathological HFOs using legacy detectors. 1 Introduction Human-defined biomarkers encapsulate the expertise of medical professionals and play a pivotal role in medical diagnosis. In EEG-based clinical practice, neurophysiological biomarkers such as spikes, spindles, and high-frequency oscillations (HFOs) are commonly used. To detect these biomarkers computationally, numerous statistical methods have been developed, including the IDE spike detector [ 15 ] , the YASA spindle detector [ 16 ] , and HFO detection such as STE [ 13 ] or MNI [ 20 ] . However, these rule-based approaches often suffer from low precision, generating false positives [ 25 ] . Clinicians must manually review a large volume of detections, which is both time-consuming and prone to human error. Machine learning approaches, especially supervised methods, have been employed to refine detection results [ 4 , 8 , 22 ] or to classify EEG segments produced by threshold-based “pseudo-detectors” [ 18 ] . While these methods can show good performance on their defined test set, they are typically derived from relatively small cohorts and heavily depend on accurately labeled training data, limiting their scalability and generalizability. Annotating such events requires specialized medical knowledge, and clinical studies have shown low inter-rater reliability for these biomarkers [ 10 , 12 , 11 ] ; standardization of annotation practices across institutions is also lacking [ 5 , 7 ] . Weakly supervised methods [ 23 , 9 ] reduce annotation demands, but require complex loss tuning, preventing clinical use. Nonetheless, earlier studies have predominantly overlooked a critical insight: rule-based biomarker detectors, developed over many years of clinical research, have already been successfully deployed in clinical practice—even after manual inspection and refinement. These detectors typically maintain a very high recall rate [ 19 , 17 , 1 ] . In other words, although the detected events may include many false positives, these legacy detectors reliably capture a large share of signals of clinical interest. Furthermore, since the verification of these detected events is often performed through visual inspection of EEG tracing, the definition of clinically meaningful characterization is reflected in the EEG morphology. This insight suggests that clinically relevant biomarkers can be distilled from the output of the rule-based detectors in a self-supervised manner—particularly in scenarios where expert annotations are limited in large datasets or the precise definition of clinically meaningful events remains elusive. Motivated by this insight, we leverage legacy detectors to identify clinically meaningful events (pathological) without requiring human labeling. Specifically, we focus on high-frequency oscillations (HFOs), a crucial intracranial EEG (iEEG) biomarker used to localize the epileptogenic zone from interictal (in-between seizures) recordings in epilepsy treatment [ 3 ] . Importantly, a clear consensus on the definition of pathological HFO is not yet established [ 24 ] . To address this challenge, we propose a Self-Supervised to Label Discovery (SS2LD) framework that automatically distills pathological HFOs from the large volume of events detected by legacy HFO detectors. Specifically, we first perform morphological pre-training using a variational autoencoder (VAE) to learn morphological representations of detector-identified events. Leveraging the model’s ability to encode distinct morphological features, we then use the VAE’s latent representations to cluster these events, extracting weak supervision corresponding to pathological events. Finally, we train a classifier on the pre-trained VAE for both feature extraction and data augmentation. This classifier takes latent codes from the VAE encoder and is trained using both real and VAE-augmented data derived from the discovered weak supervision, thus refining classification boundaries. SS2LD distills the events generated by legacy detectors and improves clinical decision-making. Our contributions are summarized as follows: • We propose the SS2LD framework that uses VAE-based morphological pre-training to automatically discover pathological HFO events without human labels and exploits these discoveries as weak supervision for classification. • We employ the VAE’s generative capability to augment training data, enhancing the classifier’s robustness in distilling pathological HFOs. • SS2LD is evaluated on large multi-institutional iEEG datasets, demonstrating superior clinical performance compared to existing state-of-the-art methods and underscoring its potential on improving clinical decision-making. 2 Methods 2.1 High-Frequency Oscillations in Intracranial EEG Recordings For each subject k in an iEEG cohort, the recording \mathcal{X}^{k} comprises multiple channels, indexed by c , selected clinically to target probable epileptogenic regions. An HFO event e_{i} in channel c of \mathcal{X}^{k} is defined by its start time s_{i} and end time e_{i} , such that e_{i}=\mathcal{X}^{k}_{c}[s_{i}:e_{i}] . These segments may reflect pathological (epileptogenic) or non-pathological (normal) activity. Since HFO durations e_{i}-s_{i} vary, we construct a fixed-length window w_{i}=\mathcal{X}^{k}_{c}\bigl[\frac{s_{i}+e_{i}}{2}-L:\frac{s_{i}+e_{i}}{2}+L\bigr] , centered at the event’s midpoint, to ensure consistent input sizes for neural networks. Figure 1: Overview of the Proposed SS2LD Framework. (a) HFO events are detected in interictal (in-between seizures) intracranial EEG recordings using rule-based detectors, including pathological, physiological, and background noise events. (b) A VAE is pre-trained to reconstruct HFO morphological features, derived via Morlet Transform, with the encoder mapping inputs to latent distributions and the decoder reconstructing sampled latent codes. (c) Latent representations are projected by PCA, with a color-coded 2D plot representing clustered event types. (d) Hierarchical clustering identifies distinct morphological groups, enabling weak supervision for classifying pathological events. (e) A classifier is trained on both original latent codes ( \mu ) and VAE-generated samples ( \hat{\mu} ) to further refine the decision boundary. 2.2 Self-supvervised Pre-Training Variational Autoencoder: We train a VAE to capture HFOs’ morphological features. The VAE includes a Time-Frequency Morphological Encoder \mathcal{E}_{\theta} and a Morphological Decoder \mathcal{D}_{\gamma} . The encoder \mathcal{E}_{\theta} transforms an HFO event e_{i} , represented as a fixed-length signal w_{i} , into a time-frequency representation \mathcal{W}_{i}=\text{MorletTransform}(w_{i}) , then projects it into a lower-dimensional latent space, yielding a distribution parameterized by \mu_{\theta}(w_{i}) and \Sigma_{\theta}(w_{i}) . A latent code \mathbf{z}_{i}\sim\mathcal{N}\bigl(\mu_{\theta}(w_{i}),\Sigma_{\theta}(w_{i})\bigr) is sampled, and the decoder \mathcal{D}_{\gamma} reconstructs \hat{\mathcal{W}}_{i}=\mathcal{D}_{\gamma}(\mathbf{z}_{i}) , reconstructing the HFO’s morphological feature.

Read the complete text