Adapting Tensor Kernel Machines to Enable Efficient Transfer Learning for Seizure Detection

S. J. S. de Rooij, B. Hunyadi · 2025

Read Adapting Tensor Kernel Machines to Enable Efficient Transfer Learning for Seizure Detection by S. J. S. de Rooij, B. Hunyadi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-02626.txt.

Introduction

S. J. S. de Rooij and B. Hunyadi adapt seizure detection models so they can move between patients or datasets. Transfer learning reuses what a model learned on one task to do better on a related one. Their method uses a tensor kernel machine, a compact model suited to structured brain signal data.

The design borrows an idea from the adaptive support vector machine. Knowledge passes through regularization, which keeps the new model close to the old one where that helps. Efficient transfer matters in epilepsy care, where labeled data per patient is scarce and fast personalization can improve alarm accuracy. Small gains per case add up fast when a ward must screen many new cases each week of the year.

Catalog record

CREATORS. J. S. de Rooij, B. Hunyadi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-02626

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Adapting Tensor Kernel Machines to Enable Efficient Transfer Learning for Seizure Detection S. J. S. de Rooij, B. Hunyadi Abstract Transfer learning aims to optimize performance in a target task by learning from a related source problem. In this work, we propose an efficient transfer learning method using a tensor kernel machine. Our method takes inspiration from the adaptive SVM and hence transfers ‘knowledge’ from the source to the ‘adapted’ model via regularization. The main advantage of using tensor kernel machines is that they leverage low-rank tensor networks to learn a compact non-linear model in the primal domain. This allows for a more efficient adaptation without adding more parameters to the model. To demonstrate the effectiveness of our approach, we apply the adaptive tensor kernel machine (Adapt-TKM) to seizure detection on behind-the-ear EEG. By personalizing patient-independent models with a small amount of patient-specific data, the patient-adapted model (which utilizes the Adapt-TKM), achieves better performance compared to the patient-independent and fully patient-specific models. Notably, it is able to do so while requiring around 100 times fewer parameters than the adaptive SVM model, leading to a correspondingly faster inference speed. This makes the Adapt-TKM especially useful for resource-constrained wearable devices. I Introduction Inspired by how humans use prior information to learn to do new tasks, transfer learning aims to improve performance in a target task by leveraging information from a related, or source , problem [ 1 , 2 , 3 ] . This way, the performance of machine learning models can be improved for target tasks for which there is little to no ‘information’ (i.e. (supervised) data ) available. Such situations arise especially in healthcare applications, where both data collection and labelling, which needs to be done by medical experts, are costly [ 4 ] . For this reason, generalized (or patient-independent ) models are easier to implement, even though there is significant inter-subject variability with respect to disease processes [ 5 ] . Transfer learning can improve the performance of these generalized models through personalization , using only a small amount of patient-specific data to adapt the patient-independent model [ 6 , 7 ] . In this work, we focus especially on the problem of electroencephalogram (EEG)-based epileptic seizure detection. Epilepsy is a highly heterogeneous disease, where the seizure patterns observed on the EEG vary substantially between patients, depending on the subtype and origin of seizures in the brain [ 8 ] . Transfer learning (TL) has been applied previously to improve seizure detection and (the related) epilepsy detection [ 9 ] . Most of the work using TL for seizure and epilepsy detection considers the semi-supervised or transductive TL case. These models consider there to be no labels available for the target dataset and only use supervision for the source data. Thus, they typically aim to minimize the distance between the distribution of the source and target data. In this manner, in [ 10 ] , the large-margin-projected transductive SVM (LMPROJ) is used to improve epilepsy detection. The LMPROJ model minimizes the maximum mean discrepancy (MMD) between source and target data during training. Inspired by this work, the authors of [ 11 ] developed a semi-supervised learning algorithm using the TSK fuzzy system for model interpretability. Instead of minimizing the distance during the training step, the authors of [ 12 ] use transfer component analysis to learn a feature latent subspace where distances between patients are minimized. The classifier is then trained in this feature subspace. A concern for the implementability of these models may be that the data from the source patients needs to be available for training the TL model, which could raise privacy concerns. Therefore, in [ 13 ] , the authors develop a privacy-preserving seizure subtype classification model which uses source-free domain adaptation. This way, data from the source patients do not need to be saved. The downside of these transductive TL (or semi-supervised) models is that they are only able to minimize the distance between the marginal distributions of the data. However, there can also be conditional distribution differences in epileptic EEG signals, i.e. differences in the distributions conditioned on the labels [ 9 ] . Methods to account for these differences require labels in the target domain (i.e. inductive TL). In [ 14 ] , they implemented a max-pooling CNN (MPCNN) to perform end-to-end learning for seizure detection. They found that fine-tuning the patient-independent model with patient-specific data outperformed both the patient-independent (PI) and the patient-specific (PS) model. Their approach is similar to our previous work, where we used fine-tuning on tensor kernel machines to update a PI model with PS data [ 15 ] . However, in that case, the fine-tuned model did not outperform the PS model. Alternatively, in [ 7 ] the authors use the adaptive SVM model to personalize a heart-rate based seizure detection algorithm. This adaptive SVM model [ 16 ] uses the distance to the source model (in this case, the PI model) as a regularizer to train a new model for the target. This way, an adapted model is learned that inherits the support vectors from the source and adds new ones from the target data. The downside of this is that it increases the model size, which can be especially problematic if the PI model is already large (in the case of a large PI training set). Moreover, recently, there has been an increase in interest in the development of efficient machine learning models [ 17 ] . Both from a sustainability perspective, as well as for application in edge devices [ 18 ] such as wearables for health monitoring. To this end, low-rank tensor networks have been proposed as a valuable asset to enable this ‘Green AI’ [ 19 ] . These tensor networks allow for a parameter-efficient expression of the models’ parameters by using low-rank approximations. Therefore, in this paper, we propose an efficient transfer learning method using tensor kernel machines [ 20 , 21 ] based on the adaptive SVM model [ 16 ] . To show the effectiveness of the method, we apply it to the detection of epileptic seizures on behind-the-ear EEG [ 22 ] . Wearable behind-the-ear EEG devices are being developed to provide continuous, noninvasive monitoring for people with epilepsy [ 23 , 24 , 25 ] . They aim to improve quality of life by enabling better tracking of seizures and providing a warning of seizure onset [ 26 , 27 , 28 ] . The adaptability of our model makes it possible to improve detection performance via personalization, even when limited patient-specific data is available. Furthermore, the model’s efficiency makes it especially useful for these resource-constrained devices [ 26 ] . It may allow for on-device inference as well as adaptation, which could reduce (or even eliminate) the need for data broadcasting. The rest of this paper is structured as follows. First, in Section II background information is provided on kernel machines and tensor networks. Then, in the following section ( III ), we introduce the adaptive tensor kernel machine (Adapt-TKM). After which, we describe the seizure detection pipeline (Section IV ). Results for the Adapt-TKM are provided in Section V . These results are discussed

Read the complete text