Towards Practical Emotion Recognition: An Unsupervised Source-Free Approach for EEG Domain Adaptation

Md Niaz Imtiaz, Naimul Khan · 2025

Read Towards Practical Emotion Recognition: An Unsupervised Source-Free Approach for EEG Domain Adaptation by Md Niaz Imtiaz, Naimul Khan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03707.txt.

Introduction

Md Niaz Imtiaz and Naimul Khan adapt emotion recognition across brain signal data sets in a 2025 paper. Electroencephalogram models falter when people or recording setups change, and labeled data are costly. Standard adaptation needs the source data, which privacy and compute limits often forbid.

Their source free method adapts with no source access. One part curbs disagreement on confident samples and steers predictions toward expected labels. Another enforces agreement among reliable neighbors, damping noisy pseudo labels. Trained on one benchmark and tested on others, accuracy beat prior methods by wide margins, reaching the mid sixties on two sets. Both pleasant and unpleasant emotions were caught well, suiting real deployments.

Catalog record

CREATORMd Niaz Imtiaz, Naimul Khan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-03707

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Practical Emotion Recognition: An Unsupervised Source-Free Approach for EEG Domain Adaptation Md Niaz Imtiaz, Naimul Khan Abstract Emotion recognition is crucial for advancing mental health, healthcare, and technologies like brain-computer interfaces (BCIs). However, EEG-based emotion recognition models face challenges in cross-domain applications due to the high cost of labeled data and variations in EEG signals from individual differences and recording conditions. Unsupervised domain adaptation methods typically require access to source domain data, which may not always be feasible in real-world scenarios due to privacy and computational constraints. Source-free unsupervised domain adaptation (SF-UDA) has recently emerged as a solution, enabling target domain adaptation without source data, but its application in emotion recognition remains unexplored. We propose a novel SF-UDA approach for EEG-based emotion classification across domains, introducing a multi-stage framework that enhances model adaptability without requiring source data. Our approach incorporates Dual-Loss Adaptive Regularization (DLAR) to minimize prediction discrepancies on confident samples and align predictions with expected pseudo-labels. Additionally, we introduce Localized Consistency Learning (LCL), which enforces local consistency by promoting similar predictions from reliable neighbors. These techniques together address domain shift and reduce the impact of noisy pseudo-labels, a key challenge in traditional SF-UDA models. Experiments on three widely used datasets, DEAP, SEED, and DREAMER, demonstrate the effectiveness of our method. Our approach significantly outperforms state-of-the-art methods, achieving 65.84% and 58.87% accuracy on SEED and DREAMER, respectively, when trained on DEAP, and 58.99% and 67.08% accuracy on DEAP and DREAMER, respectively, when trained on SEED. It excels at detecting both positive and negative emotions, making it well-suited for practical emotion recognition applications. Code available at https://github.com/RyersonMultimediaLab/EmotionRecognitionSF-UDA 1 Introduction Emotion, a fundamental mental phenomenon, is deeply connected to human cognition and behavior, shaping daily life experiences. Recognizing emotions is a critical focus in psychology, medicine, and engineering. In psychology, it provides a quantitative foundation for understanding emotion-related behaviors. In medicine, it aids in the diagnosis and treatment of conditions such as autism spectrum disorder (ASD) and depression and helps track patient recovery [ 1 , 2 ] . In engineering, emotion recognition advances affective brain-computer interfaces (aBCIs), enabling better integration of emotional states into technology. Physiological signals, such as electroencephalogram (EEG), offer a more objective approach to emotion recognition than non-physiological signals like facial expressions, gestures, and voice, which can be influenced by environmental or social factors [ 3 ] . EEG measures brain activity through electrical signals, providing high reliability and precision, while also being portable and cost-effective. Advancements in deep learning have greatly improved EEG decoding performance through various neural network models [ 4 , 5 , 6 ] . However, these models generally perform well on test data with a distribution similar to the training data, but their performance significantly declines when applied to a new domain with a different data distribution, a phenomenon known as domain shift. The considerable variations in EEG signals across individuals challenge the effectiveness of cross-domain emotion recognition models. Additionally, deep neural networks typically require a vast quantity of labeled data for training. Collecting and annotating EEG signals is often a labor-intensive and costly process. Unsupervised domain adaptation (UDA) is gaining attention to address these challenges, aiming to enhance model performance on the target domain by utilizing information from the source domain. Recent research on domain adaptation for classifying EEG emotions has largely focused on cross-subject and cross-session scenarios within the same dataset [ 7 , 8 , 9 , 10 , 11 ] . However, less attention has been given to the cross-dataset scenario, which presents even greater challenges due to variations in EEG signals not only from individual differences but also from differences in EEG recording settings and stimuli. Another limitation of traditional unsupervised domain adaptation methods is that they require access to the source domain data while adapting to the target domain. However, in many real-world applications, accessing the source data of a trained source model is not feasible. For example, when deploying domain adaptation algorithms on mobile devices with constrained computational resources, keeping source domain data on the device is impractical. Additionally, to preserve the privacy of source subjects, their data may be inaccessible during domain adaptation. This is particularly true for healthcare applications, where data sharing is complicated due to ethical concerns. With the lack of source samples, traditional distribution matching techniques become infeasible. Source-free unsupervised domain adaptation (SF-UDA) focuses on transferring knowledge from a source domain to a target domain without requiring access to the source dataset, thus inherently protecting individual privacy [ 12 ] . Unlike UDA, where labeled source domain data, the trained model, and unlabeled target data are available, SF-UDA relies solely on the trained model and unlabeled target data, with no access to source domain data (Fig. 1 ). SF-UDA faces several challenges. Biases in the source data during pre-training can cause the model to focus on domain-specific features rather than learning fundamental patterns. Additionally, without access to source data, target adaptation often suffers due to the generation of noisy pseudo-labels for the target data. To address the challenges outlined above, we propose a novel source-free unsupervised domain adaptation (SF-UDA) method for EEG-based emotion classification. SF-UDA has primarily been applied to image classification tasks [ 14 , 13 , 15 , 16 , 17 , 18 ] , with only a few studies exploring its use for EEG signal classification, such as seizure and sleep stage classification [ 20 , 19 , 21 ] . To the best of our knowledge, this is the first application of SF-UDA to EEG-based emotion recognition. Our method comprises four stages: pre-training, computation, target adaptation, and inference. The pre-training and inference stages, as well as the network architecture, a feature extractor followed by two parallel classifiers, are adopted from our previous work [ 22 ] . During the pre-training stage, the model is trained on labeled source samples to learn essential features for emotion recognition. Once pre-training is complete, the source domain data is no longer accessible for the subsequent stages. The computation stage calculates cluster centroids and classifier discrepancies using the pre-trained model’s predictions on the target domain data. These calculations lay the foundation for target adaptation. The target adaptation stage involves two training steps using unlabeled target data. In the first step, Dual-Loss Adaptive Regularization (DLAR) , the model is trained to minimize classifier discrepancies on confident samples while aligning its predictions with the calculated pseudo-labels. This ensures the model produces consistent and reliable predictions. The second step, Localized Consistency Learning (LCL) , enforces local consistency by encouraging reliable neighbors to produce similar predictions. To mitigate the influence of unreliable neighbors, we introduce a mechanism for identifying reliable neighbors based on both feature values and softmax probabilities. In the inference stage, we apply our recently proposed Prediction Confidence-aware Test-Time Augmentation (PC-TTA) [ 22 ] , which selectively augments test samples based on predictive confidence, improving model prediction performance while minimizing computational costs. Our proposed method is evaluated on three widely used emotion recognition datasets: DEAP [ 23 ] , SEED [ 24 ] , and DREAMER [ 25 ] . To assess its performance in cross-dataset settings, where distribution discrepancies are more pronounced due to differences in subject demographics and recording conditions, we conduct

Read the complete text