MMOC: Self-Supervised EEG Emotion Recognition Framework with Multi-Model Online Collaboration Journal: Nuclear Physics B

Hanqi Wang, Yang Liu, Peng Ye, Liang Song · 2025

Read MMOC: Self-Supervised EEG Emotion Recognition Framework with Multi-Model Online Collaboration Journal: Nuclear Physics B by Hanqi Wang, Yang Liu, Peng Ye, Liang Song (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03977.txt.

Introduction

Reading feelings from brain waves could help people talk to machines, but hand-labelled training data are costly and can skew the lesson. Hanqi Wang and three co-authors build a self-taught method in 2025 that needs no labels at the start. Several models learn side by side and teach each other as new data stream in.

The snag is drift: brain waves vary so much from person to person that a model trained on some fails on others. Old fixes need data from the new person in training, which clinics may not have. The new frame adapts live, as fresh waves arrive, by letting its team of models pool their strengths. That live fit aims to hold accuracy when the system meets a brand-new user.

Catalog record

CREATORHanqi Wang, Yang Liu, Peng Ye, Liang Song
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-03977

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MMOC: Self-Supervised EEG Emotion Recognition Framework with Multi-Model Online Collaboration Journal: Nuclear Physics B Hanqi Wang, Yang Liu, Peng Ye, Liang Song Abstract Electroencephalography (EEG) emotion recognition plays a crucial role in human-computer interaction, particularly in healthcare and neuroscience. While supervised learning has been widely used, its reliance on manual annotations introduces high costs and potential bias. Self-supervised learning (SSL) offers a promising alternative by generating labels through pretext tasks. However, high inter-subject variability in EEG signals leads to significant data drift, limiting self-supervised models’ generalization across unseen subjects. Traditional domain adaptation (DA) methods require access to target-domain data during training—an impractical requirement in many real-world applications. Although domain generalization (DG) avoids this constraint, it often falls short in handling complex data drift due to limited coverage of possible target distributions. To tackle these challenges, we propose MMOC, a self-supervised framework with multi-model online collaboration (MMOC), to achieve online adaptation to unseen data. MMOC trains multiple base models using diverse strategies rooted in reconstruction and contrastive learning, enabling each model to develop distinct generalization capabilities. During inference, MMOC dynamically activates the most suitable model for each test sample via a loss-based routing mechanism that evaluates both contrastive and reconstruction losses. This dual consideration allows for a comprehensive measurement of data drift at both structural and semantic levels. Experimental results on the SEED and Dreamer datasets show that MMOC achieves state-of-the-art performance: 85.39% ± 5.41 on SEED, and 68.77% ± 6.13 / 69.37% ± 7.11 on Dreamer arousal and valence dimensions, respectively. MMOC effectively mitigates inter-subject data drift, offering a practical solution for real-world EEG emotion recognition. 1 Introduction Emotion recognition through brain-computer interfaces (BCIs) has become increasingly important in advancing human-computer interaction, particularly in domains such as medicine and neuroscience. Electroencephalography (EEG) is widely regarded as a favorable modality for emotion assessment due to its non-invasive nature, objectivity, and high temporal resolution [ 1 , 2 ] . The integration of deep learning techniques into EEG-based emotion recognition has led to substantial progress, transforming how emotional states are inferred from neural signals. Historically, most approaches have relied on supervised learning paradigms that require access to large-scale labeled datasets for training. However, acquiring such annotated data presents notable challenges, as manual labeling is labor-intensive and time-consuming [ 1 , 2 ] . Moreover, label accuracy often depends on subjective self-reports or expert interpretation, which can introduce inconsistencies and bias, ultimately affecting model reliability [ 2 ] . To address this limitation, recent studies have increasingly explored self-supervised learning strategies aimed at extracting robust and generalizable representations from unlabeled EEG data for downstream emotion recognition tasks [ 3 , 4 , 5 , 6 ] . These methods typically leverage pretext tasks that automatically generate supervisory signals, thereby reducing reliance on manually labeled annotations. Recent advancements have highlighted the promise of self-supervised learning in the context of EEG-based emotion recognition. Nevertheless, the high inter-subject variability introduces a significant challenge in the form of EEG data drift [ 1 , 2 ] . In the inference phase, models frequently struggle to generalize effectively to data from unseen subjects. This limitation severely constrains the practical applicability of self-supervised models in real-world applications. Current research primarily focuses on exploring domain generalization and domain adaptation techniques to address this inter-subject data drift problem. Domain adaptation (DA) techniques mitigate this problem through the alignment of the target domain with the source domain. However, models based on domain adaptation techniques cannot be directly applied to unseen data without a calibration process. This process usually requires access to the target domain, which is often unavailable in practical applications. This limitation hinders their practical application in real-world scenarios. Domain generalization (DG) techniques aim to capture the shared characteristics in the source domain, thereby achieving generalizability on the unseen target domain. Thus, DG methods eliminate the necessity for a calibration process and bypass the requirement for access to the target domain. However, the effectiveness of DG relies on the assumption that the source domain can cover part of the target domain’s distribution. When confronted with complex data drift, DG models based on source domains may fail to cover the target domain’s distribution. This results in a decline in model performance on unseen data. This observation motivates us to explore a novel self-supervised framework to address the issue of data drift. Even when capable of capturing shared characteristics across subjects, a single DG model remains insufficiently equipped to address the data drift issue when confronted with a complex target domain. Therefore, a more promising approach is to implement online collaboration among multiple models, each possessing differentiated generalization capabilities. During inference, when encountering previously unseen data, the framework activates the appropriate model based on intrinsic characteristics of the input sample. This method enhances the framework’s real-time coverage of potential target domains via online collaboration among multiple models, while simultaneously eliminating the need for a calibration process and access to target domain data. Figure 1 : The demonstration of the existing methods and the proposed one. Most existing state-of-the-art methods (as illustrated in the left panel) depend on a single model for inference, which inherently limits their ability to generalize across diverse data distributions. In contrast, our framework (right panel) leverages an ensemble of multiple models and employs a dynamic routing mechanism that selects the most appropriate model based on the characteristics of each input sample. This design significantly improves the model’s adaptability and coverage over varying test data distributions. In this work, we introduce a novel self-supervised framework for EEG-based emotion recognition with multi-model online collaboration (MMOC). The advancement of this framework lies in the collaboration of multiple models, rather than relying on a single model. By employing diverse training strategies, MMOC prepares multiple differentiated models as the candidate pool. When faced with new data in the inference phase, the framework utilizes a dynamic routing mechanism to activate the most suitable model within the candidate pool, adapting to the target domain’s data distribution. A primary challenge of this framework lies in defining a real-time unsupervised metric to guide the routing process. Existing studies have shown that the error of reconstruction models can reflect a model’s adaptability to new data [ 7 , 8 ] . However, reconstruction loss primarily focuses on the ability to restore data at the structural level while neglecting potential drifts at the semantic level. Relying solely on reconstruction loss may lead to situations where out-of-distribution (OOD) samples are also well reconstructed—particularly when these OOD samples exhibit structural similarities to the training data. To address this limitation, our base model incorporates both reconstruction and contrastive tasks. The contrastive loss is also employed to measure data drift at the complex semantic level. During the inference phase, the routing policy activates the appropriate model by jointly considering both the reconstruction loss and the contrastive loss. Through routing and the activation of the optimal model, our framework achieves online adaptation without requiring access to the target domain or calibration. The experiments were conducted on the SEED and Dreamer datasets. Our method achieved an accuracy of 85.39\%\pm 5.41 on the SEED dataset, and accuracies of 68.77\%\pm 6.13 and 69.37\%\pm 7.11 on the Arousal and Valence dimensions of the Dreamer dataset, respectively. The contributions of

Read the complete text