EMOD: A Unified EEG Emotion Representation Framework Leveraging V-A Guided Contrastive Learning
Yuning Chen, Sha Zhao, Shijian Li, Gang Pan · 2025
Read EMOD: A Unified EEG Emotion Representation Framework Leveraging V-A Guided Contrastive Learning by Yuning Chen, Sha Zhao, Shijian Li, Gang Pan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-05863.txt.
Introduction
Yuning Chen, Sha Zhao, Shijian Li, and Gang Pan unify how brain-wave data from many studies can teach one emotion-recognition model. EEG emotion data sets differ wildly in labels and formats, so models trained on one rarely transfer. The team maps every label scheme into one shared space of valence and arousal, the two axes that describe feeling pleasantness and intensity.
A soft-weighted contrastive loss then pulls emotionally similar samples together in that space. A flexible backbone reads time, frequency, and spatial features from varied EEG formats. Pretrained on eight public data sets, the model reached state-of-the-art scores on three benchmarks. The authors argue the shared emotion space is what lets knowledge move between studies.
Catalog record
| CREATOR | Yuning Chen, Sha Zhao, Shijian Li, Gang Pan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-05863
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
EMOD: A Unified EEG Emotion Representation Framework Leveraging V-A Guided Contrastive Learning Yuning Chen, Sha Zhao, Shijian Li, Gang Pan Abstract Emotion recognition from EEG signals is essential for affective computing and has been widely explored using deep learning. While recent deep learning approaches have achieved strong performance on single EEG emotion datasets, their generalization across datasets remains limited due to the heterogeneity in annotation schemes and data formats. Existing models typically require dataset-specific architectures tailored to input structure and lack semantic alignment across diverse emotion labels. To address these challenges, we propose EMOD: A Unified EEG Emotion Representation Framework Leveraging Valence-Arousal (V-A) Guided Contrastive Learning. EMOD learns transferable and emotion-aware representations from heterogeneous datasets by bridging both semantic and structural gaps. Specifically, we project discrete and continuous emotion labels into a unified V-A space and formulate a soft-weighted supervised contrastive loss that encourages emotionally similar samples to cluster in the latent space. To accommodate variable EEG formats, EMOD employs a flexible backbone comprising a Triple-Domain Encoder followed by a Spatial-Temporal Transformer, enabling robust extraction and integration of temporal, spectral, and spatial features. We pretrain EMOD on 8 public EEG datasets and evaluate its performance on three benchmark datasets. Experimental results show that EMOD achieves the state-of-the-art performance, demonstrating strong adaptability and generalization across diverse EEG-based emotion recognition scenarios. Code — https://github.com/cyn4396/EMOD Figure 1: Comparison between conventional EEG emotion recognition and our EMOD framework. Traditional methods rely on dataset-specific supervision and manually designed architectures, limiting generalization across datasets. In contrast, EMOD employs V-A guided pretraining on heterogeneous data, enabling robust and generalizable emotion-aware representations. Introduction Emotion is a fundamental component of human life, influencing cognition, behavior, and social interaction ( 15 ) . The ability to understand and recognize emotions is crucial for the development of affective computing—a field focuses on bridging the gap between human emotions and intelligent systems ( 34 ) . By enabling more natural and adaptive human-computer interactions, affective computing highlights the growing need for accurate, robust, and scalable emotion recognition methods ( 20 ) . Among various sensing modalities, electroencephalography (EEG) stands out as a promising tool for emotion recognition. Unlike behavioral signals—such as facial expressions, vocal tone, or body gestures—that are often influenced by cultural norms or conscious control, EEG offers a direct and objective measure of neural activity underlying emotional processes. Its high temporal resolution and capacity to capture fine-grained brain dynamics make EEG well-suited for decoding affective states with improved robustness and precision. Recently, numerous deep learning models have been proposed for EEG-based emotion recognition ( 28 ; 4 ; 39 ) . However, as illustrated in Figure 1 (a), these models are typically designed for specific datasets, making joint training and deployment across different datasets difficult. Their generalizability are limited in practical applications where there are usually new EEG sources appearing. A major obstacle to such generalization lies in the inherent heterogeneity of EEG datasets, which manifests in two fundamental aspects. First, label heterogeneity arises from differences in annotation schemes. Some datasets adopt discrete emotion labels (e.g., happy, sad, fear) often derived from video stimuli or expert rating, while others rely on continuous self-reported valence-arousal (V-A) scores. Even within the same paradigm, label definitions and value ranges often vary, resulting in semantic mismatches that hinder model transferability across datasets. Second, data format heterogeneity arises from variations in EEG acquisition protocols, such as different channel configurations and sampling rates. For instance, some datasets use 62-channel EEG at 200 Hz, while others employ 32-channel signals sampled at 128 HZ. These discrepancies force prior models to adopt dataset-specific architectures, limiting their scalability and preventing unified modeling across diverse EEG formats. To address these challenges, we propose EMOD, a pretraining framework designed to learn generalizable and emotion-aware EEG representations from heterogeneous datasets, as illustrated in Figure 1 (b). EMOD aims to bridge both the semantic and structural gaps across datasets, enabling unified, scalable, and transferable representation learning for EEG-based emotion recognition. To address label heterogeneity , we leverage the widely accepted Valence-Arousal (V-A) emotion model ( 23 ) to project all available emotion annotations—whether discrete or continuous—into a shared affective space . Based on this projection, we design a soft-weighted supervised contrastive loss that defines inter-sample similarity by V-A proximity, encouraging representations that reflect the continuous emotional semantics across datasets. To our best knowledge, there have been no studies considering the emotion label consistency for the EEG emotion recognition task, and we are the first aiming to address this limitation. To handle data format heterogeneity , we devise a flexible and unified architecture that supports varying channel configurations, sampling rates, and segment lengths. It combines a Triple-Domain Encoder and Spatial-Temporal Transformer to extract temporal, spectral and spatial features across diverse EEG formats. Together, EMOD tries to learn semantically meaningful and structurally adaptive EEG representations, facilitating more robust and generalizable emotion recognition across heterogeneous datasets. Our main contributions are summarized as follows: • We propose EMOD, a unified pretraining framework for EEG-based emotion recognition that leverages V-A guided contrastive learning to learn generalizable and emotion-aware representations from heterogeneous datasets. EMOD is pretrained on 8 public EEG datasets and evaluated on 3 widely-used EEG emotion benchmarks. Extensive experiments demonstrate that EMOD achieves state-of-the-art performance and strong generalization across diverse datasets. • For the first challenge, we devise a V-A guided contrastive learning strategy that unifies discrete and continuous emotion labels into a shared affective space, enabling semantic alignment and improving label compatibility across datasets. To our best knowledge, we are the first to address the inconsistency of EEG emotion labels across different datasets. • For the second challenge, we design a flexible backbone with a Triple-Domain Encoder and Spatial-Temporal Transformer to capture temporal, spectral, and spatial features across diverse EEG formats. Related Works EEG-Based Emotion Recognition Traditional EEG-based emotion recognition relies on handcrafted features and subsequent classification ( 22 ; 6 ; 1 ) , but struggles to capture the nonlinear and dynamic nature of EEG signals. Recent works address this by adopting end-to-end deep learning models that learn hierarchical features directly from raw data. A variety of architectures have been explored, including CNNs ( 18 ) , RNNs ( 31 ) , GNNs ( 42 ) , and Transformer ( 5 ) hybrids. Beyond architecture, contrastive learning improves transferability by enforcing semantic similarity ( 24 ; 16 ; 17 ) , while continual learning addresses EEG non-stationarity and enhances adaptability ( 43 ; 44 ) . Despite good performance, existing approaches face two limitations: (1) they are largely restricted to single-dataset training and lack generalizability across datasets with diverse formats and annotation schemes; (2) they rely on discrete emotion labels and assume uniform similarity within classes, overlooking the continuous and nuanced structure of human emotions. Figure 2: Overview of the EMOD framework. Representation Learning for EEG Recent advances in self-supervised learning have enabled large-scale EEG representation pretraining. Several foundation models have emerged, including Brant ( 38 ) with masked modeling for neural signals, LaBraM ( 10 ) with channel-wise spectrum prediction, CBraMod ( 32 ) using criss-cross attention, and EEGMamba ( 33 ) based on a Mamba state-space model. Although these models show strong transferability in general EEG tasks, they are usually optimized for low-level objectives