Geometry-Aware Deep Congruence Networks for Manifold Learning in Cross-Subject Motor Imagery

Sanjeev Manivannan, Chandrashekar Lakshminarayan · 2025

Read Geometry-Aware Deep Congruence Networks for Manifold Learning in Cross-Subject Motor Imagery by Sanjeev Manivannan, Chandrashekar Lakshminarayan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-18940.txt.

Introduction

Sanjeev Manivannan and Chandra Shekar Lakshminarayan decode imagined movement from brain signals across subjects who were not in the training set. In EEG brain computer interfaces, each person's signal pattern differs, which breaks decoders trained on others. A geometry route codes signals as covariance matrices on a curved manifold of positive definite forms.

Past manifold tools skip how each subject's spread and tilt on that manifold vary. Three models built on geometry aware congruence transforms attack that gap: a plain transform, a deep linear form, and a deep U-Net form. Each serves both as an alignment front end for a sorter and as a full end to end decoder trained by cross entropy. Cross subject motor imagery is the test.

Catalog record

CREATORSanjeev Manivannan, Chandrashekar Lakshminarayan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-18940

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Geometry-Aware Deep Congruence Networks for Manifold Learning in Cross-Subject Motor Imagery Sanjeev Manivannan, Chandrashekar Lakshminarayan Abstract Cross-subject motor-imagery decoding remains a major challenge in EEG-based brain–computer interfaces due to strong subject variability and the curved geometry of covariance matrices on the SPD manifold. We address the zero-shot cross subject setting where no target-subject labels or adaptation are allowed by introducing novel geometry-aware preprocessing modules and deep congruence networks that operate directly on the SPD covariance matrices. Our novel preprocessing modules, DCR and RiFU , extend Riemannian Alignment by improving action separation while reducing subject-specific distortions. We further propose two novel manifold classifiers, SPD-DCNet and RiFUNet , which use hierarchical congruence transforms to learn discriminative, subject-invariant covariance representations. On the BCI-IV 2a benchmark, our framework improves cross subject accuracy by 3–4 % \% over the strongest classical baselines, demonstrating the value of geometry-aware transformations. 1 Introduction Motor-imagery (MI) Electro-Encephalogram (EEG) decoding is central to brain–computer interfaces (BCIs), enabling communication and control for users with limited motor function. MI-BCIs support neurorehabilitation ( 1 ) , assistive robotics ( 17 ) , and hands-free interaction ( 7 ) . However, EEG signals often exhibit low signal-to-noise ratio (SNR), strong nonstationarity, and sensitivity to cognitive and physiological factors ( 16 ) , making the extraction of stable, discriminative representations ( 13 ) challenging. Recent work shows that covariance-based representations characterize EEG structure and provide a robust basis for motor-imagery decoding ( 6 ) . Cross-subject decoding in EEG tasks such as motor imagery and brain-seizure prediction ( 21 ) requires models trained on some users to generalize to unseen ones. This is difficult because subjects exhibit distinct covariance structure and spatial orientations, creating large dispersion on the SPD manifold and causing models to fail on new users. In the zero-shot Leave-One-Subject-Out (LOSO) setting, where the target subject is held out entirely, deep models often collapse due to reliance on subject-specific fine-tuning ( 13 ) . Riemannian Alignment (RA) ( 5 ) reduces mean shifts by whitening covariances to a reference, but orientation and dispersion mismatches remain—highlighting the need for learnable, geometry-aware alignment. Classical Riemannian methods such as Common Spatial Patterns with Linear Discriminant Analysis (CSP-LDA) ( 9 ) , Minimum-Distance-to-Mean (MDM) ( 3 ) , Tangent Space Logistic Regression (TSLR), and Tangent Space Analysis with LDA (TSA-LDA) ( 4 ) rely on fixed transformations and cannot enforce subject invariance. Deep models such as EEGNet ( 15 ) and convolutional architectures ( 20 ) operate in Euclidean space and require target-subject training, violating zero-shot constraints. Manifold approaches like SPDNet ( 11 ) and RA+TSLR ( 22 ) preserve SPD geometry but still depend on static alignment and fail to correct cross-subject orientation and dispersion mismatches. We address this gap with a unified framework that couples enhanced Riemannian preprocessing with deep manifold learning. We introduce two geometry-aware pre-aligners, DCR and RiFU, which extend RA by improving action structure and suppressing subject-specific distortions. We also propose two congruence-based classifiers, SPD-DCNet and RiFUNet, that learn hierarchical SPD transformations and yield subject-invariant representations. By operating directly on SPD covariances and correcting distortions beyond static alignment, our approach moves toward subject-independent, and calibration-free EEG decoding. 2 Dataset and Notation We use the BCI-IV 2a motor-imagery dataset ( 8 ) , which contains EEG from nine subjects recorded with 22 EEG and 3 EOG (Electro-Oculogram) channels. Each subject performs two sessions of 288 trials across four actions: left hand, right hand, both feet, and tongue. Trials last 7–8 s (2 s cue and 4 s motor-imagery period) and are sampled at 250 Hz, yielding approximately 2000–2400 s of data per session. Let X_{i,a,e}\in\mathbb{R}^{C\times T_{e}} denote the EEG epoch for subject i , action a , and trial e , where C=22 channels and T_{e} is the epoch duration (typically 3–4 s after cue onset). Each trial has an associated action label y_{i,e}\in\{0,1,2,3\} corresponding to the four motor-imagery classes. Covariance matrices are computed as C_{i,a,e}=\frac{1}{T_{e}-1}\,X_{i,a,e}X_{i,a,e}^{\top}, yielding an SPD matrix C_{i,a,e}\in\mathcal{S}_{++}^{C} that form the core for all preprocessing and classification methods in this work. 3 Preliminaries 3.1 SPD Manifold and Geometry Covariance matrices C_{i,a,e}\in\mathcal{S}_{++}^{C} lie on the Riemannian manifold of symmetric positive-definite (SPD) matrices. The affine-invariant Riemannian metric (AIRM) defines the geodesic distance d_{\mathrm{AIRM}}(C_{1},C_{2})=\big\|\log(C_{1}^{-1/2}C_{2}C_{1}^{-1/2})\big\|_{F}. The logarithm and exponential maps at C are \log_{C}(C_{2})=C^{1/2}\log(C^{-1/2}C_{2}C^{-1/2})C^{1/2}, \exp_{C}(V)=C^{1/2}\exp(C^{-1/2}VC^{-1/2})C^{1/2}, which enable processing of SPD matrices in tangent space. 3.2 Congruence Transforms on SPD Matrices A fundamental operation in our models is the congruence transform C^{\prime}_{i,a,e}=WC_{i,a,e}W^{\top}, for a full-rank matrix W\in\mathbb{R}^{d\times C} . This transformation has two key properties. Lemma 3.1 (SPD Preservation) . For any C\in\mathcal{S}_{++}^{C} and full-rank W , the matrix C^{\prime}=WCW^{\top} remains SPD. x^{\top}C^{\prime}x=x^{\top}WCW^{\top}x=(W^{\top}x)^{\top}C(W^{\top}x)>0\quad\forall\,x\neq 0. Lemma 3.2 (Affine Invariance) . Congruence transforms preserve the affine-invariant Riemannian metric: d_{\mathrm{AIRM}}(C_{1},C_{2})=d_{\mathrm{AIRM}}(WC_{1}W^{\top},\;WC_{2}W^{\top}). These properties show that congruence transforms are isometries on the SPD manifold: they preserve positive-definiteness and AIRM geometry while applying controlled rotations, scalings, or projections. Their geometric stability makes them ideal building blocks for our pre-aligners and deep congruence networks. 3.3 Classical Preprocessing Methods 3.3.1 Riemannian Alignment (RA) Given a reference covariance C_{\mathrm{ref}} , whitening seeks a matrix P satisfying PC_{\mathrm{ref}}P^{\top}=I . Under a congruence transform PCP^{\top} , the unique SPD solution is P=C_{\mathrm{ref}}^{-1/2} , mapping C_{\mathrm{ref}} to identity. This yields Riemannian Alignment (RA) ( 22 ) , which aligns all covariances as C^{\prime}_{i,a,e}=C_{\mathrm{ref}}^{-1/2}C_{i,a,e}C_{\mathrm{ref}}^{-1/2}. RA removes subject-specific mean shifts and establishes a shared geometric reference, but it does not correct orientation differences or inter-subject dispersion, motivating learned alignment methods. 3.3.2 Common Spatial Patterns (CSP) Common Spatial Patterns (CSP) extracts spatial filters that emphasize variance differences between two motor–imagery classes. Let C_{k} and C_{-k} ( \sum_{j\neq k}C_{j} ) denote the class-wise mean covariances; CSP seeks a filter w\in\mathbb{R}^{C} that maximizes the variance ratio w^{\star}=\arg\max_{w}\;\frac{w^{\top}C_{k}w}{w^{\top}C_{-k}w}\approx\arg\max_{w}\;\frac{w^{\top}C_{k}w}{w^{\top}C_{t}w}. often approximated using the total covariance C_{t}=C_{k}+C_{-k} . This Rayleigh quotient corresponds to the eigenproblem C_{k}w=\lambda\,C_{-k}w , producing filters with high variance for class k and suppressed variance for the opposite class. Although discriminative, CSP is highly sensitive to subject-specific covariance structure and degrades under cross-subject shifts in zero-shot MI-BCI. 3.3.3 LDA Projection LDA can also serve as a preprocessing step by projecting vectorized covariances (e.g., upper-triangular embeddings) onto directions that maximize class separability. Let v denote a projection vector. LDA optimizes the Fisher criterion J(v)=\frac{v^{\top}S_{B}v}{v^{\top}S_{W}v}, where S_{B}=\sum_{k}n_{k}(\mu_{k}-\mu)(\mu_{k}-\mu)^{\top} is the between-class scatter and S_{W}=\sum_{k}\sum_{i\in k}(x_{i}-\mu_{k})(x_{i}-\mu_{k})^{\top} is the within-class scatter. The optimal projection is obtained from the leading generalized eigenvector of S_{B}v=\lambda\,S_{W}v. LDA improves discriminability but remains linear and cannot capture nonlinear or geometric subject variability. 3.3.4 Riemannian Procrustes Analysis (RPA) Riemannian Procrustes Analysis (RPA) ( 22 ) aligns each subject’s covariance distribution to a common template through a sequence of geometric operations: recentering, dispersion scaling, and rotation. Given subject mean \mu_{s} and dispersion \Sigma_{s} , the steps are: • Recenter: C^{(1)}_{i,a,e}=\mu_{s}^{-1/2}\,C_{i,a,e}\,\mu_{s}^{-1/2}, • Scaling: C^{(2)}_{i,a,e}=\Sigma_{s}^{-1/2}\,C^{(1)}_{i,a,e}\,\Sigma_{s}^{-1/2}, • Rotate: C^{\prime}_{i,a,e}=R_{s}^{\top}\,C^{(2)}_{i,a,e}\,R_{s};\qquad R_{s}=U_{s}. where U_{s} contains eigenvectors of \Sigma_{s} . RPA reduces global subject-level variation but remains a static, non-learned transform and cannot fully correct class-dependent or fine-grained orientation mismatches. 3.4 Classical Classifiers 3.4.1 Tangent Space Logistic Regression (TSLR) After Riemannian Alignment, each covariance matrix is first transported to the tangent space at the identity by applying the matrix logarithm T_{i,a,e}=\log\!\big(C_{\mathrm{ref}}^{-\frac{1}{2}}C_{i,a,e}C_{\mathrm{ref}}^{-\frac{1}{2}}\big) . The symmetric matrix T_{i,a,e} is then vectorized using its upper-triangular entries and directly provided to a multinomial logistic

Read the complete text