Geometry-Aware Contrastive Learning for Few-Shot Automatic Modulation Recognition
Guanqun Zhao, Yitong Liu, Jiaxuan Fang, Yufei Mao, Hongwen Yang · 2026
Read Geometry-Aware Contrastive Learning for Few-Shot Automatic Modulation Recognition by Guanqun Zhao, Yitong Liu, Jiaxuan Fang, Yufei Mao, Hongwen Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-26600.txt.
Introduction
Guanqun Zhao and four others build DyCo-CL, a learning scheme for naming radio signal types from very few examples. Plain self-taught methods suffer from flat distortions, wobbly spectra, and drifting meaning. DyCo-CL pairs hostile virtual distortions with a meaning-consistency loss, which steadies the learned space like a spectral guard. A windowed backbone and physics priors add further stability. On standard radio tests it gains 6.27 points in one-shot accuracy over prior methods.
Catalog record
| CREATOR | Guanqun Zhao, Yitong Liu, Jiaxuan Fang, Yufei Mao, Hongwen Yang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56391 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.26600
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Geometry-Aware Contrastive Learning for Few-Shot Automatic Modulation Recognition Guanqun Zhao, Yitong Liu, Jiaxuan Fang, Yufei Mao, Hongwen Yang Abstract Standard Self-Supervised Learning (SSL) for Automatic Modulation Recognition (AMR) struggles with ineffective isotropic augmentations, spectral instability, and semantic drift. To address these challenges, we propose Dynamic-Consistency Contrastive Learning (DyCo-CL), a geometry-aware framework that couples Virtual Adversarial Augmentation (VAA) with a semantic consistency loss. We provide a theoretical analysis indicating that this strategy acts as an implicit spectral regularizer for the encoder, enabling stable manifold exploration. Complementing this, our Signal-Adaptive Swin Backbone with fixed-window attention improves structural stability by constraining attention locality, while a Hybrid Knowledge Fusion module anchors representations with physical priors. Experiments on RML benchmarks show that DyCo-CL achieves a 6.27% accuracy gain in 1-shot settings over prior methods. 1 Introduction Automatic Modulation Recognition (AMR) serves as the cornerstone of cognitive radio, enabling dynamic spectrum access in emerging 6G networks. While Deep Learning (DL) has superseded traditional expert-based methods in terms of complexity and representational power ( 25 ; 23 ) , its efficacy remains contingent on massive labeled datasets, a luxury often unavailable in non-cooperative environments. To mitigate data scarcity, Self-Supervised Learning (SSL) has emerged as the dominant paradigm. Researchers have adapted contrastive frameworks to RF signals ( 7 ; 3 ) , typically relying on stochastic data augmentations to learn invariant representations. To further boost robustness, recent works have begun to integrate physical priors or employ lightweight attention mechanisms ( 12 ; 16 ; 8 ) . However, these methods operate on the flawed assumption that standard augmentations and generic attention remain robust in high-dimensional spaces. By analyzing the signal manifold, we identify three critical geometric limitations that hinder current frameworks: The Geometric Dilemma of Augmentation. High-dimensional concentration of measure ( 21 ) renders isotropic noise ineffective as perturbations tend to be orthogonal to decision boundary gradients. Meanwhile, unconstrained transformations often breach class margins, inducing semantic drift. Spectral Instability of Self-Attention. Self-attention exhibits unbounded Lipschitz constants ( 11 ) , resulting in sharp decision boundaries that are brittle to anisotropic perturbations. Existing hybrid architectures ( 12 ; 16 ) prioritize efficiency but neglect this instability, leaving models vulnerable to distortion. Inefficacy of Static Fusion. Prevalent methods rely on shallow concatenation ( 8 ) , treating physical priors as static auxiliary inputs ( 9 ) . This fails to leverage them as immutable semantic anchors, preventing the rectification of semantic drift during aggressive exploration, especially in 1-shot settings. To address these challenges, we propose DyCo-CL, a semi-supervised framework synergizing optimization, architecture, and physical priors. Our contributions are: • Dynamic-Consistency Framework: We propose a geometric optimization strategy that couples Virtual Adversarial Augmentation (VAA) with a semantic consistency constraint. This approach overcomes the concentration of measure where isotropic noise fails, and we theoretically characterize it as an implicit spectral regularizer to promote the geometric stability of the encoder. • Signal-Adaptive Swin Backbone: To complement the geometric regularization, we design a 1D Swin Transformer featuring a Deep Convolutional Stem and Fixed Window attention. This architecture addresses the spectral instability of standard Transformers, enabling the model to robustly capture transient signal primitives under adversarial perturbations. • Hierarchical Hybrid Knowledge Fusion: To prevent semantic drift in data-scarce regimes, we bridge the semantic gap via a physics-aware fusion module. By dynamically calibrating deep representations with expert physical priors , we ensure that the manifold exploration remains physically grounded, essential for extreme 1-shot recognition. 2 Related Work 2.1 Contrastive Learning for Modulation Recognition While early AMR methods relied on manual feature extraction ( 6 ; 10 ) or likelihood-based inference ( 22 ; 24 ) , these approaches struggle with modeling complexity. Consequently, DL has become the dominant paradigm. For instance, ( 25 ) proposed an LSTM-based method to effectively extract spatiotemporal features for modulation classification, while ( 23 ) utilized ResNet to improve recognition accuracy in wireless communication systems. To further enhance model robustness, ( 13 ) introduced fuzzy regularization into the classification framework. SSL has recently emerged to address data scarcity, with frameworks like MoCo ( 5 ) and SimCLR ( 4 ) adapted to RF signals ( 7 ; 3 ) . To further boost performance, recent studies have begun to explore advanced augmentation strategies. Notably, SSCL-AMC ( 2 ) introduces gradient-based adversarial augmentation to mine hard samples. However, these approaches operate primarily at the data level, lacking explicit spectral constraints to guarantee the geometric stability of the learned representation against perturbations. 2.2 Backbone Architectures: From CNNs to Transformers Convolutional Neural Networks (CNNs) have long been the de facto standard for robust AMR, with architectures explicitly designed to handle multipath fading and channel impairments ( 20 ) . Recently, Transformers have attracted attention for their sequence modeling capabilities ( 3 ; 16 ) . Despite their potential, standard Transformers are known to yield sharp decision boundaries due to the unbounded Lipschitz constant of the self-attention mechanism ( 11 ) , making them brittle to anisotropic noise. Although hybrid architectures ( 12 ; 16 ) improve efficiency, they typically lack structural mechanisms to explicitly bound the spectral norm, leaving the model vulnerable to adversarial stress. 2.3 Physics-Aware Knowledge Fusion Integrating expert knowledge is a proven strategy to enhance robustness. Existing methods typically employ a dual-stream approach ( 9 ; 14 ) , merging physical and deep features ( 15 ) via simple concatenation ( 1 ; 8 ) . While effective, these strategies treat physical priors as static auxiliary inputs ( 19 ) , failing to bridge the semantic gap required to dynamically calibrate deep features in extreme few-shot regimes. 3 Preliminaries We formulate the AMR signal model and analyze the geometric landscape, identifying three bottlenecks: concentration of measure, semantic drift, and spectral instability that motivate the geometry-aware design of DyCo-CL. 3.1 Signal Model We formulate AMR as a classification task for complex-valued radio signals. A received signal frame of length L is represented as a real-valued tensor \mathbf{x}\in\mathbb{R}^{2\times L} , consisting of In-Phase ( I ) and Quadrature ( Q ) components. The observed signal is modeled as: \mathbf{x}=h(\mathbf{s})+\mathbf{n}, (1) where \mathbf{s} is the clean modulated signal , h(\cdot) denotes channel impairments, and \mathbf{n} represents additive noise. Our objective is to learn a mapping f_{\theta}:\mathbb{R}^{2\times L}\to\mathcal{Y} that predicts the modulation label y\in\mathcal{Y} given the observation \mathbf{x} . 3.2 Problem Formulation: Concentration of Measure and Geometric Dilemma Let the signal space be \mathcal{X}\subset\mathbb{R}^{D} with D=2L . From a geometric perspective, the core challenge lies in learning an encoder f_{\theta} that maintains class separability while ensuring invariance to channel perturbations. Standard contrastive learning minimizes representation divergence over a distribution of transformations \mathcal{T} . We analyze the geometric limitations of this paradigm below. 3.2.1 The Orthogonality of Isotropic Noise Consider the set of isotropic augmentations \mathcal{T}_{iso} , typically implemented as additive white Gaussian noise: t(\mathbf{x})=\mathbf{x}+\mathbf{r} , where \mathbf{r}\sim\mathcal{N}(0,\sigma^{2}\mathbf{I}_{D}) . Let \mathbf{v}=\nabla_{\mathbf{x}}\mathcal{L}/\|\nabla_{\mathbf{x}}\mathcal{L}\| be the unit vector representing the sensitive direction . Here, \mathcal{L} denotes the self-supervised contrastive loss ( \mathcal{L}_{\text{NCE}} ), implying that \mathbf{v} is the direction that maximally disrupts the feature consistency between positive pairs. We decompose the perturbation \mathbf{r} into sensitive and tangent components: \mathbf{r}=z\mathbf{v}+\mathbf{r}_{\perp},\quad\text{where }z=\langle\mathbf{r},\mathbf{v}\rangle\sim\mathcal{N}(0,\sigma^{2}). (2) In high dimensions, the perturbation magnitude concentrates around its mean: \|\mathbf{r}\|\approx\sigma\sqrt{D} . Vanishing Sensitive Projection. Applying the Gaussian