DenoMAE: A Multimodal Autoencoder for Denoising Modulation Signals

1 st Atik Faysal, 2 nd Taha Boushine, 3 rd Mohammad Rostami, 4 th Reihaneh Gh. Roshan, 5 th Huaxia Wang, 6 th Nikhil Muralidhar, 7 th Avimanyu Sahoo, 8 th Yu-Dong Yao · 2025

Read DenoMAE: A Multimodal Autoencoder for Denoising Modulation Signals by 1 st Atik Faysal, 2 nd Taha Boushine, 3 rd Mohammad Rostami, 4 th Reihaneh Gh. Roshan, 5 th Huaxia Wang, 6 th Nikhil Muralidhar, 7 th Avimanyu Sahoo, 8 th Yu-Dong Yao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11538.txt.

Introduction

Atik Faysal and co-authors present, in a 2025 paper, a self-training system that cleans noise from radio modulation signals while learning from unlabeled data. Knowing a signal's modulation type matters for spectrum work, yet noise and scarce labels hamper classifiers. Their model hides parts of the input and learns to rebuild the clean signal and its constellation picture.

Noise itself is fed in as an extra input channel, so the model learns across modes. After this pre-training, a small labeled set fine-tunes it for classification. The system topped prior accuracy while using less data on both stages. It also held up at harsh noise levels it had never seen.

Catalog record

CREATOR1 st Atik Faysal, 2 nd Taha Boushine, 3 rd Mohammad Rostami, 4 th Reihaneh Gh. Roshan, 5 th Huaxia Wang, 6 th Nikhil Muralidhar, 7 th Avimanyu Sahoo, 8 th Yu-Dong Yao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-11538

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DenoMAE: A Multimodal Autoencoder for Denoising Modulation Signals Thanks: This work is funded by the U.S. Department of Energy, funding number DE-FE0032196. 1 st Atik Faysal, 2 nd Taha Boushine, 3 rd Mohammad Rostami, 4 th Reihaneh Gh. Roshan, 5 th Huaxia Wang, 6 th Nikhil Muralidhar, 7 th Avimanyu Sahoo, 8 th Yu-Dong Yao Abstract We propose Denoising Masked Autoencoder (DenoMAE), a novel multimodal autoencoder framework for denoising modulation signals during pretraining. DenoMAE extends the concept of masked autoencoders by incorporating multiple input modalities, including noise as an explicit modality, to enhance cross-modal learning and improve denoising performance. The network is pre-trained using unlabeled noisy modulation signals and constellation diagrams, effectively learning to reconstruct their equivalent noiseless signals and diagrams. DenoMAE achieves state-of-the-art accuracy in automatic modulation classification tasks with significantly fewer training samples, demonstrating a 10 × 10\times reduction in unlabeled pretraining data and a 3 × 3\times reduction in labeled fine-tuning data compared to existing approaches. Moreover, our model exhibits robust performance across varying signal-to-noise ratios (SNRs) and supports extrapolation on unseen lower SNRs. The results indicate that DenoMAE is an efficient, flexible, and data-efficient solution for denoising and classifying modulation signals in challenging, noise-intensive environments. Our codes are public at GitHubDenoMAE . Fig. 1: DenoMAE Pretraining Strategy : We apply a random 75% masking (not to scale in the illustration) across all input modalities. The remaining 25% of visible patches are processed by a shared encoder, while each modality utilizes a dedicated decoder to reconstruct its masked patches. Only the encoder is reused for fine-tuning the downstream tasks. I Introduction In recent years, the deep learning paradigm has shifted to address the high costs and scarcity of labeled data and the intensive data demands of supervised models. Self-supervised learning has emerged as an efficient solution, allowing models to leverage abundant raw data in pretraining. This approach drastically reduces the need for labeled data during fine-tuning while maintaining strong downstream performance [ 1 ] . Self-supervised methods have shown remarkable success across fields like natural language processing [ 2 ] and computer vision [ 3 , 4 ] , paving the way for new applications in fields with sparsely labeled data, including communications. In communication systems, particularly wireless networks, maintaining signal integrity is crucial, yet it’s often compromised by limited data availability and varying noise levels during transmission. Estimating modulation signals becomes especially challenging as noise levels fluctuate with changing SNRs [ 5 ] . This limitation becomes particularly problematic when models encounter previously unseen modulation types [ 6 ] . While existing models can often classify known modulation schemes, they struggle to generalize to new or noisy conditions, resulting in misclassification and necessitating extensive retraining [ 7 , 8 ] . This problem highlights an urgent need for robust, adaptive models that can generalize across diverse conditions with minimal reliance on labeled data. One approach to improving generalizability and robustness is through pretraining methods that not only capture robust representations but also denoise signals effectively, enhancing classification accuracy in downstream tasks and providing scalable solutions in dynamic communication environments. Masking-based methods have traditionally been effective for denoising and improving signal clarity, but they are often limited to single-modality approaches. Though effective, these methods are inherently constrained by the information within their specific modality, which restricts their potential to leverage cross-modal interactions for more robust learning [ 9 , 10 ] . Recent advances in multimodal learning address this limitation by integrating data from multiple modalities, enhancing model robustness and enabling more flexible zero-shot learning capabilities. In works like [ 11 , 12 ] , attention mechanisms and masked modeling pretraining across modalities have successfully reconstructed masked signals, proving beneficial in improving classification under complex conditions [ 13 , 14 ] . Building on recent advancements, we adapt these techniques and present DenoMAE, a multimodal autoencoder tailored for the unique challenges in communication systems. DenoMAE’s innovative approach involves treating noise as an additional modality, allowing the model to generate all other modalities from a single input modality. This unique framework helps the network gain a comprehensive understanding of noise across modalities, significantly enhancing its denoising capabilities. A random masking strategy, which hides 75% of the input modalities, is employed to challenge the model in reconstructing the missing patches, reducing computational complexity, and introducing beneficial uncertainty conducive to effective learning. Our contributions to DenoMAE are threefold: • We propose a novel multimodal paradigm that incorporates noise as an additional modality, enabling more effective pretraining on modulation signals and enhancing model resilience to noise. • We demonstrate that our pre-trained model achieves significant improvements in classification accuracy under low SNR conditions, with accuracy gains of up to 22.1% over non-pre-trained models. • Our approach outperforms traditional methods, achieving superior results while requiring only one-tenth of the unlabeled data for pretraining and one-third of the labeled data for fine-tuning, underscoring its efficiency and scalability for real-world applications. II Related Work Modulation Classification Recent advancements in deep learning have transformed Automatic Modulation Classification (AMC) by enabling advanced analysis of constellation and other image diagrams. Much of the research emphasizes CNN-based architectures designed to classify modulation types while effectively handling uncertainties introduced by varying channel conditions [ 15 , 16 , 17 , 18 ] . Attention-based models like LSTMs and GRUs have been used widely for processing modulation signals as time-series data [ 19 , 20 , 21 , 22 ] . More recently, transformer-based architectures have been adopted to leverage self-attention for improved classification accuracy [ 23 , 24 , 25 ] . Despite these advancements, these architectures often lack robustness across diverse noise scenarios, limiting their generalization beyond specific tasks. Multisensory Masked Modeling Masking large portions of the input and training the model to reconstruct or predict missing elements has become a popular self-supervised approach, especially within autoencoder-based methods. For example, BERT [ 26 ] introduced masked language modeling by masking words in sentences and training the model to predict them, a concept adapted for vision with Masked Autoencoders (MAE), where image patches are masked to encourage the model to learn robust visual representations [ 27 ] . In multimodal contexts, masked modeling extends to tasks combining text, vision, and audio, promoting cross-modal understanding. For instance, Vision-Language Pretraining (VLP) models [ 28 , 29 , 30 ] utilize masked language and vision modeling to jointly learn from masked image regions and text tokens. Additionally, image modality-centered models like MultiMAE [ 11 ] , 4M [ 31 ] , and 4M21 [ 12 ] have demonstrated strong performance by pretraining on multiple image modalities and enhancing inference capabilities across diverse inputs. These multimodal masking methods have demonstrated significant gains in self-supervised learning, advancing model performance in tasks that benefit from multimodal reasoning. III Methodology In this work, we propose DenoMAE, an innovative pretraining method for modulation classification that leverages recent advancements in multisensory pretraining. By incorporating noise as an additional modality during pretraining, DenoMAE significantly reduces data requirements while enhancing performance in downstream classification tasks. Fig. 2: Denoised outputs of DenoMAE on unlabeled constellation diagrams at different SNRs during pretraining. III-A DenoMAE Framework DenoMAE consists of four primary components: input embedding, encoder, shared latent space, and decoder. Figure 1 illustrates

Read the complete text