SNR-aware Semantic Image Transmission with Deep Learning-based Channel Estimation in Fading Channels
Mahmoud M. Salim, Mohamed S. Abdalzaher, Ali H. Muqaibel, Hussein A. Elsayed, Inkyu Lee · 2025
Read SNR-aware Semantic Image Transmission with Deep Learning-based Channel Estimation in Fading Channels by Mahmoud M. Salim, Mohamed S. Abdalzaher, Ali H. Muqaibel, Hussein A. Elsayed, Inkyu Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20557.txt.
Introduction
Mahmoud Salim, Mohamed Abdalzaher, Ali Muqaibel, Hussein Elsayed, and Inkyu Lee published this paper in 2025. It improves semantic image transmission, a scheme where a sender ships an image's meaning rather than its pixels, and the receiver rebuilds a faithful picture. The setting is the fading channels of future 6G wireless, where signal strength swings wildly.
Their system, SwinSIT, uses a Swin transformer to extract and rebuild image content. A signal-quality-aware module reads the channel's noise level and boosts the semantic features twice, once before sending and once after arrival. A repurposed image-denoising network estimates and compensates the fading itself. Pruning and quantization then shrink the model for small internet-of-things devices. Simulations beat conventional benchmarks, and the compressed model kept its picture quality while shrinking greatly. The authors present the design as a practical semantic radio for unreliable airwaves.
Catalog record
| CREATOR | Mahmoud M. Salim, Mohamed S. Abdalzaher, Ali H. Muqaibel, Hussein A. Elsayed, Inkyu Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-20557
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SNR-aware Semantic Image Transmission with Deep Learning-based Channel Estimation in Fading Channels Mahmoud M. Salim, Mohamed S. Abdalzaher, Ali H. Muqaibel, Hussein A. Elsayed, Inkyu Lee Abstract Semantic communications (SCs) play a central role in shaping the future of the sixth generation (6G) wireless systems, which leverage rapid advances in deep learning (DL). In this regard, end-to-end optimized DL-based joint source-channel coding (JSCC) has been adopted to achieve SCs, particularly in image transmission. Utilizing vision transformers in the encoder/decoder design has enabled significant advancements in image semantic extraction, surpassing traditional convolutional neural networks (CNNs). In this paper, we propose a new JSCC paradigm for image transmission, namely Swin semantic image transmission (SwinSIT), based on the Swin transformer. The Swin transformer is employed to construct both the semantic encoder and decoder for efficient image semantic extraction and reconstruction. Inspired by the squeezing-and-excitation (SE) network, we introduce a signal-to-noise-ratio (SNR)-aware module that utilizes SNR feedback to adaptively perform a double-phase enhancement for the encoder-extracted semantic map and its noisy version at the decoder. Additionally, a CNN-based channel estimator and compensator (CEAC) module repurposes an image-denoising CNN to mitigate fading channel effects. To optimize deployment in resource-constrained IoT devices, a joint pruning and quantization scheme compresses the SwinSIT model. Simulations evaluate the SwinSIT performance against conventional benchmarks demonstrating its effectiveness. Moreover, the model’s compressed version substantially reduces its size while maintaining favorable PSNR performance. I Introduction Semantic communications (SC) is an innovative approach that attracts the attention of both the industry and academia to fulfill high requirements of the sixth generation (6G) networks [ 1 , 2 ] . Virtual reality, augmented reality, holographic projection, high-definition image and video, and other high-capacity multimodal services are among the applications of 6G. This comes with the need for intelligent, collaborative, and personalized communications [ 3 , 4 , 5 , 6 ] . Source coding and channel coding are the two main stages of conventional wireless communication systems [ 7 ] . For instance, most wireless image transmission relies on compression techniques such as JPEG for source coding, as well as turbo codes [ 8 ] or polar coding [ 9 ] for channel coding. Joint source-channel coding (JSCC) has recently become a key factor in allowing graceful performance adaptation even in the presence of channel changes [ 10 , 11 ] . Due to lower computational costs and shorter delays than separate source-channel coding, the latter is preferable in situations where computational effectiveness and real-time processing are crucial [ 12 , 13 ] . In the context of SC, JSCC makes use of intelligent deep learning (DL)-based architectures to extract significant semantics and transmit them through fading channels [ 14 , 15 ] . This makes tasks like reconstruction, classification, or segmentation easier to complete, with notable advantages in image transmission [ 16 , 1 ] . The combination of computer vision and DL has allowed substantial improvements in the design of semantic encoders and decoders in recent years. Convolutional neural networks (CNNs) excel at extracting image semantics, impacting semantic perception [ 17 ] , whereas autoencoders [ 18 ] play a crucial role in compressing and reconstructing semantic information due to their ability to capture compact representations [ 11 ] . Recent advances in semantic processing introduced attention-based vision transformers, such as the Swin transformer, which can handle high-resolution (HR) images with complex semantic content [ 19 , 20 ] . In the domain of semantic communication for image transmission, accurate channel estimation is crucial to ensuring communication reliability by preserving the semantic content of transmitted images [ 21 ] . Traditional estimation techniques, such as maximum likelihood (ML) and least squares, are widely used for their simplicity and computational efficiency. However, these methods often face limitations in practical scenarios, as they do not effectively account for noise in the channel estimation process [ 22 ] . To address these limitations, advanced methods like minimum mean square error (MMSE) and linear MMSE (LMMSE) are generally preferred because they incorporate noise statistics, enabling more accurate estimates in fading environments [ 23 ] . A common practical approach involves obtaining initial channel estimates using ML or least squares estimators, which are subsequently refined through advanced techniques like MMSE or LMMSE for improved accuracy [ 24 ] . Recently, DL has emerged as a promising tool for enhancing channel estimation by leveraging its ability to model complex relationships in noisy environments [ 25 , 24 , 26 ] . Specifically, DL-based image denoising models can take channel parameters derived from ML or least squares estimators as inputs, effectively replacing conventional refinement methods such as MMSE. This approach has demonstrated superior performance in terms of mean squared error (MSE), making it a compelling alternative for channel estimation in semantic communication systems [ 27 ] . IoT devices often face constraints such as limited memory, low computational power, and short battery life, which pose challenges for deploying complex DL models. To mitigate these limitations, much of the computational load can be offloaded to cloud or edge platforms, where DL models are trained on IoT data before deployment [ 28 ] . However, the large size of DL models can introduce high latency and increased power consumption, impacting their performance in resource-constrained environments. Pruning and quantization offer efficient solutions for creating lightweight models capable of addressing the resource limitations of IoT devices in SC [ 27 ] . Pruning reduces model complexity by removing unnecessary parameters, thereby conserving memory and processing capacity [ 29 ] . On the other hand, quantization decreases the precision of model weights, reducing memory requirements while maintaining acceptable performance levels [ 30 ] . I-A Related Work DL-based joint JSCC schemes have gained significant attention for wireless image transmission surpassing traditional image codecs and channel codes in both efficiency and performance [ 11 , 31 , 32 , 33 ] . Early works, such as [ 11 ] , introduced CNN-based JSCC models, demonstrating superior robustness under low signal-to-noise ratio (SNR) conditions. Advancements like attention-based JSCC [ 31 ] and adaptive bottleneck-guided compression [ 34 ] further improved transmission efficiency, while generative models such as InverseJSCC and GenerativeJSCC [ 35 ] leveraged pre-trained StyleGANs for enhanced perceptual quality. In multi-user and multi-device settings, collaborative JSCC [ 36 ] utilized channel-aware deep neural networks (DNNs) to enhance image retrieval in additive white Gaussian noise (AWGN) and Rayleigh fading conditions. ResNet-based task-oriented JSCC [ 32 ] was developed for multimodal data, while autoencoder-driven aerial image classification [ 37 ] and SNR-adaptive JSCC [ 38 ] demonstrated improved adaptability. Recently, transformer-based models like WITT [ 19 ] employed the Swin Transformer to optimize global dependencies in HR image transmission. DL has become a key enabler in communication systems that improves modulation and channel estimation [ 25 , 24 , 39 , 40 , 41 , 42 ] . In orthogonal frequency division multiplexing (OFDM) systems, DNNs have been used for channel estimation and data demodulation, improving performance under time-varying conditions [ 41 ] . In [ 42 ] , a lightweight transformer-based estimator was introduced, which combined CNNs with resource-efficient transformers to improve accuracy while reducing complexity. Furthermore, a CNN deactivating CNN for multiple-input multiple-output (MIMO) uplink