Enabling Training-Free Semantic Communication Systems with Generative Diffusion Models
Shunpu Tang 2 , Yuanyuan Jia 2 5 , Qianqian Yang 2 , Ruichen Zhang 4 , Jihong Park 3 , Dusit Niyato 4 · 2025
Read Enabling Training-Free Semantic Communication Systems with Generative Diffusion Models by Shunpu Tang 2 , Yuanyuan Jia 2 5 , Qianqian Yang 2 , Ruichen Zhang 4 , Jihong Park 3 , Dusit Niyato 4 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01209.txt.
Introduction
Shunpu Tang, Yuanyuan Jia, Qianqian Yang, and a team of co-authors design a wireless system that sends meaning rather than raw data, without any training phase. Sending only the gist of a message saves bandwidth, but most such systems must first train on huge datasets for one set of channel conditions.
Their design borrows the machinery of image-generating diffusion models, which need no task-specific training here. Sending and receiving share the two halves of a controlled noising process, so the receiver can rebuild the intended content from what survives the channel. They also tune the number of cleanup steps to offset the extra noise a real channel adds. Tests on a standard photo set beat the existing training-free rivals.
Catalog record
| CREATOR | Shunpu Tang 2 , Yuanyuan Jia 2 5 , Qianqian Yang 2 , Ruichen Zhang 4 , Jihong Park 3 , Dusit Niyato 4 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-01209
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enabling Training-Free Semantic Communication Systems with Generative Diffusion Models Shunpu Tang 2 , Yuanyuan Jia 2 5 , Qianqian Yang 2 , Ruichen Zhang 4 , Jihong Park 3 , Dusit Niyato 4 Abstract Semantic communication (SemCom) has recently emerged as a promising paradigm for next-generation wireless systems. Empowered by advanced artificial intelligence (AI) technologies, SemCom has achieved significant improvements in transmission quality and efficiency. However, existing SemCom systems either rely on training over large datasets and specific channel conditions or suffer from performance degradation under channel noise when operating in a training-free manner. To address these issues, we explore the use of generative diffusion models (GDMs) as training-free SemCom systems. Specifically, we design a semantic encoding and decoding method based on the inversion and sampling process of the denoising diffusion implicit model (DDIM), which introduces a two-stage forward diffusion process, split between the transmitter and receiver to enhance robustness against channel noise. Moreover, we optimize sampling steps to compensate for the increased noise level caused by channel noise. We also conduct a brief analysis to provide insights about this design. Simulations on the Kodak dataset validate that the proposed system outperforms the existing baseline SemCom systems across various metrics. I Introduction Semantic communication (SemCom) has emerged as a promising paradigm for the next generation of wireless communication systems and has attracted significant research interest in recent years. The key idea of SemCom is to understand the meaning of the transmitted data and transmit the most relevant information to the receiver, which can significantly reduce the amount of data transmitted over the channel and support downstream tasks at the receiver [ 1 ] , such as autonomous driving, metaverse, and smart cities. Benefiting from recent advances in artificial intelligence (AI) technologies, various SemCom systems have been proposed. Specifically, the authors in [ 2 ] proposed a deep joint source-channel coding (DeepJSCC) system for wireless image transmission, where the semantic encoder and decoder are implemented using convolutional neural networks (CNNs) to extract the semantic information behind the original pixels and reconstruct the original image. DeepJSCC achieves superior reconstruction performance compared to conventional digital communication systems and effectively mitigates the cliff effect. Following this work, the authors in [ 3 ] modified the architecture of the semantic encoder and decoder by introducing the powerful transformer backbone, significantly improving transmission quality. In addition, a contrastive learning-based SemCom framework [ 4 ] was proposed to train the semantic encoder and decoder, which enhances the semantic consistency during transmission. However, due to the use of the autoencoder architectures and the discriminative AI paradigm, these approaches struggle to achieve high communication efficiency, and also require extensive training on large datasets and various channel conditions, which significantly limit their performance and flexibility in practical systems. Fortunately, the recent emergence of generative artificial intelligence (GenAI) offers new opportunities to overcome this limitation. By learning to capture the underlying data distribution rather than direct input-to-label mappings in discriminative AI [ 5 ] , GenAI enables the generation of high-dimensional data (e.g., images or text) from low-dimensional vectors. This allows SemCom systems to transmit minimal data while enabling the receiver to reconstruct the original content through conditional sampling from the learned distribution [ 6 ] . For example, the authors in [ 7 ] proposed a generative JSCC framework in which a generative adversarial network (GAN) is integrated into the decoder to enhance reconstruction quality by leveraging the semantic priors learned by the generator. Moreover, more powerful generative diffusion models (GDMs) [ 8 , 9 ] have been introduced into DeepJSCC-based frameworks [ 10 , 11 ] , where the degraded images reconstructed by DeepJSCC serve as conditional inputs to guide the diffusion sampling process, resulting in more realistic and perceptually faithful reconstructions. However, these approaches remain dependent on a well-trained DeepJSCC system. To eliminate the dependency on training, recent studies have explored training-free generative SemCom frameworks. Specifically, the authors in [ 12 ] introduced a channel-aware GAN inversion method for semantic encoding and employed the same GAN generator for decoding, thus avoiding any encoder–decoder training on the communication task. Meanwhile, the works in [ 13 , 14 ] proposed to use a pretrained image captioner to extract textual descriptions from source images. These captions, along with auxiliary visual features such as edge maps or latent vectors, are transmitted to the receiver, where the caption serves as a conditioning prompt to guide a GDM in reconstructing the original image. However, these training-free approaches lack robustness to channel noise, as the transmitted semantic conditions, such as captions or latent features, are easily corrupted during transmission, leading to degraded reconstruction quality. To overcome these limitations, we propose a fully training-free generative SemCom framework that leverages publicly available pretrained GDMs. Specifically, we design a semantic encoding and decoding method based on the sampling and inversion processes of the denoising diffusion implicit model (DDIM) [ 9 ] , which introduces a two-stage forward diffusion strategy split between the transmitter and receiver to enhance robustness against channel noise. In addition, we optimize the number of sampling steps at the receiver to match the total noise level introduced by the channel noise. We further provide a brief analysis of this design, how channel noise shifts the latent distribution away from the latent distribution of GDM in ideal conditions, and give insights into how the proposed system mitigates this mismatch. Simulations on the Kodak dataset are conducted to demonstrate the superiority of the proposed system across a wide range of perceptual and distortion metrics. In particular, our method achieves over 50% performance gains in Fréchet Inception distance (FID) compared to baselines when the SNR is below 5 dB. II Preliminaries II-A System model of SemCom In this paper, we consider a typical SemCom system for wireless image transmission, where the transmitter and receiver are equipped with a semantic encoder and decoder, respectively. For the input RGB image \bm{x}\in\mathbb{R}^{3\times W\times C} , where H and W denote the image height and width, respectively , the semantic encoder first extracts the semantic information and directly maps it into to a k complex-dimensional channel input signal \bm{z}\in\mathbb{C}^{k} , given by \bm{z}=\mathcal{E}_{\theta}(\bm{x}), (1) where \mathcal{E}_{\theta}(\cdot) is the semantic encoder with parameters \theta . To evaluate the communication efficiency, we define the bandwidth compression ratio as \text{BCR}=\frac{k}{N} , where N=3\times H\times C denotes the source bandwidth. Then, the channel input \bm{z} is transmitted over a noisy channel, which is modeled as \bm{y}=\bm{z}+\bm{n}, (2) where \bm{n}\sim\mathcal{CN}(0,\sigma_{\text{ch}}^{2}\bm{I}) is the additive white Gaussian noise (AWGN) with zero mean and variance \sigma_{\text{ch}}^{2} . At the receiver side, the semantic decoder reconstructs the image \hat{\bm{x}} from the received signal \bm{y} , which can be expressed as \hat{\bm{x}}=\mathcal{D}_{\phi}(\bm{y}), (3) where \mathcal{D}_{\phi}(\cdot) represents the semantic decoder with parameter \phi . The performance of the SemCom system can be assessed by the difference between \bm{x} and \hat{\bm{x}} using various metrics, including distortion metrics such as peak signal-to-noise ratio (PSNR) and multi-scale structural similarity (MS-SSIM), human perceptual metrics like learned perceptual image patch similarity (LPIPS), and distribution metrics such as Fréchet Inception distance (FID). II-B Generative Diffusion Models GDMs are a class of generative models that learns to generate data by gradually denoising from a pure noise distribution. Specifically, a typical