RWZC: A Model-Driven Approach for Learning-based Robust Wyner-Ziv Coding

Yuxuan Shi, Shuo Shao, Yongpeng Wu, Wenjun Zhang, Merouane Debbah · 2025

Read RWZC: A Model-Driven Approach for Learning-based Robust Wyner-Ziv Coding by Yuxuan Shi, Shuo Shao, Yongpeng Wu, Wenjun Zhang, Merouane Debbah (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-09520.txt.

Introduction

Yuxuan Shi and co-authors build a coding system for sending images when the decoder, not the sender, holds a related picture. Their 2025 paper works in the Wyner-Ziv setting, where the shared information between two images can save bandwidth. The catch is that the overlap shifts from pair to pair, and many learned systems break when it does.

Their method first models the simple geometric link between the paired images, a shift and warp, and lets that model drive both masking and rate control. A second network undoes warping damage and channel noise at the far end. Tests on real images show clear gains in sharpness scores over leading methods, which the authors credit to trusting geometry over complex statistics.

Catalog record

CREATORYuxuan Shi, Shuo Shao, Yongpeng Wu, Wenjun Zhang, Merouane Debbah
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-09520

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RWZC: A Model-Driven Approach for Learning-based Robust Wyner-Ziv Coding Yuxuan Shi, Shuo Shao, Yongpeng Wu, Wenjun Zhang, Merouane Debbah Abstract In this paper, a novel learning-based Wyner-Ziv coding framework is considered under a distributed image transmission scenario, where the correlated source is only available at the receiver. Unlike other learnable frameworks, our approach demonstrates robustness to non-stationary source correlation, where the overlapping information between image pairs varies. Specifically, we first model the affine relationship between correlated images and leverage this model for learnable mask generation and rate-adaptive joint source-channel coding. Moreover, we also provide a warping-prediction network to remove the distortion from channel interference and affine transform. Intuitively, the observed performance improvement is largely due to focusing on the simple geometric relationship, rather than the complex joint distribution between the sources. Numerical results show that our framework achieves a 1.5 1.5 dB gain in PSNR and a 0.2 0.2 improvement in MS-SSIM, along with a significant superiority in perceptual metric, compared to state-of-the-art methods when applied to real-world samples with non-stationary correlations. I Introduction The rapid progress in mobile devices and wireless networks has sparked growing interest in multi-node communications, particularly in applications such as autonomous driving assistance, virtual reality, multi-camera surveillance, and medical imaging. A key challenge in these scenarios is the need for edge devices to transmit data at low rates while maintaining reliability and minimizing latency. Distributed source coding (DSC) offers a promising solution by exploiting the statistical dependencies between correlated sources, allowing them to be encoded without direct inter-source communication. This approach improves encoding efficiency and reduces data redundancy. Research on DSC dates back to the 1970s, when Slepian and Wolf [ 1 ] established the optimal rate region for independently encoding two correlated sources (SW problem). This was followed by the study of the Wyner-Ziv (WZ) problem (source coding with decoder-only side information) [ 2 ] , the multi-terminal (MT) problem (source coding for correlated multiple users) [ 3 ] , and the chief executive officer (CEO) problem (source coding for correlated sources with a common remote source) [ 4 ] . These foundamental works provide key theoretical insights that have guided the design of compression and transmission systems in real-world applications. When combining DSC with transmission, the integration of source and channel coding becomes especially critical. Joint source-channel coding (JSCC) has been shown to outperform separate source-channel coding in scenarios with limited block lengths, despite its higher implementation complexity. However, this problem has been solved by the rapid advances in deep learning (DL) technologies. In recent years, numerous convolutional neural network (CNN) or Transformer-based frameworks for distributed compression and transmission have emerged, particularly for image sources [ 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 ] . For scenarios where both correlated sources require encoding (SW problem), Wang et al. [ 5 ] proposed a deep neural network solution incorporating a cross-attention module being aware of channel state information. In [ 6 ] , the authors explored distributed audio-visual parsing using a multi-modal Transformer and DL-based JSCC. In the case where side information is only available at the decoder (WZ problem), Ayzik and Avidan [ 8 ] introduced a side-information-finder block to perform plane-wise projection for DL-based image compression, termed the Deep Side Information Network (DSIN). Mital et al. [ 9 , 10 ] further improved Ayzik’s work by integrating an entropy model and cross-attention mechanism to create a more efficient compression scheme, known as Neural Distributed Image Compression (NDIC). More recently, Yilmaz et al. [ 11 ] proposed a novel framework, DeepJSCC-WZ, which integrates an attention feature module and achieves low-latency joint source-channel coding for transmission scenarios. However, the existing frameworks for both SW and WZ problems primarily focus on highly correlated and stably distributed sources to achieve optimal compression or transmission performance, which does not accurately reflect the variability of real-world data. In scenarios where source correlation fluctuates significantly, such as image pairs with varying parallax (as shown in Fig. 1 ), these methods often fail to achieve satisfactory results. This performance gap can be attributed to three main reasons. First, when training on images with non-stationary correlations, instability arises during feature extraction, leading to mismatches and inaccurate representations. Second, CNN-based architectures often have insufficient receptive fields to capture the correlations in highly uncorrelated images, resulting in confusion among convolutional features and a decline in performance. Third, the non-stationary distribution of correlation in the input data significantly reduce the network’s ability to generalize across different data samples. In summary, the performance of feature-level interaction heavily relies on the stability of input distribution in data-driven architectures, thus it performs unsatisfactorily in situations where the correlation distribution fluctuates, inevitably. In such cases, a well-designed correlation model can effectively address these issues. high correlation medium correlation low correlation Fig. 1: Illustration for image pairs of different correlation/parallax (from dataset UDIS-D), where parallax means the visual deviation between two images caused by different positions Therefore, we assume that there exists a conception, named as source state information (abbreviated by SSI), which used to describe the correlation between sources with low complexity. This approach facilitates source decorrelation, thereby preventing mismatched representations and feature confusion. To validate the effectiveness of this conception, we consider a practical WZ scenario in this paper involving camera arrays, where two stereo cameras capture images of the same object. One camera transmits photos \bm{x} to the receiver, while the receiver has access to the noise-free image \bm{y} from the other camera. Note that, we assume the correlation between two images is non-stationary owing to the changeable camera poses, camera parameters or even a movable objects. To address the performance degradation caused by varying correlation, we propose three key components driven by the modeling of SSI: correlation estimation and decoupling, low-rate transmission, and SSI-aided source reconstruction. Specifically, we first estimate the SSI between the image pairs and use it for source decoupling of \bm{x} , where ”decoupling” refers to removing the redundant information carried by the side image \bm{y} . The SSI is also available at the decoder without error. Next, we apply an efficient JSCC scheme to transmit the decoupled image with limited resources. Finally, \bm{y} , along with SSI, aids in the reconstruction of \bm{x} at the decoder. Following this idea, we propose a novel learning-based joint source-channel coding framework for images, named as Robust Wyner-Ziv coding (abbreviated by RWZC), which ensures reliable transmission of sources with non-stationary correlation. The key contributions of this paper are summarized as follows: • We propose a perspective transform layer (PTL)-based mask generation module for source decoupling. This module learns the dynamic distribution of the SSI and generates adaptive masks to decorrelate the transmitted image from the side image. This approach overcomes the issues of corrupted masking encountered in traditional methods. Additionally, since the decoupled image is significantly smaller than the original, RWZC offers superior performance in low-rate transmission compared to other schemes. • We propose a CNN-based autoencoder that implements low-rate JSCC, encoding the decoupled image into feature representations whose size adapts to the masked regions. This rate-adaptive mechanism utilizes non-linear transform (NLT) and entropy modeling of each feature component, effectively saving the transmission resources. •

Read the complete text