Goal-Oriented Joint Source-Channel Coding: Distortion - Classification - Power Trade-off

Andriy Enttsel 1 , Weichen Wang 3 , Mauro Mangia 1 2 , Riccardo Rovatti 1 2 , Deniz Gündüz 3 · 2025

Read Goal-Oriented Joint Source-Channel Coding: Distortion - Classification - Power Trade-off by Andriy Enttsel 1 , Weichen Wang 3 , Mauro Mangia 1 2 , Riccardo Rovatti 1 2 , Deniz Gündüz 3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-14217.txt.

Introduction

Andriy Enttsel and four co-authors set out a theory in 2025 for sending a signal when the receiver must do more than rebuild it. Joint source and channel coding packs a signal for a noisy channel in one step, which suits fast, simple links. Here the receiver must also classify the signal and flag odd cases.

Working with a single bell shaped source and encoders built from straight line pieces, the authors derive usable design rules. They spell out the trade off among three goals: low distortion in the rebuilt signal, low classification error, and low sending power. Improving one goal tends to hurt another. The rules let a designer pick a balance on purpose rather than by trial and error.

Catalog record

CREATORAndriy Enttsel 1 , Weichen Wang 3 , Mauro Mangia 1 2 , Riccardo Rovatti 1 2 , Deniz Gündüz 3
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-14217

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Goal-Oriented Joint Source-Channel Coding: Distortion - Classification - Power Trade-off Andriy Enttsel 1 , Weichen Wang 3 , Mauro Mangia 1 2 , Riccardo Rovatti 1 2 , Deniz Gündüz 3 Abstract Joint source-channel coding is a compelling paradigm when low-latency and low-complexity communication is required. This work proposes a theoretical framework that integrates classification and anomaly detection within the conventional signal reconstruction objective. Assuming a Gaussian scalar source and constraining the encoder to piecewise linear mappings, we derive tractable design rules and explicitly characterize the trade-offs between distortion, classification error, and transmission power. I Introduction In practical applications where low latency and low complexity are critical, joint source channel coding (JSCC) offers an attractive alternative to classical digital schemes. By combining source compression and channel coding into a single operation, JSCC eliminates the need for buffering and block-based processing, typical of digital codecs, and enables “zero delay” transmission [ 1 ] . However, the main limitation of JSCC lies in the lack of a systematic design procedure for encoder and decoder mappings covering general source-channel pairs. Early work derived optimal linear mappings [ 2 , 3 ] . Later results highlighted their suboptimality when there is a mismatch between the source and channel bandwidths, as well as provided necessary conditions for optimal nonlinear encoder and decoder mappings under a power constraint [ 4 ] . Yet, the numerical methods used to find these mappings are often sensitive to local minima. In response, more recent research has developed deep learning approaches to JSCC, with promising results on complex sources such as images and text [ 5 , 6 , 7 ] . Nevertheless, closed-form optimal mappings remain known only for specific cases, such as scalar Gaussian sources over additive white Gaussian noise (AWGN) channels. A comprehensive review on JSCC can be found in [ 1 ] . A complementary trend is the design of semantic and task-oriented communication systems [ 8 , 9 ] . These paradigms reduce communication overhead by transmitting only information relevant to accomplish a downstream task, such as classification, rather than reconstructing the full signal. This is particularly beneficial for machine-oriented communication scenarios, where the objective is to process high-dimensional data with minimal delay and bandwidth consumption [ 9 ] . One of the most common downstream tasks is classification. A substantial body of work has examined classification-aware lossy compression. Earlier studies [ 10 , 11 , 12 ] focused on tailoring vector quantizers by integrating classification-related terms in the distortion measure to explicitly manage the distortion–classification trade-off. More recent work integrated classification in neural network-based codecs [ 13 ] and JPEG compression standard [ 14 ] . Fig. 1 : JSCC scheme for a source corrupted by additive noise to be reconstructed and classified at the receiver. Anomaly detection (AD) is also gaining particular attention [ 15 , 16 , 17 ] . Unlike conventional classification, which assumes that all classes are known a priori, AD involves only a single nominal class representative of normal behavior. For this reason, it is often referred to as one-class classification. The goal is to identify deviations from this class, including all events that are rare, unexpected, or qualitatively different, which may compromise system operation [ 18 ] . Therefore, AD naturally requires low-latency, low-bandwidth communication, making zero-delay analog schemes especially well suited. The work in [ 15 ] analyzes how lossy digital schemes optimized for sole reconstruction affect the subsequent anomaly detection task. In [ 16 , 17 ] , the authors design autoencoder-based schemes that manage the trade-off between anomaly detection and reconstruction. This work aims to extend the theoretical results of JSCC beyond the objective of classical signal reconstruction by incorporating classification and anomaly detection within the system design. In the case of binary classification, we assume a Gaussian source with balanced binary classes and constrain the encoder to a piecewise linear form. We also report learning-based numerical results without constraints, which provides greater performance at the cost of computational complexity. For anomaly detection, we show that, under similar assumptions, a modified JSCC scheme can be designed to simultaneously preserve signal fidelity under normal conditions and transmit sufficient statistics to enable anomaly detection at the receiver. Proofs of the main theoretical results are reported in Appendices A and B. II Problem setup We consider a source pair (X,C) , where X\in\mathbb{R} is modeled as a mixture of \mathcal{C} distributions, C is the discrete class: C\in\mathbb{Z}^{+}_{<\mathcal{C}} , so that f_{X}(x)=\sum_{c=0}^{\mathcal{C}-1}\pi_{c}f_{X|C=c}(x) , where \pi_{c} is the weight of each class c . The source is to be transmitted through a single AWGN channel with zero delay. The objective is to reconstruct X as well as obtain the classification C at the receiver. As shown in Fig. 1 , we consider a JSCC scheme with a separate decoder h and a classifier \gamma to achieve optimal information utilization. The optimal encoder-decoder-classifier triple \left(g^{\star},h^{\star},\gamma^{\star}\right) can then be defined as the solution to the following distortion-classification-power (DCP) optimization problem. \displaystyle(g^{\star},h^{\star},\gamma^{\star}) \displaystyle=\arg\min_{\begin{subarray}{c}g\in\mathcal{G},\,h\in\mathcal{H},\,\gamma\in\Gamma\end{subarray}}\mathrm{MSE}\!\left(X,\hat{X}\right) (DCP) s.t. \displaystyle\Pr\{C\neq\hat{C}\}\leq P_{e},\quad\mathbb{E}\left[Y^{2}\right]\leq P, where \mathcal{G},\mathcal{H}\subseteq\mathcal{M}(\mathbb{R},\mathbb{R}) are the measurable deterministic 1 1 1 Determinism can be derived following the same arguments as in [ 4 ] . function spaces and \Gamma is the set of all deterministic 2 2 2 We make the assumption that the measure of set of events with equal posteriors is zero, which is realistic. Then determinism follows from the definition of Bayes classifier. functions \gamma:\mathbb{R}\to\mathbb{Z}^{+}_{<\mathcal{C}} . That is, (g,h,\gamma) are optimized within (\mathcal{G},\mathcal{H},\Gamma) to minimize the mean squared error (MSE), subject to a constraint in classification error P_{e} and the transmitted average power P . Note that while (X,C) may have a complicated dependency, in this work, we concentrate on the case where c(x) is well-defined, i.e., C can be uniquely determined by the value of X . III Binary classification III-A Preliminaries To solve DCP analytically, without loss of generality, we consider a zero-mean 3 3 3 This is easily reducible from an arbitrary Gaussian, with constant shifting. Gaussian source X\sim\mathcal{N}(0,\sigma_{X}^{2}) with balanced disjoint binary classes, i.e., C=1\left\{x>0\right\} so that f_{X}(x)=0.5f_{X|C=0}(x)+0.5f_{X|C=1}(x) . As channel noise, we consider additive Gaussian white noise (AWGN): Z\sim\mathcal{N}(0,\sigma_{Z}^{2}) . We limit the set of encoding functions \mathcal{G} to piecewise linear mappings of the form: \mathcal{\bar{G}}=\left\{g(x)=Ax+B\cdot\mathbf{1}_{I}(x)\;:\;A,B\in\mathbb{R}_{+}\right\}, (1) where \mathbf{1}_{I}(\cdot) is an indicator function with support of finite unions of open intervals. It can be immediately seen that under balanced binary class, due to symmetry, the indicator function reduces to Heaviside function, which is \operatorname{sign}(x) . We may now see that \mathcal{\bar{G}} , paired with the power constraint, can also be viewed as a linear combination of the optimal encoders for two different objectives: reconstruction and classification. For the former, the optimal encoding is given by g(x)=x\sqrt{P}/\sigma_{X} , while for the latter, the problem can be viewed as analog bit transmission, where the optimal encoding that maximizes classification performance is g(x)=\sqrt{P}\,\operatorname{sign}(x) . We work with dimensionless parameters: \alpha=A\sigma_{X}/\sigma_{Z} , \beta=B/\sigma_{Z} and \operatorname{SNR}=P/\sigma_{Z}^{2} and normalized variables \tilde{x}=x/\sigma_{X} , \tilde{z}=z/\sigma_{Z},\tilde{w}=w/\sigma_{Z}=\tilde{g}(\tilde{x})+\tilde{z}=\alpha\,\tilde{x}+\beta\,\operatorname{sign}(\tilde{x})+\tilde{z} and \tilde{h}(\tilde{w})=\hat{x}/\sigma_{X} . All subsequent expressions are written in terms of the standard normal probability density function (PDF), and tail function \phi(\xi)=\exp\left(-\xi^{2}/2\right)/\sqrt{2\pi},\qquad Q(\xi)=\textstyle{\int_{\xi}^{\infty}}\phi(s)\,ds. (2) We also rely on Owen’s T function T(h,a) [ 19 ] , which yields compact expressions for the

Read the complete text