Secure Joint Source-Channel Coding of Multimodal Semantic Sources

Denis Kozlov, Mahtab Mirmohseni, and Rahim Tafazolli · 2026

Read Secure Joint Source-Channel Coding of Multimodal Semantic Sources by Denis Kozlov, Mahtab Mirmohseni, and Rahim Tafazolli (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14334.txt.

Introduction

Kozlov, Mirmohseni and Tafazolli study secure joint source-channel coding for multimodal semantic sources over wiretap channels. The encoder observes samples from a subset of modalities. Samples are encoded with wiretap coding and a shared secret key, then sent over a wiretap channel for the receiver to rebuild all modalities. Rate-distortion-perception results extend to semantic sources. Outer and inner bounds cover the tradeoff between transmission rate, key rate, and fidelity under per-modality distortion and per-subset equivocation constraints. The secrecy limit has three operationally distinct components.

Catalog record

CREATORDenis Kozlov, Mahtab Mirmohseni, and Rahim Tafazolli
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46748
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14334

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Secure Joint Source-Channel Coding of Multimodal Semantic Sources Denis Kozlov, Mahtab Mirmohseni, and Rahim Tafazolli Abstract We study the problem of secure joint source-channel coding for multimodal semantic sources transmitted over noisy wiretap channels. The source model consists of m m modalities (e.g., image, audio, and sensor data), all represented as random variables. The encoder observes independent and identically distributed samples of an arbitrary non-empty subset of modalities. The samples are encoded and transmitted over a discrete memoryless wiretap channel. The legitimate receiver reconstructs all modalities. We extend the rate-distortion-perception problem formulation to multimodal sources. We establish converse and achievability bounds on the fundamental limits of transmission rate, fidelity, and secrecy, under per-modality distortion and perception constraints, and per-subset equivocation constraints. We show that the fundamental limit for secrecy consists of three operationally distinct components: the level of compression, the secret key rate, and the statistics of the wiretap channel. I Introduction Understanding how multimodal semantic sources can be jointly represented and securely transmitted over wireless networks presents a set of information-theoretic challenges, such as characterisation of the fundamental limits of compression and secrecy. Some of these challenges are already addressed. For example, information-theoretic unimodal, i.e., with two correlated components, and multimodal semantic source models are introduced in [ 10 , 9 ] , together with the accompanying rate-distortion function characterisation. Since then, the unimodal semantic source model is considered in a variety of settings such as source coding with side information [ 6 ] , perceptual constraints [ 2 ] , joint source-channel coding (JSCC) [ 12 ] , and game-theoretic formulations [ 14 ] . However, corresponding results for multimodal sources are unexplored and constitute a current research gap. In wireless communication, which is vulnerable to eavesdropping, secrecy is an important aspect of data transmission. In multimodal data transmission, some modalities can reveal sensitive information to an eavesdropper directly or via their correlation. Thus, we may require some modalities to have stricter secrecy requirements. Meanwhile, correlations across modalities mean that one modality can leak information about the others, requiring a per-subset secrecy rather than individual modality secrecy. There are results for models with unimodal semantic source and secrecy constraints, e.g., secure lossy source coding without a secret key [ 15 ] , lossless secure source coding with a secret key [ 16 ] , lossy secure source coding with a secret key [ 5 ] , and secure JSCC of unimodal semantic sources [ 7 ] . Extending these results to secure multimodal models remains an open problem. In this paper, we bridge this gap and consider secure JSCC of multimodal semantic sources. Compared to previous works with secrecy constraints [ 5 , 7 ] , in this paper, the source is multimodal and the encoder has access to samples of an arbitrary non-empty subset of source components. To enable our main coding theorems, we adapt the lossy source coding problem and the rate-distortion function presented in [ 9 ] to account for per-modality perception and reflect practical scenarios where a transmitter may have direct access to some modalities of the data. The goal of this work is to show the possible tradeoff between transmission rate, fidelity, and secrecy given constraints for each modality within the model of secure JSCC of multimodal sources over wiretap channels. The main contribution of this work is the converse and achievability bounds, based on operational separation of the source coding, encryption, and the secure channel coding. This paper is organised as follows: Section II formalises the problem; Section III presents the multimodal rate-distortion-perception function and the main converse and achievability theorems; Section IV provides the proofs; Section V concludes this paper. II Problem Statement II-A Notation We denote random variables (r.v.s) with capital letters (e.g., X ), the lowercase equivalent represents the realisation of r.v. (e.g., x ) and the capital letter in calligraphic font \mathcal{X} stands for the alphabet of r.v. We refer to S_{i} as the i -th modality of the source, the reconstruction r.v.s are denoted with a hat, e.g., \hat{S}_{i} . We denote tuples using bold font, e.g., \mathbb{S}=(S_{1},...,S_{m}) . The probability mass function of some r.v. X is written as p(x) or as p_{X} . We write a Bernoulli distribution using \mathcal{B}(.) . Typical and conditional typical sets are denoted as \T^{n}(X) and \T^{n}(Y|x^{n}) , respectively. For brevity, we may also use \T^{n} without arguments. The total variation (TV) distance between p and q is shown as \|p-q\|_{\mathrm{TV}} . We show the probability simplex on the alphabet specified by the subscript as \mathcal{D}_{\mathcal{X}} . The superscript k denotes the source sequence of length k , while n stands for the channel sequence of length n . Given a length- k sequence S_{i}^{k} , the second subscript indexes time: S_{i,j} is the j -th sample of modality i , with j\in[k] . We extend this to subsets via \mathbb{S}_{A,j}\doteq\{S_{i,j}\}_{i\in A} , which collects the j -th sample across all modalities in A . The complement of a set A is denoted as A^{c} . The complement of some event \mathcal{E} is shown as \bar{\mathcal{E}} . We denote [m]=\{1,\ldots,m\} . The power set of [m] without empty set is 2^{[m]}_{*}\doteq\{A\subseteq[m]:A\neq\emptyset\} . For some A\in 2^{[m]}_{*} we define parent sets as, \pa(A)\doteq\{A^{\prime}:A^{\prime}\subsetneq A\} . We also consider a linear extension of \subseteq to be an ordering A_{1}\prec A_{2}\prec\cdots s.t. A_{t}\subseteq A_{t^{\prime}}\Rightarrow t\leq t^{\prime} . \mathbbm{1}\{A\} denotes the indicator function. XOR operation is shown as \oplus . We refer to equation number when it is used as a superscript in our derivations, e.g., =^{(42)} means that the equality is based on equation (42). II-B Problem Statement p_{S_{1}} \vdots p_{S_{i}} \vdots p_{S_{m}} Encoder \{S_{i}^{k}\}_{i\in E} p_{YZ|X} X^{n} Decoder Y^{n} Eve Z^{n} K,K_{A}=h_{A}(K) \{S_{i}^{k}\}_{i\in[m]} Modalities Channel Secret Key Fig. 1: System model. We consider the problem (see Fig. 1 ) of secure transmission of a multimodal source consisting of m correlated source components (modalities) \mathbb{S}=(S_{1},...,S_{m}) ; all modelled as discrete r.v.s with finite alphabets and the joint distribution p_{S_{1},...,S_{m}} . The independent and identically distributed (i.i.d.) samples of this source are encoded by the encoder into the channel input X^{n} . The encoder has direct access to a non-empty subset of modality i.i.d. samples \mathbb{S}^{k}_{E} , where E\in 2_{*}^{[m]} . The legitimate receiver and the eavesdropper observe Y^{n} and Z^{n} , respectively, via the discrete memoryless broadcast channel p_{YZ|X} . The first goal of the encoder is to guarantee average distortion for each modality S^{k}_{i} to be below the threshold, i.e. \EX d_{i}(S_{i}^{k},\hat{S}_{i}^{k})\leq D_{i} for all i\in[m] , where d_{i}(S_{i}^{k},\hat{S}_{i}^{k})\doteq\frac{1}{k}\sum_{j=1}^{k}d_{i}(S_{i,j},\hat{S}_{i,j}) , d_{i}:\mathcal{S}_{i}\times\hat{\mathcal{S}_{i}}\to[0,\infty) . The second goal of the encoder is to maintain perception constraints \phi_{i}(p_{S_{i}},\bar{p}_{\hat{S}^{k}_{i}})\leq P_{i} , \forall i\in[m] , where \bar{p}_{\hat{S}^{k}_{i}}\doteq\tfrac{1}{k}\sum_{j=1}^{k}p_{\hat{S}_{i,j}} is the time-averaged marginal distribution of the i -th modality, and \phi_{i}:\mathcal{D}_{\mathcal{S}_{i}}\times\mathcal{D}_{\hat{\mathcal{S}}_{i}}\to[0,\infty) is a perception metric such that it is convex and continuous in its second argument. And the third goal is to maintain secrecy against eavesdropper for each modality separately and for every combination of modalities jointly, which is reflected by the tuple of equivocation constraints \mathbb{\Delta}=\{\Delta_{A}\}_{A\in 2^{[m]}_{*}} , \{\frac{1}{k}H(\mathbb{S}^{k}_{A}|Z^{n})\geq\Delta_{A}\}_{A\in 2^{[m]}_{*}} . The model assumes an optional secret key with limited rate R^{key} is shared between the encoder and the legitimate decoder to enable partial secrecy via encryption. For this

Read the complete text