Mismatch Capacity under Stochastic Decoding

Francesc Molina and Albert Guillén i Fàbregas · 2026

Read Mismatch Capacity under Stochastic Decoding by Francesc Molina and Albert Guillén i Fàbregas (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17964.txt.

Introduction

Molina and Guillen i Fabregas study channel capacity under mismatched stochastic decoding, where the decoder uses the wrong model. They derive Feinstein-style and Verdú-Han-style bounds on error rates. They obtain an information-spectrum formula for mismatch. It takes a supremum over inputs of a limit in probability of scaled mismatched information densities. When they are uniformly integrable, an expectation-based upper bound follows. It is met for discrete-memoryless channels with product metrics, showing the Csiszár-Narayan conjecture is tight in such cases.

Catalog record

CREATORFrancesc Molina and Albert Guillén i Fàbregas
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52325
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.17964

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Mismatch Capacity under Stochastic Decoding Francesc Molina and Albert Guillén i Fàbregas Abstract This manuscript investigates channel capacity under mismatched stochastic likelihood decoding. We derive Feinstein- and Verdú-Han-style bounds on the error probability coded communication. These are used to obtain a general information-spectrum formula for the channel capacity under mismatched stochastic decoding. The mismatch capacity formula is expressed as the supremum over all input distribution sequences of the limit inferior in probability of the sequence of normalized mismatched information densities. The resulting capacity formula is the mismatched analog of the channel capacity formula for the matched case by Verdú and Han. We also show that when the sequence of normalized mismatched information densities is uniformly integrable, the capacity formula admits an upper-bound as the limit of the corresponding sequence of expectations. This upper-bound is shown to be achievable for discrete-memoryless channels and product decoding metrics, showing that the Csiszár-Narayan conjecture is tight for mismatched stochastic decoders. I Introduction Most coding theorems in information theory are often established under the assumption that the channel transition law is known at the decoder. In this setting, the maximum likelihood decoder is the optimal decoder in the sense that it minimizes error probability. Other decoders that exploit the channel knowledge have also been studied in the literature, such as threshold, typical-set or stochastic likelihood decoders, and have been used to characterize channel capacity. In situations where the channel law is unknown or too costly to compute, one naturally adopts sub-optimal or mismatched decoding metrics. Mismatched decoding is a variant of the reliable communication problem where the decoder employs a fixed, not necessarily optimal, decoding metric [ 12 , 5 , 11 , 14 ] . Examples of mismatched decoding are surveyed in [ 14 ] : channel uncertainty where the decoder only has an imperfect channel estimate available; finite-precision decoder implementations in which the likelihoods are computed using quantized or approximate arithmetic; nearest neighbor decoding in additive non-Gaussian noise channels; zero-error and zero-undetected error communication; bit-interleaved coded modulation where independent bit-wise metrics are employed in place of the corresponding symbol metric; or computing achievable rates for channels with memory using simplified metrics. To be specific, we consider a standard point-to-point setting in which M_{n} messages are to be reliably transmitted over a channel with transition law W^{n}(y^{n}|x^{n}) with input-output alphabets \mathcal{X}^{n} and \mathcal{Y}^{n} , respectively. We consider a communication system with an encoder and a decoder, where the encoder maps each equiprobable message m=1,\dotsc,M_{n} to an n -length codeword x^{n}{(m)}=(x_{1}{(m)},\dots,x_{n}{(m)})\in\mathcal{X}^{n} . We refer to the codebook as the set of all codewords \mathcal{C}_{n}=\{x^{n}{(1)},\dots,x^{n}{(M_{n})}\} , with rate R_{n}=\frac{1}{n}\log M_{n} . In its simplest instance, the mismatched decoding problem is formulated as a variant of maximum likelihood decoding, where the channel likelihood W^{n}(y^{n}|x^{n}) is replaced with a non-negative decoding metric q^{n}(x^{n},y^{n}) . Upon observing y^{n} , the maximum metric decoder outputs the message whose codeword maximizes the decoding metric, i.e., \displaystyle\hat{m}=\argmax_{1\leq m\leq M_{n}}q^{n}(x^{n}(m),y^{n}). (1) The channel capacity C is defined as the supremum of all the code rates for which the error probability can be made arbitrarily small. Instead, the mismatch capacity C_{M} is defined as the supremum of all the code rates for which the error probability can be made arbitrarily small for a fixed channel-metric pair (W^{n},q^{n}) . Even in the discrete-memoryless case, a single-letter expression of the mismatch capacity with the maximum metric decoder ( 1 ) remains elusive, apart from a small number cases. The literature is rich in lower bounds (see e.g. [ 14 ] and references therein) and only recently a few single-letter upper-bounds have been proposed [ 2 , 18 , 1 , 19 ] . The most common achievable rates are the generalized mutual information (GMI) [ 10 ] and the LM rate [ 9 , 4 ] , attained by i.i.d. and constant-composition random coding, respectively. Csiszár and Narayan in [ 5 ] conjectured that the mismatch capacity under decoder ( 1 ) for discrete-memoryless channels and product decoding metrics was given by the limiting multi-letter extension of the optimized LM rate. The conjecture remains open at the time of writing this article. Given the difficulty of analyzing the mismatch capacity with decoder ( 1 ), a number of alternative mismatched decoders have been considered in the literature alongside a variety of techniques. Inspired by Shannon [ 16 ] , Verdú and Han used in [ 7 , 20 ] information-spectrum techniques to lower-bound the error probability as the tail probability of the information density, and derive a capacity formula for general channels in terms of the limit inferior in probability of the sequence of normalized information densities. Based on this information-spectrum framework, Somekh-Baruch derived a general formula for the mismatch capacity for a broad family of threshold-type decoders, including maximum metric, margin and constant-threshold decoders [ 17 ] . Although very general, the capacity expression is multi-letter in nature and does not lend itself to simple analysis even in the discrete-memoryless case. For some specific decoders, excepting the decoder in ( 1 ), the expression allows to prove that the Csiszár-Narayan conjecture is tight [ 17 ] . In this work, we instead consider mismatched stochastic likelihood decoders and characterize average error probability and mismatch capacity. The main appeal of stochastic decoders lies in the fact that they enable markedly simpler derivations while, in the matched case, achieving the same rate and error exponent as maximum likelihood decoding. Stochastic decoders were first considered in quantum information theory (see e.g. [ 8 ] ) within the framework of positive operator-valued measures, the mathematical framework for describing general quantum measurements. Yassaee et al. employed the stochastic likelihood decoder to provide general one-shot achievability derivations in single- and multi-user scenarios [ 22 ] . Building on the ideas introduced in [ 15 ] for mismatched stochastic decoders, we derive Feinstein- and Verdú-Han-type bounds on the average error probability for general multi-letter channels and decoding metrics. Using the derived bounds, we find an information-spectrum formula for the mismatch capacity with stochastic decoders given as the supremum over all input distribution sequences of the limit inferior in probability of the sequence of normalized mismatched information densities, establishing a direct parallel with Verdú and Han’s general formula for channel capacity [ 7 , 20 ] . An interesting consequence of our analysis is that the Csiszár-Narayan conjecture is tight for mismatched stochastic likelihood decoders. Notation Vectors are written in lowercase italic letters, with their dimension indicated as a superscript and their components indexed by subscripts: x_{i} denotes the i -th element of the n -dimensional vector x^{n} . Random variables are denoted by uppercase italic letters, with an explicit dependence on their dimension: X^{n} is an n -dimensional random vector. |\mathcal{A}| denotes the cardinality of set \mathcal{A} . The indicator function is denoted by \mathbbm{1}\{\cdot\} . Probabilities and expectations are denoted by \mathbb{P}[\cdot] and \mathbb{E}[\cdot] , respectively. Natural logarithms are adopted throughout the paper. Paper organization Section II introduces the main concepts and definitions. A summary of contributions is provided at the end of the section. Section III develops the main part of this work by deriving upper and lower bounds on the error probability as well as the general mismatch capacity

Read the complete text