From Bayesian Asymptotics to General Large-Scale MIMO Capacity
Sheng Yang, Richard Combes · 2025
Read From Bayesian Asymptotics to General Large-Scale MIMO Capacity by Sheng Yang, Richard Combes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13325.txt.
Introduction
Sheng Yang and Richard Combes unite two fields to compute the capacity of large antenna arrays. Their 2025 paper bridges Bayesian asymptotics and information theory for MIMO channels, including messy real ones with clipping, coarse converters, phase noise, or fading. Past capacity results often needed a clean, ideal channel to work at all.
Their framework gives both a capacity formula and the best input distribution for the many-antenna limit. Both hinge on one quantity drawn from the single-output channel's Fisher information, which the authors name the Jeffreys factor. The method reaches even optical Poisson channels. It also suggests a practical signal shaping trick and a simple receiver that bins outputs yet stays near capacity. Numerical tests back the claims.
Catalog record
| CREATOR | Sheng Yang, Richard Combes |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 93 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-13325
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Bayesian Asymptotics to General Large-Scale MIMO Capacity Sheng Yang, Richard Combes Abstract We present a unifying framework that bridges Bayesian asymptotics and information theory to analyze the asymptotic Shannon capacity of general large-scale MIMO channels including ones with nonlinearities or imperfect hardware. We derive both an analytic capacity formula and an asymptotically optimal input distribution in the large-antenna regime, each of which depends solely on the single-output channel’s Fisher information through a term we call the (tilted) Jeffreys factor . We demonstrate how our method applies broadly to scenarios with clipping, coarse quantization (including 1-bit ADCs), phase noise, fading with imperfect CSI, and even optical Poisson channels. Our asymptotic analysis motivates a practical approach to constellation design via a compander-like transformation. Furthermore, we introduce a low-complexity receiver structure that approximates the log-likelihood by quantizing the channel outputs into finitely many bins, enabling near-capacity performance with computational complexity independent of the output dimension. Numerical results confirm that the proposed method unifies and simplifies many previously intractable MIMO capacity problems and reveals how the Fisher information alone governs the channel’s asymptotic behavior. I Introduction Ever-increasing demand for high data rates has made large-scale (or massive) MIMO systems a leading candidate in modern wireless architectures. By deploying a large number of antennas, these systems can substantially improve spatial diversity and spectral efficiency. However, analyzing the Shannon capacity of such large-scale systems is complex, especially when hardware impairments (e.g., clipping or saturation effects), low-precision analog-to-digital converters (ADCs), or other nonlinearities are present. In addition, certain channel models (e.g., optical Poisson channels) are inherently nonlinear, further challenging conventional approaches primarily suited to idealized linear MIMO channels. When the number of receive antennas grows, a powerful link emerges between Bayesian asymptotics and information theory. This link is closely tied to the concept of Bayesian redundancy , wherein the minimum expected redundancy — defined as the Kullback-Leibler (KL) divergence from the true distribution within a parametric family to the estimated one — coincides with the mutual information between the parameter and the observations. The worst-case or maximin Bayesian redundancy thus equals the maximum mutual information over all prior distributions of the parameter. In their seminal paper [ 1 ] , Clarke and Barron showed that, in the large-sample regime, this maximum is achieved by Jeffreys prior , which is proportional to the square root of the Fisher information determinant. In a communication setting — where the channel input can be viewed as the parameter of the output distribution — Clarke–Barron’s result provides a natural route to derive the asymptotic channel capacity, as demonstrated in [ 2 ] for 1-bit MIMO channels in the large-antenna regime. In this paper, we present a unified, step-by-step method that leverages Bayesian asymptotics to analyze a broad class of large-scale MIMO channels. In essence, when each receive antenna provides an independent observation drawn from a distribution parameterized by the input, the channel’s capacity can be characterized up to a vanishing term as the number of antennas grows large. We show that the asymptotically optimal input distribution is Jeffreys prior, determined solely by the Fisher information matrix of the single-letter (per-antenna) distribution. Since this Fisher information is straightforward to compute analytically or numerically in most cases, the framework readily applies to many scenarios of interest. Our contributions are fourfold: • First, we derive a systematic recipe for computing the asymptotic capacity of large-scale MIMO channels under both peak- and average-power constraints. Specifically, we extend Clarke and Barron’s result [ 1 ] by incorporating an additional second-moment constraint typical in communication settings. A key outcome is a compact capacity expression in which a single Jeffreys factor encapsulates both the power constraints and the channel distribution, all through the Fisher information of the per-antenna output. • Second, we illustrate how this recipe addresses capacity problems that are intractable under conventional methods. Starting with single-input multiple-output (SIMO) channels that involve clipping, quantization, or phase noise, we then show how fading (including imperfect channel state information) and optical Poisson models also fit naturally into the proposed framework. Notably, we demonstrate how introducing dithering (i.e., artificially shifting signals prior to quantization) can boost the capacity of a multi-antenna channel with 1-bit ADCs. • Third, inspired by the asymptotically optimal Jeffreys prior, we propose a systematic and universal compander-like transformation for practical constellation design. By applying a smooth nonlinear mapping to a uniform grid, one obtains a constellation that can significantly outperform conventional choices. We demonstrate this numerically in a multi-antenna system with low-resolution ADCs. • Finally, we introduce a low-complexity receiver architecture that approximates the log-likelihood by quantizing the channel outputs into finitely many bins. We prove — by analyzing the scaling of its capacity loss — that this approach achieves near-capacity performance while maintaining computational complexity independent of the output dimension, thereby further reinforcing the practicality of our Bayesian-asymptotic framework. Standard MIMO systems — i.e., linear channels with infinite-precision receivers and only average-power constraints — have been well investigated since the pioneering works [ 3 , 4 ] . For channels with nonlinearities such as clipping or saturation [ 5 , 6 ] , quantized output [ 7 , 8 , 9 ] , or phase noise [ 10 , 11 , 12 , 13 ] , and for channels with only partial channel state information (CSI) [ 14 , 15 , 16 ] , capacity results are generally known only in special asymptotic-SNR regimes. In the optical domain, Poisson channel models [ 17 , 18 ] yield capacity bounds but no simple closed-form expressions. Motivated by large-scale or massive MIMO systems [ 19 ] , our work focuses on the regime where the number of receive antennas grows large. We extend Clarke–Barron’s Bayesian asymptotic result [ 1 ] to incorporate both peak- and average-power constraints into a wide class of MIMO models, yielding explicit, and surprisingly simple, capacity expressions valid for large arrays. Consequently, even for standard linear MIMO channels, our approach provides a new capacity characterization that includes both peak- and average-power constraints in a tractable form. Beyond this, our framework naturally accommodates nonlinear transceivers and channels with imperfect CSI, as well as other nonlinear channel models. Just as the SNR serves as the canonical surrogate for capacity in the linear regime, the Jeffreys factor now emerges as the key surrogate for capacity in these more general large-scale MIMO settings. From a statistical perspective, the notion of a Jeffreys prior and its variants [ 20 ] is well known as a noninformative prior that is invariant by any change of coordinates in the parameter space. In [ 1 ] , Clarke and Barron formally proved that it is asymptotically minimax and maximin in the large-sample regime. Remarkably, the same distribution that is least favorable in a statistical sense turns out to be the best input distribution in a communication sense: it maximizes the mutual information (i.e., capacity) as the number of receive antennas grows large. Thus, the minimax principle for KL divergence — originally posed in parametric estimation — coincides with the capacity-achieving design principle in large-scale MIMO channels. The rest of the paper is organized as follows. In Section II , we introduce the channel model and formulate the capacity characterization problem. Then,