Nonlinear Sparse Bayesian Learning Methods with Application to Massive MIMO Channel Estimation with Hardware Impairments
Arttu Arjas, Italo Atzeni · 2025
Read Nonlinear Sparse Bayesian Learning Methods with Application to Massive MIMO Channel Estimation with Hardware Impairments by Arttu Arjas, Italo Atzeni (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-03775.txt.
Introduction
Arttu Arjas and Italo Atzeni tackle channel estimation for massive MIMO, a system where antennas work in large arrays. Their 2025 paper notes that real receivers distort signals. Amplifier flaws and coarse digitizing break the clean models that standard estimators assume. The pair build a method that learns the distortion instead of ignoring it.
They model the distortion curve with a Gaussian process, a flexible curve-fitting tool, using stand-in points to keep computing cheap. That model feeds new sparse Bayesian methods that exploit the channel's sparsity. Two versions trade accuracy against computing cost. In tests, both beat a standard linear estimator and a linear sparse method. Gains grew strongest under heavy distortion and clean signals.
Catalog record
| CREATOR | Arttu Arjas, Italo Atzeni |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-03775
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Nonlinear Sparse Bayesian Learning Methods with Application to Massive MIMO Channel Estimation with Hardware Impairments Arttu Arjas, Italo Atzeni Abstract Accurate channel estimation is critical for realizing the performance gains of massive multiple-input multiple-output (MIMO) systems. Traditional approaches to channel estimation typically assume ideal receiver hardware and linear signal models. However, practical receivers suffer from impairments such as nonlinearities in the low-noise amplifiers and quantization errors, which invalidate standard model assumptions and degrade the estimation accuracy. In this work, we propose a nonlinear channel estimation framework that models the distortion function arising from hardware impairments using Gaussian process (GP) regression while leveraging the inherent sparsity of massive MIMO channels. First, we form a GP-based surrogate of the distortion function, employing pseudo-inputs to reduce the computational complexity. Then, we integrate the GP-based surrogate of the distortion function into newly developed enhanced sparse Bayesian learning (SBL) methods, enabling distortion-aware sparse channel estimation. Specifically, we propose two nonlinear SBL methods based on distinct optimization objectives, each offering a different trade-off between estimation accuracy and computational complexity. Numerical results demonstrate significant gains over the Bussgang linear minimum mean squared error estimator and linear SBL, particularly under strong distortion and at high signal-to-noise ratio. I Introduction Channel estimation is crucial to enable beamforming design in multiple-input multiple-output (MIMO) systems. It becomes even more important for massive MIMO, where large antenna arrays allow for transmit/receive beamforming with extreme spatial resolutions [ 2 , 3 ] . Channel estimation is usually carried out via uplink pilots, where the user equipments (UEs) send predetermined pilot signals to the base station (BS) to probe the channels. When the channels are Gaussian, the linear minimum mean squared error (LMMSE) channel estimator can be shown to be optimal among the linear estimators. To reduce pilot overhead, compressed sensing techniques such as sparse Bayesian learning (SBL), matching pursuit, or \ell_{1} -norm regularization can be used to estimate the channels [ 4 , 5 , 6 , 7 , 8 , 9 ] . These methods exploit the angular sparsity of the channels arising, for instance, when there is a limited number of scatterers between the transmitter and the receiver, which causes most of the received signal to come from few channel paths. The aforementioned approaches to channel estimation typically assume ideal hardware at the receiver, which is unrealistic in real-world systems. In practice, the receiver hardware is non-ideal, creating impairments such as nonlinearities in the low-noise amplifiers (LNAs), I/Q imbalance, phase noise, and quantization errors [ 10 ] . Although these impairments can be partly mitigated by compensation algorithms [ 11 ] , ignoring the residual impairments in the channel estimation leads to decreased estimation accuracy [ 10 ] . In practical systems, channel reciprocity is disrupted due to non-ideal transceiver hardware, which introduces different impairments at the transmitter and receiver. These hardware asymmetries lead to uplink and downlink channels that are no longer simple transposes of one another [ 12 ] . To overcome this, one must separately estimate the propagation channel, which excludes the transceiver hardware, and model the hardware impairments separately. The resulting nonlinear mapping can then be accounted for in the data detection stage. Despite their practical relevance, hardware impairments are rarely modeled explicitly in channel estimation frameworks, creating a gap between theory and practice that motivates the present work. In signal processing, a popular approach to analyze nonlinearities is to use the Bussgang decomposition [ 13 ] , which allows to express the output of a nonlinear function as a linearly scaled version of the input plus an uncorrelated distortion term. This statistical tool can be utilized to analyze communication systems under hardware impairments [ 14 ] and design distortion-aware extensions of common linear channel estimation and data detection methods (such as LMMSE) based on the first- and second-order statistics of the distortion term [ 15 , 16 , 17 ] . However, these methods assume perfect covariance and cross-covariance information of the input and output. Moreover, approaches that directly model the nonlinear transformation itself can enable more accurate compensation under significant hardware impairments. This motivates the need for a unified framework for nonlinear estimation and analysis in wireless systems, as recently highlighted in [ 18 ] . In this work, we propose to model the hardware impairments using Gaussian processes (GPs), a data-driven tool that can be utilized to model nonlinear functions; we refer to [ 19 ] for a thorough introduction to GPs. In general, GPs can be used to learn nonlinear functions from paired input-output training data. Given the data, the GP can be evaluated at any input point not included in the training data using Bayes’ formula. The properties of a GP (e.g., smoothness and scale of the nonlinearity) are governed by a covariance function, also referred to as kernel, which defines the similarity between two inputs, usually based on their mutual distance. Compared with parametric models, GPs are more flexible as they do not assume a fixed functional form but rather assign a prior distribution over functions. By incorporating prior assumptions on the function to be learned, GPs have been shown to perform well even with limited data [ 20 ] . In contrast, deep learning methods typically require huge datasets due to the large number of parameters involved [ 21 , 22 ] . Alternatively, support vector machines can learn nonlinear relations by projecting the input data onto a high-dimensional space using kernels, and have been applied to channel estimation in [ 23 , 24 ] . However, with nonlinear kernels, the recovery of the channels becomes difficult since the estimate lies in the reproducing kernel Hilbert space and cannot be directly mapped back to the original channel space in closed form. GPs typically require tuning only few hyperparameters, some of which can be automatically selected using approaches such as maximum likelihood (ML). A well-known limitation of standard GPs is their cubic computational cost with respect to the number of training samples [ 19 ] . To address this, several techniques for reducing the computational complexity have been proposed, including low-rank matrix approximations [ 25 , 26 ] . A promising approach to enhance the scalability of GPs is using pseudo-inputs [ 27 ] , which summarize the training data with a smaller set of representative points, thereby reducing the computational complexity. Contribution. Despite the significance of hardware impairments in real-world communication systems, existing channel estimation techniques predominantly assume ideal hardware. Neglecting hardware impairments not only leads to performance degradation but also fails to account for the resulting disruption of channel reciprocity. To bridge this gap, we propose a nonlinear channel estimation framework that models the distortion function arising from hardware impairments while leveraging the inherent sparsity of massive MIMO channels. The distortion function is replaced by a GP-based surrogate function learned from data, with pseudo-inputs employed to reduce the computational complexity. The GP-based surrogate function is then integrated into newly developed enhanced SBL methods, enabling distortion-aware sparse channel estimation. The main contributions are summarized as follows. • We consider a MIMO system characterized by channel sparsity and hardware impairments, with the LNA distortion serving as our main motivating example. We model the nonlinear distortion function using the GP regression framework