CSI Compression Beyond Latents: End-to-End Hybrid Attention-CNN Networks with Entropy Regularization

Maryam Ansarifard 1 , Mostafa Rahmani 2 , Mohit K. Sharma 3 , Kishor C. Joshi 1 , George Exarchakos 1 , Alister Burr 2 · 2025

Read CSI Compression Beyond Latents: End-to-End Hybrid Attention-CNN Networks with Entropy Regularization by Maryam Ansarifard 1 , Mostafa Rahmani 2 , Mohit K. Sharma 3 , Kishor C. Joshi 1 , George Exarchakos 1 , Alister Burr 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-08776.txt.

Introduction

Maryam Ansarifard and 5 co-authors propose an end-to-end method to compress channel data for massive MIMO in a 2025 paper. MIMO uses many antennas, and feedback about the channel grows with antenna count. Most learning methods ignore quantization and entropy coding, which limit real use.

An attention step guided by spatial correlation learns compact codes that are also cheap to store. Quantization and entropy aware training are built into the whole system. Tests beat prior end-to-end schemes by clear margins indoors and outdoors. The rate and distortion trade-off improves. The authors present the method as ready for practical feedback systems.

Catalog record

CREATORMaryam Ansarifard 1 , Mostafa Rahmani 2 , Mohit K. Sharma 3 , Kishor C. Joshi 1 , George Exarchakos 1 , Alister Burr 2
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-08776

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CSI Compression Beyond Latents: End-to-End Hybrid Attention-CNN Networks with Entropy Regularization Maryam Ansarifard 1 , Mostafa Rahmani 2 , Mohit K. Sharma 3 , Kishor C. Joshi 1 , George Exarchakos 1 , Alister Burr 2 Abstract Massive MIMO systems rely on accurate Channel State Information (CSI) feedback to enable high-gain beamforming. However, the feedback overhead scales linearly with the number of antennas, presenting a major bottleneck. While recent deep learning methods have improved CSI compression, most overlook the impact of quantization and entropy coding, limiting their practical deployability. In this work, we propose an end-to-end CSI compression framework that integrates a Spatial Correlation-Guided Attention Mechanism with quantization and entropy-aware training. Our model effectively exploits the spatial correlation among the antennas, thereby learning compact, entropy-optimized latent representations for efficient coding. This reduces the required feedback bitrates without sacrificing reconstruction accuracy, thereby yielding a superior rate-distortion trade-off. Experiments show that our method surpasses existing end-to-end CSI compression schemes, exceeding benchmark performance by an average of 21.5 % 21.5\% on indoor datasets and 18.9 % 18.9\% on outdoor datasets. The proposed framework results in a practical and efficient CSI feedback scheme. I Introduction Massive Multiple-Input Multiple-Output (MIMO) systems have emerged as a cornerstone of next-generation wireless communication networks, offering significant gains in spectral and energy efficiency. A critical enabler of these gains is the availability of accurate Channel State Information (CSI) at the base station (gNB). However, in Frequency Division Duplex (FDD) massive MIMO systems, obtaining CSI feedback from the receiver to the transmitter introduces a prohibitive overhead which scales linearly with the number of antennas, thus posing a major bottleneck for practical deployments. To address the CSI feedback problem, various approaches have been explored. Classical Compressive Sensing (CS) methods leverage the sparsity of the wireless channel to reduce feedback requirements [ 1 ] but often struggle under practical channel conditions and require complex recovery algorithms. Deep Learning (DL) techniques, particularly autoencoders, have shown significant promise in learning compact CSI representations. CsiNet [ 2 ] pioneered Convolutional Neural Network (CNN)-based CSI compression using an Auto-Encoder (AE), with an encoder at the UE and a decoder at the gNB. However, CNN performance heavily depends on the size of the receptive field (or convolutional kernel). To address this, CsiNet+ [ 3 ] enhances the original CsiNet by enlarging the receptive field, better exploiting CSI sparsity in the angular-delay domain, while small kernels capture fine details more effectively. Based on this, CRNet [ 4 ] introduces a multi-resolution design, using different kernel sizes in both the encoder and decoder, enabling more adaptive and effective CSI feedback. Nevertheless, they still perform poorly in outdoor scenarios with high compression ratios (CRs), a common issue for existing algorithms. To address this, CsiNet+DNN [ 5 ] introduces additional layers and incorporates a different activation function to acquire more knowledge to enhance the performance of the RefineNet. (a) UE side includes CNN-transformer based encoder, quantization, and entropy encoding (b) gNB side includes entropy decoder, dequantization, transformer-CNN based decoder Fig. 1: STQENet architecture for CSI feedback. “CONV” and “CONVT” denote convolutional and transposed convolutional layers, respectively. “STB” refers to a spatially separable attention transformer block. “CR Block” represents the multi-resolution CNN module from CRNet (see Fig. 2c .) While many deep learning-based CSI compression methods enhance performance through architectural modifications, the CSI matrix is often treated as an unstructured data, thus neglecting the spatial correlations between antennas induced by the propagation environment. The attention mechanisms offer a more adaptive solution by explicitly modeling these correlations, enabling the network to focus on the most informative features. Notably, Attention-CSINet [ 6 ] pioneered the integration of attention mechanism into CNN-based CSI compression by introducing a module that generates a vector to describe the importance of each feature map, leading to superior performance. A two-layer transformer model, TransNet [ 7 ] , demonstrated significant performance improvements but was ultimately deemed impractical due to its high computational complexity. To address this, CSIFormer [ 8 ] proposed a more efficient architecture employing locally grouped (windowed) self-attention, which lowered the computational burden, albeit with some reduction in performance. Furthermore, [ 9 ] addresses the generalizability challenge of CSI compression by introducing AiANet, an attention-infused autoencoder that captures both global and local spatial features through self-attention mechanisms. In practical systems, CSI is fed back as bitstreams. Directly transmitting 32-bit floating-point codewords from the encoder would incur excessive overhead. To reduce this, codewords are quantized before feedback [ 10 ] , using uniform or non-uniform schemes to balance compression and accuracy. In [ 11 ] , the authors propose a bit-level CSI feedback framework that compresses downlink CSI using an encoder, followed by non-uniform quantization to produce a discrete bitstream. To mitigate quantization noise, a quantizer-dequantizer pair is introduced, along with an offset neural network that reconstructs the compressed CSI before decoding. This approach improves feedback accuracy but involves a complex three-stage training process, including pre-training the autoencoder, training the offset network while freezing other parameters, and a final fine-tuning phase. [ 12 ] introduces a quantization module with bit allocation and propose a joint training method with an adaptive loss that balances quantization and reconstruction errors. Beyond quantization, entropy coding is an essential step for further reducing the bitrate by exploiting the statistical redundancy in quantized outputs. By assigning shorter codes to more probable symbols, entropy coding—such as Huffman or arithmetic coding—enables bit-level compression without information loss. While such frameworks mark a step toward practical CSI feedback, they typically treat quantization and entropy coding as separate post-processing steps, disconnected from the encoder-decoder training. This suboptimal separation can lead to performance degradation, as the encoder is not optimized to produce quantized representations that are both compact and entropy-efficient. [ 13 ] introduces a simple AE-based CSI compression framework incorporating an entropy bottleneck to optimize quantization, entropy coding, and reconstruction quality jointly. Although effective, our method surpasses theirs in terms of reconstruction accuracy at lower bit rates. To address these limitations, we propose an end-to-end CSI compression framework, Spatially separable Transformer with Quantization and Entropy encoding Network (STQENet), that combines attention-based encoding, quantization, and entropy modeling to reduce feedback overhead in massive MIMO systems. The attention module captures inter-antenna correlations via spatially informative features, while quantization produces low-bit codewords for efficient transmission. A learned entropy model guides the compression by estimating the bit cost and introducing an entropy loss during training, enabling compact and accurate CSI representations. The main difference between our work and the state-of-the-art lies in the joint integration of attention-based encoding, quantization, and entropy modeling within a single end-to-end trainable framework. Unlike AiANet [ 9 ] , which focuses solely on attention mechanisms for spatial feature extraction without addressing quantization or entropy efficiency, our method incorporates both, enabling practical low-bitrate feedback. Compared to [ 13 ] , which applies an entropy bottleneck to a standard autoencoder without attention modeling, our approach employs a spatially separable transformer to better capture antenna-domain correlations. Experiments show that our method achieves superior rate-distortion performance compared to state-of-the-art transformer-based approaches, with lower bitrate and complexity. The remainder of the paper is structured as follows. Section II introduces the system model. Section III describes the proposed architecture in detail. Section IV presents the

Read the complete text