Over-the-Air Inference over Multi-hop MIMO Networks

Chenghong Bian, Meng Hua, Deniz Gündüz · 2025

Read Over-the-Air Inference over Multi-hop MIMO Networks by Chenghong Bian, Meng Hua, Deniz Gündüz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00430.txt.

Introduction

Chenghong Bian, Meng Hua, and Deniz Gunduz propose over-the-air inference across multi-hop MIMO networks. Their 2025 arXiv paper runs neural network layers through wireless channels. Fully connected layers are imitated by careful radio precoding design. Each terminal's antennas match the neuron count of its layer. A custom network, PrototypeNet, anchors the scheme.

Training uses a loss that joins classification error with signal power. Noise is injected during training to harden the model. Precoding matrices for each hop come from an optimization step. A multi-block version handles cases with few antennas. Tests reached solid classification accuracy under power limits. More hops raised accuracy at modest signal-to-noise levels. The work merges communication and computation in one physical pass.

Catalog record

CREATORChenghong Bian, Meng Hua, Deniz Gündüz
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-00430

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Over-the-Air Inference over Multi-hop MIMO Networks Chenghong Bian, Meng Hua, Deniz Gündüz Abstract A novel over-the-air machine learning framework over multi-hop multiple-input and multiple-output (MIMO) networks is proposed. The core idea is to imitate fully connected (FC) neural network layers using multiple MIMO channels by carefully designing the precoding matrices at the transmitting nodes. A neural network dubbed PrototypeNet is employed consisting of multiple FC layers, with the number of neurons of each layer equal to the number of antennas of the corresponding terminal. To achieve satisfactory performance, we train PrototypeNet based on a customized loss function consisting of classification error and the power of latent vectors to satisfy transmit power constraints, with noise injection during training. Precoding matrices for each hop are then obtained by solving an optimization problem. We also propose a multiple-block extension when the number of antennas is limited. Numerical results verify that the proposed over-the-air transmission scheme can achieve satisfactory classification accuracy under a power constraint. The results also show that higher classification accuracy can be achieved with an increasing number of hops at a modest signal-to-noise ratio (SNR). I Introduction There has been a growing trend toward the integration of computation and wireless communications to enhance the performance of future Internet of Things (IoT) networks [ 1 , 2 ] . Instead of traditional digital schemes where the computation and communication are separated, over-the-air computation (OAC) enables integrated communication and computation using analog transmissions [ 3 , 4 , 5 , 6 ] . A key advantage of the OAC scheme is to shift the computation burden to the wireless domain by leveraging the propagation principle of the wireless signals. For instance, linear operations such as summations and polynomials can be carried out by exploring the signal-superposition property of the wireless medium, which have been widely applied in federated learning [ 3 , 4 ] . Recently, edge learning [ 1 ] has been widely studied, where the nodes participate in a machine learning task and communicate with each other via wireless links. To facilitate this, the concept of over-the-air neural networks (NNs) is proposed, where the output of the wireless channel is treated as the NN output [ 7 , 8 , 9 ] . For example, the authors in [ 7 ] constructed a convolutional neural network for a modulation classification problem by leveraging the ambient wireless propagation environment through a reconfigurable intelligent surface. Inspired by the similarity in the input-output relation between a multiple-input and multiple-output (MIMO) channel with a precoding matrix and a fully connected (FC) layer, the authors in [ 8 ] and [ 9 ] developed OAC schemes for efficient deep learning algorithms over wireless networks. To be specific, in [ 8 ] , an OAC FC layer was constructed under the scenario where multiple synchronized users precode their messages and deliver them to the destination node, which forms a multiple input single output (MISO) system. System-level validation was conducted and a 92\% classification accuracy was achieved when evaluated on the MNIST dataset. However, its performance is limited by the single antenna at the receiver. A more complicated OAC FC layer based on the MIMO channel was considered in [ 9 ] for split learning, where the FC layer is constructed using the precoding and combining matrices at the transceiver. The gradients were back-propagated via the MIMO channel to update the precoding matrix leading to extensive computational overhead, which is not suitable for low-complexity edge devices. Moreover, these works focus on single-hop scenarios. Figure 1 : The flowchart of the multi-hop MIMO network and the PrototypeNet. We consider a N -hop MIMO network and it is equivalent to the PrototypeNet with (N+1) FC layers (including the one at the destination node). The second loss function, \mathcal{L}_{2} , defined in ( 9 ) is used to train the PrototypeNet. To fill this gap, this paper studies OAC machine learning over multi-hop MIMO networks. A multi-hop MIMO network resembles a complex-valued neural network with multiple FC layers. We first design a novel PrototypeNet consisting of multiple FC layers, power normalization, and non-linear activation functions, which is trained in an end-to-end fashion using a customized loss function, a combination of the classification error and the power of the latent vectors. After obtaining the weights of PrototypeNet as well as the channel state information (CSI), the precoding matrix for each hop is obtained by solving an optimization problem, where the goal is to approximate the PrototypeNet operations over-the-air as accurately as possible. This differs from [ 9 ] , where the precoding and combining matrices are trained along with the neural network weights. Numerical experiments show that the proposed OAC scheme can achieve satisfactory classification accuracy under a power constraint. The results also show that a larger number of hops leads to a higher classification accuracy even at a modest SNR value. While this method is successful in deploying NNs over-the-air, the width of the NN is limited by the number of antennas at the transmitters. To overcome this limitations, we propose transmission of multiple channel symbols per input sample over time. In the proposed scheme, a large-dimensional input is partitioned into several low-dimensional components, each of which is precoded by a different precoding matrix. In this paper, we show that adopting multiple symbol transmissions can significantly improve the classification performance by allowing the deployment of a wider NN using a limited number of antennas. II System Model We consider an image classification problem over a multi-hop MIMO network, but the results can be applied to other tasks carried out by NNs. An image, denoted by {\bf{S}}\in\mathbb{R}^{C\times H\times W} , where C , H and W represent the number of channels, the height, and the width of the image, respectively is available at the source node ( \mathrm{S} ). Each image \mathbf{S} belongs to a certain class, which can be represented via a one-hot vector \bm{c}\in\mathbb{R}^{K} , where K is the total number of classes. Destination node ( \mathrm{D} ) would like to detect the class of the image. However, \mathrm{D} does not have access to the image, and is connected to \mathrm{S} only through (N-1) relay nodes denoted by \{\mathrm{R}_{1},\ldots,\mathrm{R}_{N-1}\} . The source, destination, and relay nodes are all equipped with multiple antennas. We further assume that the CSI of each hop is available at the transmitter. The flowchart of the OAC multi-hop MIMO network is shown in Fig. 1 and is detailed as follows. The source node transforms the input image \mathbf{S} into a complex-valued vector denoted by \bm{s}_{1}^{\prime}\in\mathbb{C}^{M_{1}} via a function g(\cdot) which can be realized by 2D average pooling operation, where M_{1} denotes the number of antennas at the source node. It is worth mentioning that we denote the number of antennas at the i -th relay node and the destination node by M_{i+1},i\in[1,N-1] and M_{N+1} , respectively. Then, we apply power normalization (PN) to the complex vector \bm{s}_{1}^{\prime} to obtain \bm{s}_{1} , expressed as: \bm{s}_{1}=(\bm{s}_{1}^{\prime}-\mu_{1})/v_{1}, (1) where \mu_{1} and v_{1} denote the mean and variance of \bm{s}_{1}^{\prime} , respectively, which are recorded during training. The PN module ensures that \mathbb{E}\left[||\bm{s}_{1}||^{2}_{2}\right]\leq M_{1} . The source node \mathrm{S} adopts a precoding matrix \mathbf{F}_{1}\in\mathbb{C}^{M_{1}\times M_{1}} , and the transmitted signal,

Read the complete text