Goal-oriented Communications based on Recursive Early Exit Neural Networks

Alessio Devoto 1 3 , Mateus Pontes Mota 6 , Paolo Di Lorenzo 2 3 and Simone Scardapane 2 3 · 2024

Read Goal-oriented Communications based on Recursive Early Exit Neural Networks by Alessio Devoto 1 3 , Mateus Pontes Mota 6 , Paolo Di Lorenzo 2 3 and Simone Scardapane 2 3 (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-19587.txt.

Introduction

Jary Pomponi, Mattia Merluzzi, Alessio Devoto, and colleagues design phone-style networks that answer easy questions early and ship hard ones to a server. Their goal-oriented framework rests on recursive early exit neural networks. A sample climbs the layers, and when its confidence stalls, the rest of the work is offloaded. A reinforcement learning controller picks exit points and split points live.

The controller weighs wireless conditions, accuracy, and resource cost together. Edge inference tests showed a strong balance of performance, latency, and efficiency. The work sits inside the 6G-GOALS research program on semantic communications.

Catalog record

CREATORAlessio Devoto 1 3 , Mateus Pontes Mota 6 , Paolo Di Lorenzo 2 3 and Simone Scardapane 2 3
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-19587

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Goal-oriented Communications based on Recursive Early Exit Neural Networks Thanks: This work has been supported by the SNS JU project 6G-GOALS under the EU’s Horizon program Grant Agreement No 101139232, by Sapienza grant RG123188B3EF6A80 (CENTS), by European Union under the Italian National Recovery and Resilience Plan of NextGenerationEU, partnership on Telecommunications of the Future (PE00000001 - program RESTART), and by the ANR under the France 2030 program, grant ”NF-NAI: ANR-22-PEFT-0003”. Alessio Devoto 1 3 , Mateus Pontes Mota 6 , Paolo Di Lorenzo 2 3 and Simone Scardapane 2 3 Abstract This paper presents a novel framework for goal-oriented semantic communications leveraging recursive early exit models. The proposed approach is built on two key components. First, we introduce an innovative early exit strategy that dynamically partitions computations, enabling samples to be offloaded to a server based on layer-wise recursive prediction dynamics that detect samples for which the confidence is not increasing fast enough over layers. Second, we develop a Reinforcement Learning-based online optimization framework that jointly determines early exit points, computation splitting, and offloading strategies, while accounting for wireless conditions, inference accuracy, and resource costs. Numerical evaluations in an edge inference scenario demonstrate the method’s adaptability and effectiveness in striking an excellent trade-off between performance, latency, and resource efficiency. Jary Pomponi 2 3 § , Mattia Merluzzi 6 § , § § footnotetext: Equal contribution I Introduction Recent years have witnessed a surge of interest in goal-oriented semantic communications [ 1 ] , which transcend traditional bit-centric metrics commonly employed in system design and optimization, emphasizing the recovery of the meaning encoded within the transmitted bits and/or ensuring the effective completion of the tasks that drive the information exchange. A fundamental enabler of this research direction is artificial intelligence (AI) and, specifically, deep learning (DL) models that can extract from data only the features that are strictly relevant and must be communicated [ 1 , 2 ] . However, current state-of-the-art DL models demand substantial memory, energy, and computation [ 3 ] , making them unsuitable for communication systems without tailored design. Their requirements often clash with the device-server paradigm, where devices have limited computational and energy resources, preventing full execution on-device. Offloading computations to the cloud or edge servers, while feasible, introduces challenges such as increased end-to-end latency, potential privacy risks from transmitting raw data, and susceptibility to noise and errors in communication channels [ 4 , 5 ] . A hybrid approach can address the aforementioned limitations by determining the optimal strategy for offloading data from the device to the server. This decision is strongly influenced by the dynamic availability of computational resources on the device and at (edge) servers, as well as by the varying conditions of the wireless channel. Such an interplay between communication and computation is a hallmark of next-generation wireless networks, which serve as key enablers and potentially efficient platforms for delivering and accessing Artificial Intelligence (AI) as a service [ 6 ] . The final objective is to find the partition that best balances end-to-end (loop [ 7 ] ) latency, communication and computation costs, while guaranteeing a minimum target level of performance. However, fixing the partitioning point a priori is sub-optimal due to the changing nature of the whole system. A better solution would be to learn and adapt the splitting point over time [ 8 , 9 ] . In this context, early exiting is a powerful technique to avoid computing across the whole DL model for all input data, by retrieving the result after an intermediate layer of the neural network [ 10 ] . Several early exit (EE) points can be placed across a DL model in order to gain degrees of freedom in optimizing splitting point and EE in a dynamic goal-oriented fashion, based on time-varying resource availability and wireless channel quality. Such architectures must be designed by taking into account the communication burden of transmitting intermediate results for further processing at a selected edge server, and to reduce the payload size as much as possible, without over-sacrificing performance. From a communication perspective, the optimization of the splitting/early exit choice, depending on inference performance target and communication costs (e.g., energy consumption and bandwidth usage), has been shown to be the best solution [ 11 , 12 , 13 ] . The aim of this paper is twofold: (i) we propose a novel early exit approach that not only halts samples that can be solved locally on the device, but also implements a dynamic partition approach in which samples can be sent to the server model at any step of the device-side computation, using a criterion based on how fast the prediction changes from one layer to another; (ii) we introduce an online optimization that dynamically decides early exit, splitting point, and offloading strategy, considering wireless channel conditions, inference performance, and communication/computation costs. Differently from the existing literature [ 11 , 12 , 13 ] , the online optimization is based on a Reinforcement Learning procedure that takes into consideration communication, computation, and learning aspects in a joint manner. Also, the proposed early exit model is specifically designed for the considered goal-oriented communication setup. Numerical results illustrate the performance of the proposed approach in an edge inference scenario, and its flexibility in balancing inference performance, delay, communication and computation costs. II Recursive Early Exit Neural Networks A generic neural network for classification can be represented as a composition of b sequential blocks followed by a classification layer c_{b} : f_{b}(x)=c_{b}\circ\mathrm{l}_{b}\circ\mathrm{l}_{b-1}\circ\cdots\circ\mathrm{l}_{1}(x), (1) where x is the input data, \mathrm{l}_{i} represents the mapping of the i -th layer, and c_{b} is the final classification layer. In the context of EE models, the goal is to enable the model to classify samples at intermediate layers i<b . To achieve this, auxiliary classifiers are attached and trained at specific inner layers, in addition to the final classifier c_{b} . Let the set of indices of hidden layers with attached exits be \mathcal{I} , where i\in\mathcal{I} and i<b . The i -th exit is defined as: f_{i}(x)=c_{i}\circ\mathrm{l}_{i}\circ\mathrm{l}_{i-1}\circ\cdots\circ\mathrm{l}_{1}(x), (2) where c_{i} is the classifier attached to the i -th layer. Each c_{i} consists of a combination of a convolutional module and a linear layer and can be decomposed as c_{i}(x)=p_{i}\circ e_{i}(x) . Here, e_{i} processes the inner activations of the model, and p_{i} maps the processed features to the output prediction vector. The simplest approach to train the neural network model in ( 1 )-( 2 ) is to jointly optimize all classifiers by minimizing a weighted sum of their individual loss functions, see, e.g., [ 10 ] . Recursive Architecture. Similarly to [ 14 , 15 ] , we structure our model as a recursive one, in which the predictions at a given exit are created by recursively combining all the predictions up to the current point. Specifically, our model gives a probability for each class independently, so that f_{i}^{j}(x)\in[0,1] , with j\in\mathcal{C} , and \mathcal{C} being the set of classes. To build such predictions recursively, at a generic early exit layer i , we combine the intermediate output of it, e_{i}(x) , with the previous prediction f_{i-1}(x) to create the vector of the current predictions f_{i}(x)=c_{i}(f_{i-1}(x),e_{i}(x)) , where c_{i}(\cdot) is a classification function

Read the complete text