Adversarial Robustness of Bottleneck Injected Deep Neural Networks for Task-Oriented Communication

Alireza Furutanpey, Pantelis A. Frangoudis, Patrik Szabo, Schahram Dustdar · 2024

Read Adversarial Robustness of Bottleneck Injected Deep Neural Networks for Task-Oriented Communication by Alireza Furutanpey, Pantelis A. Frangoudis, Patrik Szabo, Schahram Dustdar (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-10265.txt.

Introduction

Task-oriented communication sends only the bits a receiver needs for a job, often squeezed through a neural bottleneck. Alireza Furutanpey, Pantelis Frangoudis, Patrik Szabo, and Schahram Dustdar probe how safe that squeezing is against attack in this 2024 paper. Attackers who nudge the sent signal can try to wreck the task at the far end.

Tests across several data sets show bottleneck training gives some base resistance to attacks on the task itself. Depth mattered: a shallow bottleneck design proved weaker than a deep one, and the gap widened on harder tasks. The defense held up better against attacks that hit a few bright pixels hard than against attacks that touched many pixels lightly. Systems that rebuild content with generative models, the authors warn, open fresh attack surface.

Catalog record

CREATORAlireza Furutanpey, Pantelis A. Frangoudis, Patrik Szabo, Schahram Dustdar
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-10265

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Adversarial Robustness of Bottleneck Injected Deep Neural Networks for Task-Oriented Communication Alireza Furutanpey, Pantelis A. Frangoudis, Patrik Szabo, Schahram Dustdar Abstract This paper investigates the adversarial robustness of Deep Neural Networks (DNNs) using Information Bottleneck (IB) objectives for task-oriented communication systems. We empirically demonstrate that while IB-based approaches provide baseline resilience against attacks targeting downstream tasks, the reliance on generative models for task-oriented communication introduces new vulnerabilities. Through extensive experiments on several datasets, we analyze how bottleneck depth and task complexity influence adversarial robustness. Our key findings show that Shallow Variational Bottleneck Injection (SVBI) provides less adversarial robustness compared to Deep Variational Information Bottleneck (DVIB) approaches, with the gap widening for more complex tasks. Additionally, we reveal that IB-based objectives exhibit stronger robustness against attacks focusing on salient pixels with high intensity compared to those perturbing many pixels with lower intensity. Lastly, we demonstrate that task-oriented communication systems that rely on generative models to extract and recover salient information have an increased attack surface. The results highlight important security considerations for next-generation communication systems that leverage neural networks for goal-oriented compression. I Introduction Intelligent tasks refer to programs that classical control structures cannot compute tractably or with sufficient precisions, which is common in visual applications, such as image recognition. Deep Learning (DL) has repeatedly demonstrated that it can solve recognition tasks reliably. Unsurprisingly, applications with stringent performance criteria (e.g., remote sensing, video analytics) increasingly offload requests to a remotely deployed large Deep Neural Network (DNN). The pervasiveness of DNNs exposes significant vulnerabilities to adversarial attacks [ 1 ] . Another limitation is that continuous offloading of high-dimensional visual data must compete for limited bandwidth, which may lead to network congestion. Task-oriented communication [ 2 ] has emerged as a paradigm to meet the need for solving intelligent tasks. Compression for task-oriented communication uses a semantic rate-distortion objective to transmit only the most salient bits. Among the earliest examples is the information bottleneck [ 3 ] (IB), which is still the foundation of modern approaches. Notably, IB-based objectives improve adversarial robustness for DNN predictors [ 4 ] . The idea is that perturbations are intrinsically redundant information, and the IB objective naturally enhances the robustness of DNNs by learning to discard redundancy more aggressively along their information processing path [ 5 ] . However, the established consensus on the value of IB-based objectives is based on the assumption that the networks are deep . Yet, task-oriented communication is feasible only when paired with lightweight compression such that the codec computational overhead is offset by the reduced transmission costs [ 6 , 7 ] . Moreover, there are additional constraints on the encoder design. While a neural encoder may still be wide enough to leverage parallelization from onboard AI accelerators, meeting stringent latency requirements demands reducing the number of sequential operations. Hence, envisioned future communication networks that rely on neural encoding schemes will realistically converge towards shallow networks. To this end, this work investigates the robustness of methods that apply an IB-based objective intended for task-oriented communication. Specifically, we apply several common adversarial attacks on recent approaches based on Shallow Variational Bottleneck Injection (SVBI) [ 8 , 9 , 10 , 11 , 12 ] ). SVBI focuses on information necessary only for practically relevant tasks by targeting the shallow representation of foundational models as a reconstruction target in the rate-distortion objective. Our results show that deep networks trained with a traditional IB objective exhibit higher adversarial robustness than SVBI. However, a shallow variational encoder still provides a defense mechanism that results in considerably more robust models than purely discriminative models trained with non-IB objectives. We finalize our experiments by accentuating the increased attack surface of systems that rely on generative models for communicating salient information with a simple attack specifically targeting generative models. In other words, the overall system is more vulnerable even if task-oriented communication is intrinsically more robust than passing messages through conventional channels for downstream tasks. We summarize our contributions as follows: • Empirically demonstrating that task-oriented communication systems have an increased attack surface. • Showing that adversarial robustness for task-oriented communication systems requires a study distinct from general research on security for DNNs. • Determining the role of bottleneck depth for adversarial robustness with IB-based objectives. We hope our results and insights can facilitate research in securing next-generation communication systems that rely on otherwise easily exploitable neural networks. II Background & Related Work II-A Adversarial Attacks on DNNs Adversarial attacks represent a significant challenge for deploying AI systems. The susceptibility of DNNs to adversarial examples was first investigated by Szegedy et al. [ 13 ] , who demonstrated that small, imperceptible perturbations to input data can lead to significant misclassifications. Adversarial attacks are classified into white-box and black-box attacks. White-box attacks assume complete model knowledge, including architecture and gradient calculation, allowing for computing highly effective adversarial samples. In contrast, black-box attacks assume no access to model details and are generally more challenging but more realistic for real-world scenarios. The following briefly describes the attacks we have chosen due to their influence and being subject to numerous follow-up studies. The focus is on white-box attacks due to the open nature of ML research and the popularity of readily available open-source weights for a wide range of tasks. II-A 1 Fast Gradient Sign Method (FGSM) FGSM by Goodfellow et al. [ 14 ] efficiently generates adversarial examples by leveraging the gradient of the loss function. FGSM adjusts the input along the gradient’s direction, with the perturbation defined as: x_{adv}=x+\epsilon\cdot\operatorname{sign}\left(\nabla_{x}J(x,y)\right) (1) where x is the input, \epsilon controls perturbation magnitude, and \nabla_{x}J(x,y) is the gradient of the loss concerning the input. II-A 2 Carlini and Wagner (C & W) The attack by Carlini and Wagner [ 15 ] minimizes the L_{2} , L_{0} , or L_{\infty} distance between the original input and the adversarial example, and a term that penalizes classifications other than the desired target class using the objective function: J(x^{\prime})=\alpha\cdot||x-x^{\prime}||_{p}+\beta\cdot\mathcal{L}_{\text{mcls}}(f(x^{\prime}),y_{t}) (2) where x^{\prime} is the perturbed input, \alpha,\beta balance the terms, and \mathcal{L}_{\text{mcls}} is the missclassification loss. Notably, this attack is shown to be highly effective against networks pre-trained on ImageNet, which are commonly used to finetune by practical recognition tasks. II-A 3 Elastic-Net Attacks on DNNs (EAD) This method [ 16 ] is particularly useful for producing sparse perturbations, which can trick DNNs while maintaining minimal changes to the input. It generates adversarial samples by minimizing the objective c\cdot f(\mathbf{x},t)+\beta\left\|\mathbf{x}-\mathbf{x}_{0}\right\|_{1}+\left\|\mathbf{x}-\mathbf{x}_{0}\right\|_{2}^{2} (3) where f(x,t) is a target loss function and c,\beta\geq 0 are the regularization parameters. EAD’s dual-norm optimization is an interesting alternative benchmark for evaluating how variational bottleneck injection handles diverse attack strategies. II-A 4 Jacobian-based Saliency Map Attack (JSMA) The JSMA attack by Papernot et al. [ 17 ] constructs adversarial examples by identifying and perturbing input features most critical to the classifier’s decision-making process. Unlike gradient-based methods, JSMA uses forward derivatives to create a saliency map, guiding perturbations to specific input features. Given that variational bottleneck techniques may alter feature representations, testing JSMA will allow us to explore how bottleneck injection influences feature saliency and adversarial resilience. II-A 5 Targeting Generative Models Lastly, we include the attack introduced by Tabacof et al. [ 18 ]

Read the complete text