FGGM: Formal Grey-box Gradient Method for Attacking DRL-based MU-MIMO Scheduler

Thanh Le 1 2 , Hai Duong 3 , Yusheng Ji 2 1 , ThanhVu Nguyen 3 and John C.S. Lui 4 · 2025

Read FGGM: Formal Grey-box Gradient Method for Attacking DRL-based MU-MIMO Scheduler by Thanh Le 1 2 , Hai Duong 3 , Yusheng Ji 2 1 , ThanhVu Nguyen 3 and John C.S. Lui 4 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-26075.txt.

Introduction

Thanh Le, Hai Duong, Yusheng Ji, ThanhVu Nguyen, and John C. S. Lui design an attack on a learning based scheduler for 5G wireless users. In MU-MIMO, a base station serves several users at once on the same channel to raise spectral efficiency, and it must pick a fair subset each time. That choice is hard, so deep reinforcement learning schedulers have been proposed, but they bring a security risk.

Adversarial users can feed unsanitized channel reports to degrade throughput for others. Prior attacks assumed the attackers know victim channel values exactly, which is unrealistic on the uplink. The new scheme exploits the observation normalizer inside the learned policy to bound victim data, then uses polytope domains, a formal bounding tool, to craft the attack.

Catalog record

CREATORThanh Le 1 2 , Hai Duong 3 , Yusheng Ji 2 1 , ThanhVu Nguyen 3 and John C.S. Lui 4
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-26075

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FGGM: Formal Grey-box Gradient Method for Attacking DRL-based MU-MIMO Scheduler Thanh Le 1 2 , Hai Duong 3 , Yusheng Ji 2 1 , ThanhVu Nguyen 3 and John C.S. Lui 4 Abstract In 5G mobile communication systems, multi-user multiple-input multiple-output (MU-MIMO) has been applied as a core technology to enhance spectral efficiency and support high data rates for accommodating multiple users. To fully exploit the spatial diversity and maximize spectral efficiency while providing fairness among users, the base station (BS) needs to selects a subset of users for data transmission. Given that this problem is NP-hard, deep reinforcement learning (DRL)-based methods have been proposed to infer the near-optimal solutions in real-time [ 1 ] . However, this approach has an “ intrinsic security problem ”. This paper investigates how a group of adversarial users can exploit unsanitized raw CSIs to launch a throughput degradation attack. We assume that the group of adversarial users have obtained the DRL policy. Most existing studies only focused on systems in which adversarial users can obtain the exact values of victims’ CSIs, but this is impractical in the case of uplink transmission in LTE/5G mobile systems. We note that the DRL policy contains an observation normalizer which has the mean and variance of the observation to improve training convergence. Adversarial users can then estimate the upper and lower bounds of the local observations including the CSIs of victims based solely on that observation normalizer. We develop an attacking scheme fggm by leveraging polytope abstract domains, a technique used to bound the outputs of a neural network given the input ranges. Our goal is to find one set of intentionally manipulated CSIs which can achieve the attacking goals for the whole range of local observations of victims. Experimental results demonstrate that FGGM can determine a set of adversarial CSI vector controlled by adversarial users, then reuse those CSIs throughout the simulation to reduce the network throughput of a victim up to 70% without knowing the exact value of victims’ local observations. This study serves as a case study and can be applied to many other DRL-based problems, such as a knapsack-oriented resource allocation problems. I Introduction Massive multiple-user multiple-input multiple-output (MU-MIMO) is a core technology that can greatly enhance the efficiency of current access networks by using numerous antennas at the base station [ 2 ] . This allows the base station to perform multi-user beamforming and to serve many user in the same time-frequency resource block. However, in dense environments where users are closely located, significant inter-user interference can occur. This issue can be mitigated by selecting only a group of users that contribute to the highest overall spectral efficiency and fairness [ 3 , 4 ] . Since channel state information (CSI) between users and base station change rapidly in mobile networks where users move frequently, as a result, base station must resolve the fair resource scheduling problem while maximizing spectral efficiency in real-time [ 5 , 6 ] . However, the fair scheduling problem can be reformulated as an integer linear programming (ILP) problem and is NP-hard [ 4 ] . The complexity of solving ILP makes it challenging to design optimal yet fast schedulers for next-generation access networks, especially with a large number of users and resource blocks. Recent studies applied deep reinforcement learning (DRL) to find near-optimal solutions for NP-hard problems such as travelling salesman problem (TSP) or knapsack problems [ 7 ] . In [ 1 ] , DRL -based MU-MIMO schedulers were trained and tested on realistic channel models and real-world channel measurements, and demonstrated a close performance to the optimal proportional fairness ( OptPF ) scheduler in terms of spectral efficiency and fairness. Especially, the DRL -based scheduler has a small computational complexity, so it can solve the problem in network scenarios where OptPF is computationally infeasible. Nevertheless, the MU-MIMO scheduler based on DRL introduces an “ intrinsic security problem ” as it utilizes the unsanitized CSI from users to make scheduling decisions. DRL is known to be susceptible to adversarial observations crafted by attackers to manipulate the decisions of DRL agents, which can significantly degrade the performance of a well-trained DRL policy [ 8 ] . Given that the reported CSI s form part of the inputs/observations for the DRL -based scheduling policy, a few adversarial users can falsify their CSI s to negatively influence user selection outcomes such as to degrade the throughput of normal users, e.g., victims. In this work, we investigate how to craft the most detrimental adversarial CSI s, which are determined by the trained DRL policy and the CSI s of victims. We propose a threat model in which adversaries know the trained DRL policy for white-box testing, as it can generate better adversarial examples compared to black-box testing. This represents the worst-case scenario that network operators need to prepare for. If the DRL -based scheduler can survive this scenario, it would have a better chance of being robust against attacks that are agnostic to DRL policies. Most prior works on attacking MU-MIMO resource allocation algorithms relied on precise knowledge of victims’ CSI , which adversarial users can capture by listening to the plain text CSI feedback to the base station [ 9 , 10 ] . This approach might be impractical for systems with uplink CSI reference signal, where the base station estimates CSI instead of relying on users feedback, or for systems with physical layer encryption of CSI feedback. On the other hand, our proposed threat model assumes that the adversaries work for all potential values within the normal ranges of victim observations including the victim CSI s. The total domain of the observation space is established by concatenating the adversarial users’ concrete observations with the lower and upper bounds of the victims’ observations. Our conceptual contribution is the grey-box threat model for DRL -based MU-MIMO scheduler, which incorporates both white-box ( DRL policy) and black-box testing elements (victims’ observations). We then propose the fggm to solve for the adversarial CSI under our grey-box threat model. FGGM leverages the polytope abstraction domain [ 11 ] , which is commonly used in deep neural network (DNN) verification [ 12 , 13 ] , to handle the observation intervals. FGGM subsequently propagates these observation boundaries through the hidden and output layers of the DRL policy to construct an objective function on the output bounds. Note that the upper bounds of the output determine the chance that base station select an user, i.e. the highest possible performance when base station selecting that user. We formulate the problem of finding adversarial CSI s such that the upper bounds for all outputs that allow victims to transmit data are minimized for all possible victim CSI s. Thus, this attack strategy provides “a single adversarial input” at the initiation of the attack, without the need of recalculating during the attack. Given that the abstract domain is differentiable, we solve this problem using stochastic gradient descent. To this end, this paper introduces a new and practical adversarial attack strategy for DRL -based massive MU-MIMO schedulers. The key contributions of this paper are: 1. Develop a grey-box threat model for DRL -based MU-MIMO schedulers, which encompasses the

Read the complete text