Multi-agent deep reinforcement learning for UAV-based 5G network slicing

Ghoshana Bista 1 , Abbas Bradai 2 , Emmanuel Moulay 1 , Abdulhalim Dandoush 3 · 2025

Read Multi-agent deep reinforcement learning for UAV-based 5G network slicing by Ghoshana Bista 1 , Abbas Bradai 2 , Emmanuel Moulay 1 , Abdulhalim Dandoush 3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03835.txt.

Introduction

Drones acting as flying base stations could fill coverage gaps in crowded cities and remote countryside alike. Ghoshana Bista and colleagues study how to run such a fleet in a 2025 systems preprint on 5G network slicing. Slicing lets one network serve premium, silver, and bronze users at different quality levels, and the drones must position themselves and share resources wisely.

Their framework trains several learning agents together but lets each act on its own, comparing three multi-agent algorithms head to head. MAPPO gave the best balance between service quality and energy use, especially where interference was heavy. MADDPG offered finer continuous control and slightly cleaner signals in open rural scenes, at higher energy cost. MADQN served as an efficient baseline for discrete choices. No algorithm won everywhere: the right pick depends on terrain, user density, and service demands.

Catalog record

CREATORGhoshana Bista 1 , Abbas Bradai 2 , Emmanuel Moulay 1 , Abdulhalim Dandoush 3
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-03835

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multi-agent deep reinforcement learning for UAV-based 5G network slicing Ghoshana Bista 1 , Abbas Bradai 2 , Emmanuel Moulay 1 , Abdulhalim Dandoush 3 Abstract The growing demand for robust and scalable wireless networks in the 5G-and-beyond era has led to the deployment of Unmanned Aerial Vehicles (UAVs) as mobile base stations to enhance coverage in dense urban and underserved rural environments. This paper presents a Multi-Agent Deep Reinforcement Learning (MADRL) framework that integrates Proximal Policy Optimization (MAPPO), Multi-Agent Deep Deterministic Policy Gradient (MADDPG), and Multi-Agent Deep Q-Networks (MADQN) to jointly optimize UAV positioning, resource allocation, Quality of Service (QoS), and energy efficiency through 5G network slicing. The framework adopts Centralized Training with Decentralized Execution (CTDE), enabling autonomous real-time decision-making while preserving global coordination. Users are prioritized into Premium ( A ) (A) , Silver ( B ) (B) , and Bronze ( C ) (C) slices with distinct QoS requirements. Experiments in realistic urban and rural scenarios show that MAPPO achieves the best overall QoS–energy tradeoff, especially in interference-rich environments; MADDPG offers more precise continuous control and can attain slightly higher SINR in open rural settings at the cost of increased energy usage; and MADQN provides a computationally efficient baseline for discretized action spaces. These findings demonstrate that no single MARL algorithm is universally dominant; instead, algorithm suitability depends on environmental topology, user density, and service requirements. The proposed framework highlights the potential of MARL-driven UAV systems to enhance scalability, reliability, and differentiated QoS delivery in next-generation wireless networks. I Introduction The rapid expansion of wireless communication networks, driven by the proliferation of Internet of Things (IoT) devices and 5G technology, has intensified the demand for flexible and adaptive wireless coverage. Traditional ground-based base stations often struggle in highly dynamic environments: urban regions suffer from dense user populations, severe interference, and frequent coverage holes, while rural areas lack sufficient infrastructure to guarantee reliable connectivity. These limitations underscore the need for agile and scalable solutions capable of delivering differentiated service across heterogeneous environments. Unmanned Aerial Vehicles (UAVs) have emerged as a promising complement to terrestrial infrastructure. Acting as mobile base stations, UAVs offer rapid deployment, enhanced maneuverability, and the ability to dynamically reposition to meet short-term coverage demands or disaster-induced outages [ 1 , 2 , 3 ] . However, ensuring high Quality of Service (QoS) with UAVs requires solving tightly coupled challenges related to mobility, interference, limited battery capacity, and fluctuating traffic loads. These challenges become even more prominent in future 5G-and-beyond architectures, where multi-service differentiation and stringent QoS guarantees must be provided simultaneously. To address these requirements, 5G network slicing allows physical resources to be partitioned into virtual slices with distinct QoS guarantees. In UAV-assisted networks, this capability is essential for serving heterogeneous users—Premium ( A ), Silver ( B ), and Bronze ( C )—each with unique latency, throughput, and SINR targets. Efficient UAV deployment therefore requires the joint optimization of slice-level QoS, UAV motion, energy use, and interference management [ 4 ] . Traditional optimization and control approaches struggle to meet these combined objectives due to the highly non-stationary and multi-agent nature of UAV networks. Reinforcement Learning (RL), and particularly Multi-Agent Reinforcement Learning (MARL), offers a compelling alternative due to its ability to learn adaptive policies in complex environments. While prior MARL studies have investigated UAV coverage, trajectory planning, or throughput optimization, they typically address a single metric and do not incorporate slice-based QoS differentiation or joint QoS–energy optimization. Contributions. In this work, we propose a unified Multi-Agent Deep Reinforcement Learning (MADRL) framework that integrates 5G network slicing with coordinated UAV control under a Centralized Training with Decentralized Execution (CTDE) paradigm. Our framework jointly optimizes latency, throughput, SINR, and energy consumption across user priority levels ( A/B/C ), addressing a multi-slice QoS problem that remains underexplored in UAV-assisted networks. Specifically: • We develop a CTDE-based MADRL architecture enabling UAVs to autonomously adapt movement, coverage, and resource allocation while respecting slice-specific QoS requirements. • We integrate three representative MADRL algorithms—MAPPO, MADDPG, and MADQN—chosen for their ability to handle continuous, mixed, and discrete action spaces, respectively. • We provide a comparative analysis of these algorithms in two contrasting environments (dense urban and sparse rural), highlighting how environmental structure affects MARL suitability rather than assuming a single universal solution. Findings. Our experiments reveal a clear scenario-dependent pattern. MAPPO achieves the best overall QoS–energy tradeoff, especially in interference-rich urban environments requiring coordinated continuous control. MADDPG provides smoother trajectories and can yield slightly higher SINR in open rural areas, but at the cost of higher energy consumption and variance. MADQN offers computational efficiency but underperforms in complex or highly dynamic environments due to its discretized action space. These results emphasize that algorithm selection must consider both environmental topology and QoS requirements rather than relying on a single MARL method. Paper organization. Section II reviews related work. Section III presents the system modeling and channel assumptions. Section IV formulates the UAV QoS–energy optimization problem. Section V details the MARL algorithms and training approach. Section VI-C evaluates their performance in urban and rural scenarios. Section VII concludes the paper. For implementation details, please refer to our code repository. 1 1 1 https://github.com/ghoshana/MARL_COMPARE . If you cannot access it, please contact the first author and I will provide access. II Bibliographical review UAVs are increasingly integral to modern communication networks, addressing scalability demands. DRL enables UAVs to autonomously optimize tasks such as path planning and resource allocation, significantly enhancing QoS [ 5 ] . Recent advances in DRL have demonstrated notable improvements in UAV trajectory planning and resource management, with research broadly categorized into UAV operations and QoS optimization. II-A DRL in UAV operations. The application of DRL in UAV operations has shifted network infrastructure management paradigms. For example, Shamsoshoara et al. propose in [ 6 ] an interference-aware path planning and power allocation mechanism for UAVs using inverse reinforcement learning. The approach, compared against Behavioral Cloning and other methods, demonstrates improved performance, though scalability in more complex networks requires further investigation. Jiang et al. employ in [ 7 ] a MARL framework to optimize UAV base station positions within Vehicular Ad-Hoc Networks (VANETs). While the framework reduces data transmission delays, challenges remain regarding real-time scalability in complex environments. Similarly, Kim et al. present in [ 8 ] a multi-agent DRL framework for enhancing energy management and network efficiency, but scalability in larger networks with more UAVs and users requires further study. DRL applications in Internet of Drones (IoD) networks tackle challenges such as navigation and channel allocation, but practical concerns like real-time decision-making and computational complexity are underexplored [ 9 ] . Tarekegn et al. demonstrate in [ 10 ] how DRL can optimize drone base station deployment for improved coverage, although multi-drone scenarios and energy demands remain areas for future research. Hammami et al. investigate in [ 11 ] MARL for managing drone-assisted cellular networks, focusing on deployment during peak demand periods, but larger network scalability remains unresolved. Warrier et al. use in [ 12 ] a DQL framework to mitigate air-ground interference in 5G-connected UAVs, though computational and latency challenges persist. Additionally, Ouamri et al. propose in [ 13 ] a DDPG-based solution to optimize energy efficiency and throughput in UAV-assisted

Read the complete text