Handover and SINR-Aware Path Optimization in 5G-UAV mmWave Communication using DRL
Achilles Kiwanuka Machumilane, Alberto Gotta, Pietro Cassará · 2025
Read Handover and SINR-Aware Path Optimization in 5G-UAV mmWave Communication using DRL by Achilles Kiwanuka Machumilane, Alberto Gotta, Pietro Cassará (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-02688.txt.
Introduction
Achilles Kiwanuka Machumilane, Alberto Gotta, and Pietro Cassará propose, in twenty twenty-five, a deep learning method to plan drone paths in 5G millimeter-wave networks. Drones that relay or use 5G need paths that keep connectivity in dense cities, where towers and street canyons block signals. Classic statistical planning cannot adapt to fast-changing channels, handovers between base stations, and interference. Their framework uses actor-critic deep reinforcement learning, where an agent learns by trial and reward, with no prior model.
The agent seeks the shortest flight time to a target with fewest handovers, while keeping the signal quality metric, SINR, as high as possible. Training data came from a ray tracing tool that models signal paths in three-dimensional city scenes.
Catalog record
| CREATOR | Achilles Kiwanuka Machumilane, Alberto Gotta, Pietro Cassará |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-02688
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Handover and SINR-Aware Path Optimization in 5G-UAV mmWave Communication using DRL Thanks: Work supported by the European Union under the Italian National Recovery and Resilience Plan (PNRR) PE00000001 - program ”RESTART” and by the HORIZON-CL4-2021-SPACE-01 project ”5G+ evoluTion to mutioRbitAl multibaNd neTwORks” (TRANTOR) No. 101081983 Achilles Kiwanuka Machumilane, Alberto Gotta, Pietro Cassará Abstract Path planning and optimization for unmanned aerial vehicles (UAVs)-assisted next-generation wireless networks is critical for mobility management and ensuring UAV safety and ubiquitous connectivity, especially in dense urban environments with street canyons and tall buildings. Traditional statistical and model-based techniques have been successfully used for path optimization in communication networks. However, when dynamic channel propagation characteristics such as line-of-sight (LOS), interference, handover, and signal-to-interference and noise ratio (SINR) are included in path optimization, statistical and model-based path planning solutions become obsolete since they cannot adapt to the dynamic and time-varying wireless channels, especially in the mmWave bands. In this paper, we propose a novel model-free actor-critic deep reinforcement learning (AC-DRL) framework for path optimization in UAV-assisted 5G mmWave wireless networks, which combines four important aspects of UAV communication: flight time, handover, connectivity and SINR . We train an AC-RL agent that enables a UAV connected to a gNB to determine the optimal path to a desired destination in the shortest possible time with minimal gNB handover, while maintaining connectivity and the highest possible SINR. We train our model with data from a powerful ray tracing tool called Wireless InSite, which uses 3D images of the propagation environment and provides data that closely resembles the real propagation environment. The simulation results show that our system has superior performance in tracking high SINR compared to other selected RL algorithms. I Introduction In recent years, interest in unmanned aerial vehicles (UAVs) has increased significantly, with applications in military operations, transportation, reconnaissance, search and rescue missions, environmental monitoring, photography and telecommunications [ 1 ] . The attractiveness of UAVs lies in their lightweight design, cost efficiency in production and operation and the ability to navigate difficult flight spaces. In non-payload mode, UAVs are used to exchange critical safety information with remote controllers, while in payload communication, UAVs are used to transmit data such as aerial imagery and high-speed video to and from various ground devices [ 1 , 2 , 3 , 4 ] . Therefore, ensuring seamless and secure UAV operations as well as reliable and efficient communication between the UAV and its control unit or application server is of utmost importance. In its Release 15 [ 5 ] , the 3rd Generation Partnership Project (3GPP) has confirmed the feasibility of supporting UAVs with terrestrial Long-Term Evolution (LTE) and New Radio (NR). UAVs can either act as users in the air accessing the cellular network from the sky, which is referred to as cellular-connected UAV communication , or be used as airborne base stations (BS) or relay units, which is referred to as UAV-assisted cellular communication [ 6 ] . Despite their great potential and capabilities, UAVs pose a number of challenges for terrestrial cellular systems, as both LTE and NR were originally developed for terrestrial users only. For example, the high interference resulting from the variations in LOS probability leads to a lower SINR for airborne user equipment (UEs) compared to their terrestrial counterparts [ 6 ] . Moreover, the high mobility of UAVs often results in more frequent handovers and handover failures, as well as fluctuating wireless backhaul links between UAVs and ground base stations or users, leading to practical difficulties in ultra-reliable low-latency communication (URLLC) scenarios [ 7 ] . Although the NR with multiple-input-multiple-output (MIMO) and beamforming [ 1 ] can provide better performance, further improvements in mobility management are needed as the NR was not originally designed for aerial users. One of the solutions proposed by 3GPP [ 5 ] is the efficient planning and optimization of the UAV flight path, as this can improve LOS availability, minimize interference and handovers, and ensure reliable connectivity. Conventional optimization algorithms focus primarily on minimizing flight duration. However, with the stringent quality of service (QoS) requirements envisaged in the upcoming sixth generation (6G) [ 8 ] networks, a UAV must take a route regardless of whether it is the most direct or the shortest route. 3GPP provides that the network can request a terminal to periodically send its path information, which includes a set of location points and associated timestamps that the network can use to predict the sequence of cells that the terminal can visit and the arrival time of the UAV in the network coverage [ 9 ] . However, such a priori flight planning is only possible if physical features such as buildings and hills are taken into account, as these are static. In such cases, path optimization can be performed using statistical or model-based path optimization methods [ 10 ] . However, if dynamic wireless channel characteristics such as bandwidth, delay, congestion, loss and SINR are to be considered, advanced path optimization methods that can account for the dynamic nature of propagation channels are required. Artificial intelligence (AI)/machine learning (ML) techniques, especially RL, have shown great potential for path optimization in dynamic and time-varying environments as they can adapt to the rapidly changing channel conditions in real time [ 11 , 12 ] . In this work, we propose an AC-DRL-based UAV path optimization scheme in UAV-assisted 5G mmWave communication networks that jointly optimizes time, handover, and SINR (connectivity) . We train an RL agent that helps a UAV connected to a gNB to determine the optimal path to a desired destination in the shortest possible time with minimal gNB handover, while maintaining connectivity and the highest possible SINR. We train our AC-DRL model with channel data obtained using a very powerful ray tracing tool called Wireless InSite [ 13 ] . This tool takes as input the 3D image of the investigated area and simulates the propagation where the signal interacts with the surrounding geometry, including reflections and diffraction, as it would be the case in the real world. The result is that the obtained channel data is very close to the real data and ensures an accurate and reliable model for path optimization. More details about this tool can be found in Section V. Our main contributions can be outlined as follows: 1. We present a learning-based framework for UAV trajectory optimization in 5G-UAV communication that jointly optimizes flight time, handovers, and SINR, which have not been combined into a single model in previous studies. 2. Unlike other studies, we train our AC-DRL model with channel data obtained using a ray tracing tool called Wireless InSite with is very powerful in providing channel data that is very close to the actual data ensuring an accurate and efficient path optimization model. 3. We use a model-free AC-DRL algorithm that does not require any prior information about the propagation environment making our model suitable for real-time path optimization in a time-varying UAV propagation environment. II Related Work Several research works have been proposed that use RL-based methods for UAV path optimization. In [ 14 ] , a Q-learning framework is proposed for optimizing the trajectory of a UAV serving ground users and the gNB