DQN–Based Joint UAV Trajectory and Association Planning in NTN-Assisted Networks
Afsoon Alidadi Shamsabadi, Cosmas Mwaba, Thomas Nugent, Jie Gao, Pablo Madoery · 2026
Read DQN–Based Joint UAV Trajectory and Association Planning in NTN-Assisted Networks by Afsoon Alidadi Shamsabadi, Cosmas Mwaba, Thomas Nugent, Jie Gao, Pablo Madoery (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22127.txt.
Introduction
Shamsabadi and co-authors plan drone flights and network links together in a satellite-assisted system. Advanced air mobility needs steady links between drones and control centers. Ground networks leave gaps and force frequent handovers. The team pairs ground networks with a geostationary satellite layer. Their deep Q-network algorithm plans each drone's path and network association jointly. The goals are lower energy use, fewer handovers, and less time disconnected. Simulations support the design inside the combined satellite-ground framework.
Catalog record
| CREATOR | Afsoon Alidadi Shamsabadi, Cosmas Mwaba, Thomas Nugent, Jie Gao, Pablo Madoery |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27664 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.22127
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DQN–Based Joint UAV Trajectory and Association Planning in NTN-Assisted Networks Thanks: Afsoon Alidadi Shamsabadi, Cosmas Mwaba, Jie Gao, Pablo Madoery, and Halim Yanikomeroglu are with Carleton University, Ottawa, Canada. Thomas Nugent and Subhadeep Pal are with Honeywell, Ottawa, Canada. Corresponding author Email: {[email protected].} Afsoon Alidadi Shamsabadi, Cosmas Mwaba, Thomas Nugent, Jie Gao, Pablo Madoery Abstract Advanced Air Mobility (AAM) has emerged as a key pillar of next-generation transportation systems, encompassing a wide range of uncrewed aerial vehicle (UAV) applications. To enable AAM, maintaining reliable and efficient communication links between UAVs and control centers is essential. At the same time, the highly dynamic nature of wireless networks, combined with the limited on-board energy of UAVs, makes efficient trajectory planning and network association crucial. Existing terrestrial networks often fail to provide ubiquitous coverage due to frequent handovers and coverage gaps. To address these challenges, geostationary Earth orbit (GEO) satellites offer a promising complementary solution for extending UAV connectivity beyond terrestrial boundaries. This work proposes an integrated GEO–terrestrial network architecture to ensure seamless UAV connectivity. Leveraging artificial intelligence (AI), a deep Q-network (DQN)–based algorithm is developed for joint UAV trajectory and association planning (JUTAP), aiming to minimize energy consumption, handover frequency, and disconnectivity. Simulation results validate the effectiveness of the proposed algorithm within the integrated GEO–terrestrial framework. I Introduction Advanced air mobility (AAM) represents an emerging paradigm in next-generation air transportation systems, focusing on the safe, efficient, and sustainable movement of people, goods, and services through low-altitude airspace. From passenger air taxis connecting urban centers to uncrewed aerial vehicles (UAVs) conducting cargo delivery, surveillance, and emergency response missions, AAM complements traditional ground-based transportation networks that continue to face growing challenges such as congestion and limited infrastructure capacity [ 6 ] . The reliable operation of UAVs to facilitate AAM depends on stable communication links between them and their control centers for command and control signal transmission especially in beyond visual line-of-sight (LoS) operations. To this end, the UAVs can get associated to terrestrial macro base stations (MBSs) which offer multi-point connections for reliability, fast data transfer and allow for long operational distances [ 15 ] . However, MBSs typically have their antennas down-tilted to provide coverage to ground users, resulting in a weak received signal power [ 5 , 4 ] . Additionally, deploying MBSs in rural and remote areas may be impractical or expensive, leading to coverage gaps and thus limiting UAV operation in such areas. In such situations, non-terrestrial networks (NTN), including the space satellites, can complement terrestrial MBSs in supporting UAV connectivity [ 8 ] . Satellites provide wider geographic coverage over rural and remote regions with few or no MBSs, and supplement coverage and capacity in densely populated urban areas with congested MBSs. By connecting to satellites, UAVs benefit from favorable LoS conditions and enhanced reliability, ensuring consistent communication even in areas beyond terrestrial network coverage. However, UAV operation requires not only a reliable communication link but also demands energy-aware trajectory design, given the UAV’s limited on-board energy [ 12 ] . Moreover, since UAVs may need to switch between terrestrial and satellite links or among MBSs, minimizing the number of handovers is essential to prevent the ping-pong effect and associated link degradation [ 13 ] . Therefore, efficient trajectory and association planning algorithms should aim to minimize handovers along the UAV’s trajectory [ 3 ] . Artificial intelligence (AI)–driven algorithms, particularly reinforcement learning, have been extensively utilized to address UAV trajectory planning optimization problem. In this context, the authors in [ 14 ] and [ 7 ] employ deep reinforcement learning (DRL) to enhance UAV communication and control, focusing on objectives such as maximizing energy efficiency and enabling rapid policy adaptation in dynamic environments. The authors in [ 3 ] investigate cargo-delivery applications and apply a Q-learning algorithm to jointly design UAV trajectory and cell association in a standalone terrestrial network. In [ 11 ] , multi-agent DRL was employed for trajectory planning of multiple UAVs to maximize ground-user throughput, while the authors in [ 2 ] proposed a hybrid graph-neural-network–Q-learning framework to optimize UAV trajectories and satellite link selection for improved user coverage. This paper investigates an integrated geostationary Earth orbit (GEO) satellite–terrestrial network in which an UAV flies between two designated points. At any given time, the UAV can associate with either the GEO satellite or one of the terrestrial MBSs. Accordingly, a joint UAV trajectory and association planning (JUTAP) problem is formulated to minimize the UAV’s energy consumption, handover, and disconnectivity. To address this problem, a deep Q-network (DQN)–based algorithm is proposed, where the UAV learns optimal trajectory and association policies through interactions with a known environment model. The performance of the proposed DQN framework is then evaluated through simulations under near-realistic satellite and terrestrial channel conditions. The remainder of this paper is structured as follows. Section II presents the system model and formulates the problem. Section III presents the proposed DQN algorithm, and Section IV validates the performance of the proposed algorithm. Finally, Section V concludes our paper. II System Model and Problem Formulation We consider a geographical region of size A\times A , covered by N_{B} tri-sector multi-antenna MBSs and a single GEO high-throughput satellite that remains stationary relative to the Earth, as illustrated in Fig. 1 (a). The UAV is served by either the GEO satellite or one of the MBSs at any given time, depending on the link quality. The GEO satellite is serving the users on the ground and the aerial users using N fixed beams, each covering multiple users in a time division multiplexing manner. The UAV is assumed to be served by one of the GEO beams, utilizing a total bandwidth of B_{G} . The GEO satellite and terrestrial MBSs operate in distinct frequency bands; hence, no inter-tier interference exists between them. Each MBS allocates a total bandwidth of B_{M} to serve the UAV, while sharing the same time–frequency resources across the terrestrial tier. Consequently, the UAV experiences co-channel interference from neighboring MBSs. The UAV’s motion is defined within an airspace represented by a three-dimensional (3D) Cartesian coordinate system (x,y,z) for local navigation and an Earth-centered, Earth-fixed (ECEF) geocentric coordinate system for global referencing. The UAV begins its mission from a randomly selected START location (x_{s},y_{s},0) within the coverage area and flies toward a fixed END position (x_{e},y_{e},0) . At the START , the UAV vertically ascends to its operational altitude h_{\text{UAV}} , constrained to be less than 300 meters as defined by the Third Generation Partnership Project (3GPP) [ 1 ] . This altitude is maintained throughout the flight, and upon reaching the destination, the UAV descends vertically to the ground. The b -th MBS, \forall b\in\mathcal{B}=\{1,\dots,N_{B}\} , is located at coordinates (x^{\text{MBS}}_{b},y^{\text{MBS}}_{b},z^{\text{MBS}}_{b}) , where z^{\text{MBS}}_{b} denotes the antenna height of the MBS. We assume that the geographical region is discretized in two dimensions, uniformly divided into N_{G}\times N_{G} grid cells, where the j -th grid center point (x_{j},y_{j},h_{\text{UAV}}) represents a possible UAV position. We assume that at each time step t , the UAV moves from one grid center to another grid center. The discrete trajectory of the UAV is denoted by \mathcal{T}=\{q_{1},\ldots,q_{T}\} , where q_{t},~\forall t=1,\dots,T, represents the grid index of the UAV position at