Cooperative UAVs for Remote Data Collection under Limited Communications: An Asynchronous Multiagent Learning Framework
Cuong Le, Symeon Chatzinotas, , and Thang X. Vu · 2026
Read Cooperative UAVs for Remote Data Collection under Limited Communications: An Asynchronous Multiagent Learning Framework by Cuong Le, Symeon Chatzinotas, , and Thang X. Vu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-10849.txt.
Introduction
Cuong Le, Symeon Chatzinotas, and Thang X. Vu study drone teams that gather data from remote sensors. Several unmanned aerial vehicles must plan paths and share bandwidth to be energy-efficient. A catch sets this work apart: the drones cannot act in sync. In real deployments, action synchronization across all UAVs is impossible.
The authors build an asynchronous multiagent learning framework for the joint task. Paths and bandwidth are tuned together, since a drone far from its peers needs both time and channel space. Asynchrony matches how real fleets behave, with each craft on its own clock. The results target data collection for farms, disasters, and remote sites where power is precious.
Catalog record
| CREATOR | Cuong Le, Symeon Chatzinotas, , and Thang X. Vu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-10849
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cooperative UAVs for Remote Data Collection under Limited Communications: An Asynchronous Multiagent Learning Framework Cuong Le, Symeon Chatzinotas, , and Thang X. Vu Abstract This paper addresses the joint optimization of trajectories and bandwidth allocation for multiple Unmanned Aerial Vehicles (UAVs) to enhance energy efficiency in the cooperative data collection problem. We focus on an important yet underestimated aspect of the system, where action synchronization across all UAVs is impossible. Since most existing learning-based solutions are not designed to learn in this asynchronous environment, we formulate the trajectory planning problem as a Decentralized Partially Observable Semi-Markov Decision Process and introduce an asynchronous multi-agent learning algorithm to learn UAVs’ cooperative policies. Once the UAVs’ trajectory policies are learned, the bandwidth allocation can be optimally solved based on local observations at each collection point. Comprehensive empirical results demonstrate the superiority of the proposed method over other learning-based and heuristic baselines in terms of both energy efficiency and mission completion time. Additionally, the learned policies exhibit robustness under varying environmental conditions. I Introduction The rapid advancement of communication technologies like 5G and the anticipated rollout of 6G networks have paved the way for efficient and scalable deployment of Unmanned Aerial Vehicles (UAVs) in real-life applications. Sectors such as agriculture, environmental monitoring, and disaster management increasingly rely on UAVs to collect data quickly and reliably, thanks to their accessibility and highly probable line-of-sight links to ground terminals. For example, UAVs can be used to regularly collect sensory information of the crop conditions in smart agriculture, or monitoring information of windmills in a windfarm. However, distributed autonomous decision-making and efficient cooperation under limited onboard energy remain critical challenges that must be addressed to maximize the potential of UAVs and ensure their sustainable use. As future network generations promise unparalleled capabilities, including AI-driven automation, multiagent reinforcement learning (MARL) has emerged as a key approach to addressing the above challenges. With its ability to adapt to dynamic environments and enable autonomous collaboration, MARL is increasingly applied to a wide range of UAV cooperative planning problems [ 2 , 3 , 4 , 5 , 6 ] . However, most existing MARL-based solutions assume that all UAVs are well-synchronized, in the sense that they all make decisions at the same time. While this assumption simplifies algorithm design, it is difficult to achieve in real-world environments for several reasons: i ) different UAVs naturally require varying amounts of time to complete their actions; ii ) forcing UAVs to wait for one another wastes time and system resources; iii ) achieving synchronization across all UAVs requires extensive control signaling, either among agents or between agents and an intermediary medium; and iv ) even with an effective synchronization mechanism, unexpected signaling delays or hardware issues can still disrupt synchronization. Moreover, timing mismatches can directly undermine the performance of policies learned under synchronous assumptions. For instance, UAVs may be required to meet periodically to exchange information or confirm task completion. If their actions are not perfectly aligned, they may fail to meet as planned, leading to overlapping exploration, inefficient waiting cycles, or, in the worst case, a complete breakdown of the learned policy. Addressing asynchronous decision-making is therefore crucial for extending MARL solutions beyond laboratory simulations and making them viable in physical environments. Despite its significance, to the best of our knowledge, asynchronous decision-making in wireless communications, specifically in multi-UAV planning, has not yet been examined. In this study, we consider the joint optimization problem of UAVs’ trajectories and bandwidth allocation at each data collection point to maximize the overall energy efficiency. Our work stands out from existing studies by focusing on an overlooked aspect of the system, where UAVs have to make decisions independently, without time synchronization with one another. This is motivated by the fact that different collection points have varying amounts of data and different transmission channel qualities. As a result, the time required for data collection at each of these points naturally varies. Additionally, since UAVs operate in remote areas with limited inter-UAV communication, synchronizing actions across all UAVs at every step is impossible. The contributions of this paper are as follows: • We consider the UAV-assisted data collection problem under practical conditions: i ) the location of available data points and the data size are random and unknown in advance; and ii ) different collection points have varying amounts of data and transmission channel qualities, resulting in different time requirements at each point. Under these conditions, offline optimization approaches are infeasible, and online solutions must equip the UAVs with the capability to make decisions asynchronously. • We introduce a learning-based solution, where the problem is decomposed into two subproblems: trajectory optimization and bandwidth allocation at each hovering point. While bandwidth allocation can be solved independently by each UAV at each hovering point using any convex optimizer, trajectory optimization is more challenging as it requires UAVs to collaborate without explicit time synchronization. To tackle this challenge, we transform it into a Decentralized Partially Observable Semi-Markov Decision Process (Dec-POSMDP), which allows for varying action durations. We then propose Asynchronous-QMIX, a MARL algorithm specifically designed for asynchronous environments . Our algorithm is based on QMIX algorithm [ 7 ] - one of the state-of-the-art MARL algorithms for synchronous environments . We theoretically show that under our asynchronous setting, local deterministic greedy policies remain applicable for UAVs, as long as a monotonic relationship between the global Q-value and local utility values holds. Additionally, we also introduce a state downsampling technique to reduce the state space and enhance the scalability of the proposed algorithm. • Extensive experiments are conducted to validate the effectiveness of the proposed method. The numerical results show that our solution outperforms existing learning-based and heuristic solutions. Moreover, the policies learned by our algorithm also demonstrated robust performance under varying environmental conditions. The rest of this paper is organized as follows. Section II provides a brief review of existing studies and their limitations. Section III introduces the system model and problem formulation. Section IV presents the formulation of the trajectory optimization problem as a Dec-POSMDP. Section V presents the Asynchronous-QMIX algorithm for asynchronous environments. Section VI optimizes the bandwidth allocation under imperfect channel state information. Performance evaluation and discussions are presented in Section VII . Finally, conclusions and future work are drawn in Section VIII . Notations : we use superscripts n , c , and i to indicate the indices of UAVs, cells, and sensor nodes (SNs), respectively; square brackets [k] to index the individual decision-making steps of each UAV; and subscript m to index the joint global environment transition steps. II Related work Research on the deployment of UAVs for data collection has flourished in recent years, with a rich body of literature exploring a breadth of system configurations. Early research started with simple scenarios involving a single UAV, with static and deterministic assumptions, allowing traditional optimization approaches to be applied. Most studies focus on UAV trajectory planning and may jointly consider transmission scheduling [ 8 , 9 , 10 , 11 , 12 ] , SN scheduling [ 9 ] , bandwidth allocation [ 13 , 14 ] , power control [ 15 , 14 , 16 ] . The common objectives are mission completion time