How to Coordinate UAVs and UGVs for Efficient Mission Planning? Optimizing Energy-Constrained Cooperative Routing with a DRL Framework
Md Safwan Mondal, Subramanian Ramasamy, Luca Russo, James D. Humann, James M. Dotterweich, Pranav Bhounsule · 2025
Read How to Coordinate UAVs and UGVs for Efficient Mission Planning? Optimizing Energy-Constrained Cooperative Routing with a DRL Framework by Md Safwan Mondal, Subramanian Ramasamy, Luca Russo, James D. Humann, James M. Dotterweich, Pranav Bhounsule (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-21111.txt.
Introduction
Drones and ground robots make a natural team, if their routes are planned well, and a 2025 paper by Md Safwan Mondal and co-authors builds a learning system for that planning. Drones cover ground fast but run out of battery, while ground vehicles move slowly yet can carry charge and act as mobile recharging stations.
The team's deep reinforcement learning system plans routes for the mixed team so all task points are visited in the least time. Drones drop back to the ground vehicles to recharge along the way. A transformer-based design assigns task points and meeting spots, and a switching scheme hands work between agents sortie by sortie. The aim is a planner that scales to larger teams.
Catalog record
| CREATOR | Md Safwan Mondal, Subramanian Ramasamy, Luca Russo, James D. Humann, James M. Dotterweich, Pranav Bhounsule |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-21111
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
How to Coordinate UAVs and UGVs for Efficient Mission Planning? Optimizing Energy-Constrained Cooperative Routing with a DRL Framework Md Safwan Mondal, Subramanian Ramasamy, Luca Russo, James D. Humann, James M. Dotterweich, Pranav Bhounsule Abstract Efficient mission planning for cooperative systems involving Unmanned Aerial Vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) requires addressing energy constraints, scalability, and coordination challenges between agents. UAVs excel in rapidly covering large areas but are constrained by limited battery life, while UGVs, with their extended operational range and capability to serve as mobile recharging stations, are hindered by slower speeds. This heterogeneity makes coordination between UAVs and UGVs critical for achieving optimal mission outcomes. In this work, we propose a scalable deep reinforcement learning (DRL) framework to address the energy-constrained cooperative routing problem for multi-agent UAV-UGV teams, aiming to visit a set of task points in minimal time with UAVs relying on UGVs for recharging during the mission. The framework incorporates sortie-wise agent switching to efficiently manage multiple agents, by allocating task points and coordinating actions. Using an encoder-decoder transformer architecture, it optimizes routes and recharging rendezvous for the UAV-UGV team in the task scenario. Extensive computational experiments demonstrate the framework’s superior performance over heuristic methods and a DRL baseline, delivering significant improvements in solution quality and runtime efficiency across diverse scenarios. Generalization studies validate its robustness, while dynamic scenario highlights its adaptability to real-time changes with a case study. This work advances UAV-UGV cooperative routing by providing a scalable, efficient, and robust solution for multi-agent mission planning. More details are available on the website: https://sites.google.com/view/muavugvdrl . I Introduction In applications like disaster response, search-and-rescue operations, and environmental monitoring, rapid and persistent coverage of critical areas is essential. Unmanned Aerial Vehicles (UAVs) play a pivotal role in these tasks, providing real-time surveillance of disaster zones, wildfire perimeters, and critical infrastructure [ 1 , 2 , 3 ] . Their ability to access otherwise unreachable areas, such as dense forests, mountainous terrains, and urban rooftops, makes them invaluable for time-sensitive tasks. However, UAVs are fundamentally limited by their battery capacity, requiring frequent recharges thereby disrupting sustained mission coverage [ 4 ] . To mitigate this limitation, Unmanned Ground Vehicles (UGVs) have emerged as complementary agents in multi-agent systems. UGVs, capable of traversing road networks and operating for extended durations, act as mobile recharging stations for UAVs, extending their operational range and enabling uninterrupted mission execution. The synergy between UAVs and UGVs combining the agility of aerial operations with the endurance and logistical support of ground vehicles has shown immense potential for improving mission efficiency across diverse applications [ 5 ] . However, this demands intelligent coordination to optimize routes, synchronize recharging schedules, and ensure all task points are visited in an efficient manner. Fig. 1 : Illustration of the fuel-constrained UAV-UGV cooperative routing problem. UAV-specific task points (red hollow circles) and ground task points (blue solid circles) must be visited, with rendezvous points (black circles) for UAVs recharging on the UGVs. The goal is to plan UAV and UGV routes (red dashed and blue solid paths, respectively) to minimize total mission time while adhering to UAV fuel and UGV speed constraints. The coordination of UAVs and UGVs in such cooperative missions presents unique challenges. UAVs must balance fuel consumption and mission routing (i.e., the order of task point visits) while timing their rendezvous with UGVs for recharging. UGVs, meanwhile, are constrained by their slower speeds and reliance on road networks. In multi-agent systems, these challenges are amplified as multiple UAVs and UGVs must collaboratively plan routes and synchronize operations for seamless task execution. Traditional heuristic-based or hierarchical optimization approaches often struggle to scale with the increasing complexity and dynamic nature of these problems. This highlights the need for a comprehensive cooperative routing framework that optimally plans routes for UAVs and UGVs while synchronizing recharging rendezvous. Such a framework must account for the heterogeneous capabilities of these agents, balance their operational constraints, and deliver robust, scalable solutions that adapt to real-time changes, ensuring efficient and timely mission completion. I-A Related works The cooperative routing problem has been extensively explored within the fields of transportation [ 6 ] and robotics [ 7 , 8 ] , with various strategies proposed to address its inherent complexity. These approaches can be categorized into traditional optimization techniques, heuristic methods, and learning-based frameworks, including reinforcement learning for cooperative multi-agent systems. Traditional methods often model UAV-UGV cooperative routing as extensions of the Vehicle Routing Problem (VRP) or the Traveling Salesman Problem (TSP). In transportation, the Truck-Drone Delivery Problem, a specialized form of VRP with Drones (VRP-D) or TSP with Drones (TSP-D) has been formulated using Mixed Integer Linear Programming (MILP) to derive optimal solutions [ 9 , 10 ] . MILP provides a rigorous mathematical framework for integrating energy constraints, time windows, and heterogeneous vehicle characteristics. However, MILP’s applicability to large-scale, real-time problems is severely limited due to its computational complexity, as the number of nodes increases [ 11 ] . Consequently, while MILP offers theoretical optimality, it becomes impractical for dynamic and complex scenarios. To address these scalability challenges, heuristic and metaheuristic methods have been widely adopted as practical alternatives. Techniques such as Genetic Algorithms (GA) [ 12 ] , Tabu Search (TS) [ 13 ] , and Simulated Annealing (SA) [ 14 ] have shown effectiveness in approximating optimal solutions within reasonable computation times. Adaptive approaches, including Iterated Local Search [ 15 ] and Adaptive Large Neighborhood Search [ 16 ] , further enhance solution quality by iteratively exploring and refining the solution space, balancing exploitation and exploration. In the context of UAV-UGV systems, heuristic methods often employ multi-echelon or multi-level optimization frameworks to simplify coordination complexities. For instance, strategies like “UGV first, UAV second” decompose the problem into manageable subproblems, where rendezvous points are identified using Minimum Set Cover (MSC) formulations and routes are optimized through MILP or metaheuristic algorithms [ 4 , 17 , 18 ] . Seyedi et al. [ 19 , 20 ] introduced a heuristic for cyclical patrolling by uniform UAV-UGV teams, leveraging spatial partitioning to optimize area coverage. While effective for continuous surveillance, this method may not be well-suited for scenarios involving discrete task points. Despite their practicality, heuristic methods often require significant domain-specific customization, limiting their adaptability to diverse problem settings. Furthermore, their performance in dynamic, real-time scenarios, particularly in large-scale multi-agent systems remains constrained, underscoring the need for more robust and scalable solutions. In recent years, learning-based approaches have emerged as promising alternatives for solving complex routing tasks. Deep Reinforcement Learning (DRL) has shown the capability to learn optimal policies through environment interaction, eliminating reliance on handcrafted heuristics [ 21 , 22 , 23 , 24 ] . Vinyals et al. [ 22 ] introduced the Pointer Network, which leveraged attention mechanisms to solve the Traveling Salesman Problem (TSP). This framework was later extended by Bello et al. [ 25 ] , who incorporated reinforcement learning to tackle more complex VRP and TSP variants. Kool et al. [ 26 ] advanced the field further by proposing an encoder-decoder transformer architecture with multi-head attention layers, achieving state-of-the-art performance on VRP tasks while surpassing traditional heuristics. Zhang et al. [ 27 ] and Fuertes et al.