Digital Twin-Assisted Adaptive Multi-Agent DRL for Intelligent Spectrum and Resource Management in Open-RAN UAV-Enabled 6G Networks
Marwan Dhuheir, Thang X. Vu, and Symeon Chatzinotas · 2026
Read Digital Twin-Assisted Adaptive Multi-Agent DRL for Intelligent Spectrum and Resource Management in Open-RAN UAV-Enabled 6G Networks by Marwan Dhuheir, Thang X. Vu, and Symeon Chatzinotas (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01324.txt.
Introduction
Dhuheir, Vu, and Chatzinotas manage spectrum for drone-aided 6G networks. Drones extend coverage and add resilience for ground users. Open-RAN design makes the network more open and flexible. But spectrum and resource choices shift fast in such settings. Mobility reshapes the topology as drones move. Tight latency and energy limits add more strain. A digital twin assists deep reinforcement learning here.
The problem splits into two linked parts. Particle swarm optimization steers drone trajectories. Multi-agent learning handles spectrum, power, and user association. The twin supports context-aware calls across the drones. Simulations show gains in spectral efficiency and data rates. Energy use also improves in their tests. The path points toward self-evolving 6G service.
Catalog record
| CREATOR | Marwan Dhuheir, Thang X. Vu, and Symeon Chatzinotas |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.01324
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Digital Twin-Assisted Adaptive Multi-Agent DRL for Intelligent Spectrum and Resource Management in Open-RAN UAV-Enabled 6G Networks Marwan Dhuheir, Thang X. Vu, and Symeon Chatzinotas Abstract The evolution toward 6G wireless networks envisions a seamlessly intelligent, Open-RAN-enabled architecture where unmanned aerial vehicles (UAVs) play a pivotal role in extending coverage, enhancing resilience, and ensuring reliable connectivity for ground users’ deployment. However, efficiently managing spectrum and resources in such highly dynamic UAV-assisted environments remains a major challenge due to nonlinear system interactions, mobility-induced topology variations, and stringent latency and energy constraints. To address these challenges, we propose a digital twin (DT)-assisted adaptive deep reinforcement learning (DRL) framework that enables intelligent spectrum sharing and resource allocation across distributed ground users. The complex optimization problem is decomposed into UAV trajectory optimization using particle swarm optimization (PSO) and dynamic spectrum-power-association management via multi-agent DRL (MADRL). This hybrid DT-driven approach empowers intelligent, context-aware decision-making and adaptive coordination among UAVs. Extensive simulations demonstrate significant gains in spectral efficiency, data rates, and energy utilization, showcasing a transformative path toward self-evolving, autonomous 6G UAV and ground users (GUs) connectivity. I introduction The evolution toward beyond 5G (B5G) and 6G wireless networks marks a paradigm shift in connectivity, targeting ultra-high data rates, extreme reliability, low latency (xURLLC), massive device connectivity, and AI-native intelligence across all layers [ 12 , 8 ] . Achieving these goals demands scalable, adaptive, and intelligent network architectures capable of real-time optimization under dynamic conditions. A key enabler is the open radio access network (Open-RAN), which decouples hardware and software components across distributed units (DUs), radio units (RUs), central units (CUs), and RAN intelligent controllers (RICs), promoting flexibility and interoperability [ 7 ] . Complementing Open-RAN, digital twin (DT) technology creates real-time virtual replicas of physical network elements, enabling predictive analytics and proactive optimization [ 10 ] . Integrated within the Open-RAN hierarchy, the DT enhances coordination between the Non-RT RIC (in the O-Cloud) and the Near-RT RIC (at the edge), enabling centralized training and distributed inference for intelligent self-optimization and low-latency orchestration. Meanwhile, UAVs have emerged as crucial components of 6G non-terrestrial networks (NTNs) due to their mobility, rapid deployment, and ability to extend coverage to remote or disaster-stricken areas [ 14 ] . Acting as aerial RUs (ARUs), UAVs support ground users (GUs) deployments and emergency communication, while DT-assisted Open-RAN control allows real-time flight path adjustment, dynamic resource allocation, and adaptive spectrum management. However, large-scale UAV-GU integration introduces challenges in spectrum sharing, energy efficiency, and maintaining reliable, low-latency links [ 4 , 11 ] . Existing works often rely on traditional optimization or game-theoretic methods [ 2 , 9 , 6 ] , which ignore considering real-time adaptability, latency constraints, and concurrent coordination required in 6G networks. The study in [ 15 ] adopted the DT for resource allocation, nevertheless, critical constraints hve not been considered in the evaluations and the model is limited to terrestrial network. Another related study in [ 1 ] studied the DT and DRL optimization for target search technology. However, the considered model is simple to adopt for improving wireless communication systems. To overcome these limitations, learning-driven mechanisms such as multi-agent reinforcement learning (MARL) have gained attention for enabling decentralized and adaptive decision-making [ 3 , 13 ] . When integrated with DT-based centralized training, MARL enables a DT-assisted MARL framework that combines global optimization through the Non-RT RIC with real-time distributed control via the Near-RT RIC, ensuring scalability, fast convergence, and robustness to dynamic environments. To this end, we propose an adaptive DT-assisted multi-agent deep reinforcement learning (MADRL) framework for intelligent spectrum sharing and resource allocation in Open-RAN UAV-assisted 6G networks. The problem of data rate maximization is decomposed into two subproblems: UAV position optimization using low-complexity particle swarm optimization (PSO) and resource optimization (association, power, bandwidth) using adaptive MADRL. Unlike conventional methods, the proposed hybrid framework leverages DT-based centralized training for global synchronization and decentralized execution for real-time adaptability. The main contributions of this paper are summarized as follows: • We propose a UAV-assisted Open-RAN DT-based framework for intelligent spectrum sharing and resource management in 6G wireless networks, addressing practical issues such as latency, energy consumption, and dynamic adaptability. • We formulate the joint data rate maximization problem by optimizing UAV positions, RU transmission power, bandwidth allocation, and RU-GU associations under the constraints of energy consumption, latency, and DT synchronization. • Due to the nonconvexity of the problem, we introduce an adaptive and iterative hybrid solution combining PSO for trajectory optimization and MADRL for decentralized resource allocations. • Extensive simulations validate the proposed framework, demonstrating superior performance over state-of-the-art solutions in terms of spectral efficiency, data rate maximization, and energy utilization. The rest of this article is organized as follows: Section II presents the description of our system model. In Section III , we delineate the problem formulation. Section V explains the implementation results of the proposed approach. At the end, section VI concludes and discusses future research directions. II system model Fig. 1: System model. Fig. 1 illustrates the proposed system model, which consists of a high-altitude platform (HAP), an Open-RAN CU/DU, multiple UAVs, ground radio units (GRUs), and distributed GUs operating within an Open-RAN-enabled 6G architecture. In this framework, some GRUs may become overloaded or experience service failures; therefore, UAVs are deployed as aerial radio units (ARUs) to assist GRUs in maintaining reliable connectivity for GUs such as post-disaster, special events, etc. Both RUs (UAVs and GRUs) provide wireless access and data services to the set of GUs \mathcal{N}=\{1,2,\ldots,N\} distributed across the coverage area. Let \mathcal{U}=\{1,2,\ldots,U\} and \mathcal{G}=\{1,2,\ldots,G\} denote the sets of UAVs and GRUs, respectively, where u\in\mathcal{U} and g\in\mathcal{G} . The network area is partitioned into clusters, each centered at the position of a GRU, such that every UAV supports one GRU cluster. The set of RU clusters is defined as ru\in\mathcal{RU}=\{(GRU_{1},UAV_{1}),(GRU_{2},UAV_{2}),\ldots,(GRU_{g},UAV_{u})\} , representing the pairwise association between GRUs and UAVs. Each UAV operates within its assigned cluster at a fixed altitude, following a trajectory that starts and ends at the corresponding cluster’s center to ensure coordinated and energy-efficient operation. The positions of GRUs, UAVs, and GUs are denoted as Q_{g}^{t}=(x_{g}^{t},y_{g}^{t},H_{g}) , Q_{u}^{t}=(x_{u}^{t},y_{u}^{t},H_{u}) , and Q_{n}=(x_{n},y_{n},0) , respectively. During the service duration T , divided into I discrete time slots \mathcal{T}=\{1,2,\ldots,I\} of length \delta=T/I , each UAV and GRU dynamically allocates its bandwidth and power resources to serve the associated GUs. We assume that UAVs share the available spectrum of GRUs to enhance spectral efficiency and overall throughput while ensuring interference coordination across aerial and terrestrial links. In the backhaul layer, GRUs connect to the Open-RAN CU/DU via terrestrial fiber or microwave links, whereas UAVs maintain aerial backhaul through the HAP. The HAP and CU/DU are further connected to the O-Cloud, which hosts the Non-RT RIC and the DT. The DT continuously receives real-time network data, including channel states, UAVs positions, and traffic loads through telemetry feedback from the RU, and the Near-RT RIC. Using the received data, the DT performs global training, policy optimization, and predictive analytics, generating updated control policies that are transmitted to the Near-RT RIC. These outputs enable real-time spectrum sharing, resource allocation, and adaptive UAV-GRU coordination at the network edge. Through this hierarchical Open-RAN-DT interaction, the system achieves continuous