Quantum Reinforcement Learning for 6G and Beyond Wireless Networks
Dinh-Hieu Tran, Thai Duong Nguyen, Thanh-Dao Nguyen, Ngoc-Tan Nguyen, Van Nhan Vo, Hung Tran, Mouhamad Chehaitly, Yan Kyaw Tun, Cedomir Stefanovic, Tu Ho Dac, Eva Lagunas, Symeon Chatzinotas, Nguyen Van Huynh · 2025
Read Quantum Reinforcement Learning for 6G and Beyond Wireless Networks by Dinh-Hieu Tran, Thai Duong Nguyen, Thanh-Dao Nguyen, Ngoc-Tan Nguyen, Van Nhan Vo, Hung Tran, Mouhamad Chehaitly, Yan Kyaw Tun, Cedomir Stefanovic, Tu Ho Dac, Eva Lagunas, Symeon Chatzinotas, Nguyen Van Huynh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01070.txt.
Introduction
Dinh-Hieu Tran and colleagues survey quantum reinforcement learning as a tool for sixth generation wireless networks. Sixth generation systems are expected to deliver higher data rates, lower delay, and denser connections than 5G. Artificial intelligence is seen as essential to running them. Yet classical methods strain under the strict delay and throughput limits.
As a review and vision article, the paper summarizes what deep reinforcement learning has achieved for 6G and where it falls short, then introduces the quantum version and its potential advantages. A case study on dynamic spectrum access shows the quantum approach outperforming the classical one. The authors close with research directions they judge most promising for quantum learning in future networks.
Catalog record
| CREATOR | Dinh-Hieu Tran, Thai Duong Nguyen, Thanh-Dao Nguyen, Ngoc-Tan Nguyen, Van Nhan Vo, Hung Tran, Mouhamad Chehaitly, Yan Kyaw Tun, Cedomir Stefanovic, Tu Ho Dac, Eva Lagunas, Symeon Chatzinotas, Nguyen Van Huynh |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-01070
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Quantum Reinforcement Learning for 6G and Beyond Wireless Networks Dinh-Hieu Tran, Thai Duong Nguyen, Thanh-Dao Nguyen, Ngoc-Tan Nguyen, Van Nhan Vo, Hung Tran, Mouhamad Chehaitly, Yan Kyaw Tun, Cedomir Stefanovic, Tu Ho Dac, Eva Lagunas, Symeon Chatzinotas, Nguyen Van Huynh Abstract While 5G is being deployed worldwide, 6G is receiving increasing attention from researchers to meet the growing demand for higher data rates, lower latency, higher density, and seamless communications worldwide. To meet the stringent requirements of 6G wireless communications networks, AI-integrated communications have become an indispensable part of supporting 6G systems with intelligence, automation, and big data training capabilities. However, traditional artificial intelligence (AI) systems are difficult to meet the stringent latency and high throughput requirements of 6G with limited resources. In this article, we summarize, analyze, discuss the potential, and benefits of Quantum Reinforcement Learning (QRL) in 6G. As an example, we show the superiority of QRL in dynamic spectrum access compared to the conventional Deep Reinforcement Learning (DRL) approach. In addition, we provide an overview of what DRL has accomplished in 6G and its challenges and limitations. From there, we introduce QRL and potential research directions that should continue to be of interest in 6G. To the best of our knowledge, this is the first review and vision article on QRL for 6G wireless communication networks. I Introduction While 5G is being deployed and operated worldwide, new research is still being done towards 6G to meet the growing demand for higher data transmission, lower latency, and wider coverage worldwide. 6G is expected to be released in the early 2030s, and many challenges need to be solved before then. 6G promises to bring drastic changes compared to 5G, such as transmission speeds 50 to 100 times faster than 5G, using a wider frequency range including sub-THz bands (e.g., 90 GHz to 3 THz in 6G) or new mid-band spectrum from 7 to 15 GHz, thus providing much larger bandwidth than 5G. In addition, 6G also offers significantly lower latency than 5G, e.g., it expects to reduce the transmission delay to 0.1 ms compared to 1 ms in 5G. In addition, 6G will provide infrastructure for a much larger number of mobile users (MUs) than 5G, thus meeting the widespread connectivity needs of massive Internet of Things (IoT) devices. In addition, 6G promises to enable new applications such as holographic, extended reality, haptics, AI integration, advanced medical applications, and Metaverse communications. Along with the potential promises discussed above, the infrastructure requirements for 6G will also need to improve significantly to meet these capabilities. As networks evolve, they will incorporate AI-driven optimization into their core, ensuring efficient resource allocation and dynamic network management. The integration of AI into 6G will create a self-learning, self-optimizing network that can adapt to MUs’ needs in real-time. Among AI technologies, Deep Reinforcement Learning (DRL) offers some significant advantages in wireless communications. More specifically, DRL algorithms are effective in sequential decision-making environments, making them ideal for dynamic and uncertain systems. Moreover, DRL agents interact with the environment and learn from their experiences, thus it can achieve optimal long-term rewards under complicated, ever-changing conditions. However, DRL is not without its drawbacks. Since DRL applies Deep Neural Network (DNN) for approximating the optimal policy, it needs a long time to learn the dynamics and uncertainty of the environment, especially in environments with large state spaces. Therefore, DRL can hardly meet the very low-latency requirements in wireless communications in highly dynamic communication systems where the environment changes quickly. For example, base stations in future communication systems are required to make radio resource allocation decisions to serve MUs in its coverage area within one transmission time interval which can be less than 1 ms. Therefore, running DRL with a rapidly changing environment and responding to new conditions within a transmission time interval is very challenging and difficult to achieve an optimal solution. Fortunately, the recent breakthrough in quantum computing has shown positive signs and may provide a potential solution due to its ability to significantly increase the computational speed compared to classical computation systems. This can be done due to the properties of quantum computing, such as quantum superposition and quantum entanglement. Quantum superposition allows a quantum bit (qubit) to exist in multiple states simultaneously until it is measured or observed. While classical computation systems store data in binary bits, where each of which can hold a value of 0 or 1. However, in quantum computing, a qubit can be in a state of 0, 1, or a combination of both states at the same time. This allows quantum computers to process multiple states at once, resulting in exponentially faster computations than traditional computers. Entanglement is explained as a phenomenon in which two or more particles are tightly bound and influence each other instantaneously, regardless of the huge physical distance between them. In quantum computing, changing the state of one qubit can immediately change another entangled qubit’s state, thus significantly speeding up computation. Based on these properties, quantum reinforcement learning (QRL) has been proposed recently and shows promise to speed up the training of DRL. In QRL, conventional deep neural networks (DNNs) are replaced by variational quantum circuits or parameterized quantum circuits to approximate the optimal policy. Furthermore, QRL leverages quantum superposition and quantum entanglement to explore multiple states simultaneously, allowing for more efficient discovery of optimal policies, especially in environments with high-dimensional state spaces. Although 6G has not yet been formally defined, we believe that QRL will become one of the key players. QRL will provide excellent computational capabilities to overcome the limitations of DRL, and bring many advantages in quantum-inspired security, quantum routing, quantum-inspired air-ground-sea networks, quantum-inspired real-time optimization, etc. Recently, some studies have proposed quantum machine learning (QML) for 6G and beyond networks [ 1 , 2 ] . However, none of them have provided a comprehensive overview of QRL for 6G and beyond networks. They only discussed the general Quantum Machine Learning for 6G cellular networks [ 1 ] or for 6G ultra-reliable and low-latency communication (URLLC) [ 2 ] . The novelty and contributions of our work are as follows: • To the best of our knowledge, this article is the first one that discusses the fundamentals, applications, and case studies of QRL for 6G. • This article presents specific QRL opportunities for 6G. These opportunities include quantum routing, quantum space-air-ground-sea networks, quantum-inspired metaverse, quantum-inspired integrated sensing and communucations, quantum-inspired security, quantum-inspired real-time digital twins, and quantum-inspired holographic communications. Such information inspires researchers who extend their research to QRL-enabled 6G communication systems. • This article provides some simulation results about the QRL-based dynamic spectrum access case study, a hot issue for 6G with limited spectrum and the increasing demand for capacity and data rate of users. • Finally, we present a list of crucial challenges and future directions for QRL in 6G, such as 6G security, space-air-ground-sea communications, routing and massive access, ultra-reliable and low-latency communications, and integrated emerging technologies. The rest of our work is organized as follows. First, we provide an overview of DRL for 6G in section II . Second, we discuss the motivation, overview and applications of QRL for 6G in sections III , IV , V respectively. Third, we