Towards Ultra-Reliable 6G in-X Subnetworks: Dynamic Link Adaptation by Deep Reinforcement Learning
Fateme Salehi, Aamir Mahmood, Sarder Fakhrul Abedin, Kyi Thar, Mikael Gidlund · 2025
Read Towards Ultra-Reliable 6G in-X Subnetworks: Dynamic Link Adaptation by Deep Reinforcement Learning by Fateme Salehi, Aamir Mahmood, Sarder Fakhrul Abedin, Kyi Thar, Mikael Gidlund (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12031.txt.
Introduction
Fateme Salehi and co-authors design a smarter radio link for future 6G factory networks, in a 2025 paper. Small in-factory subnetworks must deliver nearly every packet on time, since missed packets can upset control loops and threaten safety. The team focuses on bursts of lost packets, a risk earlier work often ignored. Their controller learns by trial and error, using a deep reinforcement learning method.
The controller adjusts signal power and packet length based only on a measure of signal quality. In simulations it cut bursts of lost packets while using only 18 percent of the sending cost of a full-power policy. Weights in its reward let engineers trade energy savings against reliability for each site. The authors present the design as a flexible fit for strict industrial needs.
Catalog record
| CREATOR | Fateme Salehi, Aamir Mahmood, Sarder Fakhrul Abedin, Kyi Thar, Mikael Gidlund |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-12031
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Ultra-Reliable 6G in-X Subnetworks: Dynamic Link Adaptation by Deep Reinforcement Learning Fateme Salehi, Aamir Mahmood, Sarder Fakhrul Abedin, Kyi Thar, Mikael Gidlund Abstract 6G networks are composed of subnetworks expected to meet ultra-reliable low-latency communication (URLLC) requirements for mission-critical applications such as industrial control and automation. An often-ignored aspect in URLLC is consecutive packet outages, which can destabilize control loops and compromise safety in in-factory environments. Hence, the current work proposes a link adaptation framework to support extreme reliability requirements using the soft actor-critic (SAC)-based deep reinforcement learning (DRL) algorithm that jointly optimizes energy efficiency (EE) and reliability under dynamic channel and interference conditions. Unlike prior work focusing on average reliability, our method explicitly targets reducing burst/consecutive outages through adaptive control of transmit power and blocklength based solely on the observed signal-to-interference-plus-noise ratio (SINR). The joint optimization problem is formulated under finite blocklength and quality of service constraints, balancing reliability and EE. Simulation results show that the proposed method significantly outperforms the baseline algorithms, reducing outage bursts while consuming only 18% of the transmission cost required by a full/maximum resource allocation policy in the evaluated scenario. The framework also supports flexible trade-off tuning between EE and reliability by adjusting reward weights, making it adaptable to diverse industrial requirements. I Introduction Ultra-reliable low-latency communication (URLLC) is a key service class in 5G and emerging 6G networks, targeting block error rates as low as 10^{-5} and air-interface delays below one millisecond [ 1 ] . These guarantees are essential for mission-critical industrial applications such as real-time motion control, collaborative robotics, and closed-loop process automation. To reduce infrastructure cost and simplify deployment, many industrial Internet-of-things (IIoT) systems are increasingly operating in unlicensed Industrial, Scientific, and Medical (ISM) spectrum. Extending 5G URLLC capabilities to unlicensed spectrum through 5G New Radio-Unlicensed (NR-U) can enhance IIoT connectivity and enable cost-effective deployments of industrial wireless networks. However, the ISM band is heavily utilized by diverse technologies such as Wi-Fi, Bluetooth, Zigbee, and proprietary industrial protocols, resulting in significant cross-technology interference (CTI) [ 2 ] . This interference poses substantial challenges for 5G NR-U deployments, which must ensure coexistence with other technologies while maintaining the stringent performance requirements of mission-critical URLLC applications. 6G in-X subnetworks, where ‘X’ denotes the specific physical domains or environments hosting the subnetwork, such as a robot, vehicle, factory, hospital, etc., demand extreme communication requirements in terms of throughput, reliability and latency [ 3 ] . Therefore, effective coexistence management strategies are imperative for mitigating interference, meeting the stringent requirements of robust communication, and optimizing resource efficiency. I-A Literature Review Managing CTI in a wireless network is a complex task, particularly in shared-spectrum environments such as the ISM band. Various approaches have been developed to address this issue. Interference avoidance strategies [ 4 ] focus on proactively preventing interference by techniques such as dynamic channel allocation, time division access, and spatial separation (e.g., directional antennas or beamforming) to minimize overlaps between transmissions. The work in [ 5 ] presents environment-aware mechanisms for interference management in 6G in-X subnetworks via dynamic channel allocation. Cognitive radio techniques [ 6 ] rely on dynamic spectrum access and intelligent spectrum sensing to detect and use underutilized frequency bands, allowing devices to opportunistically avoid interference and adapt to changing spectrum conditions. Interference mitigation techniques [ 7 ] involve reducing the impact of interference through methods like robust signal processing techniques, interference cancellation, power control, etc. With the increasing number of networks operating in ISM bands, more robust coexistence mechanisms with interference awareness must be introduced in NR-U, replacing generic coping strategies to address interference more efficiently and effectively. To this end, novel schemes propose leveraging interference prediction methods as a foundation for link adaptation (LA). The works in [ 8 , 9 , 10 ] employ model-based techniques such as kernel density estimation and discrete state space discrete-time Markov chain to analyze tail statistics for predicting future interference power, demonstrating their suitability for URLLC applications. In [ 11 , 12 ] , two probabilistic prediction methods are proposed to model the tail behavior of interference using extreme value theory (EVT) and transformer-based architecture, respectively. In the dynamic landscape of wireless communication systems, the high complexity of model-based methods and the significant overhead of collecting environmental parameters necessitate a new methodology that can encapsulate all dynamic aspects of the system (such as the radio channel, interference power, and so on) into a real-time state without relying on predefined models. As a result, there is a pressing need for innovative and efficient resource allocation strategies capable of adapting these dynamic factors to ensure robust and reliable communication performance. I-B State-of-the-Art Machine learning (ML)-based approaches, particularly deep reinforcement learning (DRL), have emerged as a promising solution to address these kinds of problems effectively. Reinforcement learning (RL)’s capability to learn and adapt to the environment allows it to leverage the unique characteristics of communication networks. By doing so, RL can make informed decisions regarding parameter adjustments, ensuring optimal performance amidst the ever-changing conditions of wireless communication systems. Recently, numerous works have leveraged DRL to address resource allocation and decision-making challenges in wireless networks. The authors in [ 13 ] proposed a mechanism for distributed resource management and interference mitigation in wireless networks using multi-agent DRL. They proposed a mechanism for user scheduling and downlink power control in multi-cell wireless networks. In [ 14 ] , the authors introduced a heterogeneous radio frequency/visible light communication industrial network architecture. They formulated a joint uplink and downlink resource management problem as a Markov decision process (MDP). In [ 15 ] , a deep Q-network based scheme was proposed to address bandwidth utilization and energy efficiency (EE) in a networking graph-based IIoT system. The authors in [ 16 ] introduced an optimization theory-based DRL framework for the design of a wireless networked control system (WNCS) to minimize the power consumption of the communication system. The work in [ 17 ] considered a joint uplink and downlink scheduling problem of a fully distributed WNCS with a limited number of frequency channels. It formulated the optimal transmission scheduling problem into an MDP problem with a countable state space for achieving the minimum expected total discounted cost. The authors in [ 18 ] propose a resource management framework for 6G in-X subnetworks based on multi-agent DRL, which can extract inter-subnetwork interference relationships from the received signal strength indicator (RSSI) without requiring instantaneous channel gain between subnetworks. However, these studies typically focus on average performance metrics such as throughput, delay, or reliability, and they overlook the temporal structure of transmission failures, which can have critical implications for delay-sensitive control applications. I-C Summary of Contributions In industrial wireless control systems, the occurrence of sequential transmission failures, referred to as consecutive outages, can be more detrimental than the high probability of a mean outage. Although a link may meet average reliability constraints, clustered outages can violate real-time deadlines and destabilize control loops. For such systems, performance metrics such as link availability and the probability of consecutive outages are essential to assess the reliability of communication. Despite the importance of consecutive outages for reliability performance, to the best of our knowledge, this critical aspect has not been investigated in existing research [ 13