Beam Scheduling for Cross-Layer ISAC: A Deep Reinforcement Learning Approach
Xiyu Wang, Gilberto Berardinelli, Hei Victor Cheng, Petar Popovski, Ramoni Adeogun · 2026
Read Beam Scheduling for Cross-Layer ISAC: A Deep Reinforcement Learning Approach by Xiyu Wang, Gilberto Berardinelli, Hei Victor Cheng, Petar Popovski, Ramoni Adeogun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24369.txt.
Introduction
Wang and four colleagues study beam scheduling for cross-layer joint sensing and communication systems. Sharing resources must balance communication and sensing needs under tangled traffic and queues in multi-user settings. They propose a deep reinforcement learning method that cuts feedback overhead by using sensing observations instead of channel state data. Simulations show the method weighs buffer status, adapts to wireless conditions, and lifts throughput with only modest delay growth. Beam management also lands near a genie-aided benchmark with perfect departure-angle knowledge for both communication and sensing.
Catalog record
| CREATOR | Xiyu Wang, Gilberto Berardinelli, Hei Victor Cheng, Petar Popovski, Ramoni Adeogun |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67968 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.24369
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beam Scheduling for Cross-Layer ISAC: A Deep Reinforcement Learning Approach Thanks: X. Wang and H. V. Cheng are with the Department of Electrical and Computer Engineering, Aarhus University, Denmark (email: [email protected], [email protected]). R. Adeogun, G. Berardinelli, and P. Popovski are with the Department of Electronic Systems, Aalborg University, Denmark (email: [email protected], [email protected], [email protected]). This work is presented in part at EuCNC/6G Summit 2025. This research is supported in part by the HORIZON JU-SNS-2022-STREAM-B-01-02 CENTRIC project (Grant Agreement No.101096379). Xiyu Wang is also supported in part by the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie Grant agreement No. 101146247. Hei Victor Cheng’s work is supported in part by the Aarhus Universitets Forskningsfond project No. AUFF39001 and NordForsk Nordic University Cooperation on Edge Intelligence (Grant No. 168043). . Xiyu Wang, Gilberto Berardinelli, Hei Victor Cheng, Petar Popovski, Ramoni Adeogun Abstract Resource allocation in integrated sensing and communication (ISAC) systems needs to be optimized to balance the requirements of the communication and sensing modules considering complicated cross-layer data traffic and queue status in dynamic multi-user environments. This paper studies the beam allocation for cross-layer ISAC that achieves low-latency communication and minimizes sensing parameters estimation error. To handle the complex coupling between practical data buffer dynamics and varying wireless channels, we propose a deep reinforcement learning (DRL)-assisted approach. Rather than relying on explicit channel state information, the DRL-assisted beam allocation reduces feedback overhead by leveraging sensing observations. Simulation results verify that the DRL framework effectively takes buffer status into account and adapts to the wireless environment while allocating resources. The proposed multi-beam scheme improves overall throughput with only modest delay increases. Finally, the DRL-assisted beam management achieves both communication and sensing performance close to that of the genie-aided benchmark with perfect angle-of-departure (AoD) knowledge. These contributions advance the state-of-the-art intelligent resource management for ISAC systems. I Introduction Sensing is gaining increasing importance in sixth-generation (6G) communications, as it provides richer information to aid communication. Integrated sensing and communication (ISAC) has become a crucial component of 6G technologies for improving quality of service and expanding application scenarios. In ISAC, the sensing module retrieves information such as locations and velocities of objects of interest through parameter estimation from received radio frequency (RF) signals; the communication module focuses on reliable, low-latency data transmission to users over wireless channels. The two integrated modules share hardware and RF resources, including time, spectrum, energy, and beam space. Managing resources allocated to both modules to fulfill their respective requirements is nontrivial in ISAC, especially considering cross-layer requirements in dynamic multi-user scenarios [ 1 ] . Owing to the maturation of millimeter-wave (mmWave) space division multiplexing, resource allocation in the beam space is promising [ 2 ] . mmWave signals suffer from severe free-space path loss and exhibit sparse channel properties, which necessitate directive beamforming to maintain an adequate link budget. Equipping base stations (BSs) with large antenna arrays generates narrow, high-gain beams that compensate for the path loss while simultaneously providing the angular resolution for accurate sensing parameter estimation. This angular sparsity makes beam space a natural and efficient resource dimension, offering an additional degree of freedom to the time and frequency domains [ 3 ] . That said, resource allocation within beam space is non-trivial in practice. Narrow beams in the mmWave spectrum are susceptible to beam drifting, i.e., the beamforming target is not aligned with the center of the beam, especially in high-mobility environments [ 4 ] . In dynamic environments, beams should be predicted to prevent beam failure and avoid losing track of targets. Wide beams cover a large field of view (FoV) but sacrifice signal strength concentration. Beyond physical-layer beam alignment, practical ISAC deployments also need to accommodate stringent quality-of-service (QoS) demands arising from upper-layer data traffic. Conventional single-layer beam management yields poor performance in fulfilling communication latency, sensing accuracy, and QoS requirements simultaneously. The complex coupling between communication and sensing objectives, together with environmental dynamics, makes traditional methods difficult to apply. However, this situation can be turned into an advantage by noting that sensing provides informative observations of the environment and those can be exploited to assist resource management. Motivated by this, this paper develops a deep reinforcement learning (DRL) framework that relies upon the sensing module to facilitate cross-layer interaction between the queue management and physical-layer beam management for ISAC. I-A Related Work Various frameworks have been proposed for aligning beams and resolving beam drifting. 3GPP standards adopt periodic beam sweeping as the solution [ 2 ] . The sweeping frequency should be optimized according to system kinematics. The work [ 4 ] proposes a varying-beamwidth transmission to mitigate beam drifting in a single user scenario. This protocol relies on user feedback, which can yield high overhead and result in late beam updates. Sensing helps characterize the wireless environment and can potentially predict beam allocation with reduced tracking overhead [ 5 ] . Available works [ 1 , 6 , 7 , 8 ] deploy a sensing receiver to capture reflected echoes, from which the AoD is estimated and predicted to improve beam alignment using state evolution models. Obtaining prior knowledge of state evolution is challenging, especially in multi-user dynamic environments. ISAC systems generate a large volume of information on data traffic and sensing requirements that need be processed at control centers. In this case, BS resource allocation and scheduling significantly affect requirement fulfillment and its efficiency. Available work primarily investigates waveform design and resource management [ 8 , 9 , 10 , 7 , 11 , 12 ] by optimizing the metrics of the physical layer or media access control (MAC) layer separately [ 13 ] . Only a few attempts have been made to characterize upper-layer performance that account for queuing effects. [ 14 ] investigates a power and time allocation scheme that jointly minimizes queuing delay and maximizes target detection probability in a single-input single-output (SISO) system. The work [ 15 ] extends the allocation strategy to MIMO ISAC systems. Additionally, [ 16 ] minimizes the transmit power while guaranteeing radar SINR and delay constraints. The stochastic scheduling schemes proposed in [ 14 , 15 ] assume known quantized channel state information (CSI). The scheduling also requires the calculation of state transition probabilities, whose complexity grows exponentially with the quantization level of the channel and packet arrival rates. This scalability issue presents significant challenges for real-time implementation in dynamic environments. Learning-based algorithms stand out because they can capture complex dynamic environments to optimize beam management. Beam selection has been done using deep neural networks to maximize the sum rate [ 11 ] . A deep reinforcement learning (DRL) approach to optimize the beam and power allocation in an ISAC system is studied in [ 9 ] . It maximizes the sum rate while taking estimation precision, i.e., Cramér-Rao lower bound (CRLB), as a penalty. However, resource allocation is optimized for a single time instant, and the proposed method requires genie information for the CRLB calculation. Management of beamwidth and interference between a communication train and a sensing target in a fast-moving railway scenario is studied in [ 10 ] . The proposed DRL model requires user signal-to-interference-plus-noise ratio (SINR) feedback as observations, which increases the scheduling overhead.