Two-Agent DRL for Power Allocation and IRS Orientation in Dynamic NOMA-based OWC Networks
Ahrar N. Hamad, Ahmad Adnan Qidan, Taisir E.H. El-Gorashi and Jaafar M. H. Elmirghani · 2025
Read Two-Agent DRL for Power Allocation and IRS Orientation in Dynamic NOMA-based OWC Networks by Ahrar N. Hamad, Ahmad Adnan Qidan, Taisir E.H. El-Gorashi and Jaafar M. H. Elmirghani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-18937.txt.
Introduction
Ahrar Hamad and three colleagues present a 2025 telecommunications paper on making light-based indoor networks smarter. Visible light links fail when something blocks the beam, so engineers add intelligent reflecting surfaces, walls of tiny mirrors that bounce light around obstacles. Pairing those mirrors with a scheme that lets users share the channel can raise total throughput.
Because users move, the best power split and mirror angles keep changing, and the math has no tidy solution. The authors train two cooperating deep reinforcement learning agents, one steering power, the other mirror orientation, under a train-centrally, act-locally scheme. Simulations beat standard learning methods and setups with no mirrors or random mirrors on both efficiency and fairness.
Catalog record
| CREATOR | Ahrar N. Hamad, Ahmad Adnan Qidan, Taisir E.H. El-Gorashi and Jaafar M. H. Elmirghani |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-18937
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Two-Agent DRL for Power Allocation and IRS Orientation in Dynamic NOMA-based OWC Networks Ahrar N. Hamad, Ahmad Adnan Qidan, Taisir E.H. El-Gorashi and Jaafar M. H. Elmirghani Abstract Intelligent reflecting surfaces (IRSs) technology has been considered a promising solution in visible light communication (VLC) systems due to its potential to overcome the line-of-sight (LoS) blockage issue and enhance coverage. Moreover, integrating IRS with a downlink non-orthogonal multiple access (NOMA) transmission technique for multi-users is a smart solution to achieve a high sum rate and improve system performance. In this paper, a dynamic IRS-assisted NOMA-VLC system is modeled, and an optimization problem is formulated to maximize sum energy efficiency (SEE) and fairness among multiple mobile users under power allocation and IRS mirror orientation constraints. Due to the non-convex nature of the optimization problem and the non-linearity of the constraints, conventional optimization methods are impractical for real-time solutions. Therefore, a two-agent deep reinforcement learning (DRL) algorithm is designed for optimizing power allocation and IRS orientation based on centralized training with decentralized execution to obtain fast and real-time solutions in dynamic environments. The results show the superior performance of the proposed DRL algorithm compared to standard DRL algorithms typically used for resource allocation in wireless communication. The results also show that the proposed DRL algorithm achieves higher performance compared to deployments without IRS and with randomly oriented IRS elements. I Introduction Sixth-generation (6G) networks face the challenge of supporting ever-increasing user connectivity and bandwidth-intensive applications. To address this, researchers explore significant technologies such as optical wireless communications (OWCs) [ 1 ] . More specifically, visible light communication (VLC) has emerged as a promising complementary technology to radio frequency (RF), which offers several advantages, including unlicensed spectrum utilization, immunity to RF interference, and enhanced spectral efficiency [ 2 ] . In indoor environments, VLC systems can significantly improve throughput and connectivity through the dual use of lighting infrastructure for both illumination and data transmission [ 3 ] . However, practical VLC deployments face critical challenges, particularly in maintaining reliable line-of-sight (LoS) connections in dynamic indoor environments where signal blockage and shadowing are common occurrences. Intelligent reflecting surfaces (IRSs) technology, which reprovides an alternative path for signals to follow, has emerged as an important enabling technology for 6G networks [ 4 ] . IRS is a surface that consists of several reflecting elements, such as metasurfaces or mirrors, which can be dynamically adjusted to control the reflection characteristics of incoming signals [ 5 ] . The integration of IRS in VLC systems has demonstrated improved data rate, enhanced coverage of the system, and the ability to overcome the LoS blockage challenge through steering non-line-of-sight (NLoS) reflection signals towards users [ 6 ] . In multiuser VLC systems, employing non-orthogonal multiple access (NOMA) technique has the potential to significantly increase the VLC system throughput compared to conventional orthogonal multiple access (OMA) techniques [ 7 ] . In [ 8 ] , the integration of IRS and NOMA in VLC systems was investigated for enhancing spectral efficiency and user connectivity. However, this integration presents challenges in system optimization. For instance, the joint optimization of power allocation coefficients and IRS configuration parameters becomes crucial in dynamic VLC systems [ 9 ] . Moreover, conventional optimization algorithms, such as greedy algorithms, genetic algorithms, and iterative algorithms, are insufficient for real-time deployments where traffic demand and user distribution are subject to frequent updates [ 10 ] , [ 11 ] . To tackle the aforementioned limitations, machine learning (ML) techniques have emerged as a promising solution to address the limitations of traditional algorithms in solving nonlinear and non-convex optimization problems [ 12 ] . In [ 13 ] , the use of deep neural networks (DNNs) in VLC systems shows potential to estimate and predict key parameters for optimization. However, DNN models require extensive labeled data, which can be time-consuming and hard to obtain. Reinforcement learning (RL) is another ML technique considered as a promising tool to solve various optimization problems in wireless communication environments where the environment interacts with an agent and obtains rewards [ 14 ] , [ 15 ] . Unlike supervised learning, RL agents navigate without explicit guidance, discovering policies through trial and error within the environment. For solving high-dimensional optimization problems with computational complexity, deep reinforcement learning (DRL) algorithms effectively address such challenges due to their model-free nature, which enables direct learning. In [ 16 ] , [ 17 ] , a deep Q-network (DQN) algorithm was used to solve complex resource allocation in heterogeneous wireless networks. However, DQN is a value-based method and inherently limited to discrete action spaces. To address this limitation, a deep deterministic policy gradient (DDPG) algorithm is developed to handle continuous state and action spaces by combining DQN principles with an actor-critic architecture [ 18 ] , [ 19 ] . I-A Related Works and Motivation Recently, the integration of IRS into VLC systems has attracted attention from both academia and industry [ 5 ] , [ 6 ] , [ 11 ] , [ 20 ] . In particular, analytical expressions were derived in [ 5 ] for IRS implementations in VLC systems using metasurfaces and mirror arrays. In [ 6 ] , an efficient sine-cosine algorithm was designed to determine the ideal IRS configuration and to create reliable NLoS links. In [ 11 ] , the inherent blockage limitation of VLC with IRS integration was addressed by using a point-source model considering LoS and NLoS signals. Furthermore, iterative algorithms called frozen variables and minorization-maximization were developed in [ 20 ] to solve a resource management optimization problem in an IRS-aided VLC system, aiming for enhanced spectral efficiency. The application of NOMA in IRS-assisted wireless networks has gained increasing interest, particularly in RF systems, for better use of resources. Existing studies have focused on optimizing various communication parameters, including power allocation, phase shift, and user pairing, to maximize spectral and energy efficiency [ 21 ] , [ 22 ] , [ 23 ] , [ 24 ] . In the context of OWC, only a few works in the literature have employed NOMA for multi-user interference management in IRS-assisted VLC networks. For instance, in [ 25 ] , an adaptive-restart genetic algorithm was proposed to solve the optimization of IRS reflection coefficients, NOMA decoding order, and power allocation. Moreover, a low-complexity algorithm was introduced in [ 26 ] for optimal IRS passive beamforming in an IRS-assisted NOMA-based VLC system. However, several critical challenges remain unaddressed, including user mobility and time-varying traffic demand, where conventional algorithms for optimization are impractical, facing computational limitations in real-time. For practical and instantaneous solutions, RL algorithms were explored as promising alternatives to consider for complex optimization problems in wireless networks [ 27 ] . In [ 16 ] , DQN was designed to optimize power allocation in hybrid RF/VLC networks to reach target data rates. In [ 28 ] , a deep Q-learning (DQL) framework was proposed for NOMA-VLC to optimize power allocation and LED transmission angles. Furthermore, a two-stage DQL resource management approach was designed to optimize spectral efficiency and fairness in indoor VLC systems. It is worth pointing out that DQL algorithms are effective for discrete action spaces, and they face significant