Adaptive DRL for IRS Mirror Orientation in Dynamic OWC Networks
Ahrar N. Hamad, Ahmad Adnan Qidan, Taisir E.H. El-Gorashi and Jaafar M. H. Elmirghani · 2025
Read Adaptive DRL for IRS Mirror Orientation in Dynamic OWC Networks by Ahrar N. Hamad, Ahmad Adnan Qidan, Taisir E.H. El-Gorashi and Jaafar M. H. Elmirghani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01818.txt.
Introduction
Ahrar Hamad and co-authors use deep reinforcement learning to steer mirrors that bounce light signals around a room, in a paper from 2025. Optical wireless links are fast but fail when something blocks the direct path. A wall of small adjustable mirrors, called an intelligent reflecting surface, can route light around obstacles.
The goal is to set each mirror's angle to maximize the total data rate for moving users. The task was cast as a step-by-step decision problem. A learning agent based on a policy gradient method adjusts the mirrors in real time. Simulations with moving users and blockages showed the method beat a deep Q-learning baseline. It also far outperformed mirrors left at random angles.
Catalog record
| CREATOR | Ahrar N. Hamad, Ahmad Adnan Qidan, Taisir E.H. El-Gorashi and Jaafar M. H. Elmirghani |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-01818
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adaptive DRL for IRS Mirror Orientation in Dynamic OWC Networks Thanks: This work has been supported by the Engineering and Physical Science Research Council (EPSRC), by the INTERNET project under Grant EP/H040536/1, by the STAR project under Grant EP/K016873/1, by the TOWS project under Grant EP/S016570/1, and by the TITAN project under Grant EP/X04047X/2. All data are provided in full in the results section of this paper. Ahrar N. Hamad, Ahmad Adnan Qidan, Taisir E.H. El-Gorashi and Jaafar M. H. Elmirghani Abstract Intelligent reflecting surfaces (IRSs) have emerged as a promising solution to mitigate line-of-sight (LoS) blockages and enhance signal coverage in optical wireless communication (OWC) systems with minimal additional power. In this work, we consider a mirror-based IRS to assist a dynamic indoor visible light communication (VLC) environment. We formulate an optimization problem that aims to maximize the sum rate by adjusting the orientation of the IRS mirrors. To enable real-time adaptability, the problem is modelled as a Markov decision process (MDP), and a deep reinforcement learning (DRL) algorithm is developed based on the deterministic policy gradient for real-time mirror-based IRS optimization in dynamic VLC networks. The proposed DRL is employed to optimize mirror orientation toward mobile users under blockage and mobility constraints. Simulation results demonstrate that our proposed DRL algorithm outperforms the conventional deep Q-learning (DQL) algorithm and achieves substantial improvements in sum rate compared to random-orientation IRS configurations. I Introduction Optical wireless communication (OWC) is envisioned as a promising technology to meet green communication requirements in sixth-generation (6G) networks, as it offers higher bandwidth, improved energy efficiency, and reduced electromagnetic pollution compared to conventional radio frequency (RF) systems [ 1 ] . Among various OWC technologies, visible light communication (VLC) has gained significant attention due to its ability to provide both lighting and data transmission in indoor environments. However, VLC systems face key challenges, particularly in maintaining reliable coverage. This is because the coverage area of an optical access point (AP) is confined, and line-of-sight (LoS) signals are easily obstructed by physical objects [ 2 ] . The integration of intelligent reflecting surfaces (IRS) offers a promising approach to improve connectivity in indoor VLC systems without consuming much power [ 3 ] . IRS extend coverage by reflecting non-line-of-sight (NLoS) optical signals towards useres, thereby enhancing user experience. Two primary technologies are considered for IRS implementation: mirror arrays and metasurfaces. A mirror array consists of small, passive, and individually controllable mirrors, while a metasurface comprises sub-wavelength elements (meta-atoms) arranged in a planar array. In [ 4 ] , the performance of these IRS types in VLC systems was analyzed. The results indicate that the effectiveness of power focusing depends on the number of IRS reflecting elements as well as the dimensions of the source and reflector. Steerable IRSs offer flexibility by dynamically controlling and directing reflected signals toward mobile users in rapidly changing environments. Recent studies have proposed various algorithms to optimize IRS element orientation in VLC networks. For instance, an efficient sine-cosine algorithm was introduced in [ 5 ] to determine the optimal IRS configuration for establishing a reliable NLoS link. In [ 6 ] , a particle swarm optimization algorithm was developed for an IRS-assisted VLC system to maximize secrecy by identifying optimal mirror orientations. However, conventional optimization algorithms often face limitations in solving complex problems in real-time as they rely on static models and assumptions and lack adaptability to dynamic conditions [ 7 ] . To address these limitations, reinforcement learning (RL) has emerged as a powerful tool that supports adaptive and intelligent decision-making [ 8 ] . RL can derive policies by interacting with the environment, making it well-suited for dynamic wireless network scenarios. In [ 9 ] , conventional RL algorithms such as Q-learning and state-action reward-state-action (SARSA) were employed to improve data rates in indoor IRS-aided OWC systems. However, these methods suffer from memory inefficiency due to their reliance on a Q-table, which becomes computationally infeasible in large state-action spaces. To overcome this, deep Q-learning (DQL) was proposed in [ 10 ] to manage VLC networks and enhance spectral efficiency. DQL leverages experience replay and target networks to improve sample efficiency and training stability. Nevertheless, it still struggles with continuous action spaces, which are common in practical scenarios. To address this, a deep reinforcement learning (DRL) algorithm was proposed in [ 11 ] , combining the strengths of deterministic policy gradients and DQL to effectively manage continuous action spaces, overcoming the limitations of DQL-based methods. Fig. 1: IRS-assisted VLC system model with the DRL framework. In contrast to the prior works that optimize IRS configuration as an association matrix or assume static users, we develop a DRL-based algorithm based on a deterministic policy to jointly optimize IRS mirror orientations for multi users while ensuring quality of service (QoS) constraints for each user in indoor environments. The optimisation problem is formulated as a Markov decision process (MDP) and solved using the DRL framework [ 11 ] . The algorithm is trained offline and tested in real-time to improve the QoS for multiple mobile users traveling at varying velocities. We evaluate system performance considering realistic dynamic conditions, including blockage, mobility and channel variations. Our results demonstrate that the proposed DRL algorithm significantly enhances user experience compared to DQL and conventional algorithms. The rest of this paper is structured as follows: Section II presents the system model. Section III formulates the optimization problem. Section IV explains the application of RL algorithms to solve the problem. Section V discusses the simulation results. Finally, Section VI concludes the paper. II System Model We consider a downlink IRS-assisted VLC system, as shown in Fig. 1 . An array of light-emitting diode (LEDs) is placed on the ceiling as an optical AP, l , for communication and illumination. On the communication floor, a number of mobile users, \mathcal{K}=[1,\dots,K] , move at different velocities. Each user is equipped with a multi-branch angle diversity receiver (ADR) assumed to be upward-oriented as in [ 12 ] . Furthermore, an IRS mirror array is mounted on one of the walls and consists of \mathcal{M}=[1,\dots,M_{ij}] mirrors. The area of each mirror is dA_{m}=h_{m}\times w_{m} , where h_{m} and w_{m} represent the height and width, respectively. A space q_{m} is considered between the mirrors. In addition, the orientation of the rotational mirror can be controlled by two angles: the roll angle, \varphi_{m} , and the yaw angle, \vartheta_{m} , via the micro-electro-mechanical systems (MEMS) technology [ 13 ] . This rotation allows the mirror to steer the reflected signal from the AP in the desired direction toward the users, as shown in Fig. 1 . The network is managed through a central unit (CU), which gathers global information through a WiFi AP and manages resource allocation in real time. II-A VLC channel model 1) LoS channel gain: The channel gain of the direct LoS between user k and the optical AP is given by H_{k,l}^{\text{LoS}}=\begin{cases}\frac{(n+1)A_{r}\cos^{n}(\varpi_{k,l})\cos(\delta_{k,l})}{2\pi D_{k,l}^{2}},&0\leq\delta_{k,l}\leq\psi_{c}\\ \quad\quad 0,&\delta_{k,l}>\psi_{c}\end{cases} (1) where n=-\ln(2)/\ln(\cos(\phi_{1/2})) is the order of Lambertian emission, which is based on the LED half-power semi-angle \phi_{1/2} . A_{r} is the area of the detector, \varpi_{k,l} and \delta_{k,l} are the irradiance angle and incidence angle, respectively. D_{k,l} is the LoS transmission distance between AP l