Optimizing Resource Allocation for QoS and Stability in Dynamic VLC-NOMA Networks via MARL
Aubida A. Al-Hameed, Safwan Hafeedh Younus, Mohamad A. Ahmed, Abdullah Baz · 2025
Read Optimizing Resource Allocation for QoS and Stability in Dynamic VLC-NOMA Networks via MARL by Aubida A. Al-Hameed, Safwan Hafeedh Younus, Mohamad A. Ahmed, Abdullah Baz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15841.txt.
Introduction
Aubida Al-Hameed and co-authors published an engineering paper in 2025 on sharing resources in indoor wireless networks that use light. These networks pair visible light links with a method that lets users share the same channel. Conditions shift as users move and lights dim, which strains service quality and stability. Older methods and simple learning methods struggle to balance both aims at once.
The team built learning frameworks where each light access point acts as an agent that sets power and picks users. They compare two training styles, one with shared training and local action, one fully shared. Test runs show both handle the joint task, with trade-offs between them in service quality for high-priority users.
Catalog record
| CREATOR | Aubida A. Al-Hameed, Safwan Hafeedh Younus, Mohamad A. Ahmed, Abdullah Baz |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-15841
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Optimizing Resource Allocation for QoS and Stability in Dynamic VLC-NOMA Networks via MARL Aubida A. Al-Hameed, Safwan Hafeedh Younus, Mohamad A. Ahmed, Abdullah Baz Abstract Visible Light Communication (VLC) combined with Non-Orthogonal Multiple Access (NOMA) offers a promising solution for dense indoor wireless networks. Yet, managing resources effectively is challenged by VLC network dynamic conditions involving user mobility and light dimming. In addition to satisfying Quality of Service (QoS) and network stability requirements. Traditional resource allocation methods and simpler RL approaches struggle to jointly optimize QoS and stability under the dynamic conditions of mobile VLC-NOMA networks. This paper presents MARL frameworks tailored to perform complex joint optimization of resource allocation (NOMA power, user scheduling) and network stability (interference, handovers), considering heterogeneous QoS, user mobility, and dimming in VLC-NOMA systems. Our MARL frameworks capture dynamic channel conditions and diverse user QoS , enabling effective joint optimization. In these frameworks, VLC access points (APs) act as intelligent agents, learning to allocate power and schedule users to satisfy diverse requirements while maintaining network stability by managing interference and minimizing disruptive handovers. We conduct a comparative analysis of two key MARL paradigms: 1) Centralized Training with Decentralized Execution (CTDE) and 2) Centralized Training with Centralized Execution (CTCE). Comprehensive simulations validate the effectiveness of both tailored MARL frameworks and demonstrate an ability to handle complex optimization. The results show key trade-offs, as the CTDE approach achieved approximately 16% higher for High priority (HP) user QoS satisfaction, while the CTCE approach yielded nearly 7 dB higher average SINR and 12% lower ping-pong handover ratio, offering valuable insights into the performance differences between these paradigms in complex VLC-NOMA network scenarios. I Introduction The relentless demand for increased data rates and broad connectivity, especially in indoor environments, is propelling research beyond traditional Radio Frequency (RF) wireless technologies. Visible Light Communication (VLC) has arisen as an innovative complementary technology, utilizing current lighting infrastructure to deliver high-bandwidth, license-free, and intrinsically secure wireless connections [ 2 ] [ 52 ] . By employing Light Emitting Diodes (LEDs) for illumination as well as data transmission, Visible Light Communication (VLC) provides a substantial unregulated spectrum and significant spatial reuse potential, making it appropriate for densely populated indoor environments [ 3 ] . Non-Orthogonal Multiple Access (NOMA) has been recognized as a pivotal technology for augmenting spectral efficiency in the VLC systems [ 4 ] [ 53 ] . NOMA enables multiple users to simultaneously utilize identical time-frequency resources through power-domain multiplexing, considerably enhancing user capacity relative to conventional Orthogonal Multiple Access (OMA) techniques, and is particularly compatible with the characteristics of VLC channels [ 5 ] . Nonetheless, achieving the entire capacity of VLC-NOMA in dynamic indoor environments poses major challenges. These environments are defined by multiple light sources and users in close proximity, resulting in extensive interference patterns. User mobility and light attenuation lead to channel fluctuations, requiring effective handover strategies between VLC access points to ensure uninterrupted connectivity [ 6 ] . In addition, within an indoor network, users often require diverse Quality of Service (QoS) requirements, with applications such as video conferencing and virtual reality demanding elevated data rates and low latency. Alongside traditional data users requiring a minimum assured throughput, this addresses the many requirements expected in forthcoming 6G applications [ 7 ] . Simultaneously guaranteeing higher Quality of Service (QoS) for priority users, managing inter-cell interference (ICI), and facilitating seamless handovers constitutes a highly intricate and multi-faceted resource allocation challenge [ 8 ] . The inherent dependency of these aims, such as maximizing throughput, can cause interference, consequently complicating optimization significantly. Traditional resource allocation approaches to VLC-NOMA, typically reliant on static rules [ 14 ] . Also, the mathematical optimization designed for simplified scenarios without with the high dimensions and unpredictability inherent to dynamic VLC-NOMA networks [ 9 ] . Optimization methods may become computationally unfeasible, while heuristics frequently yield sub optimal results, struggling to adapt to real-time fluctuations in network conditions, user requirements, or fluctuations in channel quality due to mobility and dimming [ 10 ] . Single-agent Reinforcement Learning (RL) approaches have shown potential in adapting to dynamic conditions in wireless networks [ 11 ] [ 55 ] [ 56 ] . Early study utilizing reinforcement learning for VLC-NOMA power allocation underlines its potential, however often focuses on relatively basic reinforcement learning models [ 15 ] . Consequently, a distinct need emerges for an intelligent and coordinated resource allocation mechanism that can develop near-optimal strategies for these sophisticated network requirements. In this paper, we present a Multi-Agent Reinforcement Learning (MARL) framework to overcome these limitations in resource allocation for dynamic VLC-NOMA networks. MARL is effective at handling challenges involving numerous interacting decision-makers within a such an environment [ 12 ] . In addition, in [ 16 ] , the MARL has proven effective in complicated resource management tasks, including those in VLC network setups. In our proposed framework, individual VLC access points act as autonomous agents, acquiring cooperative strategies to enhance resource allocation (NOMA power coefficients, user scheduling decisions) based on local observations during training. Our aim is to empower agents to develop policies that collectively enhance network performance across various dimensions: 1) fulfilling diverse QoS needs, 2) maintaining network stability, 3) effectively managing interference, and 4) assuring handover stability. We examine and compare two key MARL paradigms: Centralized Training with Decentralized Execution (CTDE) and Centralized Training with Centralized Execution (CTCE). These paradigms present unique trade-offs between coordination capabilities and execution complexity [ 13 ] [ 17 ] . We develop tailored state representations, action spaces, and multi-objective reward functions that explicitly integrate key components of the VLC-NOMA dynamic environment, covering user mobility, light dimming, QoS classes, interference levels, and handover. This paper’s main contributions are summarized as follows: • We propose and assess tailored MARL frameworks, specifically Centralized Training with Decentralized Execution (CTDE) employing Multi-Agent Proximal Policy Optimization (MAPPO) and Centralized Training with Centralized Execution (CTCE) utilizing Centralized Proximal Policy Optimization (PPO), for the tangled task of simultaneously optimizing Quality of Service (QoS) maintaining and network stability, which includes resource allocation, interference management, and handover stability, within dynamic indoor VLC-NOMA networks characterized by user mobility and light dimming. • We developed tailored MARL components, which include state representations that integrate local and neighboring information, composite action spaces that facilitate simultaneous management of NOMA power allocation, users’ scheduling and handover triggers. In addition to design a multi-objective reward function that specifically targets those distinct challenges and dynamics of mobile VLC-NOMA systems with diverse user requirements. • We establish a systematic method employing Bayesian Optimization to determine the critical convergence between possibly conflicting QoS and stability objectives within the MARL reward function, thereby providing a methodical tuning procedure for the multi-objective problem. • We illustrated through thorough simulations the ability of the proposed MARL frameworks in attaining enhanced performance in QoS satisfaction, network throughput, fairness, and handover stability compared to a traditional baseline resource allocation strategy. The subsequent sections of this paper are structured as follows. Section II outlines the system model for the dynamic mobile VLC-NOMA network. Section III defines the proposed MARL framework and the particulars of the CTDE and CTCE implementations. Section IV defines the simulation configuration and settings. Section discusses and analyzes the