Access Probability Optimization in RACH: A Multi-Armed Bandits Approach

Ahmed O. Elmeligy, Ioannis Psaromiligkos, and Au Minh · 2025

Read Access Probability Optimization in RACH: A Multi-Armed Bandits Approach by Ahmed O. Elmeligy, Ioannis Psaromiligkos, and Au Minh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-14085.txt.

Introduction

Elmeligy, Psaromiligkos and Minh tackle in 2025 congestion on the random access channel when huge numbers of devices try to join a cellular network. They model a two-priority access system where the base station watches device behavior patterns. A non-uniform preamble choice gives high-priority devices better odds. An allocation model then sets access probabilities to favor urgent devices while protecting others.

Solving that model needs knowledge the base station lacks, so they use multi-armed bandits, a reinforcement learning method. It finds near-optimal settings and scales well. The approach needs no count of how many devices are present.

Catalog record

CREATORAhmed O. Elmeligy, Ioannis Psaromiligkos, and Au Minh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-14085

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Access Probability Optimization in RACH: A Multi-Armed Bandits Approach Ahmed O. Elmeligy, Ioannis Psaromiligkos, and Au Minh Abstract The use of cellular networks for massive machine-type communications (mMTC) is an appealing solution due to the availability of the existing infrastructure. However, the massive number of user equipments (UEs) poses a significant challenge to the cellular network’s random access channel (RACH) regarding congestion and overloading. To mitigate this problem, we first present a novel approach to model a two-priority RACH, which allows us to define access patterns that describe the random access behavior of UEs as observed by the base station (BS). A non-uniform preamble selection scheme is proposed, offering increased flexibility in resource allocation for different UE priority classes. Then, we formulate an allocation model that finds the optimal access probabilities to maximize the success rate of high-priority UEs while constraining low-priority UEs. Finally, we develop a reinforcement learning approach to solving the optimization problem using multi-armed bandits, which provides a near-optimal but scalable solution and does not require the BS to know the number of UEs in the network. I Introduction The random access channel (RACH) is a crucial component in cellular networks, enabling user equipments (UEs) to request access for communication and establish a connection to the base station (BS) [ 1 ] The RACH is created through a periodic allocation of time and frequency resources, known as RACHs slot [ 2 ] . The periodicity of the RACH slot is determined by the physical RACH configuration index, which is broadcasted by the BS . During a RACH slot, UEs can access the network by transmitting a randomly selected preamble to the BS from a finite set of preambles. A preamble is a sequence of symbols uniquely identifying a UE to the BS ; it can be thought of as a UE ’s digital signature. If a single UE chooses a unique preamble, the BS can successfully decode it. However, challenges arise in the context of massive machine-type communication (mMTC) applications, where a large number of UEs accessing the network through the RACH can lead to congestion and overloading issues [ 3 , 4 ] . Futhermore, congestion can be exacerbated by recurring UEs that periodically synchronize to communicate simultaneously with application servers [ 5 ] . The RACH congestion problem arises when multiple UEs select the same preamble during a slot, resulting in collisions [ 6 ] . In essence, this situation can be likened to a scenario where a finite set of resource blocks (RBs) , represented by the preambles, are randomly accessed by a pool of UEs . The collisions pose a significant challenge in effectively managing the access requests from a massive number of UEs [ 7 , 8 ] . The challenge intensifies due to the implementation of priority access (PA) , which consolidates multiple mMTC applications to be served by a single cellular network. This strategic approach aims for cost efficiency by leveraging existing infrastructure and eliminating the necessity for deploying multiple networks. However, the amalgamation of diverse mMTC applications seeking PA introduces complexities in the RACH mechanism, necessitating innovative approaches to mitigate congestion and enhance the overall efficiency of the access procedure. I-A Related Work There have been several studies on the PA problem in the literature. Statistical based multiple access (SPMA) is a PA scheme first utilized by the U.S. Military Tactical Targeting Network Technology (TTNT) [ 9 ] . In SPMA , each UE first estimates how busy the channel is by calculating the channel occupancy statistic (COS) . Several methods have been developed to calculate the COS [ 9 , 10 ] ; for example, to find the COS , each UE counts the number of transmissions heard from other UEs in the network using a weighted sum over a predefined statistical sliding window [ 11 ] . Then, the COS is compared to a threshold that depends on the UE ’s priority. If the COS is below the threshold, the UE can access the channel. Otherwise, the UE is denied access. Once channel access is granted, SPMA uses a combination of frequency and time hopping in conjunction with turbo codes to split the packet into multiple bursts and transmit them over the channel [ 12 ] . On the other hand, the work in [ 13 ] dynamically adjusts the number of available RBs for each priority class based on the network load before each RACH slot to reduce access delay. Another PA scheme is Access class barring (ACB) proposed by the 3rd Generation Partnership Project (3GPP) to mitigate access congestion in long-term evolution (LTE) random access [ 14 ] . In ACB , each UE is assigned a backoff time or barring rate depending on the predetermined priority level of the UE . A challenge with ACB is that the barring rate for each UE is fixed; as a result, if a low-priority user equipment (L-UE) is denied access multiple times to the channel, its buffer might overflow, resulting in dropped packets. A solution to the above problem is the queue-aware priority access classification (QPAC) -based ACB , which dynamically adjusts the barring rate based on the packet queue size of each UE [ 15 ] . In QPAC , a higher priority is assigned to UEs with longer packet queues in their respective buffers. The authors in [ 16 ] dynamically allocate non-overlapping RBs to each priority class by first estimating the number of UEs in each class using a Bayesian approach. This estimation is based on the number of empty RBs , leaving out potentially useful information that could improve the estimator’s accuracy. Based on the estimation, the RBs are then distributed to achieve a success rate that aligns with the corresponding priority class. Moving beyond conventional approaches, several studies have explored the application of reinforcement learning (RL) techniques to optimize resource allocation in cellular networks [ 17 , 18 , 19 , 20 ] . RL , a subfield of machine learning, involves training agents via trial and error to make decisions in an environment to achieve specific goals. Through continuous interaction and adaptation, RL enables autonomous decision-making, making it well-suited for addressing the complex and evolving nature of resource allocation challenges in cellular networks, where the network is subject to constant changes in UE behavior, traffic patterns, network conditions, and overall demand for resources. For instance, in the context of cellular networks, Q-learning has been employed to maximize spectrum utilization efficiency [ 21 ] , while in [ 22 ] , learning automata in combination with Q-learning is used to minimize UE collisions. Furthermore, the authors in [ 23 ] leverage a proximal policy optimization RL algorithm to dynamically adjust the number of available RBs and find ACB parameters that maximize the number of successful UEs . Deep RL approaches, as seen in [ 24 ] , aim to reduce collisions and improve the success probability of UEs by dynamically distributing RBs across different priority classes instead of using a fixed allocation such as in [ 25 , 26 , 27 ] ; this is possible due to the ability of deep RL to leverage deep neural networks and learn complex and

Read the complete text