Accelerating Network Slice Placement with Multi-Agent Reinforcement Learning

Ioannis Panitsas *§ , Tolga O. Atalay § , Dragoslav Stojadinovic § , Angelos Stavrou †§ , Leandros Tassiulas * · 2025

Read Accelerating Network Slice Placement with Multi-Agent Reinforcement Learning by Ioannis Panitsas *§ , Tolga O. Atalay § , Dragoslav Stojadinovic § , Angelos Stavrou †§ , Leandros Tassiulas * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-18545.txt.

Introduction

Network slicing lets one mobile network serve many uses, each with its own service promises. Ioannis Panitsas and four co-authors present SlicePilot, a framework for placing those slices across mixed clouds. Their 2025 paper tackles a hard layout problem: cloud sites differ in power and cost, and slices differ in demand. Placement must stay cheap while keeping each slice's quality promises.

SlicePilot first profiles real traffic to estimate what each slice type needs. A team of learning agents then schedules the software functions, aiming at low cost under quality limits. On a multi-cloud testbed, the method ran nineteen times faster than exact combinatorial solvers. Its costs stayed within about eight percent of the best known. Under heavy load it breached quality promises more often, a trade the authors accept for speed. They present it as fit for live, fast-moving deployments.

Catalog record

CREATORIoannis Panitsas *§ , Tolga O. Atalay § , Dragoslav Stojadinovic § , Angelos Stavrou †§ , Leandros Tassiulas *
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-18545

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Accelerating Network Slice Placement with Multi-Agent Reinforcement Learning Ioannis Panitsas *§ , Tolga O. Atalay § , Dragoslav Stojadinovic § , Angelos Stavrou †§ , Leandros Tassiulas * Abstract Cellular networks are increasingly realized through software-based entities, with core functions deployed as Virtual Network Functions (VNFs) on Commercial-off-the-Shelf (COTS) hardware. Network slicing has emerged as a key enabler of 5G by providing logically isolated Quality of Service (QoS) guarantees for diverse applications. With the adoption of cloud-native infrastructures, the placement of network slices across heterogeneous multi-cloud environments poses new challenges due to variable resource capabilities and slice-specific requirements. This paper introduces a modular framework for autonomous and near-optimal VNF placement based on a disaggregated Multi-Agent Reinforcement Learning (MARL) approach. The framework incorporates real traffic profiles to estimate slice resource demands and employs a MARL-based scheduler to minimize deployment cost while meeting QoS constraints. Experimental evaluation on a multi-cloud testbed shows a 19× speed-up compared to combinatorial optimization, with deployment costs within 7.8% of the optimal. While the method incurs up to 2.42× more QoS violations under high load, the trade-off provides significantly faster decision-making and reduced computational complexity. These results suggest that MARL-based approaches offer a scalable and cost-efficient solution for real-time network slice placement in heterogeneous infrastructures. I Introduction Next-generation cellular networks are evolving to support various use cases, each with distinct Quality of Service (QoS) requirements. To accommodate this evolving diversity, “network slicing” has emerged as a key enabler, facilitating the creation of virtually isolated network segments over a shared physical infrastructure to support different use cases like URLLC (Ultra-Reliable Low-Latency Communication), eMBB (Enhanced Mobile Broadband), and mMTC (massive Machine Type Communications) [ 1 , 2 ] . The advent of network slicing is facilitated by the adoption of foundational technologies such as Network Function Virtualization (NFV) and Software Defined Networking (SDN) [ 3 , 4 ] . Leveraging NFV and SDN, the proprietary Physical Network Functions (PNFs) that made up the legacy 4G Radio Access Network (RAN) and Core Network (CN), are now deployed as Virtual Network Functions (VNFs) on Commercial-off-the-Shelf (COTS) hardware in the form of finer-grained microservices. A network slice is ultimately formed by service chaining a set of VNFs to create an isolated network segment that extends from the RAN to the CN [ 2 ] . To capitalize on this software-driven approach, network operators are partnering with cloud providers to advance cloud-based 5G deployments [ 5 , 6 ] . This shift enables the dynamic instantiation and migration of network slice VNFs across a geographically distributed cloud infrastructure. By leveraging this flexibility, operators can tailor deployment strategies to accommodate the diverse Service Level Agreements (SLAs) of different use cases. Specifically, operators can strategically position latency-sensitive VNFs closer to the RAN at edge locations [ 7 , 8 ] , despite higher computational costs, while hosting less critical functions more cost-effectively in regional or central clouds [ 2 , 9 , 10 ] . Modern multi-cloud infrastructures provide a wide range of computing, networking, and storage capabilities. With infrastructure heterogeneity, coupled with diverse service requirements in terms of latency, bandwidth, and reliability, strategic VNF placement decisions become essential for optimizing resource use and supporting varied application demands in next-generation networks. Motivation . The problem of network slice placement is widely recognized in the literature as a variant of the Virtual Network Embedding (VNE) problem, which is proven to be NP-hard [ 9 ] . Prior work has explored Integer Linear Programming (ILP)-based methods to achieve optimality [ 11 , 12 , 13 ] , but these approaches do not scale and are computationally intensive, making them impractical for real-time decisions. Heuristic-based strategies have been proposed to improve efficiency, yet they often fail to achieve solutions close to the optimum, as they tend to get stuck in local optima [ 14 , 15 ] . More recently, Reinforcement Learning (RL) has gained traction as a promising approach for optimal slice placement through trial and error procedures [ 16 , 17 ] . However, existing RL solutions predominantly rely on monolithic agent implementations that struggle to capture resource and service constraints of different slice types [ 18 , 19 , 20 ] , lack real-world validation [ 20 , 21 ] , and scale poorly in large deployments [ 19 , 20 ] . To address the optimal VNF placement problem, this paper introduces SlicePilot , a Multi-Agent Reinforcement Learning (MARL)-based placement framework designed to minimize human intervention and enable automated, zero-touch network management. SlicePilot automates the deployment of network slice VNFs and disaggregated RAN components by leveraging slice-specific traffic profiles, resource demands, and infrastructure resource state. This information is then used to craft an optimal VNF placement strategy within a distributed cloud environment. Building on this foundation and practical insights, this work makes the following key contributions: • We collect real-world traffic from our over-the-air 5G testbed, capturing diverse slice-specific patterns to construct realistic and representative traffic profiles. • We analyze the resource demands of key user plane VNFs by replaying the captured traffic, enabling accurate resource estimation and slice placement optimization through enhancements to the open-source OpenAirInterface (OAI) 5G software stack [ 22 ] . • We design and implement a fully customized, disaggregated MARL scheduler that optimizes slice deployment in heterogeneous cloud infrastructures while jointly ensuring cost-efficiency and SLA compliance. • We deploy SlicePilot in a Kubernetes-orchestrated cluster hosted on OpenStack, emulating a realistic multi-cloud infrastructure environment. Our evaluation demonstrates that SlicePilot delivers a 19× speed-up over traditional combinatorial optimization methods, achieves deployment costs within 7.8% of the optimal solution, and tolerates 2.42× more SLA violations, highlighting its ability to enable cost-efficient and scalable slice deployments. • To foster reproducibility and enable further research, we plan to publicly release all artifacts, including the collected datasets, source code, and deployment scripts. The remainder of the paper is organized as follows. Section II provides background on 5G architecture and network slicing. Section III introduces the SlicePilot framework along with its components. Section IV outlines the experimental setup used for real-world validation while Section V presents the evaluation results, followed by a discussion of related work in Section VI. Finally, Section VII concludes our work. II BACKGROUND 5G System Architecture . A 5G cellular system, as illustrated in Fig. 1 , consists of three main components: the RAN, which provides over-the-air connectivity between User Equipment (UE) and the network; the CN, which manages session control, mobility, and interconnectivity with external Data Networks (DNs); and the Transport Network (TN), responsible for carrying traffic between RAN and CN elements. Radio Access Network : Unlike previous generations, the 5G RAN embraces a disaggregated virtualized architecture that enhances efficiency and scalability by allowing network operators to dynamically allocate resources based on service demands [ 23 ] . This is achieved by virtualizing baseband processing functions, enabling flexible deployment on cloud infrastructures. The RAN is composed of three main units: the Radio Unit (RU), which handles radio transmission, reception, and antenna processing; the Distributed Unit (DU), responsible for lower-layer processing such as error correction and resource allocation; and the Centralized Unit (CU), which manages higher-layer functions [ 23 ] . Core Network : The 5G CN is designed with a service-based,

Read the complete text