Scale : Deep Reinforcement Learning for Container Scheduling in Serverless Edge Computing
Chen Chen 1 , Zihan Jia 2 , Andrea Sabbioni 3 , Reza Farahani 4 , Lei Jiao 5 · 2026
Read Scale : Deep Reinforcement Learning for Container Scheduling in Serverless Edge Computing by Chen Chen 1 , Zihan Jia 2 , Andrea Sabbioni 3 , Reza Farahani 4 , Lei Jiao 5 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15704.txt.
Introduction
Chen Chen, Zihan Jia, Andrea Sabbioni, Reza Farahani, and Lei Jiao present Scale, a scheduling frame for serverless edge computing. Placing requests and managing resources in shifting, mixed edge systems is hard. Scale uses policy deep reinforcement learning to balance stability and performance under shifting loads. Its design weighs service-level goals, end-to-end latency, and data locality in each scheduling choice. In Huawei Cloud simulations it lands within a factor of 1.11 to 1.15 of a top integer programming solver, while cutting decision time by up to 99 percent.
Catalog record
| CREATOR | Chen Chen 1 , Zihan Jia 2 , Andrea Sabbioni 3 , Reza Farahani 4 , Lei Jiao 5 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26530 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.15704
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Scale : Deep Reinforcement Learning for Container Scheduling in Serverless Edge Computing Chen Chen 1 , Zihan Jia 2 , Andrea Sabbioni 3 , Reza Farahani 4 , Lei Jiao 5 Abstract Serverless computing has emerged as a promising computing paradigm for edge computing. However, adopting the event-driven model in highly dynamic, heterogeneous, and distributed edge systems poses significant challenges in request placement and resource management. Efficiently allocating requests to containers is therefore critical to reduce resource over-provisioning and unnecessary data movement. This paper proposes Scale , a Service Level Objective (SLO)-aware container scheduling and resource allocation framework designed for serverless edge computing. Scale employs a policy-based deep reinforcement learning algorithm to balance system stability and performance under dynamic workloads. The design jointly incorporates SLO constraints, end-to-end latency, and data locality into the scheduling decision process. Extensive simulations using large-scale real-world datasets from Huawei Cloud demonstrate that Scale achieves solutions within a factor of 1.11–1.15 of a state-of-the-art Integer Linear Programming (ILP) solver, while reducing decision-making time by up to 99%. I Introduction Serverless computing has emerged as a computing paradigm that abstracts infrastructure management and enables fine-grained, elastic resource provisioning, with Function-as-a-Service (FaaS) representing its most widely adopted execution model for event-driven workloads [ 4 , 22 , 24 ] . By decoupling application logic from infrastructure concerns, serverless platforms relieve developers from explicitly provisioning, configuring, and managing compute resources, allowing them to focus primarily on application functionality. In this paradigm, developers submit function code to the FaaS platform, which dynamically provisions, scales, and manages the underlying execution environments in response to workload demand [ 5 , 12 ] . Serverless computing is particularly well-suited for applications with highly variable workloads, such as those in machine learning (ML) and the Internet of Things (IoT) [ 20 ] , where elastic scaling can significantly improve performance and resource efficiency. In addition, serverless platforms are commonly employed for processing data close to its source, including system operation logs and user-generated data, thereby reducing data movement and latency [ 7 ] . Existing serverless platforms, such as Google Cloud Functions and AWS Lambda, allow developers to rapidly deploy a large number of container instances triggered by incoming events. To maintain a satisfactory end-user experience, many latency-sensitive applications enforce Service-Level Objectives (SLOs) on end-to-end latency. To meet these SLOs, service providers often rely on resource over-provisioning; however, this strategy may substantially increase overall resource consumption and adversely affect system performance. Therefore, a key enabler of efficient resource allocation is SLO-aware container scheduling, which aims to continuously minimize user-perceived latency by assigning requests to the most latency-efficient containers while satisfying end-to-end SLO constraints. However, modern applications are increasingly moving from centralized architectures toward distributed edge deployments, enabled by advances in and the growing availability of edge computing infrastructures [ 3 , 10 ] . As a result, user requests may be deployed across geographically distributed and heterogeneous edge nodes. This architectural shift introduces two key challenges: first, data movement must be considered due to the fact that the communication latency between the data source and host node is usually non-negligible. Second, the system must balance strict SLO guarantees against resource consumption in large-scale and dynamic deployments. To address these challenges in serverless edge computing ( SEC ), we decouple request scheduling from container reuse, enabling latency-aware execution while satisfying application-defined service-level objectives (SLOs). We formulate the container placement problem for serverless requests at the edge as an integer linear programming (ILP) model that captures fine-grained resource allocation decisions and request-level latency constraints, with the objective of minimizing end-to-end latency. Given the computational complexity of solving the ILP in large-scale or dynamic settings, we further design a deep reinforcement learning (DRL)–based approach. The proposed solution builds on actor–critic networks with a hierarchical action space, jointly considering system performance, workload dynamicity and SLO compliance. The main contributions of this paper are listed as follows. 1. We formulate an SLO-aware container scheduling problem in serverless edge computing, including comprehensive motivations, to minimize the end-to-end latency. 2. We propose Scale , a novel actor-critic network using a hierarchical action space to make decisions in two phases. The request scheduling is decided in the first phase, while the container reuse is decided in the second. The DRL agent is modeled to fully consider the temporal variability in workloads, the position of the request source and the position of the host node, ensuring a comprehensive understanding on the state and action space. 3. We evaluate Scale via large-scale simulations using real-world datasets and network topologies. By comparing with an ILP solver and another popular DRL approach, the results show that Scale achieves latency within 1.15\times of the ILP, while reducing decision-making time by up to 99%. II Related work Many recent works have extensively studied container scheduling in SEC, optimizing a number of objectives such as end-to-end latency, deployment cost, energy consumption and SLO violation rate. A large amount of research has focused on mitigating the cold-start problem, as cold starts remain a major source of latency overhead in serverless systems. In particular, several studies [ 1 , 30 , 25 , 17 , 29 ] aim to reduce the frequency of cold starts through techniques such as container pre-warming, container reuse, and workload prediction. Another direction is to reduce the cold-start time [ 28 , 14 ] . Different techniques are proposed to achieve this, such as partial code loading, container snapshot and checkpointing. In addition, other approaches focus on reducing the cold-start latency itself [ 28 , 14 ] . While the scale of serverless clusters is continuously increasing, a few works [ 16 , 24 , 9 , 11 ] have focused on reducing the overhead introduced by serverless workflows and large-scale clusters, such as execution time. However, those papers are largely orthogonal to Scale , as they typically focus either on mitigating cold start or container placement in isolation, while overlooking the joint trade-off among end-to-end latency, SLO satisfaction, and container placement and reuse. Yue et al. [ 27 ] proposes a multi-agent reinforcement learning algorithm to co-optimize per-function placement and resource allocation. The authors in [ 26 ] use DRL with an attention mechanism to harvest idle resources to accelerate serverless containers. Cui et al. [ 7 ] uses DRL for serverless cluster upgrading. Although existing DRL frameworks have shown promising performance in various settings, they are generally not designed to explicitly balance end-to-end latency objectives against constraints imposed by heterogeneous and limited resources. Scale employs an actor–critic–based deep reinforcement learning architecture to achieve efficient container reuse and placement while maintaining acceptable SLO violation rates. III Problem formulation III-A System model We model the edge infrastructure as a network \mathcal{G}=(\mathcal{V},\mathcal{E}) , which consists of |\mathcal{V}| geographically distributed edge nodes. Each node v\in\mathcal{V} is provisioned with finite CPU and memory capacities, denoted by F_{v} and C_{v} , respectively. We use B_{v} to denote the available bandwidth at edge node v . The link between the request source s and its placement node v is represented by (s,v)\in\mathcal{E} . Each request k is characterized by a CPU requirement f_{k} and a memory requirement c_{k} . For each request k , we denote by s_{k} the container image