STaleX: A Spatiotemporal-Aware Adaptive Auto-scaling Framework for Microservices

Majid Dashtbani, Ladan Tahvildari · 2025

Read STaleX: A Spatiotemporal-Aware Adaptive Auto-scaling Framework for Microservices by Majid Dashtbani, Ladan Tahvildari (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18734.txt.

Introduction

Majid Dashtbani and Ladan Tahvildari present a framework for scaling microservices in cloud systems in this 2025 paper. Microservices split one app into many small services in a chain. Each link has its own load pattern and needs. A single central scaler cannot fit them all well. Their framework, STaleX, is aware of both space and time patterns. It gives each service its own scaler while minding the chain as a whole.

Load in such systems shifts by place and by hour in linked ways. Ignoring those links causes over- or under-scaling of single services. The authors combine several strategies to track those shifts. The goal is steady performance without paying for idle capacity. Cloud operators running large service chains are the audience. The paper sets out the design and its rationale in full.

Catalog record

CREATORMajid Dashtbani, Ladan Tahvildari
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-18734

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

STaleX: A Spatiotemporal-Aware Adaptive Auto-scaling Framework for Microservices Majid Dashtbani, Ladan Tahvildari Abstract While cloud environments and auto-scaling solutions have been widely applied to traditional monolithic applications, they face significant limitations when it comes to microservices-based architectures. Microservices introduce additional challenges due to their dynamic and spatiotemporal characteristics, which require more efficient and specialized auto-scaling strategies. Centralized auto-scaling for the entire microservice application is insufficient, as each service within a chain has distinct specifications and performance requirements. Therefore, each service requires its own dedicated auto-scaler to address its unique scaling needs effectively, while also considering the dependencies with other services in the chain and the overall application. This paper presents a combination of control theory, machine learning, and heuristics to address these challenges. We propose an adaptive auto-scaling framework, STaleX, for microservices that integrates spatiotemporal features, enabling real-time resource adjustments to minimize SLO violations. STaleX employs a set of weighted Proportional-Integral-Derivative (PID) controllers for each service, where weights are dynamically adjusted based on a supervisory unit that integrates spatiotemporal features. This supervisory unit continuously monitors and adjusts both the weights and the resources allocated to each service. Our framework accounts for spatial features, including service specifications and dependencies among services, as well as temporal variations in workload, ensuring that resource allocation is continuously optimized. Through experiments on a microservice-based demo application deployed on a Kubernetes cluster, we demonstrate the effectiveness of our framework in improving performance and reducing costs compared to traditional scaling methods like Kubernetes Horizontal Pod Autoscaler (HPA) with a 26.9% reduction in resource usage. I Introduction The rapid growth of internet users and the increasing demand for online services require flexible, scalable applications to handle fluctuating loads. Cloud computing provides a solution with scalable infrastructure and auto-scaling, which dynamically adjusts resources based on demand. However, traditional monolithic architectures struggle to take advantage of cloud auto-scaling due to tightly coupled components. Microservices, by decomposing applications into independently deployable services, offer a more scalable solution [ 1 , 2 , 3 ] , but introduce challenges in scaling due to their spatiotemporal features [ 4 , 5 ] . These features include Service Level Objectives (SLOs), such as response times, which must be upheld across interconnected service chains [ 6 ] . A performance issue in one service can cascade, violating the SLOs of the entire chain [ 7 ] . Temporal features like workload fluctuations [ 8 ] and service invocation patterns, often overlooked by traditional scaling algorithms [ 9 , 10 , 11 ] , must be integrated into new strategies for improved effectiveness. Spatial features such as service dependencies and specific resource needs complicate scaling. For example, service failures can disrupt dependent services, and variations in computational needs or initialization delays during scaling require service-specific scaling parameters [ 7 ] . Addressing these challenges is critical for developing effective scaling strategies and enhancing the performance of microservice-based applications in cloud environments. Challenge. Auto-scaling microservices presents several critical challenges in terms of performance, cost, and resilience: • SLO Violations : Interconnected services in a microservice architecture can cause performance degradation in one service to affect the entire service chain, making it difficult to maintain collective SLOs. • Spatial Features : Unique spatial characteristics, such as service dependencies and varying resource requirements, complicate the allocation of resources to meet SLOs effectively. • Temporal Features : Workload fluctuations and unpredictable traffic patterns further complicate auto-scaling, as sudden spikes can overwhelm services, leading to SLO violations. • SLO and Cost Trade-Off : Balancing SLOs with cost is difficult in microservices. Over-provisioning leads to higher costs, while under-provisioning risks performance degradation and SLO violations. Performance bottlenecks in one service can render resource allocations to others ineffective. Fig. 1: A) Uniform Scaling - Response Time, B) Uniform Scaling - Resource Usage, C) Differentiated Scaling - Response Time, D) Differentiated Scaling - Resource Usage This study investigates the following research questions: RQ1: How do spatial features impact auto-scaling in microservices architectures? This question examines the role of spatial features such as service dependencies, service role within the service chain, and service timing in improving the auto-scaling performance in microservices environments. RQ2: How do spatial and temporal features improve auto-scaling in microservices architectures? This question investigates the combined effect of spatial features and temporal features, particularly workload prediction using Long Short-Term Memory (LSTM) models, on the efficiency and effectiveness of auto-scaling decisions in microservices applications. The remainder of this paper is structured as follows: Section 2 presents a motivating example, Section 3 introduces our framework, Section 4 covers the evaluation, Section 5 discusses related work, and Section 6 concludes with future work. II Motivating Example In this section, we demonstrate the potential of our framework through a motivating experiment. We deployed the Sock-Shop [ 12 ] demo microservice application on a self-hosted Kubernetes [ 13 ] cluster, using the Kubernetes Horizontal Pod Autoscaler (HPA) [ 14 ] to apply reactive auto-scaling. The goal is to evaluate HPA’s effectiveness in meeting the performance requirements of a SLO. We focus on the ’/login’ service, which depends on a chain of microservices: ’front-end’, ’user’, and ’carts’. We define an SLO for ’/login’, requiring response times to stay under 200 ms. A limitation of HPA is that it primarily relies on low-level metrics, such as CPU and memory usage, and does not natively support high-level metrics like response time. To simulate realistic traffic, we used LOCUST.io [ 15 ] to generate a workload based on the WorldCup98 [ 16 ] dataset. In the first step, we applied the same CPU utilization threshold to all services to see if HPA can effectively scale while meeting the SLO. We tested various thresholds—25%, 50%, 60%, and 70%—to assess their impact on response time. Figure 1.A shows the response time at each threshold, while Figure 1.B illustrates resource usage over time. In the second step, we set different thresholds for each service to evaluate whether tailored scaling improves performance and resource utilization. We tested a set of values for each service, focusing on dynamic scaling based on individual service needs. Figure 1.C shows the response time with varying thresholds for each service, while Figure 1.D illustrates resource usage distribution. TABLE I: Comparison of Resource Usage and Response Time Violations for Uniform and Differentiated Scaling Approaches HPA Threshold (CPU Utilization %) Resource Violations # Fron-end User Carts (Core/Min) (ms) 1 25 25 25 4039 0 2 50 50 50 2678 40225 3 60 60 60 1610 77236 4 70 70 70 1110 212760 5 50 50 25 3630 3561 6 70 70 40 2155 42561 7 70 80 50 1886 50492 8 40 60 70 1621 131549 Fig. 2: STaleX framework: Green boxes represent the framework inputs, and blue boxes illustrate the framework components Table I summarizes the results, comparing CPU utilization thresholds, total resource usage (in cores/min), and response time violations (in ms). With uniform thresholds (rows 1–4), increasing the CPU utilization from 25% to 70% led to significant response time violations, with the 70% setting causing a large violation over 200 ms. In contrast, using different thresholds (rows 5–8) resulted in a more balanced approach, with tailored scaling improving both resource efficiency and response time. The experiments highlight several key challenges

Read the complete text