Optimal Configuration of API Resources in Cloud Native Computing
Eddy Truyen Wouter Joosen · 2025
Read Optimal Configuration of API Resources in Cloud Native Computing by Eddy Truyen Wouter Joosen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23494.txt.
Introduction
Eddy Truyen and Wouter Joosen ask when a microservice application's processor and memory settings should be tuned. Most research optimizes these resources while the system runs, through scheduling and autoscaling. They instead apply an existing offline optimization framework during the release phase of the DevOps cycle, before deployment, a stage they note is largely unexplored.
Using the TeaStore benchmark application, they statistically compare optimization algorithms by sampling cost and by distance from the best configuration found. An upfront screening step that shrinks the search space proved helpful when hunting the true optimum on a limited budget, and necessary when comparing algorithms fairly. When a near-optimal setting is good enough, though, Bayesian optimization without screening performed better.
Catalog record
| CREATOR | Eddy Truyen Wouter Joosen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-23494
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Optimal Configuration of API Resources in Cloud Native Computing Eddy Truyen Wouter Joosen Abstract This paper presents how an existing framework for offline performance optimization can be applied to microservice applications during the Release phase of the DevOps life cycle. Optimization of resource allocation configuration parameters for CPU and memory during the Release phase remains a largely unexplored problem as most research has focused on intelligent scheduling and autoscaling of microservices during the Ops stage of the DevOps cycle. Yet horizontal auto-scaling of containers, based on CPU usage for instance, may still leave these containers with an inappropriately allocated amount of memory, if no upfront fine-tuning of both resources is applied before the Deployment phase. We evaluate the performance optimization framework using the TeaStore microservice application and statistically compare different optimization algorithms, supporting informed decisions about their trade-offs between sampling cost and distance to the optimal resource configuration. This shows that upfront factor screening, for reducing the search space, is helpful when the goal is to find the optimal resource configuration with an affordable sampling budget. When the goal is to statistically compare different algorithms, screening must also be applied to make data collection of all data points in the search space feasible. If the goal is to find a near-optimal configuration, however, it is better to run bayesian optimization without screening. 1 Introduction Context Modern software increasingly adopts cloud-native deployment models, shifting from monolithic architectures towards distributed applications composed of containerized microservices. Such applications are typically deployed on container orchestration (CO) platforms, with Kubernetes as the most widely used example [ 22 ] . These platforms support DevOps practices and continuous integration/deployment (CI/CD), enabling rapid iteration and release [ 3 ] . A defining feature of Kubernetes (K8s) is that it exposes a wide variety of configuration parameters through its API. These API resources include not only low-level infrastructure settings such as CPU and memory allocation parameters for containers, but also application-level parameters such as environment variables, replica counts, or string-based configuration options. Correctly configuring these resources is critical, as they directly influence application performance, cost efficiency, and compliance with service-level objectives (SLOs) [ 4 , 35 ] . We build on our existing framework k8-resource-optimizer [ 19 , 27 ] that applies black-box optimization algorithms to map application-level SLOs for a given K8s-based application to cost-efficient API resource configuration settings. Unlike manual approaches, black-box optimization treats the application as a system under test and requires no manually-specified performance model [ 2 , 14 ] . The framework can be instantiated with an off-the-shelf optimization algorithm, a benchmark scenario for a specific application, as well as an utility function for scoring how well an application configuration meets the optimization goal. Once these plugin components are instantiated, the user needs to provide minimal input: the manifest name of the application (e.g. a helm chart), the workload intensity, the SLOs to be met, and the set of tunable API resource parameters. The framework can be used to fine-tune any resource parameter that is configurable via the K8s API, thus supporting performance optimization of a wide range of numerical and string-based application configuration parameters. Yet the sheer number of configuration parameters exposed by the K8s API poses a significant challenge. It is not clear whether existing optimization algorithms can reliably navigate such an expansive space to find near-optimal configurations, especially under tight search and sampling budgets. Black-box optimization, in particular, faces two key challenges when applied to performance optimization of K8s-based applications. First, the cost of evaluating a single application configuration is high, as it requires deploying the application with specific settings and running statistically significant benchmarking tests. This severely limits the number of samples that can be afforded. Second, the size of the search space grows rapidly with the number of tunable API resources, many of which may have little or no influence on the optimization goal. This is where factor screening comes in. Originating in the design of experiments literature, factor screening [ 29 ] aims to identify which parameters of a function have the largest effect on function outcomes and which can be fixed at default values without significant impact. Applied to K8s, this means reducing the dimensionality of the search space by focusing optimization efforts only on those API resources that matter most. The benefits are twofold: (i) optimization algorithms can locate optimal or near-optimal configurations more cost-efficiently, i.e. using a lower number of samples, and (ii) when the reduced search space becomes small enough, exhaustively evaluating all samples becomes feasible, which in turn enables offline comparison between optimization algorithms without repeatedly running costly tests. Thus, factor screening acts as a bridge between the wide variety of API resource parameters exposed by K8s and the practical constraints of performance optimization. Goal To demonstrate the above ideas, this paper presents a case study in the context of container resource allocation only. We focus specifically on CPU and memory allocation parameters of microservices, which are central to application performance and cost in K8s environments. For even these two parameters we show that factor screening can drastically reduce the search space for a single microservice-based application and thus improve the cost-efficiency of black-box optimization algorithms. While our study centers on CPU and memory, the methodology is general and applicable to other categories of API resources exposed by K8s. Accurately translating high-level SLOs into efficient container resource configurations has been a hot topic of research in the past decade. Most CO platforms require manual translation, often leading to suboptimal outcomes like over-provisioning and under-utilization of resources, which increases costs [ 32 ] . Case studies show significant over-provisioning in resource, such as T-Mobile’s containers having only 5.15% memory utilization [ 24 ] , and most jobs in production clusters being over-provisioned [ 18 ] . This problem is exacerbated by the complexity of modern microservice stacks, where tuning can take weeks [ 25 ] . Unsurprisingly, a large body of research has focused on using machine learning and optimization techniques to improve runtime efficiency through intelligent scheduling and autoscaling [ 42 ] . However, most of this work addresses the operational stage of the DevOps lifecycle, i.e., after deployment [ 28 ] . Runtime autoscalers adjust container replicas or resource limits in response to CPU or memory usage thresholds, but they do not guarantee optimal initial resource configurations. As illustrated in Figure 1 , horizontal auto-scaling based on CPU thresholds can still result in containers being over-provisioned with respect to memory. This gap between resource allocation and actual utilisation, termed slack [ 33 ] , even remains when autoscaling considers both CPU and memory metrics, since scaling is triggered when either metric crosses a threshold. Vertical auto-scaling [ 33 ] , which adjusts the resource allocation of running containers, risks container restarts whenever the underlying programming language runtime is not able to auto-adjust to new resource limits. In addition, autoscalers typically operate on individual microservices and fail to capture cross-service dependencies. This motivates the need for offline optimization in the Release phase, where resource configurations can be systematically explored under controlled workloads. Figure 1 : Example TeaStore trace: autoscaling triggered by CPU thresholds can leave memory over-provisioned. Therefore allocation of CPU and