Complexity at Scale: A Quantitative Analysis of an Alibaba Microservice Deployment
Giles Winchester, George Parisis, Guoyao Xu, Luc Berthouze · 2025
Read Complexity at Scale: A Quantitative Analysis of an Alibaba Microservice Deployment by Giles Winchester, George Parisis, Guoyao Xu, Luc Berthouze (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13141.txt.
Introduction
Giles Winchester and co-authors measure in 2025 the true shape of a giant microservice system run by Alibaba. Research on such systems often rests on guesses about scale and behavior that production data rarely test. The team mined tracing records from the live deployment and set the findings beside earlier measurements from Meta.
The system showed extreme scale, long-tailed workloads and dependencies, wide functional variety, and call graphs that shift over time. Some traits matched Meta's, others diverged, which tells which patterns may be general. The authors spell out what the gaps mean for fault handling, scaling research, and testbed design, and urge more realistic test setups.
Catalog record
| CREATOR | Giles Winchester, George Parisis, Guoyao Xu, Luc Berthouze |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-13141
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Complexity at Scale: A Quantitative Analysis of an Alibaba Microservice Deployment Giles Winchester, George Parisis, Guoyao Xu, Luc Berthouze Abstract . Microservice management and testbed research often rests on assumptions about deployments that have rarely been validated at production scale. While recent studies have begun to characterise production microservice deployments, they are often limited in breadth, do not compare findings across deployments, and lack consideration of the implications of findings for commonly held assumptions. We analyse a distributed tracing dataset from Alibaba’s production microservice deployment to examine its scale, heterogeneity, and dynamicity. By comparing our findings to prior measurements of Meta’s MSA we illustrate both convergent and divergent properties, clarifying which patterns may generalise. Our study reveals extreme architectural scale, long-tail distributions of workloads and dependencies, highly diverse functionality, substantial call graph variability, and pronounced time-varying behaviour which diverge from assumptions underlying research models and testbeds. We summarise how these observations challenge common assumptions in research on fault management, scaling, and testbed design, and outline recommendations for more realistic future approaches and evaluations. CCS: Networks Cloud computing CCS: Networks Logical / virtual topologies CCS: Networks Network manageability CCS: Computer systems organization Cloud computing 1. Introduction Microservice architectures (MSAs) have become the leading method for building large-scale distributed applications ( Livens, 2023 ) . These architectures are built using distinct microservices (MSs) that communicate with each other over well defined APIs to provide application logic. This architectural style facilitates small agile development teams, rapid development of new features, and fine-grained scaling. Yet, these characteristics can also lead to unique challenges associated with MSAs, such as increased operational complexity, MS co-ordination, and scale ( Soldani et al., 2018 ) . This renders system maintenance, integrity, and uptime assurance extremely complicated. However, on the other hand, online application downtime can be associated with extremely high costs, with Fortune 1000 companies reporting losses of up to $1 million per hour of disruption ( Atlassian, 2024 ; Shultz, 2018 ) . To address these challenges extensive research has been carried out into novel approaches to detect faults ( Nobre, João et al., 2023 ) , pinpoint root causes ( Zhang et al., 2025 ) , provide efficient auto-scaling through workload prediction ( Luo et al., 2022 ) , and optimise MSA design by minimising anti-patterns ( Gamage and Perera, 2021 ; Parker et al., 2023 ) . However, these approaches are often motivated and subsequently designed based on theoretical assumptions of MSAs stemming from perceived common designed practices and the challenges associated with them. This issue is further exacerbated by the reliance on small-scale open-source testbeds ( Seshagiri et al., 2022 ) due to the scarce access to industrial-scale datasets with ground truth. Whilst such testbeds are designed based on best practices, they do not match the complexity associated with real-world large-scale MSAs ( Seshagiri et al., 2022 ) . Previous work has begun to characterise the attributes of large-scale MSAs, such as the properties of MS call graphs ( Luo et al., 2021 ; Wen et al., 2022 ) , runtime performance ( Luo et al., 2021 ; Wen et al., 2022 ) , and the time-varying evolution of dependencies at runtime ( Winchester et al., 2023 ) . However, these studies only consider characteristics from a narrow viewpoint. To address this limitation, a recent study was carried out on the characteristics of Meta’s MSA ( Huye et al., 2023 ) , taking a broader view of MSA characteristics. However, this analysis still omitted several important characteristics of MSAs and the implications of their findings for the assumptions leveraged by researchers are not discussed in depth. Furthermore, without a substantial comparison to other large-scale deployments, it remains unclear how representative their results are of MSAs as a whole. Despite the growing literature, there still lacks a broad, empirically grounded understanding of how operational complexity manifests at scale, and whether observations at one provider generalise to another. To address this gap, we make the following three contributions: (1) Comprehensive, multi-dimensional analysis: building on prior work that identifies scale, heterogeneity, and dynamicity as the primary sources of operational complexity in large-scale MSAs ( Soldani et al., 2018 ; Seshagiri et al., 2022 ; Zhou et al., 2021 ; Gan et al., 2024 ; Gan et al., 2021 ; Lin et al., 2016 ; Yang et al., 2022 ; Lin et al., 2018a ) , we carry out a comprehensive, multi-dimensional analysis of Alibaba’s deployment across these three axes, offering a broader view than prior Alibaba and Meta studies. (2) Cross-deployment comparison: we provide the first cross-deployment comparison of two large-scale MSAs, revealing convergent and divergent properties. (3) Operational insights and research implications: we highlight and discuss how real-world MSA operational properties challenge common assumptions in management approaches and testbed design, and we offer recommendations (summarised in Table 4 ) to guide future work to better meet the challenges of real-world MSA deployments. All code and the processed data used to generate the figures and statistics in this paper will be publicly released upon acceptance of the paper. 2. Related Work Quantitative studies of real-world MSAs are relatively few and narrow in scope, though several notable works exist. Luo et al. ( Luo et al., 2021 ) analysed call graph characteristics from 12 hours of Alibaba traces, reporting depth and complexity statistics and clustering call graphs based on topology. Winchester et al. ( Winchester et al., 2023 ) examined the same data, focussing instead on the time-varying evolution of global dependency structure, revealing repeating system-wide states that could be linked to global system performance. While both studies offered valuable insights, their reliance on a short 12-hour window limits confidence in the completeness of their findings. Luo et al. ( Luo et al., 2022 ) later analysed 14 days of Alibaba traces to study time-varying workload in relation to dependency dynamics, topological characteristics, and architectural roles. Despite the larger dataset, this study, similar to previous work, also concentrated on a limited set of characteristics, providing only a partial view of the broader properties of large-scale MSAs. More recently, Huye et al. ( Huye et al., 2023 ) conducted a broader characterisation of Meta’s MSA, analysing its dependency topology, architectural evolution, and depth and variability of traces for a select few front-end services. Although this work presented a more comprehensive view than previous studies, it does not explore important aspects of MSAs, such as workload, cohabitation, uncommon call graphs, and time-varying topology. Furthermore, this work does not explore the implications of their findings in relation to common assumptions held by MSA management approaches. Moreover, the lack of comparison with other deployments leaves it unclear whether the reported observations reflect common characteristics of large-scale MSAs or instead are specific to Meta’s MSA. These gaps motivate our comprehensive analysis of Alibaba’s deployment and our cross-deployment comparison with Meta, to exhibit how operational characteristics of real-world MSAs challenge common assumptions in management and testbed design. Table 1. Example trace from the call data . Timestamp Trace ID RPC ID Service ID Upstream MS Downstream MS 115352 T_1156086 0.1 S_153587416 MS_58845 MS_71712 115354 T_1156086 0.2 S_153587416 MS_58845 MS_72104 115358 T_1156086 0.2.1 S_153587416 MS_72104 MS_90011 Table 2. Example rows from the resource data .