Tetris : Efficient Intra-Datacenter Calls Packing for Large Conferencing Services Conference: ; ;
Rohan Gandhi, Ankur Mallick, Ken Sueda, Rui Liang (Microsoft) · 2025
Read Tetris : Efficient Intra-Datacenter Calls Packing for Large Conferencing Services Conference: ; ; by Rohan Gandhi, Ankur Mallick, Ken Sueda, Rui Liang (Microsoft) (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00426.txt.
Introduction
Rohan Gandhi and co-authors pack video calls onto servers without overloading any of them. Their 2025 paper revisits how big meeting services place calls inside one data center. The current method in Teams, and rival methods, ignore how much CPU each call truly uses. Calls vary by head count and media type, and arrivals come in bursts.
The result is hot servers that drag quality down or raise costs. Their system, Tetris, first assigns calls using past usage data. It then shifts calls off hot servers on a cycle, guided by linear optimization. On a day-long trace of over ten million calls, Tetris cut the people stuck on hot servers by at least two and a half times.
Catalog record
| CREATOR | Rohan Gandhi, Ankur Mallick, Ken Sueda, Rui Liang (Microsoft) |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-00426
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Tetris : Efficient Intra-Datacenter Calls Packing for Large Conferencing Services Conference: ; ; Rohan Gandhi, Ankur Mallick, Ken Sueda, Rui Liang (Microsoft) Abstract . Conference services like Zoom, Microsoft Teams, and Google Meet facilitate millions of daily calls, yet ensuring high performance at low costs remains a significant challenge. This paper revisits the problem of packing calls across Media Processor (MP) servers that host the calls within individual datacenters (DCs). We show that the algorithm used in Teams – a large scale conferencing service as well as other state-of-art algorithms are prone to placing calls resulting in some of the MPs becoming hot (high CPU utilization) that leads to degraded performance and/or elevated hosting costs. The problem arises from disregarding the variability in CPU usage among calls, influenced by differences in participant numbers and media types (audio/video), compounded by bursty call arrivals. To tackle this, we propose Tetris , a multi-step framework which (a) optimizes initial call assignments by leveraging historical data and (b) periodically migrates calls from hot MPs using linear optimization, aiming to minimize hot MP usage. Evaluation based on a 24-hour trace of over 10 million calls in one DC shows that Tetris reduces participant numbers on hot MPs by at least 2.5 × 2.5\times . 1. Introduction Conferencing services such as Zoom ( zoom:web ) , Google Meet ( meet:web ) , Microsoft Teams ( teams:web ) , and DingTalk ( dingtalk:web ) have become a critical part of the post-COVID19 world. However, the soaring growth in demand ( teamsgrowth:web ) is also increasing the costs incurred by such service providers. Thus, providing the best user experience at the least cost is an important challenge for such service providers. Such large-scale conferencing services host multiple millions of calls every day. Each individual call is assigned to a Media Processor (MP) server in cloud data centers (DCs) that receives media streams (such as audio, video, and screen-share) from users, processes, and redistributes the media streams. Getting the call-to-MP assignment right is crucial as it is a key driver of cost and performance ( xron:sigcomm23 ; switchboard:sigcomm23 ) . Prior works have focused on assigning calls to MP servers in two phases: (a) select the DC for the individual calls, (b) load balancing (or packing) 1 1 1 Load balancing and packing are synonymous in this paper. the calls across MP servers, i.e., assign an MP from the DC selected. Such a division of labor helps scale the MP assignment algorithms to millions of concurrent calls ( switchboard:sigcomm23 ; saving:conext24 ) . Prior works such as Switchboard ( switchboard:sigcomm23 ) have focused on (a) and have relied on existing state-of-art load balancers for (b). In this paper, we revisit the problem of assigning calls to MPs in DCs, i.e., phase (b). We found that the algorithm used in Microsoft Teams – our large scale conferencing service falls short in optimally assigning the MPs to the individual calls. Such an algorithm ends up with large imbalance in the CPU utilization – some MPs are running with high CPU utilization (hot MPs) while some other MPs are running on low CPU utilization (cold MPs). We find that the problem is not just limited to Teams as other state-of-art load balancing algorithms such as Round-robin, Least-load and others also show the same degree of imbalance. The CPU imbalance translates into either a high degree of overprovisioning (ballooning the costs) or poor user experience (§ 3 ) as more calls get placed on the hot MPs – neither of which are desired. There are two unique characteristics of the workload in large scale conferencing services that contribute to the sub-optimal performance of existing load-balancers and make this a novel and challenging scenario: (1) The nature of the calls is such that their CPU utilization changes across different calls. Calls can have any number of participants. Also, participants use different media streams (audio, video, screenshare), and their quality. All such factors result in CPU usage by the calls vary between calls; two calls can have a vastly different CPU usage. Unfortunately, with existing algorithms such peak demands are not known apriori resulting in higher imbalance (§ 2.3 ). (2) The calls arrive in bursts usually around the 30 and 60 minute marks. As a result, the Teams controller needs to assign the MPs to a large number of calls simultaneously even when their (peak) demand is unknown. In this paper, we present Tetris (Packers and Movers) – a controller that packs Teams calls across MP servers and improves user experience by reducing calls on hot MPs for a given number of MPs. Tetris controller runs in each DC and assigns MPs to individual calls in the same DC. The design of Tetris is based on the observation that knowledge of peak CPU utilization of a call can improve call assignment to MPs. We can pre-allocate CPU for the peak and help reduce the occurrences of hot MPs. While current algorithms do not attempt to estimate the peak CPU utilization, we show that it is possible to do so with reasonable accuracy and mitigate errors in the estimate through migrations. Specifically, Tetris is based on three key ideas. Firstly, we recognize that a significant portion (40-60%) of calls in Teams are recurring, with low variance in participant numbers across instances. Leveraging this, Tetris utilizes participant data from previous occurrences to estimate the attendance, and consequently peak CPU utilization for the current occurrence. Secondly, for non-recurring calls, a predictive model is employed to estimate maximum participant numbers based on call age and current participants. Although not flawless, both of these predictive models substantially mitigate hot MP instances. Finally, Tetris reacts to hot MPs by observing that calls last for tens of minutes to hours but stabilize within minutes, prompting migration from hot to cold MPs after an initial period. We model migration as a bin packing problem that considers calls and MP servers holistically that can be solved efficiently. We formulate it as a Mixed Integer Program (MIP) and optimize it for scalability and timely execution to mitigate errors in our initial call assignment. We evaluate Tetris controller using testbed and simulations using 1-day trace from one of our DCs with O(10 million) calls. Our results show: (a) Tetris substantially reduces the number of hot MPs, and calls and participants on such hot MPs ( Tetris assigns 2.5\times fewer participants on hot MPs compared to state-of-the-art load balancing approaches), (b) the three ideas in Tetris are effective individually and in combination, (c) benefits of Tetris continue even on changing the number of MPs in the DC or the fraction of recurring calls, (d) our prediction algorithms have high accuracy, and (e) the MIP provides accurate results in a timely manner at scale. In summary, the paper makes the following contributions: (a) we show the evidence for high CPU imbalance in Teams – a large scale conferencing service which translates into poor user experience or high costs, (b) we present Tetris that uses three complimentary ideas to improve user experience, (c) through at-scale evaluation using a trace from production service, we show Tetris can substantially reduce the calls and participants on the hot MPs. 2. Background