MonkeyTree: Near-Minimal Congestion for Multi-tenant Training via Migration

Anton A. Zabreyko Weiyang Wang Manya Ghobadi MIT · 2026

Read MonkeyTree: Near-Minimal Congestion for Multi-tenant Training via Migration by Anton A. Zabreyko Weiyang Wang Manya Ghobadi MIT (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08296.txt.

Description

Multi-tenant GPU clusters suffer congestion when training jobs share oversubscribed networks, degrading throughput for over a third of jobs. Anton A. Zabreyko and two co-authors present MonkeyTree, the first system to attack congestion through job-migration-based defragmentation rather than routing or flow scheduling.

Because a job's rings send just one flow across racks for each rack the job touches, congestion-free placements exist abundantly and are reachable with few migrations. MonkeyTree formulates defragmentation as an integer linear program minimizing worker movements, and once low fragmentation is reached, new arrivals disturb only a few racks, making it self-reinforcing. Cloud operators gain a placement-level fix for a problem routing alone cannot solve when traffic exceeds capacity.

Catalog record

CREATORAnton A. Zabreyko Weiyang Wang Manya Ghobadi MIT
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-08296

Browse the full library · About the Tower of Babel