Scheduler-Driven Job Atomization
Michal Konopa, Jan Fesl, Ladislav Beránek · 2025
Read Scheduler-Driven Job Atomization by Michal Konopa, Jan Fesl, Ladislav Beránek (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-19086.txt.
Description
Michal Konopa and two co-authors present a concept for running jobs on shared graphics processors more efficiently. On clusters built from sliced-up graphics processors, jobs are usually treated as rigid blocks that hold a fixed slice until they finish. Sizing each job by its peak memory use wastes capacity and turns jobs away. Their proposal, scheduler-driven job atomization, opens a two-way talk between scheduler and jobs.
The scheduler advertises open time-and-capacity slots, and jobs signal when they could carve out a subjob that fits. The scheduler picks among signals by its policy, such as fairness or deadlines, and only then does the chosen job build its subjob. Because subjobs are shaped before they run, no costly migration or interruption is needed. As a concept paper, the work defines the pieces and future research directions rather than reporting experiments.
Catalog record
| CREATOR | Michal Konopa, Jan Fesl, Ladislav Beránek |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-19086