Scheduler-Driven Job Atomization

Michal Konopa, Jan Fesl, Ladislav Beránek · 2025

Read Scheduler-Driven Job Atomization by Michal Konopa, Jan Fesl, Ladislav Beránek (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-19086.txt.

Description

Michal Konopa and two co-authors present a concept for running jobs on shared graphics processors more efficiently. On clusters built from sliced-up graphics processors, jobs are usually treated as rigid blocks that hold a fixed slice until they finish. Sizing each job by its peak memory use wastes capacity and turns jobs away. Their proposal, scheduler-driven job atomization, opens a two-way talk between scheduler and jobs.

The scheduler advertises open time-and-capacity slots, and jobs signal when they could carve out a subjob that fits. The scheduler picks among signals by its policy, such as fairness or deadlines, and only then does the chosen job build its subjob. Because subjobs are shaped before they run, no costly migration or interruption is needed. As a concept paper, the work defines the pieces and future research directions rather than reporting experiments.

Catalog record

CREATORMichal Konopa, Jan Fesl, Ladislav Beránek
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-19086

Browse the full library · About the Tower of Babel