Night-Window Batching versus Carbon-Aware Scheduling for Clinical AI GPU Workloads

Nishi Doshi 1 ORCID: 0009-0007-8148-4834, Shrey Shah 1 · 2026

Read Night-Window Batching versus Carbon-Aware Scheduling for Clinical AI GPU Workloads by Nishi Doshi 1 ORCID: 0009-0007-8148-4834, Shrey Shah 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01766.txt.

Introduction

Doshi and Shah ask when hospital AI jobs should run on graphics chips. Their 2026 study uses a computer simulation, not real patients. Grid power shifts in carbon cost through the day. The team tests 13 rules for scheduling jobs. Jobs stand in for patient-style tasks with urgency tiers.

One simple rule runs low-urgency jobs at night. A richer rule mixes urgency and carbon cost. The authors report the night rule closes most of the carbon gap. It also misses fewer urgent deadlines than the rich rule. They stress that all numbers are queue results. The results do not speak to patient care or health.

Catalog record

CREATORNishi Doshi 1 ORCID: 0009-0007-8148-4834, Shrey Shah 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.01766

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Night-Window Batching versus Carbon-Aware Scheduling for Clinical AI GPU Workloads Nishi Doshi 1 ORCID: 0009-0007-8148-4834, Shrey Shah 1 Abstract Hospitals run more machine learning on GPUs while the carbon footprint of grid electricity rises and falls through the day. Using a computer simulation, we compare 13 13 scheduling rules on mixed GPU hardware, with synthetic patient-style jobs, urgency tiers, and time-of-day carbon traces. We do not study patient outcomes; every percentage we report is a simulator queue number, not a clinical finding. We ask whether running non-urgent jobs overnight is almost as good as a richer rule that mixes urgency and carbon (CUCA at weight 0.45, written CUCA 0.45 ). The comparison keeps carbon reduction secondary to clinical priority and deadline compliance, so each policy is judged on both average kg CO 2 e and missed-deadline behavior. CarbonGreedy and CarbonShift are carbon-first stress tests that demonstrate how poorly wrong vendor presets can disrupt clinical priorities, and are not meant for production. Numbers are averages over many test settings, with wide run-to-run spread and no statistical adjustment, so headline ratios are exploratory. On an eight-GPU baseline, the overnight rule closes about 78 % 78\% of the carbon gap between urgency-only and CUCA 0.45 while missing fewer urgent deadlines than either. CarbonShift lets about 46 % 46\% of the most urgent jobs miss their deadline; this is simulated queueing, not bedside harm. At 48 48 jobs per hour, the carbon footprints almost tie, yet the overnight rule still misses fewer urgent deadlines. A geography test, where regions share one daily carbon shape with only timezone shifts, trims under one percentage point of average carbon; a twelve-hour routine window saves a little carbon for CUCA 0.45 but raises overall missed deadlines. Overnight batching stays competitive on average modelled carbon; carbon-only rules belong only in stress tests. † † toctitle: Night-Window Batching versus Carbon-Aware Scheduling for Clinical AI GPU Workloads † † tocauthor: Nishi Doshi and Shrey Shah † † institute: University of Southern California, Los Angeles, USA For hospital operations. If you run GPU queues for hospital AI under deadlines, this paper is meant to sit next to your capacity planning. It compares a richer carbon-aware system against a simpler “run the heavy jobs at night” approach. Everything here is simulated. Treat the takeaways as hypotheses, unless your job mix, deadlines, hardware, and local grid curves look like ours. Section 5 lists what would still need to be measured on site. 1 Introduction Hospitals run more and more medical AI on GPU clusters for both training and inference ( 24 ; 17 ) . Cloud operators already move batch work in time and across regions to follow lower-carbon electricity ( 25 ; 2 ; 1 ; 20 ) . Healthcare sustainability research keeps track of how big the sector’s carbon footprint is and how fast net-zero pressure is rising ( 8 ; 11 ; 23 ; 14 ) . Hospital leadership rarely cares which scheduler wins. The real question is when more complex scheduling is worth its budget line. Net-zero pledges, vendor “green mode” presets, and clinical service-level expectations often pull in different directions, and without shared units you cannot compare those tradeoffs ( 4 ; 18 ) . A carbon dashboard with no missed-deadline counter can quietly push the risk of late critical jobs onto clinical staff. A simulation cannot decide policy on its own, but it can show how far a simple “run heavy jobs at night” rule moves average carbon and deadline risk before paying for more complex scheduling. It can also flag presets that fall apart under stress and should never run in production. The tables below report results in the same units, so finance, facilities, and clinical IT can talk about the same numbers. GPU queues for hospital AI differ from regular datacenter jobs because many jobs carry hard deadlines and clinical priority tiers. Real-time scheduling theory teaches the basics of deadlines, priorities, and slack ( 12 ; 3 ; 21 ) , but it does not tell us whether a simple night-window rule is already enough, or whether a richer carbon-aware rule is worth the extra complexity. Work on ML energy and carbon has also argued for moving training and inference to greener times and places ( 22 ; 19 ; 16 ; 6 ; 15 ; 13 ) . We run a side-by-side comparison : one simulator, thirteen schedulers on a mix of GPUs, synthetic workloads, and carbon-only stress tests that show what happens when carbon-only choices break clinical priorities (we are not proposing them as policies for hospital use). Think of it as lining up thirteen queueing rules under the same stopwatch. Three experiment families in Section 3 repeat the same patterns. On the full gate grid, the overnight rule closes most of the average carbon gap from urgency-only to CUCA 0.45 , with fewer simulator critical-tier misses. By design, the stress rules miss many deadlines. At 48 jobs per hour, average carbon almost ties while the night window stays safer on critical misses. Geo adds under 1\% extra carbon savings, and only when every region shares one daily curve shifted by timezone (a small geography sanity check, not a general claim). A 12-hour routine longshift trims about 0.8\% carbon but raises overall missed deadlines. We report patterns that depend on the setting; there is no single winner. Contributions. • We run thirteen policies against the same workload and cluster model, with identical simulator rules and the same post-run metrics for every run. • In the gate study, averaged over all settings, the overnight rule closes about 78\% of the average kg CO 2 e gap from urgency-only to CUCA 0.45 , while critical-tier misses are about 2.4\times lower. CarbonGreedy and CarbonShift are deliberately unsafe carbon-only stress runs (queue numbers only); they show what bad presets look like, not policies you would deploy. • At 48 jobs per hour, the overnight rule matches or slightly beats CUCA 0.45 on average carbon, with fewer critical misses. In the geo battery (one daily curve per region, shifted only by timezone), geo gives less than 1\% extra average kg CO 2 e over the single-region night baseline we compare against. This is not a claim about real tariffs or data-sovereignty tradeoffs. • A 720-minute routine longshift trims about 0.8\% average kg CO 2 e but raises overall simulator misses from 3.75\% to 5.08\% on the geo+longshift grid. These patterns depend on our settings; they are not a single ranking for every hospital. 2 Related Work We study batch GPU scheduling when grid carbon intensity changes through the day and jobs have deadlines. The question is whether running deferrable jobs at night is enough, or whether a richer carbon-aware policy is worth the added complexity. The setting is motivated by hospital training and inference queues, but the question is operational, not clinical. Most carbon-aware computing work targets datacenters and cloud regions, moving work in time or across regions to cut emissions, usually without clinical-style urgency ( 25 ; 2 ; 1 ; 20 ) . Real-time scheduling gives the standard language of feasibility, slack, and urgency when deadlines matter ( 12 ; 3 ; 21 ) . In medical

Read the complete text