Accurate GPU Memory Prediction for Deep Learning Jobs through Dynamic Analysis
Yehia Elkhatib, Anonymous · 2025
Read Accurate GPU Memory Prediction for Deep Learning Jobs through Dynamic Analysis by Yehia Elkhatib, Anonymous (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03887.txt.
Description
Deep learning jobs often crash when the graphics card runs out of memory. Jiabo Shi and Yehia Elkhatib present VeritasEst, a tool that predicts that memory peak in advance. It runs entirely on ordinary CPUs and never touches the target GPU. Static analysis misses how models behave at runtime. Direct profiling steals scarce GPU time. Their dynamic analysis on CPU threads the needle.
Thousands of runs on convolutional networks back the claims. Relative error fell by 84 percent against baseline estimators. The chance of a failed estimate dropped by 73 percent. The authors pitch the tool for schedulers who must place jobs without wasting hardware.
Catalog record
| CREATOR | Yehia Elkhatib, Anonymous |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-03887