xMem: A CPU-Based Approach for Accurate Estimation of GPU Memory in Deep Learning Training Workloads 38 Conference: 26th ACM Middleware Conference; December 15–19, 2025; Nashville, TN, USA 26th ACM Middleware Conference (Middleware ’25), December 15–19, 2025, Nashville, TN, USA DOI: 10.1145/3721462.

Jiabo Shi, Dimitrios Pezaros, Yehia Elkhatib · 2025

Read xMem: A CPU-Based Approach for Accurate Estimation of GPU Memory in Deep Learning Training Workloads 38 Conference: 26th ACM Middleware Conference; December 15–19, 2025; Nashville, TN, USA 26th ACM Middleware Conference (Middleware ’25), December 15–19, 2025, Nashville, TN, USA DOI: 10.1145/3721462. by Jiabo Shi, Dimitrios Pezaros, Yehia Elkhatib (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-21048.txt.

Description

Jiabo Shi leads two co-authors on xMem, a CPU based method to estimate GPU memory needs of deep learning training jobs before they run. Shared clusters waste scarce graphics processors and suffer out of memory crashes when job memory is guessed badly.

Static analysis and history based learning miss runtime dynamics, while probing the GPU directly burns the resource being saved, and some tools demand intrusive code changes. xMem aims for accurate estimates from the CPU side alone, with no scarce hardware consumed and no code surgery. Better estimates enable smarter scheduling and safe GPU sharing across tenants.

Catalog record

CREATORJiabo Shi, Dimitrios Pezaros, Yehia Elkhatib
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-21048

Browse the full library · About the Tower of Babel