Aging-aware CPU Core Management for Embodied Carbon Amortization in Cloud LLM Inference
Tharindu B. Hewage 1 , Shashikant Ilager 2 , Maria Rodriguez Read 1 , and Rajkumar Buyya 1 · 2025
Read Aging-aware CPU Core Management for Embodied Carbon Amortization in Cloud LLM Inference by Tharindu B. Hewage 1 , Shashikant Ilager 2 , Maria Rodriguez Read 1 , and Rajkumar Buyya 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15829.txt.
Description
Tharindu Hewage and co-authors address a hidden cost of cloud computing for large language models. Making and shipping servers creates embodied carbon, emissions locked in before a machine ever runs, and much of it sits in the processor chips. Replacing chips sooner wastes that carbon, but running them longer risks failures as silicon ages. The team studied how inference servers actually use their cores and found many sit idle.
Their management method rests idle cores so they stop aging, and spreads work across active cores so wear stays even. In simulations built on real Microsoft Azure traces, the method cut yearly embodied carbon by about 38 percent and idle waste by 77 percent, with little loss in service quality.
Catalog record
| CREATOR | Tharindu B. Hewage 1 , Shashikant Ilager 2 , Maria Rodriguez Read 1 , and Rajkumar Buyya 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-15829