Towards Sustainable Large Language Model Serving Conference: 3rd Workshop on Sustainable Computer Systems; July 9, 2024; Santa Cruz, CA CCS: Social and professional topics Sustainability CCS: Computing methodologies Machine learning
Sophia Nguyen, Beihao Zhou, Yi Ding, Sihang Liu · 2025
Read Towards Sustainable Large Language Model Serving Conference: 3rd Workshop on Sustainable Computer Systems; July 9, 2024; Santa Cruz, CA CCS: Social and professional topics Sustainability CCS: Computing methodologies Machine learning by Sophia Nguyen, Beihao Zhou, Yi Ding, Sihang Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-01990.txt.
Description
Sophia Nguyen, Beihao Zhou, Yi Ding, and Sihang Liu study the carbon cost of running large language models. Their work, published in 2024, looks at two kinds of cost: the power used while a model runs, and the carbon spent making the chips and memory. Both count if AI services are to grow in a cleaner way.
The team measured three sizes of the LLaMA model on two kinds of Nvidia graphics chips, one new and one older. They then modeled emissions for power grids in three regions with different fuel mixes. The results show where the carbon goes and where savings are possible. Smarter choices of hardware and location can cut the footprint of serving these models.
Catalog record
| CREATOR | Sophia Nguyen, Beihao Zhou, Yi Ding, Sihang Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-01990