Towards Resource-Efficient LLMs: End-to-End Energy Accounting of Distillation Pipelines
Katherine Lambert, Sasha Luccioni · 2026
Read Towards Resource-Efficient LLMs: End-to-End Energy Accounting of Distillation Pipelines by Katherine Lambert, Sasha Luccioni (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13981.txt.
Description
Lambert and Luccioni account for the full energy cost of distilling large language models, a route often sold as cheap and efficient. Teacher-side work such as data generation, logit caching and scoring is usually left out of such claims. Their framework tracks GPU device power stage by stage across the whole pipeline, and they apply it to two common distillation methods, tracking energy and emissions.
Catalog record
| CREATOR | Katherine Lambert, Sasha Luccioni |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42319 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13981