The Illusion of Power Capping in LLM Decode: A Phase-Aware Energy Characterisation Across Attention Architectures
Bole Ma, Ayesha Afzal, Jan Eitzinger, Gerhard Wellein · 2026
Read The Illusion of Power Capping in LLM Decode: A Phase-Aware Energy Characterisation Across Attention Architectures by Bole Ma, Ayesha Afzal, Jan Eitzinger, Gerhard Wellein (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11999.txt.
Description
In 2026, Bole Ma and three colleagues show that power capping is an illusion for LLM decode, the phase that dominates production serving. Across GQA, MLA, Gated DeltaNet, and Mamba2 on an NVIDIA H200, decode draws only 137 to 300 watts on a 700-watt GPU, so no cap ever triggers. Memory-bound decode saturates bandwidth rather than compute, and firmware clock throttling further corrupts cap measurements. Locking SM clocks instead recovers up to 32 percent of decode energy at minimal throughput loss.
Catalog record
| CREATOR | Bole Ma, Ayesha Afzal, Jan Eitzinger, Gerhard Wellein |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35021 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.11999