The Illusion of Power Capping in LLM Decode: A Phase-Aware Energy Characterisation Across Attention Architectures

Bole Ma, Ayesha Afzal, Jan Eitzinger, Gerhard Wellein · 2026

Read The Illusion of Power Capping in LLM Decode: A Phase-Aware Energy Characterisation Across Attention Architectures by Bole Ma, Ayesha Afzal, Jan Eitzinger, Gerhard Wellein (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11999.txt.

Description

In 2026, Bole Ma and three colleagues show that power capping is an illusion for LLM decode, the phase that dominates production serving. Across GQA, MLA, Gated DeltaNet, and Mamba2 on an NVIDIA H200, decode draws only 137 to 300 watts on a 700-watt GPU, so no cap ever triggers. Memory-bound decode saturates bandwidth rather than compute, and firmware clock throttling further corrupts cap measurements. Locking SM clocks instead recovers up to 32 percent of decode energy at minimal throughput loss.

Catalog record

CREATORBole Ma, Ayesha Afzal, Jan Eitzinger, Gerhard Wellein
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35021
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.11999

Browse the full library · About the Tower of Babel