Babbling Suppression: Making LLMs Greener One Token at a Time
Lola Solovyeva, Fernando Castor · 2026
Read Babbling Suppression: Making LLMs Greener One Token at a Time by Lola Solovyeva, Fernando Castor (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-06755.txt.
Description
Solovyeva and Castor cut the energy cost of chatty code generation with Babbling Suppression. Language models in coding assistants often ramble past the answer, wasting attention, money, and power. Their method weaves test execution into generation, stopping as soon as a solution passes all tests, with no accuracy loss. Across two Python and two Java benchmarks and ten models, babbling hit every model, more in Java than Python. Suppression cut energy by up to 65 percent for Python and 62 percent for Java, with net savings in most of 40 model-benchmark pairs.
Catalog record
| CREATOR | Lola Solovyeva, Fernando Castor |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61277 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.06755