Entropic-Time Inference: Self-Organizing Large Language Model Decoding Beyond Attention

Andrew J. Kiruluta · 2026

Read Entropic-Time Inference: Self-Organizing Large Language Model Decoding Beyond Attention by Andrew J. Kiruluta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03310.txt.

Description

Andrew J Kiruluta proposes a different clock for running large language models. Today's inference engines generate text token by token under fixed rules, tuned for speed and low delay. His 2026 design, called entropic-time inference, lets the flow of uncertainty drive the process instead of the token count, treating generation as a thermodynamic process that spends computation where doubt falls fastest.

The design extends the popular vLLM engine in three linked ways. An entropy-aware scheduler orders work, uncertain attention blocks get pruned, and sampling temperature adjusts itself to hold generation near a target uncertainty level. Kiruluta gives the full systems design, pseudocode, and an integration plan. The aim is a self-organizing engine that uses entropy as a first-class control signal at scale.

Catalog record

CREATORAndrew J. Kiruluta
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57106
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.03310

Browse the full library · About the Tower of Babel