Fast Byte Latent Transformer

Julie Kallini, Artidoro Pagnoni, Tomasz Limisiewicz, Gargi Ghosh, Luke Zettlemoyer, Christopher Potts, Xiaochuang Han, Srinivasan Iyer · 2026

Read Fast Byte Latent Transformer by Julie Kallini, Artidoro Pagnoni, Tomasz Limisiewicz, Gargi Ghosh, Luke Zettlemoyer, Christopher Potts, Xiaochuang Han, Srinivasan Iyer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08044.txt.

Description

Julie Kallini and colleagues speed up byte-level language models. Such models match token-based models without a fixed subword vocabulary, but they generate text one byte at a time, which makes them slow. The work targets the Byte Latent Transformer and attacks the bottleneck on two fronts.

First, a diffusion variant trains with a block-wise objective beside the normal next-byte loss, so decoding can emit several bytes in parallel. Second, two speculative methods let the local decoder draft bytes past its usual patch edges and verify them in one full pass. Together the variants trade a little quality for large gains in generation speed.

Catalog record

CREATORJulie Kallini, Artidoro Pagnoni, Tomasz Limisiewicz, Gargi Ghosh, Luke Zettlemoyer, Christopher Potts, Xiaochuang Han, Srinivasan Iyer
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08044

Browse the full library · About the Tower of Babel