Fast Byte Latent Transformer
Julie Kallini, Artidoro Pagnoni, Tomasz Limisiewicz, Gargi Ghosh, Luke Zettlemoyer, Christopher Potts, Xiaochuang Han, Srinivasan Iyer · 2026
Read Fast Byte Latent Transformer by Julie Kallini, Artidoro Pagnoni, Tomasz Limisiewicz, Gargi Ghosh, Luke Zettlemoyer, Christopher Potts, Xiaochuang Han, Srinivasan Iyer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08044.txt.
Description
Julie Kallini and colleagues speed up byte-level language models. Such models match token-based models without a fixed subword vocabulary, but they generate text one byte at a time, which makes them slow. The work targets the Byte Latent Transformer and attacks the bottleneck on two fronts.
First, a diffusion variant trains with a block-wise objective beside the normal next-byte loss, so decoding can emit several bytes in parallel. Second, two speculative methods let the local decoder draft bytes past its usual patch edges and verify them in one full pass. Together the variants trade a little quality for large gains in generation speed.
Catalog record
| CREATOR | Julie Kallini, Artidoro Pagnoni, Tomasz Limisiewicz, Gargi Ghosh, Luke Zettlemoyer, Christopher Potts, Xiaochuang Han, Srinivasan Iyer |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.08044