Quad Length Codes for Lossless Compression of e4m3
Aditya Agrawal, Albert Magyar, Hiteshwar Eswaraiah, Patrick Sheridan, Pradeep Janedula, Ravi Krishnan Venkatesan, Krishna Nair, Ravi Iyer, Google LLC · 2026
Read Quad Length Codes for Lossless Compression of e4m3 by Aditya Agrawal, Albert Magyar, Hiteshwar Eswaraiah, Patrick Sheridan, Pradeep Janedula, Ravi Krishnan Venkatesan, Krishna Nair, Ravi Iyer, Google LLC (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-17849.txt.
Description
Aditya Agrawal and team introduce Quad Length Codes for lossless compression of e4m3 data, aimed at large language model training and serving. Parallelization and collective operations in such workloads bottleneck on network bandwidth, and lossless compression can help. Huffman codes suffer slow, bit-sequential decoding and high hardware complexity from deep tree traversals. Universal codes such as Exponential-Golomb codes decode faster but ignore symbol frequency distributions.
Quad Length Codes balance compression efficiency with decoding speed. The scheme uses three prefix bits to split two hundred fifty-six symbols into eight areas. Each area has a distinct code length and symbol count. A look-up table of two hundred fifty-six entries simplifies hardware against Huffman trees. The scheme adapts to varied distributions. For e4m3 data, it achieves compressibility of about fourteen percent against about sixteen percent for Huffman codes, while decoding much faster with simpler hardware.
Catalog record
| CREATOR | Aditya Agrawal, Albert Magyar, Hiteshwar Eswaraiah, Patrick Sheridan, Pradeep Janedula, Ravi Krishnan Venkatesan, Krishna Nair, Ravi Iyer, Google LLC |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 12 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-17849