Linear Layouts: Robust Code Generation of Efficient Tensor Computation Using ๐ฝ 2 \mathbb{F}_{2}
Keren Zhou, Mario Lezcano-Casado, Adam P. Goucher, Akhmed Rakhmati, Jeff Niu, Justin Lebar, Pawel Szczerbuk, Peter Bell, Phil Tillet, Thomas Raoux, Zahi Moudallal ยท 2025
Read Linear Layouts: Robust Code Generation of Efficient Tensor Computation Using ๐ฝ 2 \mathbb{F}_{2} by Keren Zhou, Mario Lezcano-Casado, Adam P. Goucher, Akhmed Rakhmati, Jeff Niu, Justin Lebar, Pawel Szczerbuk, Peter Bell, Phil Tillet, Thomas Raoux, Zahi Moudallal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23819.txt.
Description
Keren Zhou and ten co-authors introduced Linear Layouts in twenty twenty-five, a mathematical framework for the unglamorous problem that governs deep learning speed: how tensors map onto hardware. Layout choices โ which thread or register holds which element โ were traditionally handled case by case, and converting between layouts exploded combinatorially as hardware grew more complex.
Their idea represents a layout as a binary matrix over the field with two elements, acting on the bits of hardware coordinates. Layouts then compose and convert by generic linear algebra, eliminating the quadratic blowup. Integrated into the Triton compiler, linear layouts optimized individual operators and full kernels, reduced backend engineering effort, and even fixed several bugs lurking in Triton's legacy layout system. The paper gives compiler writers a systematic language for a formerly artisanal problem.
Catalog record
| CREATOR | Keren Zhou, Mario Lezcano-Casado, Adam P. Goucher, Akhmed Rakhmati, Jeff Niu, Justin Lebar, Pawel Szczerbuk, Peter Bell, Phil Tillet, Thomas Raoux, Zahi Moudallal |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-23819