Linear Layouts: Robust Code Generation of Efficient Tensor Computation Using ๐”ฝ 2 \mathbb{F}_{2}

Keren Zhou, Mario Lezcano-Casado, Adam P. Goucher, Akhmed Rakhmati, Jeff Niu, Justin Lebar, Pawel Szczerbuk, Peter Bell, Phil Tillet, Thomas Raoux, Zahi Moudallal ยท 2025

Read Linear Layouts: Robust Code Generation of Efficient Tensor Computation Using ๐”ฝ 2 \mathbb{F}_{2} by Keren Zhou, Mario Lezcano-Casado, Adam P. Goucher, Akhmed Rakhmati, Jeff Niu, Justin Lebar, Pawel Szczerbuk, Peter Bell, Phil Tillet, Thomas Raoux, Zahi Moudallal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23819.txt.

Description

Keren Zhou and ten co-authors introduced Linear Layouts in twenty twenty-five, a mathematical framework for the unglamorous problem that governs deep learning speed: how tensors map onto hardware. Layout choices โ€” which thread or register holds which element โ€” were traditionally handled case by case, and converting between layouts exploded combinatorially as hardware grew more complex.

Their idea represents a layout as a binary matrix over the field with two elements, acting on the bits of hardware coordinates. Layouts then compose and convert by generic linear algebra, eliminating the quadratic blowup. Integrated into the Triton compiler, linear layouts optimized individual operators and full kernels, reduced backend engineering effort, and even fixed several bugs lurking in Triton's legacy layout system. The paper gives compiler writers a systematic language for a formerly artisanal problem.

Catalog record

CREATORKeren Zhou, Mario Lezcano-Casado, Adam P. Goucher, Akhmed Rakhmati, Jeff Niu, Justin Lebar, Pawel Szczerbuk, Peter Bell, Phil Tillet, Thomas Raoux, Zahi Moudallal
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-23819

Browse the full library ยท About the Tower of Babel