HipKittens : Fast and Furious AMD Kernels

William Hu, Drew Wadsworth, Sean Siddens, Stanley Winata, Daniel Y. Fu, Ryan Swann, Muhammad Osama, Christopher Ré, Simran Arora · 2025

Read HipKittens : Fast and Furious AMD Kernels by William Hu, Drew Wadsworth, Sean Siddens, Stanley Winata, Daniel Y. Fu, Ryan Swann, Muhammad Osama, Christopher Ré, Simran Arora (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08083.txt.

Description

William Hu and co-authors build HipKittens, a programming framework for fast AI kernels on AMD graphics processors. AMD hardware offers strong compute and bandwidth, yet peak kernels are usually written in raw assembly, which is hard to scale across workloads. Tile based languages eased this work on NVIDIA hardware, raising the question of what transfers.

The study finds tile abstractions do generalize, but the algorithms behind them need rethinking for AMD designs. HipKittens kernels match hand tuned assembly for matrix multiplication and attention on two AMD platforms, beat compiler baselines, and in some memory bound cases outperform every available baseline by a wide margin.

Catalog record

CREATORWilliam Hu, Drew Wadsworth, Sean Siddens, Stanley Winata, Daniel Y. Fu, Ryan Swann, Muhammad Osama, Christopher Ré, Simran Arora
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE96 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08083

Browse the full library · About the Tower of Babel