HipKittens : Fast and Furious AMD Kernels
William Hu, Drew Wadsworth, Sean Siddens, Stanley Winata, Daniel Y. Fu, Ryan Swann, Muhammad Osama, Christopher Ré, Simran Arora · 2025
Read HipKittens : Fast and Furious AMD Kernels by William Hu, Drew Wadsworth, Sean Siddens, Stanley Winata, Daniel Y. Fu, Ryan Swann, Muhammad Osama, Christopher Ré, Simran Arora (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08083.txt.
Description
William Hu and co-authors build HipKittens, a programming framework for fast AI kernels on AMD graphics processors. AMD hardware offers strong compute and bandwidth, yet peak kernels are usually written in raw assembly, which is hard to scale across workloads. Tile based languages eased this work on NVIDIA hardware, raising the question of what transfers.
The study finds tile abstractions do generalize, but the algorithms behind them need rethinking for AMD designs. HipKittens kernels match hand tuned assembly for matrix multiplication and attention on two AMD platforms, beat compiler baselines, and in some memory bound cases outperform every available baseline by a wide margin.
Catalog record
| CREATOR | William Hu, Drew Wadsworth, Sean Siddens, Stanley Winata, Daniel Y. Fu, Ryan Swann, Muhammad Osama, Christopher Ré, Simran Arora |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 96 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-08083