CuAsmRL: Optimizing GPU SASS Schedules via Deep Reinforcement Learning
Guoliang He, Eiko Yoneki · 2025
Read CuAsmRL: Optimizing GPU SASS Schedules via Deep Reinforcement Learning by Guoliang He, Eiko Yoneki (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-08071.txt.
Description
The fastest code for large AI models is often hand-tuned at the assembly level, where experts shuffle instruction schedules by trial and error. Guoliang He and Eiko Yoneki teach a learning agent to do that shuffling. Their system, CuAsmRL, works on the low-level SASS code of GPU kernels.
The agent plays a kind of game: change the schedule, run it, and earn a reward if the chip runs faster. Starting from an already optimized schedule, it mutates step by step toward better ones. On existing specialized kernels, the method raised speed by up to 26 percent, and 9 percent on average. It needs no changes to the kernels themselves. The learned moves also hint at tricks human experts had not systematized. The authors propose it as a compiler add-on.
Catalog record
| CREATOR | Guoliang He, Eiko Yoneki |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-08071