GPU Forecasters: Language Models as Selective Surrogates for Kernel Runtime Optimization

Zaid Khan, Justin Chih-Yao Chen, Jaemin Cho, Elias Stengel-Eskin, Mohit Bansal · 2026

Read GPU Forecasters: Language Models as Selective Surrogates for Kernel Runtime Optimization by Zaid Khan, Justin Chih-Yao Chen, Jaemin Cho, Elias Stengel-Eskin, Mohit Bansal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31464.txt.

Description

Khan and colleagues study language models as selective stand-ins for GPU kernel runtime tuning. Tuning a kernel normally needs repeated on-device measurement, and each run is costly since it needs compiling and rerunning. A good stand-in should forecast relative speed well, and know when it might be wrong, deferring to the GPU then. The team finds models can forecast relative kernel speed accurately. Reinforcement learning sharpens both forecasts and confidence, and the stand-in lets a search test several times more candidates on the same GPU budget.

Catalog record

CREATORZaid Khan, Justin Chih-Yao Chen, Jaemin Cho, Elias Stengel-Eskin, Mohit Bansal
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE104585
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.31464

Browse the full library · About the Tower of Babel