MaxCode: A Max-Reward Reinforcement Learning Framework for Automated Code Optimization
Jiefu Ou, Sapana Chaudhary, Kaj Bostrom, Nathaniel Weir, Shuai Zhang, Huzefa Rangwala, George Karypis · 2026
Read MaxCode: A Max-Reward Reinforcement Learning Framework for Automated Code Optimization by Jiefu Ou, Sapana Chaudhary, Kaj Bostrom, Nathaniel Weir, Shuai Zhang, Huzefa Rangwala, George Karypis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05475.txt.
Description
Jiefu Ou and 6 co-authors introduce MaxCode, a 2026 framework that helps language models optimize code through search guided by execution feedback. Writing fast code, such as CUDA kernels or competition-level C++, needs deep systems knowledge. Models must also read timing and device-use signals, not just check whether code runs.
MaxCode unifies earlier search methods under a max-reward reinforcement learning view, with modular observation and value functions. A critique model turns raw execution output into plain diagnostic insights for the proposer. A trained reward-to-go model reranks candidate solutions to improve exploration. On KernelBench and PIE benchmarks, MaxCode improved speedup measures over the compared baselines.
Catalog record
| CREATOR | Jiefu Ou, Sapana Chaudhary, Kaj Bostrom, Nathaniel Weir, Shuai Zhang, Huzefa Rangwala, George Karypis |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-05475