MaxCode: A Max-Reward Reinforcement Learning Framework for Automated Code Optimization

Jiefu Ou, Sapana Chaudhary, Kaj Bostrom, Nathaniel Weir, Shuai Zhang, Huzefa Rangwala, George Karypis · 2026

Read MaxCode: A Max-Reward Reinforcement Learning Framework for Automated Code Optimization by Jiefu Ou, Sapana Chaudhary, Kaj Bostrom, Nathaniel Weir, Shuai Zhang, Huzefa Rangwala, George Karypis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05475.txt.

Description

Jiefu Ou and 6 co-authors introduce MaxCode, a 2026 framework that helps language models optimize code through search guided by execution feedback. Writing fast code, such as CUDA kernels or competition-level C++, needs deep systems knowledge. Models must also read timing and device-use signals, not just check whether code runs.

MaxCode unifies earlier search methods under a max-reward reinforcement learning view, with modular observation and value functions. A critique model turns raw execution output into plain diagnostic insights for the proposer. A trained reward-to-go model reranks candidate solutions to improve exploration. On KernelBench and PIE benchmarks, MaxCode improved speedup measures over the compared baselines.

Catalog record

CREATORJiefu Ou, Sapana Chaudhary, Kaj Bostrom, Nathaniel Weir, Shuai Zhang, Huzefa Rangwala, George Karypis
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-05475

Browse the full library · About the Tower of Babel