Beyond Inference-Time Search: Reinforcement Learning Synthesizes Reusable Solvers
Soheyl Massoudi, Gabriel Apaza, Milad Habibi, Mark Fuge · 2026
Read Beyond Inference-Time Search: Reinforcement Learning Synthesizes Reusable Solvers by Soheyl Massoudi, Gabriel Apaza, Milad Habibi, Mark Fuge (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18374.txt.
Introduction
Soheyl Massoudi and three co-authors ask in a 2026 paper whether reinforcement learning can teach a code model to write reusable solvers. Instead of solving each instance from scratch, one solver would serve a whole problem family. On a controlled knapsack variant, their fine-tuned Qwen2.5-Coder model closes the gap to the best solver from about 28.7 percent to 5.0 percent, at 91 times lower post-generation cost. A frozen solver per seed stays highly competitive when reused unchanged across the test set.
Catalog record
| CREATOR | Soheyl Massoudi, Gabriel Apaza, Milad Habibi, Mark Fuge |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 128017 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.18374