Beyond Inference-Time Search: Reinforcement Learning Synthesizes Reusable Solvers

Soheyl Massoudi, Gabriel Apaza, Milad Habibi, Mark Fuge · 2026

Read Beyond Inference-Time Search: Reinforcement Learning Synthesizes Reusable Solvers by Soheyl Massoudi, Gabriel Apaza, Milad Habibi, Mark Fuge (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18374.txt.

Introduction

Soheyl Massoudi and three co-authors ask in a 2026 paper whether reinforcement learning can teach a code model to write reusable solvers. Instead of solving each instance from scratch, one solver would serve a whole problem family. On a controlled knapsack variant, their fine-tuned Qwen2.5-Coder model closes the gap to the best solver from about 28.7 percent to 5.0 percent, at 91 times lower post-generation cost. A frozen solver per seed stays highly competitive when reused unchanged across the test set.

Catalog record

CREATORSoheyl Massoudi, Gabriel Apaza, Milad Habibi, Mark Fuge
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE128017
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.18374

Browse the full library · About the Tower of Babel