OR-R1: Automating Modeling and Solving of Operations Research Optimization Problem via Test-Time Reinforcement Learning

Zezhen Ding, Zhen Tan, Jiheng Zhang \correspondingauthor, Tianlong Chen \correspondingauthor · 2025

Read OR-R1: Automating Modeling and Solving of Operations Research Optimization Problem via Test-Time Reinforcement Learning by Zezhen Ding, Zhen Tan, Jiheng Zhang \correspondingauthor, Tianlong Chen \correspondingauthor (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-09092.txt.

Description

Zezhen Ding and three co-authors automate the operations research pipeline. There, an expert must translate a word problem about schedules, fleets, or supply chains into a formal optimization model and then into solver code. Language models can attempt both steps, but earlier systems needed mountains of annotated or synthetic data to learn how.

OR-R1 trains in two stages. Supervised fine-tuning on limited labeled data teaches the basic formulation and coding patterns. Then a test-time reinforcement method, TGRPO, squeezes learning out of abundant unlabeled problems. The system reaches state-of-the-art solving accuracy near sixty-eight percent while using a tenth of the synthetic data its predecessor needed, and it still wins with only one hundred synthetic samples. Test-time training also narrows the gap between first-try and best-of-eight performance.

Catalog record

CREATORZezhen Ding, Zhen Tan, Jiheng Zhang \correspondingauthor, Tianlong Chen \correspondingauthor
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-09092

Browse the full library · About the Tower of Babel