OR-R1: Automating Modeling and Solving of Operations Research Optimization Problem via Test-Time Reinforcement Learning
Zezhen Ding, Zhen Tan, Jiheng Zhang \correspondingauthor, Tianlong Chen \correspondingauthor · 2025
Read OR-R1: Automating Modeling and Solving of Operations Research Optimization Problem via Test-Time Reinforcement Learning by Zezhen Ding, Zhen Tan, Jiheng Zhang \correspondingauthor, Tianlong Chen \correspondingauthor (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-09092.txt.
Description
Zezhen Ding and three co-authors automate the operations research pipeline. There, an expert must translate a word problem about schedules, fleets, or supply chains into a formal optimization model and then into solver code. Language models can attempt both steps, but earlier systems needed mountains of annotated or synthetic data to learn how.
OR-R1 trains in two stages. Supervised fine-tuning on limited labeled data teaches the basic formulation and coding patterns. Then a test-time reinforcement method, TGRPO, squeezes learning out of abundant unlabeled problems. The system reaches state-of-the-art solving accuracy near sixty-eight percent while using a tenth of the synthetic data its predecessor needed, and it still wins with only one hundred synthetic samples. Test-time training also narrows the gap between first-try and best-of-eight performance.
Catalog record
| CREATOR | Zezhen Ding, Zhen Tan, Jiheng Zhang \correspondingauthor, Tianlong Chen \correspondingauthor |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-09092