OPT-Engine: Benchmarking the Limits of LLMs in Optimization Modeling via Complexity Scaling
Yitian Chen ,, Cheng Cheng,, Yinan Sun,, Zi Ling,, Dongdong Ge · 2026
Read OPT-Engine: Benchmarking the Limits of LLMs in Optimization Modeling via Complexity Scaling by Yitian Chen ,, Cheng Cheng,, Yinan Sun,, Zi Ling,, Dongdong Ge (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19924.txt.
Description
Yitian Chen and four colleagues probe the limits of language models at optimization modeling. Turning a word problem into equations a solver can crack is a skilled task. Language models have progressed fast at it, spawning new methods and benchmarks. Yet the boundaries of their ability remain poorly understood, especially as problems grow complex.
Their benchmark, OPT-Engine, scales problem complexity in a controlled way. Watching where models break reveals which ingredients defeat them: size, structure, or wording. Real-world tasks are exactly where benchmarks are thinnest. A scaling view helps users judge when to trust a model's formulation. It also directs research toward the failure modes that matter most.
Catalog record
| CREATOR | Yitian Chen ,, Cheng Cheng,, Yinan Sun,, Zi Ling,, Dongdong Ge |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-19924