OPT-Engine: Benchmarking the Limits of LLMs in Optimization Modeling via Complexity Scaling

Yitian Chen ,, Cheng Cheng,, Yinan Sun,, Zi Ling,, Dongdong Ge · 2026

Read OPT-Engine: Benchmarking the Limits of LLMs in Optimization Modeling via Complexity Scaling by Yitian Chen ,, Cheng Cheng,, Yinan Sun,, Zi Ling,, Dongdong Ge (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19924.txt.

Description

Yitian Chen and four colleagues probe the limits of language models at optimization modeling. Turning a word problem into equations a solver can crack is a skilled task. Language models have progressed fast at it, spawning new methods and benchmarks. Yet the boundaries of their ability remain poorly understood, especially as problems grow complex.

Their benchmark, OPT-Engine, scales problem complexity in a controlled way. Watching where models break reveals which ingredients defeat them: size, structure, or wording. Real-world tasks are exactly where benchmarks are thinnest. A scaling view helps users judge when to trust a model's formulation. It also directs research toward the failure modes that matter most.

Catalog record

CREATORYitian Chen ,, Cheng Cheng,, Yinan Sun,, Zi Ling,, Dongdong Ge
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-19924

Browse the full library · About the Tower of Babel