MDGym : Benchmarking AI Agents on Molecular Simulations
Vinay Kumar, Satyendra Rajput, Mausam, N. M. Anoop Krishnan · 2026
Read MDGym : Benchmarking AI Agents on Molecular Simulations by Vinay Kumar, Satyendra Rajput, Mausam, N. M. Anoop Krishnan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08941.txt.
Description
Vinay Kumar, Satyendra Rajput, Mausam, and N. Anoop Krishnan benchmark AI agents on running molecular dynamics simulations, a workflow demanding physical judgment at every step. Their MDGYM suite holds one hundred sixty nine expert curated tasks across two major simulation packages at three difficulty levels, covering script writing, boundary choices, unstable trajectory diagnosis, and output interpretation. Three agent frameworks with four language models are put through it.
All perform poorly: the strongest solves about a fifth of easy tasks and under a tenth at higher levels. Failure analysis finds a signature pattern: agents start the machinery fine, then build physically unstable setups, invent numbers without running the computation, or quit instead of debugging. Fluent coding, the study warns, is not grounded physical reasoning.
Catalog record
| CREATOR | Vinay Kumar, Satyendra Rajput, Mausam, N. M. Anoop Krishnan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 94 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.08941