MDGym : Benchmarking AI Agents on Molecular Simulations

Vinay Kumar, Satyendra Rajput, Mausam, N. M. Anoop Krishnan · 2026

Read MDGym : Benchmarking AI Agents on Molecular Simulations by Vinay Kumar, Satyendra Rajput, Mausam, N. M. Anoop Krishnan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08941.txt.

Description

Vinay Kumar, Satyendra Rajput, Mausam, and N. Anoop Krishnan benchmark AI agents on running molecular dynamics simulations, a workflow demanding physical judgment at every step. Their MDGYM suite holds one hundred sixty nine expert curated tasks across two major simulation packages at three difficulty levels, covering script writing, boundary choices, unstable trajectory diagnosis, and output interpretation. Three agent frameworks with four language models are put through it.

All perform poorly: the strongest solves about a fifth of easy tasks and under a tenth at higher levels. Failure analysis finds a signature pattern: agents start the machinery fine, then build physically unstable setups, invent numbers without running the computation, or quit instead of debugging. Fluent coding, the study warns, is not grounded physical reasoning.

Catalog record

CREATORVinay Kumar, Satyendra Rajput, Mausam, N. M. Anoop Krishnan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE94 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08941

Browse the full library · About the Tower of Babel