MolQuest: A Benchmark for Agentic Evaluation of Abductive Reasoning in Chemical Structure Elucidation

Taolin Han *, Shuang Wu *, Jinghang Wang *, Yuhao Zhou, Renquan Lv, Bing Zhao †, Wei Hu † · 2026

Read MolQuest: A Benchmark for Agentic Evaluation of Abductive Reasoning in Chemical Structure Elucidation by Taolin Han *, Shuang Wu *, Jinghang Wang *, Yuhao Zhou, Renquan Lv, Bing Zhao †, Wei Hu † (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25253.txt.

Description

Han and co-authors set language models a working chemist's task: name a molecule from its spectra. MolQuest turns structure solving into a multi-turn game with real lab data. A model must plan tests, read NMR and mass spectra, and revise its guess step by step. That tests abductive reasoning and strategy, not one-shot recall. Even the best frontier models land near 50 percent accuracy. Most others stay under 30 percent. The gap shows how far models sit from true lab reasoning.

Catalog record

CREATORTaolin Han *, Shuang Wu *, Jinghang Wang *, Yuhao Zhou, Renquan Lv, Bing Zhao †, Wei Hu †
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50951
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25253

Browse the full library · About the Tower of Babel