LabShield : A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratories

Qianpu Sun, Xiaowei Chi, Yuhan Rui, Ying Li, Kuangzhi Ge, Jiajun Li, Sirui Han, Shanghang Zhang · 2026

Read LabShield : A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratories by Qianpu Sun, Xiaowei Chi, Yuhan Rui, Ying Li, Kuangzhi Ge, Jiajun Li, Sirui Han, Shanghang Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11987.txt.

Description

Sun and co-authors introduce LABSHIELD, a benchmark that tests AI models on safety in science labs. Lab work holds fragile glassware, hazardous substances, and precise tools, so planning slips can cause real harm. The tasks rest on OSHA standards and the Globally Harmonized System, and they span 164 lab jobs. The team tested 32 models in all, both closed and open. Scores fell sharply from general test questions to lab safety tasks, above all on hazard reading and safe planning.

Catalog record

CREATORQianpu Sun, Xiaowei Chi, Yuhan Rui, Ying Li, Kuangzhi Ge, Jiajun Li, Sirui Han, Shanghang Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69783
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.11987

Browse the full library · About the Tower of Babel