LabShield : A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratories
Qianpu Sun, Xiaowei Chi, Yuhan Rui, Ying Li, Kuangzhi Ge, Jiajun Li, Sirui Han, Shanghang Zhang · 2026
Read LabShield : A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratories by Qianpu Sun, Xiaowei Chi, Yuhan Rui, Ying Li, Kuangzhi Ge, Jiajun Li, Sirui Han, Shanghang Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11987.txt.
Description
Sun and co-authors introduce LABSHIELD, a benchmark that tests AI models on safety in science labs. Lab work holds fragile glassware, hazardous substances, and precise tools, so planning slips can cause real harm. The tasks rest on OSHA standards and the Globally Harmonized System, and they span 164 lab jobs. The team tested 32 models in all, both closed and open. Scores fell sharply from general test questions to lab safety tasks, above all on hazard reading and safe planning.
Catalog record
| CREATOR | Qianpu Sun, Xiaowei Chi, Yuhan Rui, Ying Li, Kuangzhi Ge, Jiajun Li, Sirui Han, Shanghang Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69783 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.11987