AgentSafe : Benchmarking the Safety of Embodied Agents on Hazardous Instructions
Aishan Liu, Zonghao Ying, Le Wang, Junjie Mu, Jinyang Guo, Jiakai Wang, Yuqing Ma, Siyuan Liang, Mingchuan Zhang, Xianglong Liu, Dacheng Tao · 2025
Read AgentSafe : Benchmarking the Safety of Embodied Agents on Hazardous Instructions by Aishan Liu, Zonghao Ying, Le Wang, Junjie Mu, Jinyang Guo, Jiakai Wang, Yuqing Ma, Siyuan Liang, Mingchuan Zhang, Xianglong Liu, Dacheng Tao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-14697.txt.
Description
Aishan Liu and a team of colleagues wrote a 2025 paper on AgentSafe, a benchmark for the safety of embodied AI agents. Embodied agents are robots and virtual agents that see, plan, and act in human environments, often guided by vision-language models. When such an agent follows a hazardous instruction, the harm can be physical.
Older safety tests cover few kinds of hazard and check only the final outcome. This benchmark follows the whole chain of perception, planning, and execution, so failures can be located precisely. It systematically feeds agents dangerous instructions and scores how they respond. A fuller test helps developers find unsafe behavior before these agents are deployed around people.
Catalog record
| CREATOR | Aishan Liu, Zonghao Ying, Le Wang, Junjie Mu, Jinyang Guo, Jiakai Wang, Yuqing Ma, Siyuan Liang, Mingchuan Zhang, Xianglong Liu, Dacheng Tao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-14697