EMBGuard : Constructing Hazard-Aware Guardrails for Safe Planning in Embodied Agents
Dongwook Choi, Taeyoon Kwon, Bogyung Jeong, Minju Kim, Yeonjun Hwang, Hyojun Kim, Byungchul Kim, Young Kyun Jang, Jinyoung Yeo · 2026
Read EMBGuard : Constructing Hazard-Aware Guardrails for Safe Planning in Embodied Agents by Dongwook Choi, Taeyoon Kwon, Bogyung Jeong, Minju Kim, Yeonjun Hwang, Hyojun Kim, Byungchul Kim, Young Kyun Jang, Jinyoung Yeo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30924.txt.
Introduction
Choi and colleagues build a safety guardrail for embodied agents that separates risk reasoning from agent policy. Agents powered by models can miss physical hazards or over-flag risks, stalling deployment. EMBGuard judges a visual observation plus an action, flags hazardous setups, and explains the risk in words. Alongside it come a training set of over fifteen thousand action-conditioned pairs and a test set of hundreds of checked scenes across seven risk types. Despite its small size, EMBGuard matches proprietary models while cutting false alarms.
Catalog record
| CREATOR | Dongwook Choi, Taeyoon Kwon, Bogyung Jeong, Minju Kim, Yeonjun Hwang, Hyojun Kim, Byungchul Kim, Young Kyun Jang, Jinyoung Yeo |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73813 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30924
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
EMBGuard : Constructing Hazard-Aware Guardrails for Safe Planning in Embodied Agents Dongwook Choi, Taeyoon Kwon, Bogyung Jeong, Minju Kim, Yeonjun Hwang, Hyojun Kim, Byungchul Kim, Young Kyun Jang, Jinyoung Yeo Abstract MLLM-powered embodied agents deployed in real-world environments encounter physical hazards. However, existing approaches lack explicit mechanisms for identifying hazards and reasoning about action-conditioned risks, leading agents to either miss risky interactions or over-identify risks. To address this, we propose EMBGuard , the first MLLM-based safety guardrail for embodied agents designed to decouple physical risk reasoning from agent policy. By evaluating a (visual observation, action) pair, EMBGuard identifies hazardous configurations and provides natural language explanations of potential risks. Alongside EMBGuard , we contribute EMBHazard , a training dataset of 15.1K action-conditioned pairs, and EMBGuardTest , a benchmark of 329 manually curated real-world scenarios spanning seven physical risk categories. Through compositional variation of hazards and actions, we generate diverse risky and benign scenarios that agents may encounter during planning. Despite its compact size (2B, 4B), EMBGuard achieves performance competitive with proprietary MLLMs ( e.g. , GPT-5.1, Gemini-2.5-Pro) while significantly reducing the false-positive rates that hinder real-time deployment. We make the code, data, and models publicly available at LINK . † † affiliationnotice: Equal contribution 1 Introduction The rapid advancement of Multimodal Large Language Models (MLLMs) has enabled embodied agents to perform complex tasks in physical environments ( 7 ; 37 ; 13 ; 14 ; 3 ) . As the user instructions inherently require long-horizon planning, these agents decompose the overall process into subtasks that require direct physical interactions with the environment. However, real-world environments are often hazardous, and even small mistakes in executing these subtasks can lead to catastrophic risks ( 23 ; 22 ; 11 ) . As illustrated in Figure 1 , risks do not arise from the environment alone, but from how an agent’s actions interact with hazards in the scene—objects or conditions that have the potential to cause harm. For instance, a power strip placed next to a plant is not dangerous by itself, and simply moving it away does not introduce any risk. In contrast, watering the plant in this situation creates a potentially risky interaction, as the action exposes the power strip to water and can lead to an electrical risk. Figure 1 : Motivating example. Real-world environments expose embodied agents to unexpected hazards, requiring safe planning. To address this concern, recent works focus on safe planning, which refers to conducting task planning without posing any physical risks ( 24 ; 18 ) . Safe planning requires the agent to understand the environment, identify possible hazards, and mitigate potential risks while executing the given task. Therefore, this requires adding safety-related subtasks to the original plan, introducing additional complexity. However, previous approaches that delegate safety-aware instruction following entirely to agents reveal difficulties in balancing task completion with risk assessment ( 18 ) —agents either miss risky interactions while focusing on tasks or overidentify risks when prioritizing safety, highlighting the need for explicit mechanisms to identify hazards and risks. To overcome this limitation, we propose EMBGuard , the first guardrail specifically designed for embodied agents . Given a visual scene observation and a candidate action from the agent, EMBGuard evaluates whether executing the action would pose safety risks and provides explanations of the underlying hazards. By offloading safety concerns to EMBGuard , embodied agents can prioritize task completion while incorporating EMBGuard ’s feedback to enable successful safe planning. Through our comprehensive experiments, we demonstrate that EMBGuard , despite its small model size (2B, 4B), achieves performance on par with proprietary models (GPT-5.1, Gemini-2.5-Pro) and effectively enables safe planning for embodied agents. Alongside EMBGuard , we introduce EMBHazard and EMBGuardTest , datasets for training and evaluating safety guardrails for embodied agents. EMBHazard comprises 15.1K (image, action) pairs and EMBGuardTest contains 329 manually curated pairs, both featuring scene images with fine-grained annotations that identify hazardous objects and explain how their spatial configurations create risks. Importantly, these datasets go beyond simple hazardous scenarios, incorporating sophisticated cases: situations with multiple risks where different actions trigger different hazards, entirely safe scenarios, and cases where hazards are present but the action does not trigger any risk. This diversity enables EMBGuard to operate effectively in complex real-world scenarios. Our technical contributions are summarized as follows: • We introduce EMBHazard and EMBGuardTest , a new multi-modal training dataset and benchmark for action-conditioned physical risk assessment covering diverse real-world scenarios. • We propose EMBGuard , a general-purpose safety guardrail for embodied agents that not only assesses potential risks but also identifies hazardous elements and explains why they pose dangers. • We demonstrate that EMBGuard achieves performance on par with proprietary models (GPT-5.1, Gemini-2.5-Pro) despite its smaller size (2B, 4B) and effectively improves safe planning in embodied agents. 2 Related Work Figure 2 : Overview of the dataset generation pipeline. Both the training set ( EMBHazard ) and evaluation set ( EMBGuardTest ) are constructed through a systematic three-stage process. MLLM-powered embodied agents. Recent research leverages foundation models for generalized embodied control. Early approaches, like PaLM-E ( 7 ; 2 ) , decoupled high-level reasoning from conventional low-level controllers. This evolved into end-to-end VLA policies—such as RT that map multi-modal inputs directly to actions ( 37 ; 29 ; 13 ) . Recent generative frameworks like CogAct ( 16 ) decouple high-level cognition from low-level action using diffusion models. Current trends scale these capabilities into massive robotic infrastructure, such as Gemini Robotics ( 27 ) and GR00T ( 3 ) , aligning perception, reasoning, and action within a unified representation space. As these systems scale and diversify in architecture, the lack of unified safety evaluation approaches poses significant risks, making such systems increasingly critical. Physical safety for embodied agents. As the tasks of embodied agents become more complex and move toward real-world applications, various physical risks make these tasks increasingly challenging ( 11 ; 26 ) . To address this problem, previous studies have introduced realistic benchmarks that incorporate physical risks ( 22 ; 35 ; 17 ) , safety-aware planning methods ( 12 ) , and evaluation frameworks for physical safety in embodied decision-making ( 24 ) . Among them, IS-Bench ( 18 ) proposes a simulation-based benchmark to evaluate whether embodied agents can effectively avoid risky situations. However, while substantial progress has been made in constructing benchmarks and evaluation frameworks, practical methods that actively prevent embodied agents from taking risky actions are still underexplored. Guardrail for agents. Guardrails were initially developed to detect and prevent unsafe outputs such as toxic content, unsafe advice and jailbreaks in LLMs ( 10 ; 20 ; 8 ) and MLLMs ( 9 ; 5 ) . As these models increasingly serve as reasoning backbones for autonomous agents, research has shifted toward agent-specific guardrails in digital environments, including specialized policy models ( 4 ) , dynamic guardrail code generation ( 33 ) , adaptive safety checks ( 19 ) , and personalized safety preferences ( 32 ) . However, to the best of our knowledge, no prior work has developed guardrails specifically for embodied agents operating in physical environments. While 22 discuss guardrails conceptually in the context of embodied systems, their work does not extend to concrete implementation or