Pre-Execution Safety Gate & Task Safety Contracts for LLM-Controlled Robot Systems
Ike Obi, Vishnunandan L.N. Venkatesh, Weizheng Wang, Ruiqi Wang, Dayoon Suh, Temitope I. Amosa, Wonse Jo, Byung-Cheol Min · 2026
Read Pre-Execution Safety Gate & Task Safety Contracts for LLM-Controlled Robot Systems by Ike Obi, Vishnunandan L.N. Venkatesh, Weizheng Wang, Ruiqi Wang, Dayoon Suh, Temitope I. Amosa, Wonse Jo, Byung-Cheol Min (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05427.txt.
Introduction
Obi and seven colleagues add a pre-execution safety gate for robots driven by language-model commands. Such commands can reach hardware unchecked today and drift into unsafe states mid-task. Their SafeGate design pulls safety facts from plain commands and admits or rejects them by fixed rules from ISO 13482. Approved tasks get contracts of invariants, guards, and abort rules, checked with Z3 solving. Tests across 230 benchmark tasks, 30 simulations, and real robots cut bad acceptances while keeping benign tasks flowing.
Catalog record
| CREATOR | Ike Obi, Vishnunandan L.N. Venkatesh, Weizheng Wang, Ruiqi Wang, Dayoon Suh, Temitope I. Amosa, Wonse Jo, Byung-Cheol Min |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42906 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.05427
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Pre-Execution Safety Gate & Task Safety Contracts for LLM-Controlled Robot Systems Ike Obi, Vishnunandan L.N. Venkatesh, Weizheng Wang, Ruiqi Wang, Dayoon Suh, Temitope I. Amosa, Wonse Jo, Byung-Cheol Min Abstract Large Language Models (LLMs) are increasingly used to convert task commands into robot-executable code, however this pipeline lacks validation gates to detect unsafe and defective commands before they are translated into robot code. Furthermore, even commands that appear safe at the outset can produce unsafe state transitions during execution in the absence of continuous constraint monitoring. In this research, we introduce SafeGate, a neurosymbolic safety architecture that prevents unsafe natural language task commands from reaching robot execution. Drawing from ISO 13482 safety standard, SafeGate extracts structured safety-relevant properties from natural language commands and applies a deterministic decision gate to authorize or reject execution. In addition, we introduce Task Safety Contracts, which decomposes commands that pass through the gate into invariants, guards, and abort conditions to prevent unsafe state transitions during execution. We further incorporate Z3 SMT solving to enforce constraint checking derived from the Task Safety Contracts. We evaluate SafeGate against existing LLM-based robot safety frameworks and baseline LLMs across 230 benchmark tasks, 30 AI2-THOR simulation scenarios, and real-world robot experiments. Results show that SafeGate significantly reduces the acceptance of defective commands while maintaining a high acceptance of benign tasks, demonstrating the importance of pre-execution safety gates for LLM-controlled robot systems. I Introduction Large language model (LLM)-based planners have enabled natural language to serve as a high-level interface for robotic control and planning [ 16 , 1 , 8 , 18 , 12 ] . A central technical challenge is grounding language instructions in the current scene and the robot’s affordances, mapping free-form commands to executable plans consistent with the robot’s capabilities [ 5 , 17 ] . Many approaches further operationalize these plans by synthesizing programmatic representations (e.g., code or policy sketches) that can be executed by downstream controllers in the physical world [ 16 ] . Empirically, such systems have shown promising results in following natural language commands [ 4 ] , solving long-horizon tasks [ 5 ] , and improving generalization across environments [ 4 ] . Despite these advances, most language model-based planners remain fundamentally limited because they generate plans and action sequences for any natural language command without discriminating between commands that are unsafe, defective, or hazardous from those that are safe and feasible [ 22 , 19 ] . This lack of a safety verification mechanism before the generation and execution of task plans leaves the robot system vulnerable to producing plans and code that may lead to hazardous operational conditions and cause harm. Existing safety approaches often employ constraint-based verification techniques [ 21 ] , where researchers and developers specify safety requirements as temporal logic formulas, and planners verify that generated plans satisfy these properties. However, this approach is limited in two ways in that, first, constraint-based verification catches what the researcher or engineer thought to check for and is structurally blind to everything else. Second, commands that are clearly unsafe or defective should never enter the system pipeline in the first place, yet these planners process them indiscriminately. How might we prevent unsafe or defective natural language commands from ever reaching robot execution while still allowing legitimate commands to pass through? Fig. 1 : A conceptual image of the SafeGate’s neurosymbolic architecture processing a natural language command. In this research, we introduce SafeGate , a neurosymbolic pre-execution safety gate that sits at authorization points in an LLM-controlled robot system. First, Safegate intercepts every natural language command before execution, analyzes it, and produces one of three decisions, including authorize with a verified safety contract, defer to a human for clarification when critical information is missing, or reject when identified hazards cannot be prevented. Second, for authorized tasks, SafeGate sits between each action plan sequence generated by the task planner to perform runtime monitoring using invariants that evaluate and approve the robot’s plan before execution. Overall, SafeGate draws its conceptual framing from ISO-13482 [ 14 ] and ISO-12100 [ 15 ] safety standards and comprises six stages, including 1) Hazard Analysis Matrix, 2) The Hazard Binding Layer, 3) The Deterministic Decision Gate, 4) Contract Compilation stage, 5) Plan Verification with Z3 SMT solving, and 6) Runtime Monitoring during robot code execution stage. We evaluated SafeGate against existing LLM-based robot safety frameworks, including [ 21 , 13 ] on 230 expert-curated benchmark tasks that span various types of command and hazard categories, 30 AI2-THOR [ 9 ] simulation scenarios, and real-world experiments with a physical robot. Our results show that SafeGate achieves significant performance reducing acceptance of defective and unsafe commands. Our contributions through this research are as follows: 1. Neurosymbolic Pre-execution Gate: We introduce SafeGate , a neurosymbolic pre-execution safety gate for LLM-controlled robot systems, grounded in ISO-13482 [ 14 ] and 12100 [ 15 ] safety standards. Our pre-execution safety gate employs multiple new components, including the Hazard Analysis Matrix , Hazard Template Library , and Deterministic Decision Gate to intercept and analyze a natural language task command before plan and code generation, with outcomes of either accept, reject, or defer. 2. Task Safety Contracts We introduce the Task Safety Contract, a structured formal specification that enforces safety constraints on authorized tasks from the pre-execution phase. Each contract consists of (i) invariants, conditions that must hold at every state during execution, (ii) guards, preconditions that must be satisfied before specific actions can proceed, and (iii) abort conditions for runtime enforcement. 3. Benchmark Experiments We contribute a diverse benchmark of 230 expert-annotated robot task commands across three domains (manipulation, navigation, assistance) and three complexity levels (simple, medium, complex). II Related Works II- 1 Pre-Execution Evaluation in LLM-Controlled Robot Systems Recent studies have revealed vulnerabilities in LLM-controlled robot systems as a result of weak or absent pre-execution safety checks. Wu et al. [ 20 ] demonstrated that adversarial attacks through prompt and perception manipulation can degrade LLM/VLM-robot performance by 19–30%, exposing the fragility of these systems to malicious inputs. Azeem et al. [ 3 ] also found that these systems routinely fail to reject dangerous or unlawful instructions in open-vocabulary settings, inappropriately approving unsafe actions. Similarly, Hundt et al. [ 6 ] showed that robots using visio-linguistic models like CLIP perpetuate toxic stereotypes in their decision-making. In response to these challenges, researchers have proposed various safety enhancement strategies, though significant gaps remain. Wu et al. [ 21 ] developed SELP, which combines equivalence voting, constrained decoding, and domain-specific fine-tuning to improve task planning reliability. However, their approach assumes inherently safe task prompts, addressing only the planning phase rather than validating the safety of the initial instructions. Yang et al. [ 22 ] introduced a queryable safety constraint module using linear temporal logic (LTL) to ensure compliance with safety rules such as collision avoidance and task boundaries. While effective for execution-time safety, this approach similarly overlooks the critical initial task validation stage. The most relevant work to our approach comes from Althobaiti et al. [ 2 ] , who proposed a safety verification layer for LLM-generated code in drone operations, combining few-shot learning with knowledge graph prompting. However, their reliance on fine-tuning presents significant limitations, as