SafeGuard ASF: SR Agentic Humanoid Robot System for Autonomous Industrial Safety
Thanh Nguyen Canh, Thang Tran Viet, Thanh Tuan Tran, Ben Wei Lim · 2026
Read SafeGuard ASF: SR Agentic Humanoid Robot System for Autonomous Industrial Safety by Thanh Nguyen Canh, Thang Tran Viet, Thanh Tuan Tran, Ben Wei Lim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25353.txt.
Introduction
Nguyen and co-authors put humanoid robots on safety patrol in dark factories with SafeGuard ASF. Empty plants still face fire, hot pipes, and intruders. Their fleet runs on Unitree G1 robots with depth cameras and a ReAct-style reasoning loop. Fire and smoke spotting scores 94.2 percent mAP at 127 milliseconds of delay. Learned walking policies cover patrol, dance-style tracking, and speed control. Trials in sim and real halls show patrol, person spotting, and obstacle dodging. A tool framework orders each act: sense, think, move.
Catalog record
| CREATOR | Thanh Nguyen Canh, Thang Tran Viet, Thanh Tuan Tran, Ben Wei Lim |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31821 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.25353
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SafeGuard ASF: SR Agentic Humanoid Robot System for Autonomous Industrial Safety Thanh Nguyen Canh, Thang Tran Viet, Thanh Tuan Tran, Ben Wei Lim Abstract The rise of unmanned “dark factories” operating without human presence demands autonomous safety systems capable of detecting and responding to multiple hazard types. We present SafeGuard ASF (Agentic Security Fleet), a comprehensive framework deploying humanoid robots for autonomous hazard detection in industrial environments. Our system integrates multi-modal perception (RGB-D imaging), a ReAct-based agentic reasoning framework, and learned locomotion policies on the Unitree G1 humanoid platform. We address three critical hazard scenarios: fire and smoke detection, abnormal temperature monitoring in pipelines, and intruder detection in restricted zones. Our perception pipeline achieves 94.2% mAP for fire/smoke detection with 127ms latency. We train multiple locomotion policies, including dance motion tracking and velocity control, using Unitree RL Lab with PPO, demonstrating stable convergence within 80,000 training iterations. We validate our system in both simulation and real-world environments, demonstrating autonomous patrol, human detection with visual perception, and obstacle avoidance capabilities. The proposed ToolOrchestra action framework enables structured decision-making through perception, reasoning, and actuation tools. I Introduction The manufacturing industry is witnessing a paradigm shift toward fully automated “dark factories”—production facilities that operate continuously without human presence [ 4 ] . While this automation increases efficiency and reduces labor costs, it introduces critical safety challenges: traditional hazard detection systems rely on human observation for initial response, and existing automated solutions often suffer from limited coverage, high false alarm rates, or inability to perform physical intervention [ 15 ] . Industrial facilities face multiple simultaneous hazard types, including fires, gas leaks, equipment overheating, structural failures, and security breaches. Current solutions typically deploy separate systems for each hazard type—thermal cameras for fire detection, fixed gas sensors for leak detection, and access control systems for security [ 9 ] . This fragmented approach creates coverage gaps, increases maintenance complexity, and lacks the ability to perform coordinated multi-hazard response. Recent advances in humanoid robotics present an opportunity to address these limitations. Humanoid platforms offer several advantages for industrial safety applications: (1) ability to navigate human-designed environments including stairs, ladders, and narrow passages; (2) manipulation capabilities for physical intervention such as valve operation or equipment isolation; (3) mobile sensing that eliminates blind spots inherent in fixed camera installations; and (4) human-like form factor that integrates naturally with existing facility layouts [ 13 ] . In this paper, we present SafeGuard ASF (Agentic Security Fleet), a comprehensive framework for deploying humanoid robots as autonomous safety guardians in unmanned industrial facilities. Our key contributions are: 1. We introduce the first framework for humanoid robot deployment in “dark factory” safety monitoring, addressing the unique challenges of multi-hazard detection without human presence. 2. We present an integrated perception system for simultaneous detection of fire, smoke, thermal anomalies, and security threats, achieving 94.2% mAP with 127ms latency. 3. We adapt the ReAct (Reasoning and Acting) paradigm for real-time robotic hazard response, implementing a ToolOrchestra action framework with 23 specialized tools enabling structured decision-making. II Related Work II-A Industrial Inspection Robots Mobile robots for industrial inspection have evolved from simple wheeled platforms to sophisticated legged systems. ANYmal [ 7 ] demonstrated quadruped inspection in offshore platforms, while Spot [ 3 ] has been deployed for construction site monitoring. However, these systems primarily focus on data collection rather than active hazard response. Our work extends beyond inspection to include reasoning-driven intervention capabilities. Humanoid robots have seen limited deployment in industrial settings. Honda’s ASIMO performed factory tours but lacked safety-specific capabilities [ 11 ] . Boston Dynamics’ Atlas has demonstrated impressive locomotion but has not been adapted for continuous industrial monitoring [ 8 ] . The Unitree G1 platform [ 13 ] offers a cost-effective humanoid solution that we leverage for our safety application. II-B Fire and Hazard Detection Systems Traditional fire detection relies on fixed sensor networks including smoke detectors, thermal cameras, and flame sensors [ 9 ] . Deep learning approaches have improved detection accuracy, with YOLOv8-based systems achieving over 90% accuracy on fire/smoke datasets [ 6 ] . However, fixed installations suffer from coverage limitations and cannot adapt to changing facility layouts. Drone-based inspection systems offer mobility but are constrained by flight time, inability to operate in enclosed spaces, and lack of manipulation capabilities [ 17 ] . Our humanoid approach combines the mobility benefits of drones with ground-based stability and manipulation. II-C Thermal Anomaly Detection Predictive maintenance systems use thermal imaging to identify equipment overheating before failure [ 2 ] . Baseline comparison methods detect deviations from normal operating temperatures [ 10 ] . Our system integrates thermal anomaly detection with mobile sensing, enabling coverage of extensive pipeline networks that would require numerous fixed cameras. II-D LLM/VLM for Robotics Large language models have been integrated into robotic systems for task planning and reasoning. SayCan [ 1 ] grounds language in robotic affordances, while PaLM-E [ 5 ] enables embodied reasoning. The ReAct framework [ 16 ] combines reasoning traces with action execution. We adapt ReAct for real-time hazard response, where rapid decision-making is critical. III System Architecture III-A System Overview SafeGuard ASF employs a hierarchical six-layer architecture (Fig. 1 ) processing sensor data through perception, understanding, memory, decision, planning, and action layers. This design separates concerns while enabling information flow between layers for coordinated response. L1 Perception Layer Fire/Smoke Thermal Depth Person L2 Understanding Layer Severity Trend Fusion L3 Memory Layer Facility Map Baselines Personnel L4 Decision Layer (ToolOrchestra) ReAct Reasoning 23 Tools L5 Planning Layer D* Lite MPPI L6 Action Layer Locomotion Comm Actuate RGB-D Thermal IMU Unitree G1 Fig. 1 : Six-layer hierarchical architecture of SafeGuard ASF. Sensor data flows through perception (L1) and understanding (L2) layers to inform decision-making (L4), which coordinates planning (L5) and action (L6) for hazard response. III-B Hardware Platform We deploy on the Unitree G1 humanoid robot with the following sensor configuration: • RGB-D Camera : Intel RealSense D455 (1280×720 @ 30fps RGB, 640×480 depth) • Compute : NVIDIA Jetson Orin (275 TOPS AI performance) The G1 platform provides 29 degrees of freedom (23 lower body + 6 upper body) enabling stable locomotion across industrial environments including stairs and uneven surfaces. III-C Locomotion Policy Training We train locomotion policies using the Unitree RL Lab framework [ 14 ] built on IsaacLab and RSL-RL. The training employs Proximal Policy Optimization (PPO) [ 12 ] with massively parallel simulation in Isaac Sim. III-C 1 MDP Formulation The locomotion task is formulated as a Markov Decision Process (MDP) where the policy \pi_{\theta}(a_{t}|o_{t}) maps observations to actions. At each timestep t , the observation vector o_{t}\in\mathbb{R}^{235} comprises: o_{t}=[v_{cmd},q,\dot{q},g,a_{t-1},a_{t-2},\ldots,a_{t-6}] (1) where v_{cmd}\in\mathbb{R}^{3} is the velocity command (v_{x},v_{y},\omega_{z}) , q\in\mathbb{R}^{29} represents joint positions, \dot{q}\in\mathbb{R}^{29} denotes joint velocities, g\in\mathbb{R}^{3} is projected gravity, and a_{t-k} is action history over 6 timesteps. The action a_{t}\in\mathbb{R}^{29} specifies target joint positions, converted to torques via PD control: \tau=K_{p}(a_{t}\cdot s_{action}+q_{default}-q)-K_{d}\dot{q} (2) where K_{p} , K_{d} are stiffness and damping gains, s_{action} is action scale, and q_{default} is default pose. III-C 2 Reward Function The policy is trained to maximize expected cumulative reward: J(\theta)=\mathbb{E}_{\pi_{\theta}}\left[\sum_{t=0}^{T}\gamma^{t}r_{t}\right] (3) where \gamma=0.99 is the discount factor. The reward function combines tracking objectives and regularization terms: r_{t}=r_{track}+r_{reg}+r_{style} (4) The tracking reward encourages velocity