Towards Safe Robot Foundation Models Using Inductive Biases
Maximilian Tölle Theo Gruner Daniel Palenicek, Tim Schneider : Jonas Günster Joe Watson Davide Tateo Puze Liu Jan Peters, ⋆ Equal contribution Technical University of Darmstadt German Research Center for AI ( dfki ) · 2025
Read Towards Safe Robot Foundation Models Using Inductive Biases by Maximilian Tölle Theo Gruner Daniel Palenicek, Tim Schneider : Jonas Günster Joe Watson Davide Tateo Puze Liu Jan Peters, ⋆ Equal contribution Technical University of Darmstadt German Research Center for AI ( dfki ) (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10219.txt.
Introduction
Maximilian Tölle and co-authors argue that robot foundation models need a built-in safety layer rather than hope that safe acts emerge from data, in a 2025 paper. Today's broad robot models copy shown acts, which brings no formal safety pledge. Blind spots in the shown data can also demand endless extra examples.
The team bolts a guard layer, ATACOM, behind the base model. The layer enforces action limits so each state shift stays inside safe bounds, with formal pledges and no safety fine-tuning. Trials span tidy table tasks, where stray bumps were dodged, and robot air hockey, where fast paths held joint and task limits. The authors call the bias a cheap safety floor.
Catalog record
| CREATOR | Maximilian Tölle Theo Gruner Daniel Palenicek, Tim Schneider : Jonas Günster Joe Watson Davide Tateo Puze Liu Jan Peters, ⋆ Equal contribution Technical University of Darmstadt German Research Center for AI ( dfki ) |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-10219
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Safe Robot Foundation Models Using Inductive Biases Maximilian Tölle Theo Gruner Daniel Palenicek, Tim Schneider : Jonas Günster Joe Watson Davide Tateo Puze Liu Jan Peters, ⋆ Equal contribution Technical University of Darmstadt German Research Center for AI ( dfki ) Abstract Safety is a critical requirement for the real-world deployment of robotic systems. Unfortunately, while current robot foundation models show promising generalization capabilities across a wide variety of tasks, they fail to address safety, an important aspect for ensuring long-term operation. Current robot foundation models assume that safe behavior should emerge by learning from a sufficiently large dataset of demonstrations. However, this approach has two clear major drawbacks. Firstly, there are no formal safety guarantees for a behavior cloning policy trained using supervised learning. Secondly, without explicit knowledge of any safety constraints, the policy may require an unreasonable number of additional demonstrations to even approximate the desired constrained behavior. To solve these key issues, we show how we can instead combine robot foundation models with geometric inductive biases using atacom , a safety layer placed after the foundation policy that ensures safe state transitions by enforcing action constraints. With this approach, we can ensure formal safety guarantees for generalist policies without providing extensive demonstrations of safe behavior, and without requiring any specific fine-tuning for safety. Our experiments show that our approach can be beneficial both for classical manipulation tasks, where we avoid unwanted collisions with irrelevant objects, and for dynamic tasks, such as the robot air hockey environment, where we can generate fast trajectories respecting complex tasks and joint space constraints. For experimental results, see https://sites.google.com/view/safe-robot-foundation-models . Keywords: robot foundation models, generalist policies, safety 1 Introduction \Acp rfm [ 1 , 2 , 3 , 4 ] have shown a promising direction to carry out a large set of tasks across a wide range of robotics systems using textual commands as task descriptions. The current developments of rfm focus on enhancing the generalization across tasks, data modalities, and robot embodiments. In contrast, other key practical properties of robotic systems, such as safety, are not considered in depth. The key assumption behind this choice is that the emergent behavior will be inherently safe since rfm are trained using bc ( bc ). If the data distribution only contains safe trajectories, one would expect the learned behavior to also be safe. However, while this assumption may hold in simple pick-and-place scenarios, we argue that in general settings and dynamic environments, this assumption may be limiting for many key reasons. Firstly, there is no way to ensure any formal theoretical guarantees that a rfm will satisfy any safety constraint. Scaling the amount of data will move us closer and closer to the demonstrator distribution, but this does not guarantee that the policy will not generate dangerous behavior. Secondly, often safety constraints such as collision avoidance, joint limits, or any other geometric constraints are both common in robotics applications and can be easily enforced. While it would be possible to learn a policy able to deal with these safety constraints, it may require an unreasonable amount of data, particularly to make the policy robust to out of distribution objects, distractors, or unexpected disturbances of the workspace, such as a human or an animal entering the working area of the robot. In some cases, generating this data would not be even possible, due to the danger of allowing living beings in the work area of the robot, particularly if the robot’s embodiment is not intrinsically safe, as happens in the setting of self-driving cars or heavy industrial robots. Figure 1: Our proposed safety layer can be added to the output of an arbitrary rfm , e.g., \pi_{0} . (left) Without the added atacom safety layer, the vanilla \pi_{0} policy crashes the robot into the table. We highlight the importance of the safety layer by plotting the impact of the \pi_{0} action on the end effector’s vertical velocity. While vanilla \pi_{0} corrects the z position after the impact (red), the safety layer would have engaged earlier to circumvent crashing into the table. (right) Deployment with the safety layer results in a safe rollout without pronounced z-correction. For this reason, we believe that empowering robots with the knowledge of safety constraints and enforcing them directly at the policy level is extremely beneficial both in terms of formal safety guarantees — fundamental for the acceptance of robotics systems in society —and in terms of amount of data and computation needed to operate safely. To reach this objective, we rely on the key concept of inductive biases: instead of collecting demonstrations to account for the full space of possible solutions that rfm can generate, we restrict our policy to only generate safe trajectories. Furthermore, we can rely on the fact that robots interact with the physical world, where the geometry of the rigid objects plays a crucial role. Using the information coming from the object geometry, which can be easily extracted from off-the-shelf perception pipelines, we can robustly generate safety geometric constraints that can be combined with existing prior knowledge about the robot to ensure safety with formal guarantees. To achieve this ambitious goal, we propose a modular safety layer based on the atacom approach [ 5 , 6 ] , which translates known safety constraints into a constraint manifold to ensure safe actions. Due to the design of atacom , we can easily combine this safety layer with any rfm and enforce safe behavior w.r.t. a given set of safety constraints. Furthermore, assuming proper constraint evaluation atacom provides safety guarantees [ 6 ] in terms of forward invariance and input-to-state stability w.r.t. the safe set. To further demonstrate the generality of this approach, we present a semi-automated pipeline based on sam2 ( sam2 ) [ 7 ] to automatically build box constraints for collision avoidance with any object. This allows our method to go beyond user-defined constraints, e.g., workspace constraints or self-collision avoidance. While our proposed solution is not a fully-fledged automatic constraint generation methodology, it shows that this module could be, in principle, implemented robustly and reliably. We extensively evaluate our approach both in simulation and in real-world platforms, using two different rfm , \pi_{0} and octo ( octo ). Specifically, we focus on two different platforms, solving two very different types of tasks: a classical manipulation setup using the Franka robot, and a dynamic task, where we train a Kuka IIWA robot to perform a hitting motion on the air hockey game. We want to prove that our methodology is both flexible and computationally efficient while ensuring safety. Our results show that our safety layer approach, despite the lack of specific fine-tuning data, is not considerably affecting the success rate, while ensuring safe policy execution both in the dynamics and quasistatic tasks. 2 A Safety Module for Robot Foundation Models In the following, we explain in detail how to combine an arbitrary rfm with the atacom safety layer. Our approach follows a different framework w.r.t. existing approaches, as most approaches neglect the safety issue, assuming that enough safe data is provided to the model. Prior attempts at safety perform post-training alignment of rfm s to make the models safer [ 8 ] . In