TamedPUMA: safe and stable imitation learning with geometric fabrics

Saray Bakker, Rodrigo Pérez-Dattari, Cosimo Della Santina, Wendelin Böhmer, Javier Alonso-Mora · 2025

Read TamedPUMA: safe and stable imitation learning with geometric fabrics by Saray Bakker, Rodrigo Pérez-Dattari, Cosimo Della Santina, Wendelin Böhmer, Javier Alonso-Mora (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17432.txt.

Introduction

Saray Bakker and co-authors make robot imitation learning safer in 2025. Teaching robots by example gives smooth, goal-seeking motion, but safety limits are hard to guarantee. Collisions and joint limits can be broken by a learned policy alone.

Their method, TamedPUMA, merges the learned policy with a motion frame built for safety. Both parts speak the language of dynamical systems, so they blend cleanly. The result keeps goal convergence while respecting limits such as obstacle avoidance. Tests in simulation and on a real seven-joint arm back the claims, the authors report.

Catalog record

CREATORSaray Bakker, Rodrigo Pérez-Dattari, Cosimo Della Santina, Wendelin Böhmer, Javier Alonso-Mora
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-17432

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TamedPUMA: safe and stable imitation learning with geometric fabrics Saray Bakker, Rodrigo Pérez-Dattari, Cosimo Della Santina, Wendelin Böhmer, Javier Alonso-Mora Abstract Using the language of dynamical systems, Imitation learning (IL) provides an intuitive and effective way of teaching stable task-space motions to robots with goal convergence. Yet, IL techniques are affected by serious limitations when it comes to ensuring safety and fulfillment of physical constraints. With this work, we solve this challenge via TamedPUMA, an IL algorithm augmented with a recent development in motion generation called geometric fabrics. As both the IL policy and geometric fabrics describe motions as artificial second-order dynamical systems, we propose two variations where IL provides a navigation policy for geometric fabrics. The result is a stable imitation learning strategy within which we can seamlessly blend geometrical constraints like collision avoidance and joint limits. Beyond providing a theoretical analysis, we demonstrate TamedPUMA with simulated and real-world tasks, including a 7-DoF manipulator. Link to website keywords Imitation Learning, Dynamical Systems, Geometric Motion Generation , Fabrics, Movement Primitives 1 Introduction As robotic solutions rapidly enter unstructured environments such as the agriculture sector and homes, there is a critical need for methods that allow non-experts to easily adapt robots for new tasks. Currently, experts manually program these tasks, a method that is costly and not scalable for widespread use. Moreover, these sectors demand that robots safely interact with dynamic environments where humans are present. A possible solution to this societal challenge comes from il ( il ). Using this technique, robots can learn motion profiles from demonstrations provided by non-expert users. Furthermore, by encoding the learned trajectories as solutions of a dynamical system, established mathematical tools from dynamical system theory can be used to guarantee convergence to the task’s goal state, as we discuss more in detail in Sec. 1.1 . In a robotics context, these learned dynamical systems commonly encode the navigation policy towards a goal within a task space - such as the evolution of the end-effector pose of a manipulator while pouring water in a glass from all possible initial locations. However, this focus on task space motions renders il fundamentally limited when considering physical constraints involving the robot’s body impacting itself or interacting with the external environment. Substantial recent research has looked into the problem but, as we discuss in Sec. 1.1 , to the best of our knowledge, no il method can simultaneously ensure stability and real-time fulfillment of physical constraints for systems with many degrees of freedom. This work contributes to the state of the art by introducing TamedPUMA , a learning framework that builds on IL and geometric fabrics ( Ratliff et al. 2020 ) to obtain inherently stable and safe motion primitives from demonstrations. By leveraging the recently introduced geometric framework for motion generation called geometric fabrics, our approach learns stable motion profiles while considering online whole-body collision-avoidance and joint limits. To make this possible, the learned task-space policy has to be formulated as a {2^{\mathrm{nd}}\text{-order}} (neural) dynamical system as fabrics operate within the Finsler Geometry framework where vector fields must be defined at the acceleration level ( Bao et al. 2012 ) . Also, the learned policy must admit an aligned potential, which roughly means a scalar function whose gradient is aligned with the acceleration field when the velocity is null. In this paper, we formally assess how we can ensure that both conditions are met. The performance of our approach is evaluated with a simulated and real-world 7-DoF manipulator, where we also benchmark it against vanilla geometric fabrics, vanilla learned stable motion primitives and a modulation-based IL approach leveraging collision-aware IK. 1.1 Related work Learning stable dynamical systems from demonstrations Multiple methodologies have been introduced for learning stable dynamical systems ( Billard et al. 2022 ; Hu et al. 2024 ) . An influential methodology in learning stable dynamical systems is dmp ( dmp ) by Ijspeert et al. 2013 , ensuring convergence towards a simple manually-designed dynamical system. This approach is extended to non-Euclidean state spaces ( Ude et al. 2014 ) , probabilistic environments ( Li et al. 2023 ; Przystupa et al. 2023 ) , and in the context of dnn ( dnn ) ( Pervez et al. 2017 ; Ridge et al. 2020 ) . To ensure stability, several approaches enforce a specific structure on the function approximators, such as enforcing positive or negative definiteness ( Khansari-Zadeh and Billard 2011 ; Lemme et al. 2014 ; Fernandez and Billard 2018 ) , or invertibility ( Perrin and Schlehuber-Caissier 2016 ; Rana et al. 2020 ; Urain et al. 2020 ) . In contrast, Pérez-Dattari and Kober 2023 ; Pérez-Dattari et al. 2024 enforce stability via additional loss functions derived using tools from the deep metric learning literature ( Kaya and Bilge 2019 ) . Importantly, Pérez-Dattari et al. 2024 extends the ideas of Pérez-Dattari and Kober 2023 to more general scenarios, achieving better results in non-Euclidean state spaces and {2^{\mathrm{nd}}\text{-order}} dynamical systems. These two features are essential for integrating such frameworks with fabrics, which, to the best of our knowledge, have not been simultaneously demonstrated in other works using time-invariant formulations, e.g. Rana et al. 2020 ; Mohammadi et al. 2024 ; Saveriano et al. 2023 . From il to whole-body motion generation For the safe operation of robots around humans, not only the dynamical system acting as the navigation policy should be stable but the whole-body motion is desired to be stable, collision-free, and within the system limits. However, most existing il solutions that incorporate obstacle avoidance when learning dynamical systems in end-effector space focus solely on avoiding collisions with the end-effector, e.g. Mohammadi et al. 2024 ; Ginesi et al. 2019 ; Huber et al. 2023 . One possibility to achieve full-body collision avoidance in such cases is by employing collision-aware ik ( ik ) solvers ( Tedrake 2023 ; Rakita et al. 2021 ) . Nevertheless, this ignores the desired acceleration or velocity profile specified by the learned dynamical system. Another strategy is to combine il with an optimization-based motion planner such as mpc ( mpc ), inheriting the possibility to include kinodynamic and safety constraints and including the learned policy in the cost function. Several combinations exist, such as augmenting the cost function with a learned policy ( Xiao et al. 2022 ) , learning the complete cost function ( Tagliabue and How 2023 ) , and learning the complete MPC framework ( Ahn et al. 2023 ) . Hu et al. 2023 propose MPDMP + as a fast alternative for navigation amongst dynamic obstacles, combining dmp s with mpc where the cost function merges multiple demonstrations and includes obstacle avoidance using potential functions. Although some il - mpc frameworks can guarantee stability ( Ahn et al. 2023 ; Hewing et al. 2020 ) , where most methods lack these guarantees, their applications remain limited with no demonstrations in real-world robotics. Geometric motion generation A fast alternative strategy to optimization-based motion planners lies in the field of geometric motion generation . These techniques are inspired by Operational Space Control ( Khatib 1987 ) , achieving stable and converging behavior for kinematically redundant robots using differential geometry ( Bullo and Lewis 2019

Read the complete text