FF-SRL: High Performance GPU-Based Surgical Simulation For Robot Learning

Diego Dall’Alba, Michał Naskręt, Sabina Kamińska, Przemysław Korzeniowski · 2025

Read FF-SRL: High Performance GPU-Based Surgical Simulation For Robot Learning by Diego Dall’Alba, Michał Naskręt, Sabina Kamińska, Przemysław Korzeniowski (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-18616.txt.

Introduction

Diego Dall'Alba and co-authors introduce a fast training ground for surgical robots in a 2025 paper. Robots that learn by trial and error need huge numbers of practice runs. Doing those runs on real surgical systems would be unsafe and slow, so practice has to happen in simulation. Many simulators, though, are too slow for the task.

Their system, FF-SRL, runs both the physics and the learning on a single graphics card. Keeping everything in one place avoids slow data transfers between chips. On a hard task that involves moving soft tissue, training time fell by about tenfold, down to a few minutes. The team shares the code openly, hoping faster practice will help build the next generation of surgical systems.

Catalog record

CREATORDiego Dall’Alba, Michał Naskręt, Sabina Kamińska, Przemysław Korzeniowski
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-18616

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FF-SRL: High Performance GPU-Based Surgical Simulation For Robot Learning Diego Dall’Alba, Michał Naskręt, Sabina Kamińska, Przemysław Korzeniowski Abstract Robotic surgery is a rapidly developing field that can greatly benefit from the automation of surgical tasks. However, training techniques such as Reinforcement Learning (RL) require a high number of task repetitions, which are generally unsafe and impractical to perform on real surgical systems. This stresses the need for simulated surgical environments, which are not only realistic, but also computationally efficient and scalable. We introduce FF-SRL (Fast and Flexible Surgical Reinforcement Learning), a high-performance learning environment for robotic surgery. In FF-SRL both physics simulation and RL policy training reside entirely on a single GPU. This avoids typical bottlenecks associated with data transfer between the CPU and GPU, leading to accelerated learning rates. Our results show that FF-SRL reduces the training time of a complex tissue manipulation task by an order of magnitude, down to a couple of minutes, compared to a common CPU/GPU simulator. Such speed-up may facilitate the experimentation with RL techniques and contribute to the development of new generation of surgical systems. To this end, we make our code publicly available to the community. I INTRODUCTION Robot-Assisted Surgical Systems (RASS) are becoming more popular and widely used, with a constant increase in their adoption in the last two decades [ 1 ] . Researchers are also exploring new possibilities and challenges of RASS, using platforms like da Vinci Research Kit (dVRK) [ 2 ] . One of the most interesting research topics is how to automate some aspects of RASS interventions, making these systems more autonomous and efficient [ 3 ] . A common approach is to use Reinforcement Learning (RL) techniques [ 4 , 5 , 6 , 7 , 8 ] , which have proven to be effective in other robotic domains, such as legged locomotion and dexterous manipulation [ 9 ] . RL can support RASS in performing various surgical tasks that require adaptability and precision, such as manipulation of deformable tissues [ 7 , 10 ] or suture needle [ 11 , 12 ] and removing debris or liquids [ 4 , 5 , 6 ] . RL-based systems are usually trained in simulated environments, as many unsuccessful attempts are required which often exhibit unsafe behavior [ 9 ] . This is especially true for RASS, since performing real experiments faces significant economic and ethical constraints. However, to transfer the trained models in real settings, it is necessary to employ realistic, scalable, and robust simulations, supporting soft-body physics [ 7 , 10 ] . Fig. 1: Schematic representation of the integration between the proposed FF-SRL simulator and the rl_games RL framework to achieve a fully GPU training pipeline and support the development of autonomous RASS. Several simulators for RASS have been proposed, focusing on specific aspects, such as the kinematic model of the robot [ 4 ] , more realistic physical [ 8 ] or visual [ 5 ] simulation or easier interfacing with real RASS [ 6 ] . All these simulators mainly exploit CPU calculations, relegating the use of the GPU to accelerate the training and inference part of the RL model only. This is not optimal as it requires copying the data back and forth between CPU (simulation) and GPU (learning) memories . As such, it limits the complexity of the tasks that can be solved and, as a result, slows down research activities and community contributions. The solution is to compute the entire simulation and RL training process on the GPU. However, developing a massively-parallel GPU simulation is non-trivial. Its efficient implementation requires a careful handling of thousands of simultaneous threads and efficient global memory access patterns. In this work we therefore propose: • a high-performance, fully GPU-based simulator for surgical robotics, called FF-SRL, that supports soft tissue modeling via extended position based dynamics approach; • the integration of FF-SRL into an entirely GPU-based RL training pipeline; • the experimental validation of the proposed FF-SRL in a fundamental surgical task (i.e. reaching a deformable tissue), comparing with simulator proposed in [ 8 ] . To the best of our knowledge, this is the first work that proposes a simulation environment for training autonomous RASS with RL techniques entirely on GPU, and the results confirm that our approach is able to significantly improve the performance compared to available RASS simulators, e.g. completing RL training in less than 2 minutes instead of over 1 hour. This enables training of complex learning tasks even on a commonly accessible consumer-grade hardware such as gaming laptops. We make the simulator code publicly available 1 1 1 https://github.com/SanoScience/FF-SRL to encourage the community to adopt our approach and accelerate the progress of this promising research area. II RELATED WORKS Research activities on RASS have been exploring the automation of various surgical tasks: these tasks range from simple ones, such as peg transfer [ 13 , 14 , 15 ] , to more complex ones, such as manipulating suture needles [ 11 , 12 ] or deformable tissues [ 16 , 17 , 18 , 19 ] . Among these tasks, we focus on tissue retraction, a preliminary phase of most surgical interventions. Tissue retraction involves lifting deformable tissue to expose an area of interest, such as an organ or lesion to be removed (see Fig. 2 ). This task is widely used by the RASS research community since it is simple to set up but, at the same time, with an adequate level of complexity for testing the developed automation approaches. Furthermore, this task can be learned in simulation and transferred to a real environment [ 7 , 10 , 20 ] . As task complexity has increased, there has been a growing interest in applying more complex automation approaches, such as RL techniques. RL allows the inclusion of multi-agent models [ 21 ] , safety constraints [ 22 ] , or demonstrations by expert users [ 12 , 20 , 23 ] , also through interactive supervision [ 24 ] . To make RL training more effective, it is a common practice to carry it out in realistic simulation environments. Several simulation environments have been proposed for RASS. Some of them are based on rigid objects only, such as dVRL [ 4 ] and SurRoL [ 5 ] . dVRL provides an accurate kinematic model of the dVRK platform and simulates simple training or surgical tasks. SurRoL provides around ten surgical tasks supported by a more realistic visual rendering. Another simulator is AMBF-RL [ 6 ] , which extends Articulated Multi-Body Framework (AMBF) [ 25 ] simulator specific for RL training and ensures simple interfacing with the real setup. However, none of these simulators exploit the simulation of deformable objects, which are essential for many surgical tasks. UnityFlexML [ 7 ] was the first simulator to address this issue by taking advantage of the Position-Based Dynamics (PBD) approach provided by NVIDIA Flex and integrating it within the Unity framework. LapGym [ 8 ] recently proposed a more advanced simulation environment, which relies on the accurate biomechanical finite element simulation provided by SOFA [ 26 , 27 ] . Compared to other simulators, LapGym implements a rich catalog of

Read the complete text