Reinforcement Learning for Safe Autonomous Two Device Navigation of Cerebral Vessels in Mechanical Thrombectomy

Harry Robertshaw, Benjamin Jackson, Jiaheng Wang, Hadi Sadati, Alejandro Granados, Thomas C Booth, Lennart Karstensen · 2025

Read Reinforcement Learning for Safe Autonomous Two Device Navigation of Cerebral Vessels in Mechanical Thrombectomy by Harry Robertshaw, Benjamin Jackson, Jiaheng Wang, Hadi Sadati, Alejandro Granados, Thomas C Booth, Lennart Karstensen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-24140.txt.

Introduction

Harry Robertshaw and co-authors train a learning system to steer tiny tools through brain vessels for stroke care, in a paper from 2025. Removing a clot fast can save brain tissue, but guiding two fine tools by hand is slow and exposes staff to radiation. Prior learning systems stopped at larger neck arteries and ignored safety.

Their system learns from expert demos on twelve patient-specific vessel models and rewards low tip force for safety. In simulation on unseen vessels, it reached the target in almost all cases in a few seconds. Mean tip force stayed far below the level thought to risk vessel rupture. Lab tests are the next step.

Catalog record

CREATORHarry Robertshaw, Benjamin Jackson, Jiaheng Wang, Hadi Sadati, Alejandro Granados, Thomas C Booth, Lennart Karstensen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-24140

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reinforcement Learning for Safe Autonomous Two Device Navigation of Cerebral Vessels in Mechanical Thrombectomy Thanks: Citation : Robertshaw, H., Jackson, B., Wang., J., et al. Reinforcement learning for safe autonomous two device navigation of cerebral vessels in mechanical thrombectomy. Int J CARS (2025). https://doi.org/10.1007/s11548-025-03339-8 Harry Robertshaw, Benjamin Jackson, Jiaheng Wang, Hadi Sadati, Alejandro Granados, Thomas C Booth, Lennart Karstensen Abstract Purpose: Autonomous systems in mechanical thrombectomy (MT) hold promise for reducing procedure times, minimizing radiation exposure, and enhancing patient safety. However, current reinforcement learning (RL) methods only reach the carotid arteries, are not generalizable to other patient vasculatures, and do not consider safety. We propose a safe dual-device RL algorithm that can navigate beyond the carotid arteries to cerebral vessels. Methods: We used the Simulation Open Framework Architecture to represent the intricacies of cerebral vessels, and a modified Soft Actor-Critic RL algorithm to learn, for the first time, the navigation of micro-catheters and micro-guidewires. We incorporate patient safety metrics into our reward function by integrating guidewire tip forces. Inverse RL is used with demonstrator data on 12 patient-specific vascular cases. Results: Our simulation demonstrates successful autonomous navigation within unseen cerebral vessels, achieving a 96% success rate, 7.0 s procedure time, and 0.24 N \mathrm{N} mean forces, well below the proposed 1.5 N \mathrm{N} vessel rupture threshold. Conclusion: To the best of our knowledge, our proposed autonomous system for MT two-device navigation reaches cerebral vessels, considers safety, and is generalizable to unseen patient-specific cases for the first time. We envisage future work will extend the validation to vasculatures of different complexity and on in vitro models. While our contributions pave the way towards deploying agents in clinical settings, safety and trustworthiness will be crucial elements to consider when proposing new methodology. K eywords Reinforcement learning \cdot Mechanical thrombectomy \cdot Machine learning \cdot Artificial intelligence \cdot Autonomous navigation \cdot Endovascular intervention 1 Introduction Ischemic stroke causes 3.48 million global deaths annually, and accounts for $36.5 billion in direct medical costs in the U.S. alone [ 1 , 2 ] . Mechanical thrombectomy (MT) has emerged as a standard treatment for acute ischemic stroke resulting from large vessel occlusion, providing improved functional outcomes and lower mortality rates compared to medical treatment alone [ 3 , 4 ] . In MT, a guidewire is used to navigate a guide catheter from the femoral or radial artery to the internal carotid artery (ICA). An ‘access catheter’ is then advanced ahead of the guide catheter for vessel branch access. Once the access catheter is within the ICA, the guide catheter is advanced to make a stable platform. The guidewire and access catheter are then retracted, and a micro-guidewire within a micro-catheter is passed through the stable guide catheter and navigated to the target thrombus site which is typically within the M1 segment of the middle cerebral artery (MCA). The final step is to remove the micro-guidewire and exchange it for a stent-retriever to remove the thrombus thereby restoring blood flow to the brain. MT is most effective when performed early, ideally within 24 hours of stroke onset [ 4 ] . However, only 3.1% of stroke patients in the UK receive MT, despite 10% being eligible [ 5 , 6 ] . Limited access to MT centers, long travel times, and procedural risks like vessel damage and radiation exposure pose significant challenges for the delivery of MT [ 7 , 8 ] . Robotic surgical systems offer a potential solution by increasing access to MT and reducing operator risks. Tele-operated MT could allow centralized, highly-trained specialists to perform the procedure remotely, improving access in underserved regions. Alternatively, assistive robots in peripheral hospitals could help less experienced operators perform MT safely. In either scenario, integrating AI into robotic systems may further enhance procedural efficiency and safety, especially for less experienced users (e.g., interventional radiologists who are not used to performing neurointerventional procedures) [ 9 , 10 ] . A recent review on the autonomous navigation of endovascular interventions found that 71% (10/14) of studies performed experiments in the blood vessels within or around the heart [ 11 ] . More recently, a combined reward model using demonstrator data in inverse reinforcement learning (IRL) has been shown to provide improved success rates over a traditional dense reward function in the autonomous navigation of devices from the common iliac artery to the ICA, however, this work was limited to training and testing on exactly the same vasculature [ 12 ] . While reinforcement learning (RL) models have been tested on unseen vessel structures previously (for aortic arch navigation), these structures are typically simplified and computer generated [ 13 , 14 ] . Furthermore, while 29% (4/14) of studies reviewed in [ 11 ] measure the forces during navigation, there is no evidence of excessive force penalization. This is important to consider because (1) excessive vessel wall contact forces can induce vasoconstriction and damage, leading to reactive intimal proliferation chronically, or more importantly, dissection-induced distal embolization and infarction in the acute setting [ 15 ] ; (2) it is known that robotic endovascular manipulators can reduce vessel wall contact forces [ 16 ] ; and (3) patient and public involvement exercises on robotic MT showed concern about micro-guidewire safety - AI assistance was a potential solution for safety. The aim of this study was to train an RL model capable of autonomously navigating a micro-guidewire and micro-catheter from the ICA to the MCA in unseen patient vasculatures while incorporating device tip forces. The primary objective was to demonstrate in an MT environment that RL can successfully perform this navigation in complex, unseen patient vasculatures. The secondary objectives were: 1) to assess whether adding force feedback in the reward function improves surrogate measures of patient safety and/or affects navigation performance, and 2) to validate previous findings that a combined reward model enhances navigation performance. This study used two-dimensional Cartesian tracking co-ordinates as inputs to the RL agent. Using this proposed method, it is plausible that effective clinical translation would be enacted using image-tracking to obtain the guidewire and catheter tip points from live fluoroscopic images during MT [ 17 ] . This would then provide the inputs (i.e., two-dimensional co-ordinates) needed for the RL agent to navigate the vasculature. Furthermore, as tip forces are only required during training as part of the reward function, there would be no need to measure forces during the intervention. As the trained RL agent doesn’t need a reward input, no additional equipment or software would be required in the clinic. Our contributions are as follows: 1) we applied RL to train autonomous navigation models for micro-guidewire and micro-catheter in cerebral vessels, specifically targeting MT, for the first time, 2) we tested the model on realistic, unseen patient vasculatures, and 3) we introduced penalization for instrument forces in the RL model to enhance patient safety. 2 Methods 2.1 Navigation task The first MT stage of navigating a large guide catheter to form a stable platform has recently been achieved autonomously using RL [ 12 ] . This study simulates the second stage, navigating the micro-guidewire and micro-catheter to the target site (Fig. 1 ). When these devices are manipulated towards the MCA, navigation challenges include overcoming

Read the complete text