A Deep Learning-Driven Autonomous System for Retinal Vein Cannulation: Validation Using a Chicken Embryo Model
Yi Wang, Peiyao Zhang, Mojtaba Esfandiari, Peter Gehlbach, Member, IEEE, Iulian I. Iordachita · 2025
Read A Deep Learning-Driven Autonomous System for Retinal Vein Cannulation: Validation Using a Chicken Embryo Model by Yi Wang, Peiyao Zhang, Mojtaba Esfandiari, Peter Gehlbach, Member, IEEE, Iulian I. Iordachita (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21965.txt.
Introduction
Yi Wang and co-authors build a robot system that can thread a needle into a retinal vein on its own, in work from twenty twenty-five. The surgery treats a blocked retinal vein, a top cause of sight loss. The veins are tiny and fragile, and hand tremor makes the task hard.
The system pairs a microscope and a depth scan with deep learning models. The models track the needle, sense contact, and spot the moment of puncture in real time. Tests used a chicken embryo model in place of human veins. The system found needle spot and puncture with good accuracy and cut task times versus hand work. The results point to safer, steadier eye surgery.
Catalog record
| CREATOR | Yi Wang, Peiyao Zhang, Mojtaba Esfandiari, Peter Gehlbach, Member, IEEE, Iulian I. Iordachita |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-21965
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Deep Learning-Driven Autonomous System for Retinal Vein Cannulation: Validation Using a Chicken Embryo Model Yi Wang, Peiyao Zhang, Mojtaba Esfandiari, Peter Gehlbach, Member, IEEE, Iulian I. Iordachita Abstract Retinal vein cannulation (RVC) is a minimally invasive microsurgical procedure for treating retinal vein occlusion (RVO), a leading cause of vision impairment. However, the small size and fragility of retinal veins, coupled with the need for high-precision, tremor-free needle manipulation, create significant technical challenges. These limitations highlight the need for robotic assistance to improve accuracy and stability. This study presents an automated robotic system with a top-down microscope and B-scan optical coherence tomography (OCT) imaging for precise depth sensing. Deep learning-based models enable real-time needle navigation, contact detection, and vein puncture recognition, using a chicken embryo model as a surrogate for human retinal veins. The system autonomously detects needle position and puncture events with 85% accuracy. The experiments demonstrate notable reductions in navigation and puncture times compared to manual methods. Our results demonstrate the potential of integrating advanced imaging and deep learning to automate microsurgical tasks, providing a pathway for safer and more reliable RVC procedures with enhanced precision and reproducibility. I INTRODUCTION Fig. 1: Experimental setup and key components of the autonomous system for retinal vein cannulation. (a) The overall setup shows EyeRobot 2.0 and EyeRobot 2.1, which work in tandem during the procedure. EyeRobot 2.0 is responsible for needle manipulation, while EyeRobot 2.1 stabilizes the target vein (diameter approximately 300-400 micrometers) in the chicken embryo. Unlike EyeRobot 2.0, which operates autonomously during needle navigation and puncture, EyeRobot 2.1 is manually positioned before the procedure to ensure proper alignment with the target vein. The holding mechanism in EyeRobot 2.1 secures the vein in place without active control during the procedure, preventing unnecessary movement that could interfere with the puncture process (b) Close-up images of the surgical needle and vein holder. The side view of the needle and the top and side view of the vein holder demonstrate the orientation and structure used during the experiments. Retinal vein occlusion (RVO) occurs due to the blockage of a retinal vein by a thrombus, leading to transient or permanent vision loss [ 1 ] . Current treatments focus on managing complications, but no standardized surgical approach exists for thrombus removal. A 2015 meta-analysis identified RVO as the second most prevalent retinal vascular disease globally, affecting 28.06 million people aged 30-89, including 23.38 million branch RVO (BRVO) and 4.67 million central RVO (CRVO) [ 2 ] . Retinal vein cannulation (RVC) involves inserting a micro-needle into the occluded retinal vein, followed by injecting a thrombolytic agent to dissolve the clot [ 3 ] . However, manual RVC is hindered by physiological tremors that introduce instability during needle manipulation. The RMS amplitude of an ophthalmic surgeon’s hand tremor is approximately 182 \mu m [ 4 ] , while the average diameter of retinal veins at their widest is 151.32 \pm 15.22 \mu m [ 5 ] . Maintaining needle stability inside the vein for prolonged durations further exacerbates the difficulty due to tremors and fatigue [ 6 ] . To overcome these challenges, several surgical robotic systems have been developed, including the Steady Hand Eye Robot (SHER) [ 7 , 8 ] , Preceyes [ 9 ] , a compact robot with a hybrid mechanism for ophthalmic surgery [ 10 ] , and others [ 11 , 12 ] . Despite these advancements, robotic-assisted RVC still faces challenges, particularly in visual feedback. Binocular microscopes often lack the depth perception required at the micron scale, increasing the risk of double puncturing the vein and damaging retinal tissues. Several methods have been studied to overcome the challenge of depth perception in robot-assisted retinal microsurgery. One approach is to rely on deep learning networks to predict depth from a single binocular image. Kim et al . [ 13 ] predicted the depth of the needle tip on a silicone eye phantom using a convolutional neural network (CNN) based on the shadow cue from the needle shaft. They enhanced the model’s safety using chance-constrained optimization [ 14 ] and evaluated it on ex vivo porcine eyes [ 15 ] . Others have attempted to obtain accurate depth information using OCT, a non-invasive method to acquire cross-sectional images of biological tissues. The use of OCT images has been shown to enable automated subretinal injections with micrometer-level accuracy [ 16 , 17 ] , compensating both tissue deformation during tool-tissue interaction [ 18 ] and retina motion caused by respiration and heartbeat [ 19 , 20 ] . Our previous work [ 21 ] demonstrated that retinal vein cannulation can be achieved using keyboard teleoperation on intact porcine eyes. In this work, we present a fully autonomous robotic system for retinal vein cannulation that integrates a top-down microscope with B-scan imaging. The B-scan images of the region of interest (ROI) provide precise depth information, enabling accurate evaluation of the interaction between the needle and the vein. The system leverages two EyeRobot platforms: one to hold and stabilize the vein, while the other manipulates the needle (see Fig. 1 ). This configuration safeguards the needle during puncture and minimizes the risk of double puncture by maintaining vein stability. To achieve full autonomy, deep learning models were trained for needle tip detection, contact assessment, and puncture recognition, allowing the system to perform the entire procedure—from needle navigation to puncture detection—without manual intervention. While this system shows promising performance, several limitations remain. In particular, the current vision pipeline is sensitive to occlusion, motion artifacts, and lighting variations. These factors can reduce the visibility of the needle in microscope and B-scan images, which may lead to misclassification in contact and puncture stages. Moreover, since all models were trained on data collected from a single imaging setup and a single optical domain, the system may not generalize well to different imaging devices, tissue types, or lighting conditions without fine-tuning. These limitations suggest that future work should consider validating the models on external datasets or applying more generalizable architectures, such as self-supervised vision transformers or networks with geometry priors. II MOTIVATION AND PROBLEM FORMULATION II-A Chicken Embryo Model The chicken embryo model is recognized for anatomical similarities to the human eye, particularly its transparent vascular system similar to human retinal veins. These similarities make the chicken embryo (at around 12-14 days of hatching time) an excellent platform for simulating delicate ocular procedures, such as retinal vein cannulation [ 22 ] . By using the chicken embryo, surgical techniques can be refined and validated in an environment similar to the human retina. Fig. 2: Block diagram of the proposed workflow. The process is divided into two key phases: Navigation and Contact and Puncture . In the navigation phase, the surgeon selects a 2D goal position on a microscopic image, and the robot, using Detectron2 for needle tip detection, calculates the direction towards the goal position. Once the goal is reached, the system enters the Contact and Puncture phase. A B-scan image is acquired to detect contact using ResNet18, followed by puncture detection using YOLOv8x. If no contact is detected, the needle is adjusted along the z-axis until contact is confirmed. The system then increases velocity for puncture and