OccluNet: Spatio-Temporal Deep Learning for Occlusion Detection on DSA

Anushka A. Kore, Frank G. te Nijenhuis, Matthijs van der Sluijs, Wim van Zwam, Charles Majoie, Geert Lycklama à Nijeholt, Danny Ruijters, Frans Vos, Sandra Cornelissen, Ruisheng Su, Theo van Walsum · 2025

Read OccluNet: Spatio-Temporal Deep Learning for Occlusion Detection on DSA by Anushka A. Kore, Frank G. te Nijenhuis, Matthijs van der Sluijs, Wim van Zwam, Charles Majoie, Geert Lycklama à Nijeholt, Danny Ruijters, Frans Vos, Sandra Cornelissen, Ruisheng Su, Theo van Walsum (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-14286.txt.

Introduction

Anushka A Kore and co-authors build a deep learning system that spots blocked brain arteries during stroke treatment, in this 2025 paper. Doctors read live X-ray movies of blood flow while threading a catheter to pull out the clot, and they must find the blockage fast under time pressure. The system, called OccluNet, watches the whole movie rather than single frames.

OccluNet pairs a standard object detector with attention steps that track how each spot changes over time. Two ways of splitting that attention were tried, and both worked about equally well. On registry data from real stroke cases, the system reached about eighty-nine percent precision and seventy-five percent recall. It clearly beat models trained on single frames or on collapsed images, and the code is public.

Catalog record

CREATORAnushka A. Kore, Frank G. te Nijenhuis, Matthijs van der Sluijs, Wim van Zwam, Charles Majoie, Geert Lycklama à Nijeholt, Danny Ruijters, Frans Vos, Sandra Cornelissen, Ruisheng Su, Theo van Walsum
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-14286

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

OccluNet: Spatio-Temporal Deep Learning for Occlusion Detection on DSA Anushka A. Kore, Frank G. te Nijenhuis, Matthijs van der Sluijs, Wim van Zwam, Charles Majoie, Geert Lycklama à Nijeholt, Danny Ruijters, Frans Vos, Sandra Cornelissen, Ruisheng Su, Theo van Walsum Abstract Accurate detection of vascular occlusions during endovascular thrombectomy (EVT) is critical in acute ischemic stroke (AIS). Interpretation of digital subtraction angiography (DSA) sequences poses challenges due to anatomical complexity and time constraints. This work proposes OccluNet, a spatio-temporal deep learning model that integrates YOLOX, a single-stage object detector, with transformer-based temporal attention mechanisms to automate occlusion detection in DSA sequences. We compared OccluNet with a YOLOv11 baseline trained on either individual DSA frames or minimum intensity projections. Two spatio-temporal variants were explored for OccluNet: pure temporal attention and divided space-time attention. Evaluation on DSA images from the MR CLEAN Registry revealed the model’s capability to capture temporally consistent features, achieving precision and recall of 89.02% and 74.87%, respectively. OccluNet significantly outperformed the baseline models, and both attention variants attained similar performance. Source code is available here . 1 Introduction Acute Ischemic Stroke (AIS) is a potentially life-threatening medical emergency caused by a sudden interruption of blood flow to a region of the brain due to a vessel occlusion [ 2 ] . Endovascular thrombectomy (EVT) is a minimally invasive intervention to restore cerebral perfusion through mechanical removal of the occlusion. During EVT procedures, digital subtraction angiography (DSA) images are acquired to visualize the occlusion and to serve as a roadmap to navigate to the occlusion [ 6 ] . DSA is acquired in 2-4 frames per second to visualize the contrast agent flowing through the vasculature. It remains the gold standard for luminal imaging, delivering superior spatial and temporal resolution of the cerebral vasculature. Recent advances in deep learning (DL) have demonstrated potential in automating occlusion detection in various imaging modalities used for the diagnosis and management of stroke [ 4 ] . For DSA imaging in particular, recent studies to automate occlusion detection relied on DL methods applied to static frames. Karlsberg et al. [ 10 ] employed YOLOv3 (You Only Look Once), a single-stage object detector, to detect occlusions on single-frame datasets derived from DSA sequences. Khankari et al. [ 12 ] utilized a ResNet-50 convolutional neural network (CNN) to analyze patch-sampling-based regions of DSA minimum intensity projections (MinIPs) for carotid terminus detection and occlusion classification. Warman et al. [ 17 ] used an ensemble method, in which a DSA frame was evaluated by a ResNet-18-based detection model to predict if it had a large vessel occlusion (LVO), in which case the frame was then fed into a localization model based on a YOLOv5 backbone to localize the LVO with a bounding box. These approaches, however, treat DSA as a collection of independent images or collapse them into a single view using MinIP, ignoring the temporal information contained in the images. Leveraging the temporal nature of DSA imaging, Mittmann et al. [ 13 ] demonstrated that a thrombus yes-no-classification can be achieved by combining EfficientNet as a feature extractor with a bidirectionally configured long-short term memory (LSTM) or a gated recurrent unit (GRU) to establish spatio-temporal relations between the individual images of the DSA sequence. Kelly et al. [ 11 ] evaluated the performance of several DL models, including a 2D CNN Xception (using only single DSA frames), a stacked 2D CNN stacked-Xception (using multiple DSA frames), a 2D vision transformer (ViT), and a 3D-Inception CNN, the latter capturing full spatial and temporal resolution and achieving high sensitivity in occlusion detection using pre- and post-thrombectomy DSA video sequences. These studies confirmed that temporal context is critical for occlusion classification, particularly for distal occlusions where small thrombi may only become apparent through sequential frame analysis. Methods that explicitly localize the occlusion in the DSA are still underexplored. We hypothesized that occlusion detection on DSA is a task that can benefit from integration of spatio-temporal information, due to the inherently temporal aspect of occlusion visualization on DSA. Building upon these advances in spatio-temporal DSA analysis, we develop a method that explicitly localizes the occlusion using a bounding box. We introduce OccluNet, a DL pipeline that combines YOLOX [ 7 ] — a high-performance single-stage object detector— with transformer-based temporal modules. Our proposed architecture compares two attention mechanisms for temporal learning: (1) a self-attention module that processes YOLO-extracted features across frames to model long-range contrast flow dependencies, inspired by transformer-based temporal learning approaches [ 8 , 18 , 15 , 16 , 19 ] ; and (2) a divided space-time attention mechanism adapted from the TimeSFormer architecture [ 3 ] . We compare both approaches with a baseline model trained on MinIPs, demonstrating superior performance of the spatio-temporal approach. Figure 1: Overview of OccluNet. Given an input DSA sequence (1), occlusions are first detected on each current frame (timepoint t ) by taking neighbouring frames ( t\pm 1 ) as context (2), and these per-frame detections form the final output (3). The model consists of a PAFPN feature extraction module, a temporal module and a YOLOX head. For end-to-end per-frame occlusion detection, first, frame-wise spatial features are extracted using the YOLOX spatial feature extraction module. The temporal module applies (temporal or divided space-time) attention to each frame-wise spatial feature level. The output of the temporal module constitutes enhanced spatio-temporal features at each feature level for the current frame, with incorporated context from the neighbouring frames. Finally, the YOLOX decoupled head performs the occlusion detection for each level of spatio-temporal features. 2 Methods YOLOv11 Baseline To establish baseline results, we used the X variant of the YOLOv11 model with 56.9 million parameters, the latest iteration of the You Only Look Once (YOLO) series of real-time object detection models. The YOLOv11 model is commonly used across multiple vision tasks, including detection, segmentation, and pose estimation [ 9 ] . YOLOv11 predicts three outputs, bounding box locations, class probability ( P(\text{class}_{i}) ) and objectness probability ( P(\text{object}) ). From these probabilities indicating whether a bounding box is an object, and which class that object is a member of, a confidence score can be calculated per bounding box, \text{Confidence}_{\text{class}_{i}}=P(\text{object})\times P(\text{class}_{i}) . OccluNet Two custom architectures ( OccluNet1 and OccluNet2 ) were developed, based on different temporal modules. For both models, the backbone is a pretrained CSPDarknet, the same backbone as used in the S variant of YOLOX with nine million parameters. To facilitate spatio-temporal processing, the current and neighboring frames ( t-1,t,t+1 ) were passed as input channels. The backbone extracts multi-scale spatial features (C3, C4, C5) from each input frame stack. These frame-wise spatial features are then passed through a Path-Aggregation Feature Pyramid (PAFPN) neck module, as used by YOLOX, followed by a temporal module. There are two temporal approaches: • OccluNet1 uses Temporal Attention, a Transformer-based attention across frames at each spatial location, using learned positional encoding. • OccluNet2 uses Divided Space-Time Attention, which alternates between spatial and temporal attention layers, separating spatial ("where") and temporal ("when") dynamics for occlusion detection. After temporal processing for the current frame group, we are left with spatio-temporal features at three levels (P3, P4, P5). These features are then processed by the YOLOX head module, containing

Read the complete text