UltraFlwr - An Efficient Federated Medical and Surgical Object Detection Framework

Yang Li †, Soumya Snigdha Kundu †, Maxence Boels, Toktam Mahmoodi, Sebastien Ourselin, Tom Vercauteren, Prokar Dasgupta, Jonathan Shapey, Alejandro Granados · 2025

Read UltraFlwr - An Efficient Federated Medical and Surgical Object Detection Framework by Yang Li †, Soumya Snigdha Kundu †, Maxence Boels, Toktam Mahmoodi, Sebastien Ourselin, Tom Vercauteren, Prokar Dasgupta, Jonathan Shapey, Alejandro Granados (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15161.txt.

Introduction

Yang Li and eight co-authors train surgery tool spotters across hospitals without pooling video in a 2025 paper. Spotting tools in scope video helps grade skill and track workflow, but training data is scarce, private, and uneven across sites. Shared learning lets sites train one model while raw video stays home, yet modern spotter pipelines had thin support for that mode.

Their open framework, UltraFlwr, joins a standard spotter to a shared learning platform and can blend only parts of the model, such as the spine or neck blocks. Two public surgery tool sets fed tests under even and skewed data splits. Blending spine plus neck matched full blending at lower traffic cost. Plain methods varied more by site, while within site data tidiness helped even when sites drifted apart.

Catalog record

CREATORYang Li †, Soumya Snigdha Kundu †, Maxence Boels, Toktam Mahmoodi, Sebastien Ourselin, Tom Vercauteren, Prokar Dasgupta, Jonathan Shapey, Alejandro Granados
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-15161

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

UltraFlwr - An Efficient Federated Medical and Surgical Object Detection Framework Yang Li †, Soumya Snigdha Kundu †, Maxence Boels, Toktam Mahmoodi, Sebastien Ourselin, Tom Vercauteren, Prokar Dasgupta, Jonathan Shapey, Alejandro Granados Abstract Object detection shows promise for medical and surgical applications such as cell counting and tool tracking. However, its faces multiple real-world edge deployment challenges including limited high-quality annotated data, data sharing restrictions, and computational constraints. In this work, we introduce UltraFlwr , a framework for federated medical and surgical object detection. By leveraging Federated Learning (FL), UltraFlwr enables decentralized model training across multiple sites without sharing raw data. To further enhance UltraFlwr’s efficiency, we propose YOLO-PA , a set of novel Partial Aggregation (PA) strategies specifically designed for YOLO models in FL. YOLO-PA significantly reduces communication overhead by up to 83% per round while maintaining performance comparable to Full Aggregation (FA) strategies. Our extensive experiments on BCCD and m2cai16-tool-locations datasets demonstrate that YOLO-PA not only provides better client models compared to client-wise centralized training and FA strategies, but also facilitates efficient training and deployment across resource-constrained edge devices. Further, we also establish one of the first benchmarks in federated medical and surgical object detection. This paper advances the feasibility of training and deploying detection models on the edge, making federated object detection more practical for time-critical and resource-constrained medical and surgical applications. UltraFlwr is publicly available at https://github.com/KCL-BMEIS/UltraFlwr . 1 Introduction Object detection is an important task in medicine [ 3 ] , enhancing diagnostic accuracy, surgical precision, and workflow efficiency [ 19 ] . It aids in detecting anomalies [ 2 ] while also localizing surgical instruments and anatomical structures for real-time guidance [ 15 ] . The You Only Look Once (YOLO) framework [ 21 ] has revolutionized this field by providing fast and compute-efficient real-time applications such as surgical instrument tracking [ 18 ] . Its open-source availability through Ultralytics has further driven adoption in research and industry. While object detection models hold great promise, they face the general challenges of medical image analysis, which are the scarcity of high-quality annotated data, heterogeneous data sources, regulatory restrictions for medical and surgical data sharing, and computational constraints. High-performing models require extensive datasets that cover diverse feature spaces to ensure generalization. Collaborative learning approaches, such as Federated Learning (FL), offer effective solutions to these challenges by enabling the training of models in a decentralized fashion [ 12 ] . Classification tasks often dominate the FL research landscape in comparison to object detection. We hypothesize that this is mainly owed to state-of-the-art object detection models [ 26 , 27 ] being generally more compute-intensive than classification models. Additionally, there is significantly more community support and established tools for building and deploying classification models in FL, further contributing to the focus on classification in FL research. Lastly, images in classification datasets only have one class label per image, whereas in detection datasets, each image can have multiple instances of different classes, making stratified partitioning more challenging. In parallel, despite the growing attention to FL in medical image analysis, its application in surgical data science is still nascent. Existing research has primarily addressed tasks such as surgical instrument segmentation [ 24 ] and surgical phase recognition [ 13 ] , leaving surgical object detection under the radar. This gap is particularly significant given the need for real-time analysis in surgical settings [ 7 ] . Real-time object detection, especially during surgery, demands low-latency processing to ensure timely and accurate decision-making in critical scenarios. Edge computing has emerged as a vital paradigm to meet these requirements, offering localized processing capabilities that make it particularly well-suited for both medical and surgical applications [ 1 ] . Edge computing enhances FL by enabling efficient model training across decentralized data sources. While edge training is still uncommon, previous literature [ 9 , 14 , 23 ] show critical use cases— particularly to prevent the sharing of patient data across multiple sites — where both edge training and FL approaches become necessary. However, deploying FL on edge devices presents unique challenges due to their limited computational, communication, and memory resources. Techniques such as Partial Aggregation (PA) [ 5 ] , which selectively train and aggregate specific layers of the model, help reduce the computational load and communication overhead, making FL more feasible and accessible for resource-constrained edge devices, especially when there are a large number of devices. Although earlier studies [ 8 , 10 ] attempt to integrate object detection models with FL, they either lack open-source code and evidence for deployment, or demand large amounts of resources to compute [ 20 ] , thus limiting reproducibility and stifling further development in this domain. To address these challenges and limitations, we propose UltraFlwr . Our contributions are three-fold: • a novel framework for federated medical and surgical object detection, seamlessly integrating Ultralytics’ YOLOv11 with Flower [ 4 ] . UltraFlwr enhances reproducibility, accelerates deployment, and scales effortlessly. • a novel PA strategy ( YOLO-PA ) tailored for YOLO models in federated settings. With seamless integration with existing FL strategies, we decrease communication overheads by almost 83% per round while maintaining competitive performance compared with FA strategies. The FedBackboneHeadMedian strategy, our top-performing YOLO-PA variant, achieves superior results with a 1% increase in mAP50 compared to FedAvg and a 3% improvement over models trained solely on local data partitions. • creating the first benchmark for federated medical and surgical object detection 1 1 1 This paper includes key datasets and metrics, while additional tests across a wider range of datasets and metrics are available in our repository. by reporting scores across various datasets. The results clearly demonstrate the need for FL approaches by showcasing performance improvements over non-federated client-only training. 2 Methods 2.1 YOLO Object Detection Model Figure 1: Overview of Flower and Ultralytics YOLO Integration. At its core, the YOLO architecture consists of three fundamental components (Figure 1 ). First, the backbone serves as the primary feature extractor, utilizing convolutional neural networks to transform raw image data into multi-scale feature maps. Second, the neck component acts as an intermediate processing stage, employing specialized layers to aggregate and enhance feature representations across different scales. Third, the head component functions as the prediction mechanism, generating the final outputs for object localization and classification based on the refined feature maps. The base model utilized for all experiments is the YOLOv11n. We opted for YOLOv11 as it is the latest and best-performing YOLO model (as of date). Moreover, the YOLOv11n variant is aligned with our goals toward edge deployment since it is the smallest model in the YOLO family. 2.2 YOLO-PA: Native YOLO-based Partial Aggregation Strategies Table 1: Parameters saved per client during federated training for different YOLO-PA strategies, compared to standard FA. Values represent the reduction in communication costs per client per round. The fewer parameters transmitted, the better. Strategy Params. Saved (# and %) Full Aggregation 0 (0%) FedBackbone 1,034,061 (39.17%) FedNeck 2,073,798 (78.56%) FedHead 2,171,791 (82.27%) FedNeckHead 1,605,764 (60.83%) FedBackboneHead 566,027 (21.44%) FedBackboneNeck 468,034 (17.73%) We hypothesized that selectively updating weights for specific components would be sufficient, given that YOLOv11n models undergo extensive pre-training. Hence, we opted to create our PA strategy based on selecting which

Read the complete text