Parsimonious Dataset Construction for Laparoscopic Cholecystectomy Structure Segmentation
Yuning Zhou, Henry Badgery, Matthew Read, James Bailey, Catherine Davey · 2025
Read Parsimonious Dataset Construction for Laparoscopic Cholecystectomy Structure Segmentation by Yuning Zhou, Henry Badgery, Matthew Read, James Bailey, Catherine Davey (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-12573.txt.
Introduction
Yuning Zhou, Henry Badgery, Matthew Read, James Bailey, and Catherine Davey cut labeling cost for surgical video data, in work from 2025. Labeling medical images is costly and slows deep learning for surgery. Their task is structure segmentation in gallbladder removal videos, where each frame must mark anatomy and tools.
Active learning lets a trained network pick the most useful new frames for labeling. The team compared ways to judge which frames teach the model most. Distance in deep feature space picked the best frames in their tests. With half the data chosen this way, model scores nearly matched training on the full set. Surgeons and builders get a cheaper path to strong training sets.
Catalog record
| CREATOR | Yuning Zhou, Henry Badgery, Matthew Read, James Bailey, Catherine Davey |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-12573
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Parsimonious Dataset Construction for Laparoscopic Cholecystectomy Structure Segmentation Yuning Zhou, Henry Badgery, Matthew Read, James Bailey, Catherine Davey Abstract Labeling has always been expensive in the medical context, which has hindered related deep learning application. Our work introduces active learning in surgical video frame selection to construct a high-quality, affordable Laparoscopic Cholecystectomy dataset for semantic segmentation. Active learning allows the Deep Neural Networks (DNNs) learning pipeline to include the dataset construction workflow, which means DNNs trained by existing dataset will identify the most informative data from the newly collected data. At the same time, DNNs’ performance and generalization ability improve over time when the newly selected and annotated data are included in the training data. We assessed different data informativeness measurements and found the deep features distances select the most informative data in this task. Our experiments show that with half of the data selected by active learning, the DNNs achieve almost the same performance with 0.4349 mean Intersection over Union (mIoU) compared to the same DNNs trained on the full dataset (0.4374 mIoU) on the critical anatomies and surgical instruments. Clinical relevance — This paper investigates an efficient and scalable dataset construction method for laparoscopic cholecystectomy structure recognition. It will provide a premise for deep learning applications in clinical practice. I Introduction Laparoscopic cholecystectomy (LC) is a commonly performed minimally invasive surgery to remove the diseased gallbladder, where surgeons operate under the guidance of the laparoscopic video transmitted to the monitor. To mitigate the primary complication, bile duct injury (BDI), introduced by the structure misidentification, deep learning has been used recently to improve critical anatomical structures and instrument recognition by highlighting them in real-time surgical video frames, known as semantic segmentation. A big challenge in existing studies and thus limited clinical usage is the lack of large-scale datasets due to annotation difficulties. Current public LC segmentation datasets are all constructed using naive frame selection methods on video recordings, including continuous selection [ 1 ] , random selection [ 2 , 3 ] , and thresholded selection based on pixel-wise differences [ 4 ] . These methods are either too naive without considering the visual differences, or require cumbersome human calibration. They failed to consider the frames relations from different videos, therefore select massive duplicated frames [ 1 ] and reducing diversities and causing information loss. Moreover, following the normal dataset construction workflow, existing methods collect all surgical recordings first and process them with the same selection criterion, which consider neither the dataset construction efficiency nor class balance. Recently, active learning has been demonstrated effectively minimizing the dataset size while maximizing the model’s performance in medical classification datasets [ 5 ] . Active learning assumes that the model and the training dataset will evolve over time as illustrated in Figure 1 , where in each iteration the model will be about to sample informative data from the unlabeled data pool, which will then be present to the annotators for labelling and fed back to the model training [ 6 ] . In our paper, we adopt active learning for the first time as a parsimonious frame selection strategy in LC segmentation. Specifically, we apply active learning to consider newly introduced subject at each round, where the deep learning model (DNN) selects the unlabeled and informative data subset by informativeness measurement strategies on the subject’s video frames. The selected frames will then be annotated and included in the training dataset to retrain the model at each round. We access different informativeness measures from both the uncertainty aspect and diversity aspect. Trained on the data selected by active learning, the model shows better structure identification ability than random selection. Moreover, compared with random selection, using active learning could achieve the same level of performance by just half of the data. The results illustrate the possibility of constructing quality deep learning datasets within the affordable annotation budget and efficient pipeline from massive video data, which can fertilize more deep learning applications in surgery assistance. Fig. 1 : Illustration of active learning process For the rest of the paper, Section II will introduce the informativeness measurement strategies and the experiment settings. Results will be demonstrated in Section III , with detailed analysis. In the last section IV , we will summarize our work and its possible contribution to this interdisciplinary challenge. II Methods In each active learning selection round, the unlabeled frames will be fed into the model, where some informativeness measurement strategies, also known as acquisition functions, will be applied for ranking and sampling [ 6 ] . Intuitively, an unlabeled frame is considered significant from two aspects: when the model is unconfident in its prediction, known as uncertainty [ 7 , 8 ] ; and the frame itself is different from the existing dataset distribution, known as diversity [ 5 , 9 ] . We access these two types of informativeness measurement strategies and their performance in the context of LC surgery. Specifically, we use prediction entropy as the uncertainty measurement, and feature distance as diversity measurement. II-A Prediction entropy In semantic segmentation, for an input image with height H and width W , the network output will be in the shape K\times H\times W , where K refers the total number of classes defined in the task. That is, for each pixel, it will be predicted as each of the K classes with some probability p , where \sum_{i=1}^{K}p_{i}=1 . We use the prediction’s entropy as the uncertainty measurement to evaluate the model’s confidence in predicting a particular unlabeled frame. For a pixel, the entropy is defined as: H=-\sum_{i=1}^{K}p_{i}\log(p_{i}). (1) If the predicted probability of a pixel distributes more evenly on all the classes, the entropy will be higher. For a whole image with H\times W pixels, we calculate the average entropy of all pixels as the uncertainty measures. After calculating the mean entropy of every unlabeled frame in a new video, we rank and select frames in decreasing mean entropy order. To avoid selecting frames with similar visual representation, we further divide them into batches, and select a fix number of frames randomly from each batch [ 10 ] . II-B Deep feature representation distance Unlike input frame pixel difference calculation, we evaluate the deep feature representation extracted by the trained DNNs at each round to sample frames with broader distributional diversities as they contain more information [ 5 ] . Ma et al. [ 11 ] shows deep features of the training data will lies in concentrated surroundings in the high dimensional manifold. Correspondingly, for an unlabeled frame, the shorter feature distance from the existing data indicates similar feature representation. Conversely, the longer feature distance from others suggest that the feature representation do not lie on the manifold. It can be assumed that such frame is more distinct from the existing dataset, therefore more critical to include to expand the data diversities. We accessed the Euclidean (eq. 2 ) and Cosine (eq. 3 ) distance respectively as diversity measurement for the feature representations. Specifically, we pass each unlabeled data into the DNNs and extract the deep feature representation from the intermediate layer. For a deep feature representation in d dimensional sapce, we indicate it as F\in\ \mathbb{R}^{d} . An