Sampling Strategies for Efficient Training of Deep Learning Object Detection Algorithms
Gefei Shen, Yung-Hong Sun, Yu Hen Hu, Hongrui Jiang · 2025
Read Sampling Strategies for Efficient Training of Deep Learning Object Detection Algorithms by Gefei Shen, Yung-Hong Sun, Yu Hen Hu, Hongrui Jiang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18302.txt.
Introduction
Gefei Shen and co-authors wrote a paper from 2025 on training object-finding models with far fewer hand-labeled images. Labeling is the slow, costly part of teaching a model to spot things in photos or video. The team asked whether smart picking of which frames to label could cut that cost. Their work rests on a smoothness premise about how such models behave.
They test two picking plans. One spreads picks evenly yet at random across the range of ways objects can appear and move. The other exploits the sameness of video: it skips frames that barely differ from the last. Both plans built training sets that taught the model well. Yet each needed far fewer labeled frames than full training would. The team frames the plans as a route to cheaper training for video-based detection.
Catalog record
| CREATOR | Gefei Shen, Yung-Hong Sun, Yu Hen Hu, Hongrui Jiang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18302
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Sampling Strategies for Efficient Training of Deep Learning Object Detection Algorithms Gefei Shen, Yung-Hong Sun, Yu Hen Hu, Hongrui Jiang Abstract Two sampling strategies are investigated to enhance efficiency in training a deep learning object detection model. These sampling strategies are employed under the assumption of Lipschitz continuity of deep learning models. The first strategy is uniform sampling which seeks to obtain samples evenly yet randomly through the state space of the object dynamics. The second strategy of frame difference sampling is developed to explore the temporal redundancy among successive frames in a video. Experiment result indicates that these proposed sampling strategies provide a dataset that yields good training performance while requiring relatively few manually labelled samples. 1 Introduction Sun et al.’s sun2025easyvis2realtimemultiview laparoscopy project demonstrates an informative way of data collection and labeling. The project begins with a small set of initial training data, and it iteratively improves the model through a semi-automated data labeling pipeline. Initially a small batch of training data is used to train the model. Then the model is used to make predictions while a human annotator observes its real time prediction result. The annotator then records the frame where the model prediction is off, and manually correct these predictions. Corrected samples are then used to improve the model. This iterative process aims to find the cases where the model’s performance is sub-standard and strengthen the model’s performance on these cases. The selective sampling approach taken by Sun et al. sun2025easyvis2realtimemultiview can be characterized as a ”human based” active learning. The selection of additional training data is based on human annotator’s observation and decision. However, to scale this process to enhance efficiency, an automated active learning strategy is required. In this work, we builds on this manual active learning pipeline to explore two specific sampling strategies: uniform sampling and frame difference sampling. Specifically, we employ a pre-trained YOLOv8 model and customize it to detect and estimate the poses of laparoscopic surgical tools. 2 Background 2.1 Sampling and Active Learning Machine learning (ML) models need to be trained with data samples. The quality of trained ML models often is tied to the quantity (number of training samples) and quality (accuracy of labels) of the training data. Insufficient amount of training samples may yield inferior ML models that do not generalize well. On the other hand, acquiring samples and labeling samples both may consume significant resources. Therefore, it is desirable to judiciously acquire sample and label samples to achieve desired performance of trained ML models while minimizing the sampling and labeling cost. Experiment design kirk2009experimental may be applied initially to setup the sampling strategy. However, it is often unclear how many training samples are required to achieve desired performance by testing a trained ML model against a preset validation dataset. If the sampling (and labeling) cost is of no concern, one would use as many training samples as practically possible. However, if the sampling and/or labeling cost is a constraint, an active learning Settles_2009 approach may be desired. With active learning, an ML model is trained incrementally. At each iteration, the active learning algorithm will select a subset of unused samples and query their labels from an orcle which may be a human labeler. The selection criteria may depend on how well the current ML model is developed. In this work, we will investigate sampling techniques for a laparoscopy project sun2025easyvis2realtimemultiview . In this project, a ML model YoloV8-detect yolov8_ultralytics will be trained with images extracted from videos acquired in the laboratory and manually labeled. The labeling cost in terms of the numbers of images that need to be manually labeled is to be minimized. 2.2 Lipschitz Continuity of ML Models Many ML models may be approximated by a higher-dimension Lipschitz function f:\mathbb{R}^{2}\rightarrow\mathbb{R}^{n} virmaux2018lipschitz . Denote x and y to be the data and label respectively. The Lipschitz condition stipulates that if for some distance metric \delta , \delta(x_{1},x_{2})<\sigma (1) The corresponding ML model f(\cdot) will satisfy \delta(f(x_{1}),f(x_{2}))<\epsilon(\sigma) (2) where f(x_{1}) , f(x_{2}) are the corresponding labels of x_{1} and x_{2} , and \epsilon is a function. In machine learning, imposing Lipschitz continuity to the loss function during training ensures the trained machine learning model will not be overly sensitive to small perturbations in the input, leading to more robust, stable, and predictable behavior. leveraging Lipschitz continuity, active learning algorithms can select more informative data points for labeling, leading to more accurate and reliable models. 2.3 Sampling Strategies 2.3.1 State Space Sampling In this work, each sample is a frame of video (an image). If we rasterize the pixel values into a vector, it would have high dimension. Direct sampling in such a high-dimensional feature space would be very inefficient. However, by performing experiments using the prototype system, we can produce training video under different scenarios. To be more specific, the goal of object detection in this application is to estimate the 3D positions and orientations of surgical tools. These are the states of objects that need to be estimated. Hence, it is better to sample in the contextual state space rather than the context-agnostic pixel value space. Therefore, in this work, we perform experiments that covers all the operating scenarios with the prototype laparoscopic surgical system. These include different positions, orientations of the surgical tools in the training box. The objective is to generate training videos that span the state space in which the object’s state is to be estimated. 2.3.2 Uniform Sampling Uniform sampling attempt to randomly sample data from the feature distribution according to a uniform distribution. Uniform sampling promises that samples may cover the entire feature space. In this work, we apply uniform sampling in the state space to boot-strap the active learning. A ML model trained with these uniformly sampled training data is likely to provide a crude sketch of the final model over the contextual relevant sampling space. The granularity of this initial boot-strapping uniform sampling is determined by the amount of samples that will be labeled (sampling cost) for this purpose. It also depends on the Lipschitz continuity property of the loss function for training the ML model. 2.3.3 Frame Difference Sampling The other utilization of the Lipschitz continuity property is in the temporal domain. It is observed that high correlation exists between successive video frames (temporal Lipschitz continuity), we examine magnitude of frame difference to identify most informative video frames for the purpose of sampling. Specifically, we convert the video frames into grayscale and compute the frame by frame difference. D_{t}=\sum_{u,v}\bigl|I_{t}(u,v)-I_{t-1}(u,v)\bigr| (3) Where I_{t}(u,v) is the intensity of pixel (u,v) in frame t . Then we rank all frames by D_{t} and select the top P of frames for manual labeling. This approach ensures that our training set is consist of with the most dynamic and high-variance samples. 3 Methods In this work, we hypothesize that: 1. Uniform Sampling: Using the original video sequence, we select P frames evenly from the video sequence. Spacing samples evenly in time should ensure broad coverage of all video segments. We expect that even without targeting specific complex samples, the model would steadily improve as it sees representative samples from across the entire video sequence. 2. Frame Difference sampling: We hypothesize that frames