Co-Paced Learning Strategy Based on Confidence for Flying Bird Object Detection Model Training Journal: Arxiv
Zi-Wei Sun, Ze-Xi hua, Heng-Chao Li, Yan Li · 2025
Read Co-Paced Learning Strategy Based on Confidence for Flying Bird Object Detection Model Training Journal: Arxiv by Zi-Wei Sun, Ze-Xi hua, Heng-Chao Li, Yan Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-12071.txt.
Introduction
Zi-Wei Sun and co-authors published a 2025 paper on training detectors that spot flying birds in surveillance video. Birds in such footage vary widely: some are large and clear, others tiny or camouflaged against the sky. Hard examples can drag training down if the model meets them too early. The authors propose a training strategy that respects that difficulty.
Two copies of the same detector are trained side by side. Each helps the other pick training examples it already judges confidently, above a set threshold. As training proceeds, the threshold slowly drops, so harder birds enter the diet step by step. Before this joint training, both models are pre-trained so they can judge difficulty at all. On two datasets of birds in surveillance video, the strategy beat rival training schemes clearly. The authors frame it as curriculum learning driven by the models' own confidence.
Catalog record
| CREATOR | Zi-Wei Sun, Ze-Xi hua, Heng-Chao Li, Yan Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 14 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-12071
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Co-Paced Learning Strategy Based on Confidence for Flying Bird Object Detection Model Training Journal: Arxiv Zi-Wei Sun, Ze-Xi hua, Heng-Chao Li, Yan Li Abstract To mitigate the adverse effects of hard samples on the training of the Flying Bird Object Detection (FBOD) model for surveillance videos, we propose a Co-Paced Learning Based on Confidence (CPL-BC) strategy and apply this strategy to the training process of the FBOD model. This strategy involves maintaining two models with identical structures but different initial parameter configurations, which collaborate with each other to select easy samples with prediction confidence exceeding a set threshold for training. As training progresses, the strategy gradually lowers the threshold, allowing more samples to participate, enhancing the model’s ability to recognize objects from easy to hard. Before applying the CPL-BC strategy to train the FBOD models, we initially trained the two FBOD models to equip them with the capability to assess the difficulty level of flying bird object samples. Experimental results on two different datasets of flying bird objects in surveillance videos demonstrate that, compared to other model learning strategies, CPL-BC significantly improves detection accuracy, verifying the effectiveness and advancement of this method. 1 Introduction Detection of flying bird objects has essential application value in many fields [ a_new_skeleton_based_flying_bird_detection , yolov5s_farm_bird_detction , automated_monitoring_for_birds ] . At present, the method of detecting flying bird objects by radar is widely used [ 2016_Hoffmann_multistatic_radar , 2017_Jahangirstaring_radar ] , but the radar equipment has some disadvantages, such as large size, expensive, and poor visual effect. With the development of computer vision, deep learning, and other technologies, there is increasing research on using cameras to detect various objects [ Object_Detection_Method_for_Railway_Intrusion , EPFDNet_Camouflaged_object_detection , multi-camera_3D_object_detection ] . We are working on how to use surveillance cameras to detect flying bird objects [ fbod-bmi , fbod-sv , spl_bc_conference , spl_bc ] . However, the flying bird objects captured by surveillance cameras present different identification difficulties due to their different sizes or different similarities to the background. As shown in Figure 1 , these flying bird objects have various levels of difficulty to identify. In the training process of the model, if easy samples and hard samples are not distinguished, the model may be affected by the noise in hard samples, thus reducing the detection accuracy [ spl_bc ] . Figure 1: Identifying the flying bird object in the surveillance video has different degrees of difficulty. To solve the above problem, an intuitive approach is to train the model using only easy samples and discard the hard ones (this approach is similar to filtering out the noisier samples when processing data with noise labels [ lu_mentornet , malach_when_to_update , Han_co_teacher , shen_learning_with_bad_training_data ] ). In this way, it can avoid the interference of fuzzy, hard samples with the model training process to a certain extent, thus reducing the possibility of false detection. However, because hard samples are not included in the training process, the model may perform poorly when faced with these hard samples. To solve this contradiction, a new method, Self-Paced Learning strategy with Easy Sample Prior Based on Confidence (SPL-ESP-BC), was proposed in the literature [ spl_bc ] . The core idea of this strategy is to start learning from easy samples and then gradually transition to hard samples to gradually improve the model’s recognition ability of the object and effectively reduce the adverse impact of hard samples on model training. Compared with the loss-based Self-Paced Learning (SPL) strategy [ kumar_SPL_for_latent_variable , jiang_easy_samples_first_sp_regularizers , spl_diversity , spl_matrix_factor , spl_cl , evolution_spl ] , the SPL-ESP-BC [ spl_bc ] uses the prediction confidence of samples to evaluate the difficulty degree of samples. In the One-Category object detection task (the flying bird object detection belongs to the One-Category object detection), using confidence as a criterion has greater advantages than the loss of use. However, it should be noted that in the process of SPL, bias accumulation may occur in sample selection. Specifically, the model may mistakenly treat some hard samples as easy samples or the easy samples as hard samples, resulting in selection bias. Since the SPL strategy relies on the model itself to evaluate the difficulty of the sample, the sample selection bias may gradually accumulate with the training process and eventually affect the model’s performance. In response to the challenge of noise labeling, literature [ Han_co_teaching ] proposes a novel and effective learning paradigm called “Co-teaching". This paradigm trains two deep neural networks at the same time. After each iteration completes the forward inference, each network will select a batch of data with sufficiently small losses according to their calculated loss value and consider these data to be more accurate (because these data have less loss when passing through the network, meaning that the network’s prediction results for these data are more consistent with the given label). These batches of data, which are considered “clean", are then passed on to the peer network for it to update its parameters. Since deep networks tend to preferentially learn “clean" data and become robust [ closer_look_deep_networks ] , when data containing noise is mistakenly considered “clean" and passed to a peer network, the peer network can screen out these noisy data to some extent by its robustness, effectively preventing the accumulation of this type of selection bias. In this mutual screening and transmission mechanism, the two networks can work together to reduce the errors introduced by noise labels. Inspired by Co-teaching and combined with the principle of Self-Paced Learning strategy Based on Confidence (SPL-BC), In this paper, a Co-Paced Learning stragegy Based on Confidence (CPL-BC) is proposed to optimize the training process of Flying Bird Object Detection (FBOD) model for surveillance video. The core of this strategy is to maintain two object detection models with the same structure but different initial parameter configurations. In each training iteration, the two models independently evaluate the confidence of the sample set and select those whose confidence exceeds the currently set threshold as “easy samples". These selected easy samples are then passed to each other’s networks for parameter updates. As the training process progresses and the number of training rounds increases, the confidence threshold is gradually lowered to allow more samples (which gradually become hard) to participate in the training. This process starts with easy samples and progressively transitions to hard samples, which can enhance the model’s ability to recognize object features and reduce the adverse effects of hard samples on the model training process. By alternately assessing the difficulty level of samples using two models, this strategy can, to some extent, prevent the accumulation of sample selection bias. Before applying the CPL-BC strategy to the training of the FBOD model, we first independently and randomly initialize two FBOD models with the same structure to ensure that they have different initial parameter configurations. Then, the two models are trained preliminarily so that each can evaluate the difficulty degree of samples. Then, the CPL-BC strategy is applied to the subsequent training of the two models. The main contributions of this paper are as follows. 1. The CPL-BC model training strategy for the One-Category object detection model is proposed by integrating the concept of Co-teaching into the SPL-BC strategy. The strategy involves training two neural network