Purifying, Labeling, and Utilizing: A High-Quality Pipeline for Small Object Detection
Siwei Wang, Zhiwei Chen, Liujuan Cao, Rongrong Ji · 2025
Read Purifying, Labeling, and Utilizing: A High-Quality Pipeline for Small Object Detection by Siwei Wang, Zhiwei Chen, Liujuan Cao, Rongrong Ji (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20602.txt.
Introduction
Siwei Wang and co-authors put forth PLUSNet in 2025. It is a pipeline for finding small objects in images. Work in the pipeline has three stages. First, features are drawn from the image. Next, training samples are picked. Last, objects are sorted and placed. Past work tried to improve one stage at a time. That held back gains for the whole pipeline.
PLUSNet improves all three stages. A part called the Hierarchical Feature Purifier cleans the features from the first stage in layers. A part called Multiple Criteria Label Assignment picks better training samples in the middle stage. A part called Frequency Decoupled Head uses the data more fully in the last stage. The parts can plug into many detectors. Tests show steady gains across many data sets for small object detection.
Catalog record
| CREATOR | Siwei Wang, Zhiwei Chen, Liujuan Cao, Rongrong Ji |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-20602
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Purifying, Labeling, and Utilizing: A High-Quality Pipeline for Small Object Detection Siwei Wang, Zhiwei Chen, Liujuan Cao, Rongrong Ji Abstract Small object detection is a broadly investigated research task and is commonly conceptualized as a “pipeline-style” engineering process. In the upstream, images serve as raw materials for processing in the detection pipeline, where pre-trained models are employed to generate initial feature maps. In the midstream, an assigner selects training positive and negative samples. Subsequently, these samples and features are fed into the downstream for classification and regression. Previous small object detection methods often focused on improving isolated stages of the pipeline, thereby neglecting holistic optimization and consequently constraining overall performance gains. To address this issue, we have optimized three key aspects, namely P urifying, L abeling, and U tilizing, in this pipeline, proposing a high-quality S mall object detection framework termed PLUSNet. Specifically, PLUSNet comprises three sequential components: the Hierarchical Feature Purifier (HFP) for purifying upstream features, the Multiple Criteria Label Assignment (MCLA) for improving the quality of midstream training samples, and the Frequency Decoupled Head (FDHead) for more effectively exploiting information to accomplish downstream tasks. The proposed PLUS modules are readily integrable into various object detectors, thus enhancing their detection capabilities in multi-scale scenarios. Extensive experiments demonstrate the proposed PLUSNet consistently achieves significant and consistent improvements across multiple datasets for small object detection. 1 I Introduction Object detection is a widely studied task that aims to locate and classify the objects of interest. As an integral extension of object detection, small object detection commands considerable importance, straddling the realms of theoretical inquiry and practical utility. In general detection scenarios, the detection accuracy for small objects is often significantly lower compared to bigger objects. Improving the performance on small objects is beneficial for overcoming detection bottleneck and greatly enhancing overall performance. In addition, in specific detection scenarios such as remote sensing [ 1 , 2 , 3 ] , disaster rescue [ 4 , 5 ] , intelligent transportation [ 6 , 7 , 8 ] , medical applications [ 9 , 10 ] , the dominant presence is the abundance of small objects. In such cases, enhancing the performance of small object detection greatly contributes to progress in these fields. Current small object detection pipeline, similar to a factory assembly line, can be divided into three stages: upstream, midstream, and downstream. In the upstream stage, the image goes through a pre-trained model to obtain feature maps, a process akin to feeding raw materials ( i.e . , images) into a machine ( i.e . , the pre-trained model) to produce initial parts ( i.e . , feature maps). Subsequently, the feature maps along with candidate samples are fed into the midstream, where an assigner acts as a quality inspector to assess the samples, and assign positive or negative labels based on its evaluation. Finally, training samples and feature maps enter the downstream detection stage, where the detection head performs classification and regression tasks to produce results. Nevertheless, across the three crucial stages of the pipeline, small object features are prone to loss, and low-quality small object features limit information utilization, leading to a significant degradation in the detection performance of small objects. Specifically, we identify three issues in widely-used small object detection frameworks: Fig. 1: Visualization of the lowest-level feature map. The original feature map contains a large amount of noise. After separating high and low frequency information through Fast Fourier Transform [ 11 ] , highpass feature focus on small objects ( e.g . , traffic lights, vehicles, pedestrians), while lowpass feature concentrates more on overall semantic information ( i.e . , the street scene). (1) The noisy low-frequency information in the bottom layers of the Feature Pyramid Network (FPN) [ 12 ] overwhelms the information of small objects. As visualized in Fig. 1 (b), the lowest-level feature map originally designed for detecting small objects exhibits conspicuous noise. We attribute this phenomenon to the effect of feature fusion in the FPN. The top-down fusion manner continuously integrates the semantic information from the top-level with the detailed information, which inadvertently overshadows the information of small objects. (2) The single-criterion label assignment greatly restricts the number of positive sample for small objects. Many mainstream detectors [ 13 , 14 , 15 , 16 ] depend solely on the widely used IoU-based label assignment. Unfortunately, the IoU (Intersection over Union), fundamentally the Jaccard coefficient in mathematics [ 17 , 18 ] , possesses an inherent flaw: it is sensitive to the sizes of sets. When a significant difference exists in the sizes of two sets, the Jaccard similarity is likely to lose accuracy, as it solely considers the ratio of intersection to union, ignoring the size discrepancy between sets. This issue becomes particularly pronounced in small object detection, leading to various problems such as deviation and size issues, as illustrated in Fig. 2 (a). (3) Current detection heads commonly share identical feature representations and structures for both classification and regression tasks, which is detrimental to small object detection. Small objects are inherently susceptible to interference from background and noise. For example, in Fig. 1 (a), the features of pedestrians may easily blend with those of background vehicles. Directly performing classification and regression on such features simultaneously would confuse the detector’s judgment. Additionally, standard detection heads typically employ the same structure for distinct classification and regression. Employing dedicated structures tailored to each task would constitute a more rational and effective design choice. \begin{overpic}[2.pdf] \put(-1.2,11.8){\rotatebox{90.0}{\scriptsize{IoU}}} \put(60.4,6.9){\rotatebox{90.0}{\scriptsize{Average Number}}} \put(9.2,12.6){\scriptsize{\bm{$d$}}} \put(13.1,10.8){\scriptsize{\bm{$n$}}} \put(24.5,12.8){\rotatebox{90.0}{\scriptsize{\bm{$n$}}}} \put(15.5,-1.5){\scriptsize{\bm{$d$}}} \put(35.5,17.6){\scriptsize{\bm{$n_{\mathrm{g}}$}}} \put(35.5,14.8){\scriptsize{\bm{$n_{\mathrm{p}}$}}} \put(53.0,12.8){\rotatebox{90.0}{\scriptsize{\bm{$n_{\mathrm{g}}$}}}} \put(44.8,-1.5){\scriptsize{\bm{$n_{\mathrm{p}}$}}} \put(78.0,-1.5){\scriptsize{{Size of GT}}} \put(20.0,-3.6){\footnotesize{(a) Theoretical Analysis}} \put(71.8,-3.6){\footnotesize{(b) Experimental Proof}} \end{overpic} Fig. 2: Comparison of the single-criterion and multi-criteria label assignment in small object detection. (a) Deviation issue: Even when the proposal is perfectly aligned in size with the ground truth (GT), minor deviations between them can lead to a rapid decrease in the IoU, especially for small objects. Size issue: Despite being fully contained within the GT, small-sized proposals struggle to achieve competitive IoU comparable to larger ones. (b) The distribution of positive sample numbers for mainstream detectors [ 14 , 13 ] and our PLUSNet. The representative MaxIoU methods completely ignore the small-sized objects, while our proposed MCLA assigns samples in a more reasonable manner. (Experimental details are available in Sec. IV-D .) To address the above three issues in a unified and effective manner, we propose PLUSNet, which consists of three mutually collaborative components as follows: (1) To obtain informative yet noise-reduced feature representations, we propose Hierarchical Feature Purifier (HFP) for feature purification at the upstream feature fusion stage. HFP introduces Fast Fourier Transform (FFT) [ 11 ] to decompose image features into distinct low-frequency and high-frequency domains. As shown in Fig. 1 (c) and Fig. 1 (d), the low-frequency components capture semantic information ( i.e . , the street scene), while the high-frequency components eliminate the interference of background and noise, effectively highlighting small objects. (2) To improve the overall quality of training samples, we introduce a novel Multiple Criteria Label Assignment (MCLA) to increase the number of positive sample for small objects. Specifically, MCLA is a multi-criteria paradigm that includes three metrics: the Position Offset Criterion (POC), the Shape Constraint Criterion (SCC) and the