OD 3 : Optimization-free Dataset Distillation for Object Detection
Salwa K. Al Khatib, Ahmed ElHagry, Shitong Shao, Zhiqiang Shen · 2025
Read OD 3 : Optimization-free Dataset Distillation for Object Detection by Salwa K. Al Khatib, Ahmed ElHagry, Shitong Shao, Zhiqiang Shen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01942.txt.
Introduction
Salwa Al Khatib and three co-authors shrank object-detection training sets in 2025 without the usual costly optimization. Teaching detectors takes huge image collections, and compressing them into tiny stand-ins has mostly served simple classification. Their method, OD3, builds synthetic images by placing cut-out objects where they fit.
A trained observer then screens the collages, dropping objects it judges poorly placed. On two standard benchmarks the tiny sets, down to a quarter percent of the originals, still taught working detectors. Cheap distillation could cut the energy and storage bills of vision research sharply.
Catalog record
| CREATOR | Salwa K. Al Khatib, Ahmed ElHagry, Shitong Shao, Zhiqiang Shen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-01942
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OD 3 : Optimization-free Dataset Distillation for Object Detection Salwa K. Al Khatib, Ahmed ElHagry, Shitong Shao, Zhiqiang Shen Abstract Training large neural networks on large-scale datasets requires substantial computational resources, particularly for dense prediction tasks such as object detection. Although dataset distillation (DD) has been proposed to alleviate these demands by synthesizing compact datasets from larger ones, most existing work focuses solely on image classification, leaving the more complex detection setting largely unexplored. In this paper, we introduce OD 3 , a novel optimization-free data distillation framework specifically designed for object detection. Our approach involves two stages: first, a candidate selection process in which object instances are iteratively placed in synthesized images based on their suitable locations, and second, a candidate screening process using a pre-trained observer model to remove low-confidence objects. We perform our data synthesis framework on MS COCO and PASCAL VOC, two popular detection datasets, with compression ratios ranging from 0.25 % 0.25\% to 5 % 5\% . Compared to the prior solely existing dataset distillation method on detection and conventional core set selection methods, OD 3 delivers superior accuracy, establishes new state-of-the-art results, surpassing prior best method by more than 14% on COCO mAP 50 at a compression ratio of 1.0 % 1.0\% . Code and condensed datasets are available at: https://github.com/VILA-Lab/OD3 . Figure 1: Performance Comparison of OD 3 on COCO. We compare the mAP performance of our method to others with different compression rates. The upper bound is 39.8% on the full dataset. Figure 2: Illustration of the OD 3 framework. In initial stage ①, each object in \mathbf{x}_{i}\in\mathcal{T} is assigned a random location in the synthesized image \mathbf{\hat{x}}_{j}\in\mathcal{S} for j=1,...,\texttt{IPD} , and its overlap with existing candidates is checked to decide placement. After IPD synthesized images are initially constructed, a pre-trained observer model produces predictions for screening. The observer iteratively evaluates the current canvas to identify and remove objects that do not meet expectations to align with the post-evaluation process. For final reconstruction, the objects are inserted using their bounding boxes into \mathbf{\hat{x}}_{j}\in\mathcal{S} . Post-evaluation of \mathcal{S} is carried out by fast distilling knowledge shen2022fast from the observer model to a target network using PKD pkd loss on the respective feature pyramid networks. 1 Introduction Deep neural networks have achieved remarkable performance across a wide range of computer vision tasks he2016deep ; ren2015faster ; dosovitskiy2020image ; kirillov2023segment , but training these models generally requires substantial computational and data resources. Conventional strategies often involve collecting increasingly large datasets imagenet and training ever larger networks dehghani2023scaling to capture data complexity. This paradigm is particularly evident in object detection shao2019objects365 , where the need for rich annotations, such as bounding boxes or even instance masks, can greatly increase dataset sizes and labeling overhead. As a result, there is a growing interest in techniques that enable the creation of smaller, more manageable datasets capable of approximating the performance achieved by training on the original data. One promising direction in this area is dataset distillation (DD), which aims to synthesize condensed datasets that are significantly smaller yet still effective for training. The majority of DD approaches have focused on image classification, where each image contains an object or a dominant label. This narrow scope overlooks the complexity and diversity of more demanding tasks, specifically object detection. In contrast to classification, detection requires localizing and identifying multiple instances of potentially different classes in a single image. This jump in task complexity involves learning a mapping from image to label and predicting boxes and class labels for multiple regions within the same image. Consequently, methods that successfully distill datasets for classification often struggle to adapt to the richer problem space of detection. Another critical distinction lies in the type of supervision and evaluation metrics used in object detection tasks. While classification tasks use labels that can be applied at the image level, detection tasks rely on spatial annotations that align individual objects to bounding boxes, complete with class labels. This requirement introduces additional challenges when creating distilled datasets, as both the geometry (location) and identity (class) of objects must be preserved or effectively synthesized. Approaches that merely compress high-level category information may fail to capture the crucial spatial relationships and visual diversity that define detection tasks. In light of these complexities, we propose O ptimization-free D ataset D istillation for Object D etection ( OD 3 ), a novel framework explicitly tailored to address the unique challenges of synthesizing small, high-fidelity datasets for object detection. The framework leverages instance-level labels with scale-aware dynamic context extension (SA-DCE) to reconstruct diverse training images guided by an observer model, which is grounded in two core ideas: (1) an iterative candidate selection process that strategically places object instances in synthesized images, and (2) a candidate screening process powered by a pre-trained observer model, which discards low-confidence objects. By removing the need for complex optimization procedures in constructing these synthetic images, OD 3 provides a more streamlined and adaptable approach to DD for dense prediction tasks. The main contributions of this work are as follows: • We propose a novel DD framework specifically designed for object detection, named OD 3 . It involves a two-stage process: candidate selection , where masked objects are localized and selected based on minimal overlap, and candidate screening , where a pre-trained observer filters unreliable candidates. • OD 3 bridges a crucial gap by extending the concept of dataset distillation beyond the relatively well-explored territory of image classification to the more challenging domain of object detection in a training-free scheme . Through a carefully designed process that handles both the spatial and semantic requirements of detection, our framework enables significant reductions in dataset size without sacrificing performance significantly. • We evaluate our framework on MS COCO with compression ratios ranging from 0.25% to 5% and on PASCAL VOC from 0.5% to 2.0%. The results demonstrate that our framework effectively reduces dataset size while maintaining model accuracy, providing an efficient solution for training object detectors. 2 Method Preliminaries : Dataset Distillation for Object Detection. The goal of OD 3 is to compress a large object detection dataset \mathcal{T}=\{(\mathbf{x}_{i},\{<\!\bm{b}_{i1},\bm{c}_{i1},\dots\!>\})\} (i=1,\dots,|\mathcal{T}|) into a much smaller synthesized dataset \mathcal{S}=\{(\mathbf{\hat{x}}_{j},\{<\!\bm{\hat{b}}_{j1},\bm{\hat{c}}_{j1},\dots\!>\})\} (j=1,\dots,|\texttt{IPD}|) that maintains the significant characteristics of \mathcal{T} in terms of overall performance, where \bm{b}=\{\mathbf{x}_{c},\mathbf{y}_{c},\bm{w},\bm{h}\} represents the center of the bounding box and the width and height of the image. Here, |\mathcal{S}|\ll|\mathcal{T}| and IPD is the notion of images per dataset which reflects the compression ratio 1 1 1 We define IPD (images per dataset) instead of conventional IPC (images per class) used in classification task as in object detection each image can contain multi-object with different classes. . The performance of a model with weights \theta_{\mathcal{S}} trained on \mathcal{S} should be similar to that of a model with weights \theta_{\mathcal{T}} trained on \mathcal{T} , within a small margin \bm{\epsilon}_{DD} . This can be expressed as: sup\{|\mathcal{L_{\theta_{\mathcal{T}}}}-\mathcal{L_{\theta_{\mathcal{S}}}}|\}_{(\mathbf{x}_{v},\mathbf{y}_{v})\in\mathcal{T^{\prime}}}\leq\bm{\epsilon}_{DD} (1) with \mathcal{L} representing the loss function, and ( \mathbf{x}_{v},\mathbf{y}_{v} ) \in\mathcal{T}^{\prime} is some test or val set associated with \mathcal{T} . Figure 3: Illustration of our sampling controller. It ensures that the same object is not placed in different distilled images. The original dataset is divided into IPD segments. Each segment is distilled into a single