DAM: Domain-Aware Module for Multi-Domain Dataset Condensation

Jaehyun Choi, Gyojin Han, Dong-Jae Lee, Sunghyun Baek, Junmo Kim · 2025

Read DAM: Domain-Aware Module for Multi-Domain Dataset Condensation by Jaehyun Choi, Gyojin Han, Dong-Jae Lee, Sunghyun Baek, Junmo Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22387.txt.

Introduction

Jaehyun Choi and co-authors shrink mixed datasets in a 2025 machine learning paper. Dataset condensation boils a huge training set down to a tiny synthetic one that teaches models nearly as well, saving storage and compute. Past methods assume the data come from one world, yet real collections mix many domains, such as photos, sketches, and scans.

Their module stamps domain features into each synthetic image through learnable masks. Since domain labels are usually missing, rough labels are guessed from the images' frequency patterns. Models trained on the condensed set then hold up both within one domain and across many, the tests show.

Catalog record

CREATORJaehyun Choi, Gyojin Han, Dong-Jae Lee, Sunghyun Baek, Junmo Kim
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-22387

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DAM: Domain-Aware Module for Multi-Domain Dataset Condensation Jaehyun Choi, Gyojin Han, Dong-Jae Lee, Sunghyun Baek, Junmo Kim Abstract Dataset Condensation (DC) has emerged as a promising solution to mitigate the computational and storage burdens associated with training deep learning models. However, existing DC methods largely overlook the multi-domain nature of modern datasets, which are increasingly composed of heterogeneous images spanning multiple domains. In this paper, we extend DC and introduce Multi-Domain Dataset Condensation (MDDC), which aims to condense data that generalizes across both single-domain and multi-domain settings. To this end, we propose the Domain-Aware Module (DAM), a training-time module that embeds domain-related features into each synthetic image via learnable spatial masks. As explicit domain labels are mostly unavailable in real-world datasets, we employ frequency-based pseudo-domain labeling, which leverages low-frequency amplitude statistics. DAM is only active during the condensation process, thus preserving the same images per class (IPC) with prior methods. Experiments show that DAM consistently improves in-domain, out-of-domain, and cross-architecture performance over baseline dataset condensation methods. 1 Introduction Over the past decade, deep learning models have grown substantially in capacity, achieving remarkable progress in diverse tasks across vision, language, and multi-modal domains. This performance growth has been tightly coupled with the dataset size. To meet this demand, data collection has shifted from manual curation to automated web crawling, yielding datasets that are not only large in size but also highly heterogeneous. These datasets often consist of samples drawn from various domains with drastically different visual characteristics, including changes in texture, lighting, color distribution, and abstraction level. While such diversity benefits model robustness, it also raises new challenges for training efficiency and data quality management at scale. Dataset Condensation (DC) has emerged as a promising direction to reduce training cost by synthesizing a small set of highly informative samples. First introduced by Wang et al. [ 1 ] , DC replaces the original training data with a compact synthetic dataset, optimized to preserve the training dynamics of real data. Recent DC methods improve this core idea using gradient matching [ 2 ] , distribution alignment [ 3 ] , or trajectory matching [ 4 ] , and have shown strong results on curated benchmarks such as CIFAR [ 5 ] . These approaches significantly reduce training time and memory usage. However, nearly all existing methods assume that the dataset is homogeneous in style. This assumption breaks down in many realistic scenarios, where datasets contain images from multiple visual domains (e.g., photo, logo drawing, advertisement, art-painting, etc.) due to their mixed-source construction. When DC is applied to such mixed-domain data, synthetic images often collapse toward dominant domain styles, leading to degraded performance. Figure 1 illustrates this problem on the PACS [ 6 ] dataset, which includes 7 classes across 4 domains (e.g., Art-Painting, Cartoon, Photo, and Sketch). Figure 1: Performance of single- and multi-domain training for existing dataset condensation methods (DC, DM, MTT) on the PACS dataset under a 10 images per class setting. In the single-domain setup, models are trained using only Cartoon domain images, assuming access to explicit domain labels. In contrast, the multi-domain dataset setting trains on the full PACS dataset without domain supervision, reflecting modern datasets. In all prior methods, the performance drop in the multi-domain setting was significant. We compare existing DC methods under two training settings, evaluating all models on the Cartoon domain. In the single-domain setting , the Cartoon domain is isolated using oracle domain labels, resulting in higher accuracy, but this relies on metadata that is typically unavailable in a real-world setting. In contrast, the multi-domain setting uses the full PACS dataset without domain separation, reflecting a more realistic scenario. Here, all prior methods suffer significant performance drops, often exceeding 10%p. One might consider mitigating this by condensing data separately per domain or using ground-truth domain labels during condensation. However, both strategies are fundamentally flawed within the DC framework. Per-domain condensation scales linearly with the number of domains, inflating the synthetic data size, while relying on domain labels assumes costly and often unavailable annotations. To fill this gap, we introduce the Multi-Domain Dataset Condensation (MDDC) task with the goal of synthesizing a single compact dataset that performs well across both single-domain and multi-domain settings, without explicit domain labels or increasing the Images per Class (IPC). To solve this, we propose the Domain-Aware Module (DAM), a training-time module that equips each synthetic image with the capacity to represent multiple domain styles through learnable spatial masks. DAM enables the model to assign domain-specific features to different regions within an image, effectively encoding domain variation without requiring per-domain images. As explicit domain labels are unavailable, we propose a lightweight pseudo-domain labeling scheme based on frequency-domain characteristics. Specifically, we assign pseudo-domain labels by sorting real images by the mean amplitude of their low-frequency FFT components, a heuristic inspired by its success in domain adaptation [ 7 , 8 ] . These pseudo-labels are used to supervise DAM during training and are discarded afterward. DAM does not increase the number of synthetic images and introduces no additional overhead when training downstream models. Through comprehensive experiments on five datasets, including CIFAR-10, CIFAR-100, Tiny ImageNet, PACS, and VLCS, and across architectures, including ConvNet, VGG, and ViT, we show that prior methods’ performance deteriorates in the multi-domain setting and that DAM consistently improves performance in both in-domain and cross-domain evaluation settings, without compromising the efficiency goals of dataset condensation. 2 Related Works 2.1 Dataset Condensation As machine learning models have become larger and more complex, the amount of data required for training those models has also grown significantly. In this context, the emergence of massive datasets has greatly increased the burden on computational resources and training time, creating a bottleneck in model development. Dataset distillation [ 1 ] is a formulation proposed to address this issue by compressing a large dataset into a much smaller synthetic dataset while still maintaining the essential data characteristics of the original dataset for training deep learning models. This approach drastically reduces training time and computational costs, allowing models trained on the condensed dataset to achieve performance comparable to those trained on the original, large-scale datasets. Among various strategies in dataset condensation, including gradient matching methods [ 1 , 2 , 9 ] , approaches based on distribution matching [ 3 , 10 ] , trajectory matching [ 4 , 11 ] , and generative-model-based approaches leveraging GANs or diffusion models [ 12 , 13 ] , we focus on gradient matching, distribution matching, and trajectory matching. Gradient Matching Dataset distillation methods based on gradient matching aim to match the gradients of a neural network that are calculated for a loss function over a synthetic dataset and the original dataset for the purpose of dataset condensation. DC [ 2 ] first formulated the dataset distillation as a minimization problem between gradients that are calculated from an original dataset and a condensed dataset. IDC [ 9 ] improved data condensation by efficiently parameterizing synthetic data to preserve essential characteristics with a smaller dataset, and they generated multiple formations of data to maintain model performance while significantly reducing storage and computation costs. Zhang et al. [ 14 ] accelerated the distillation process by utilizing models in the early stages

Read the complete text