Fair Dataset Distillation via Cross-Group Barycenter Alignment

Mohammad Hossein Moslemi, Nima Hosseini Dashtbayaz, Zhimin Mei, Bissan Ghaddar, Boyu Wang · 2026

Read Fair Dataset Distillation via Cross-Group Barycenter Alignment by Mohammad Hossein Moslemi, Nima Hosseini Dashtbayaz, Zhimin Mei, Bissan Ghaddar, Boyu Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-00185.txt.

Introduction

Mohammad Hossein Moslemi and 4 co-authors study a fairness problem in dataset distillation, which squeezes a large dataset into a small synthetic one for training. Because social groups follow distinct predictive patterns, the squeezing can keep the signal for some groups and lose it for others. The resulting models then perform much worse for the shortchanged groups.

Simply balancing group sizes does not fix the gap, since the cause is mismatched patterns, not counts. The authors analyze how the two sources of bias interact, then aim the distillation at a shared center of the groups' predictive information. Training toward that center gives alike representations across groups. The approach works alongside existing distillation methods and cut the added bias sharply in experiments.

Catalog record

CREATORMohammad Hossein Moslemi, Nima Hosseini Dashtbayaz, Zhimin Mei, Bissan Ghaddar, Boyu Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE112 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.00185

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fair Dataset Distillation via Cross-Group Barycenter Alignment Mohammad Hossein Moslemi, Nima Hosseini Dashtbayaz, Zhimin Mei, Bissan Ghaddar, Boyu Wang Abstract Dataset Distillation aims to compress a large dataset into a small synthetic one while maintaining predictive performance. We show that as different demographic groups exhibit distinct predictive patterns, the distillation process struggles to simultaneously preserve informative signals for all subgroups, regardless of whether group sizes are mildly or severely imbalanced. Consequently, models trained on distilled data can experience substantial performance drops for certain subgroups, leading to fairness gaps. Crucially, these gaps do not disappear by merely correcting group imbalance, since they stem from fundamental mismatches in subgroup predictive patterns rather than from sample-size disparities alone. We therefore formally analyze the interaction between these two sources of bias and cast the solution as identifying a group-imbalance-agnostic barycenter of the predictive information that induces similar representations across all subgroups. By distilling toward this shared aggregate representation, we show that group fairness concerns can be reduced. Our approach is compatible with existing distillation methods, and empirical results show that it substantially reduces bias introduced by dataset distillation. Code is available at https://github.com/mhmoslemi/COBRA 1 Introduction Dataset Distillation (DD) aims to compress a large training set into a much smaller synthetic dataset, while ensuring that models trained on this distilled set reach performance levels comparable to those trained on the original data ( 45 ) . However, as distilled datasets are increasingly deployed in high-stakes applications (e.g., healthcare and finance), matching aggregate accuracy alone is insufficient; the distilled data must also preserve predictive relationships across demographic groups to avoid degraded performance for minority populations. Because distillation aggregates many real samples into a compact synthetic set, it can blur the underlying demographic subgroup structure and undermine the application of training-time fairness constraints that rely on group labels. This creates a need to explicitly design the distilled dataset to be fair by construction. To explain how these disparities arise, dataset distillation is usually performed by aligning a representation of the real dataset with that of a synthetic one, and then optimizing the synthetic samples to minimize the distance between the two representations ( 53 ; 52 ) . Yet demographic groups can follow different representation patterns and may be unevenly represented in the original data. Current distillation approaches match the synthetic representation to a single aggregate representation computed over all samples. When groups are imbalanced and their representations differ, this aggregation is dominated by the majority group, causing the distilled data to primarily capture majority group patterns and under-represent minorities. Consequently, models trained on the distilled set can perform worse on some demographic groups than on others. Figure 1(a) illustrates this effect when groups vary in both representation and size. In fairness-unaware distillation (Vanilla DD), the overall representation ( \times -mark) drifts toward the majority groups. This issue can be partially addressed by performing uniform sampling over demographic groups (Uniform DD). However, there may still be cases where certain groups are located very close to each other in the representation space. In such situations, their combined representation may match them especially well, drawing the distilled data toward these groups and consequently reducing performance for the other groups, as shown in Figure 1(b) (a) Vanilla DD (b) Uniform DD (c) Barycenter DD Figure 1 : Representation target used by dataset distillation for different objectives. Colored clouds indicate subgroup representations, and “ \times ” denotes the overall aggregate target. In this work, we establish theoretically and validate empirically that under dataset distillation, any bias present in the original data becomes amplified, and this amplification cannot be attributed solely to group imbalance or differences in subgroup representations; rather, it arises from the interaction between these two factors. We additionally propose an upper bound for the interaction between these two. Figure 2 illustrates how each effect contributes. In particular, Figure 2(a) isolates the role of varying group imbalance while keeping subgroup representations fixed, whereas Figure 2(b) analyzes the impact of increasing representational separation between subgroups while maintaining a constant imbalance ratio. Both figures indicate that each factor, on its own, has a distinct influence on the outcome. To tackle this issue, we introduce COBRA ( C ross-gr O up B a R ycenter A lignment), which frames fair distillation as a two-step process: first, we compute a barycenter of the representations of different groups in a manner that is agnostic to group imbalance, and then we distill synthetic data toward this barycenter. A barycenter is a type of average that minimizes the total distance, under a selected discrepancy measure, to a given set of points or distributions (Figure 1(c) ). As a result, this aggregate remains similarly distant from each subgroup, independent of the subgroup’s size. Consequently, the distilled dataset captures a comparable level of information and representation quality for all subgroups, thereby mitigating bias. We further demonstrate that COBRA reduces our proposed upper bound on bias amplification by controlling the interaction between group imbalance and representational separation. Consistent with this theory, COBRA achieves state-of-the-art fairness performance relative to vanilla DD and existing baselines. In particular, we make the following contributions: 1. We show that bias amplification in dataset distillation stems from the interaction between group imbalance and representational separation across subgroups, and we derive an upper bound formalizing this effect. 2. We introduce a principled strategy to tighten this upper bound, yielding COBRA , a framework compatible with any existing dataset distillation method. 3. Comprehensive experiments confirm COBRA’s effectiveness, showing consistent fairness gains across diverse datasets and distillation techniques. Conflict of Interest Disclosure. The authors declare no financial or other substantive conflicts of interest that could reasonably be perceived to influence the results reported in this work. (a) Varying imbalance (b) Varying separation Figure 2 : Bias amplification through distillation. Equalized odds difference ( \mathrm{EOD}\downarrow ) on CIFAR10-S at \textsc{IPC}=50 when varying the group-imbalance ( 2(a) ) with fixed representational separation, and subgroup representational separation ( 2(b) ) with fixed imbalance. Black curves correspond to full-data training; colored curves to training on distilled sets. A separation level of 0 indicates identical subgroup representations (see Appendix F for details). 2 Related Work Coresets are small weighted subsets of the training data that approximate learning on the full dataset, with classical constructions for clustering ( 18 ; 7 ; 13 ) , regression ( 32 ; 31 ) , and mixture models ( 30 ) . However, though extending these ideas to deep learning remains challenging, even with gradient matching approaches that use weighted subsets ( 33 ; 21 ; 42 ) . Dataset distillation is related to coreset construction, but instead of selecting real samples, it learns synthetic samples that mimic the full dataset’s training dynamics. It was first posed as a bi-level optimization in ( 45 ) , but direct solutions are computationally costly. This has motivated efficient methods such as kernel based (KIP) ( 34 ) , gradient matching (DC, DSA, IDC) ( 53 ; 51 ; 22 ) , feature alignment (CAFE) ( 44 ) , distribution matching (DM) ( 52 ) , and trajectory matching ( 4 ; 25 ; 49 ) , along with combinations of those ( 54 ; 41 ; 50 ) . In

Read the complete text