Mitigating Disparate Impact of Differentially Private Learning through Bounded Adaptive Clipping
Linzh Zhao, Aki Rehn, Mikko A. Heikkilä, Razane Tajeddine, Antti Honkela · 2025
Read Mitigating Disparate Impact of Differentially Private Learning through Bounded Adaptive Clipping by Linzh Zhao, Aki Rehn, Mikko A. Heikkilä, Razane Tajeddine, Antti Honkela (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01396.txt.
Description
Linzh Zhao and four colleagues fix a fairness flaw in privacy-preserving machine learning. Differential privacy adds noise so no one's data leaks, but the noise hits minority groups hardest. Training clips large gradients, and rare, hard examples produce exactly those.
Adaptive clipping makes it worse by shrinking the clip limit to suit the easy majority. The team's bounded version sets a floor under that limit. Worst-class accuracy rose by more than ten points on skewed test sets compared with the unbounded method. The fix is a small change with an outsized effect on the groups privacy methods usually leave behind.
Catalog record
| CREATOR | Linzh Zhao, Aki Rehn, Mikko A. Heikkilä, Razane Tajeddine, Antti Honkela |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-01396