Fair Finetuning Mitigates Distribution Inference Attacks
Rakshit Naidu · 2026
Read Fair Finetuning Mitigates Distribution Inference Attacks by Rakshit Naidu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01719.txt.
Description
Naidu shows that fair fine-tuning can block distribution inference attacks. Models trained on sensitive data can leak population-level facts. An attacker with black-box access infers demographic properties of the training set. No training data is observed directly in that attack. Defenses like differential privacy exist, but the fairness link was unexplored. Fair Fine-tuning fine-tunes a model on the complementary distribution. An Equalized Odds constraint governs that fine-tuning pass. He proves a tight bound on adversarial advantage.
The bound is the EO disparity times a distinguishability factor W. A necessary condition for the method to help is also proved. Six datasets span tabular, image, and NLP data. Rehearsal-based fine-tuning drops the accuracy gap below detection thresholds. On ACS Income it falls from about 15 percent to under 4 percent.
Catalog record
| CREATOR | Rakshit Naidu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.01719