Fair Finetuning Mitigates Distribution Inference Attacks

Rakshit Naidu · 2026

Read Fair Finetuning Mitigates Distribution Inference Attacks by Rakshit Naidu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01719.txt.

Description

Naidu shows that fair fine-tuning can block distribution inference attacks. Models trained on sensitive data can leak population-level facts. An attacker with black-box access infers demographic properties of the training set. No training data is observed directly in that attack. Defenses like differential privacy exist, but the fairness link was unexplored. Fair Fine-tuning fine-tunes a model on the complementary distribution. An Equalized Odds constraint governs that fine-tuning pass. He proves a tight bound on adversarial advantage.

The bound is the EO disparity times a distinguishability factor W. A necessary condition for the method to help is also proved. Six datasets span tabular, image, and NLP data. Rehearsal-based fine-tuning drops the accuracy gap below detection thresholds. On ACS Income it falls from about 15 percent to under 4 percent.

Catalog record

CREATORRakshit Naidu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.01719

Browse the full library · About the Tower of Babel