Do Fairness Interventions Come at the Cost of Privacy: Evaluations for Binary Classifiers

Huan Tian, Guangsheng Zhang, Bo Liu, Tianqing Zhu*, Ming Ding, Wanlei Zhou · 2025

Read Do Fairness Interventions Come at the Cost of Privacy: Evaluations for Binary Classifiers by Huan Tian, Guangsheng Zhang, Bo Liu, Tianqing Zhu*, Ming Ding, Wanlei Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-06150.txt.

Description

Huan Tian and colleagues ask if making a classifier fairer makes it leak more private data. In-processing fairness methods curb biased forecasts. But their effect on privacy was little studied. The team tests fair binary classifiers against two standard attacks. One is membership inference, which tests if a person's data was in training. One is attribute inference, which guesses traits that are sensitive.

Fairness steps did not, as a surprise, hurt privacy as a rule. Fair models often fought off both attacks better. The steps seem to strip sensitive facts from traits that are pulled out. They also lower confidence on most training cases. But the study also found a threat path. To use gaps between fair and biased models powers stronger attacks of both kinds. Broad tests confirm the results.

Catalog record

CREATORHuan Tian, Guangsheng Zhang, Bo Liu, Tianqing Zhu*, Ming Ding, Wanlei Zhou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-06150

Browse the full library · About the Tower of Babel