CENSOR: Defense Against Gradient Inversion via Orthogonal Subspace Bayesian Sampling

Kaiyuan Zhang, Siyuan Cheng, Guangyu Shen, Bruno Ribeiro, Shengwei An, Pin-Yu Chen † , Xiangyu Zhang, Ninghui Li · 2025

Read CENSOR: Defense Against Gradient Inversion via Orthogonal Subspace Bayesian Sampling by Kaiyuan Zhang, Siyuan Cheng, Guangyu Shen, Bruno Ribeiro, Shengwei An, Pin-Yu Chen † , Xiangyu Zhang, Ninghui Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15718.txt.

Description

Kaiyuan Zhang and co-authors defend federated learning against attacks that rebuild private data from shared gradients. Their 2025 paper, CENSOR, addresses a leak at the heart of the federated setup: clients send model updates, not data, yet modern inversion attacks can recover training examples from those updates. Recent attacks outrun the older defenses.

Their defense exploits the vast size of big models. Updates are perturbed inside a carefully chosen subspace, sampled by a Bayesian route, so the private signal is scrambled while the useful learning survives. The method is tailored to large networks, where the extra dimensions give the defense room to hide.

Catalog record

CREATORKaiyuan Zhang, Siyuan Cheng, Guangyu Shen, Bruno Ribeiro, Shengwei An, Pin-Yu Chen † , Xiangyu Zhang, Ninghui Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-15718

Browse the full library · About the Tower of Babel