Analyzing and Optimizing Perturbation of DP-SGD Geometrically

Jiawei Duan ∗ , Haibo Hu ∗ , Qingqing Ye ∗ , Xinyue Sun † ∗ The Hong Kong Polytechnic University † Harbin Institute of Technology [email protected]; [email protected]; [email protected]; [email protected] · 2025

Read Analyzing and Optimizing Perturbation of DP-SGD Geometrically by Jiawei Duan ∗ , Haibo Hu ∗ , Qingqing Ye ∗ , Xinyue Sun † ∗ The Hong Kong Polytechnic University † Harbin Institute of Technology [email protected]; [email protected]; [email protected]; [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05618.txt.

Introduction

Jiawei Duan, Haibo Hu, Qingqing Ye, and Xinyue Sun analyze privacy noise in training geometrically in a 2025 paper. Differentially private gradient descent adds noise to protect training data. That noise often wrecks model efficiency for unclear reasons. The team derives exactly how the noise harms training.

Their analysis separates noise on gradient direction from noise on size. Direction noise does the eminent damage to efficiency. Size noise can be tamed by clipping and learning rate choices. Standard private noise turns out biased on direction, a subtle flaw. A geometric strategy perturbs direction and magnitude separately. It cuts direction noise while keeping the same privacy guarantee. Experiments on image benchmarks confirm the efficiency gains. Two public sets and one synthetic set were used. The authors call the classic perturbation geometrically suboptimal. Their fix offers a principled replacement for private training.

Catalog record

CREATORJiawei Duan ∗ , Haibo Hu ∗ , Qingqing Ye ∗ , Xinyue Sun † ∗ The Hong Kong Polytechnic University † Harbin Institute of Technology [email protected]; [email protected]; [email protected]; [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-05618

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Analyzing and Optimizing Perturbation of DP-SGD Geometrically Jiawei Duan ∗ , Haibo Hu ∗ , Qingqing Ye ∗ , Xinyue Sun † ∗ The Hong Kong Polytechnic University † Harbin Institute of Technology [email protected]; [email protected]; [email protected]; [email protected] Abstract Differential privacy (DP) has become a prevalent privacy model in a wide range of machine learning tasks, especially after the debut of DP-SGD. However, DP-SGD, which directly perturbs gradients in the training iterations, fails to mitigate the negative impacts of noise on gradient direction. As a result, DP-SGD is often inefficient. Although various solutions (e.g., clipping to reduce the sensitivity of gradients and amplifying privacy bounds to save privacy budgets) are proposed to trade privacy for model efficiency, the root cause of its inefficiency is yet unveiled. In this work, we first generalize DP-SGD and theoretically derive the impact of DP noise on the training process. Our analysis reveals that, in terms of a perturbed gradient, only the noise on direction has eminent impact on the model efficiency while that on magnitude can be mitigated by optimization techniques, i.e., fine-tuning gradient clipping and learning rate. Besides, we confirm that traditional DP introduces biased noise on the direction when adding unbiased noise to the gradient itself. Overall, the perturbation of DP-SGD is actually sub-optimal from a geometric perspective. Motivated by this, we design a geometric perturbation strategy GeoDP within the DP framework, which perturbs the direction and the magnitude of a gradient, respectively. By directly reducing the noise on the direction, GeoDP mitigates the negative impact of DP noise on model efficiency with the same DP guarantee. Extensive experiments on two public datasets (i.e., MNIST and CIFAR-10), one synthetic dataset and three prevalent models (i.e., Logistic Regression, CNN and ResNet) confirm the effectiveness and generality of our strategy. I Introduction Although deep learning models have numerous applications in various domains, such as personal recommendation and healthcare, the privacy leakage of training data from these models has become a growing concern. There are already mature attacks which successfully reveal the contents of private data from deep learning models [ 1 , 2 ] . For example, a white-box membership inference attack can infer whether a single data point belongs to the training dataset of a DenseNet with 82% test accuracy [ 3 ] . These attacks pose imminent threats to the wider adoption of deep learning in business sectors with sensitive data, such as healthcare and fintech. To address this concern, differential privacy (DP), which can provide quantitative amount of privacy preservation to individuals in the training dataset, is embraced by the most prevalent optimization technique of model training, i.e., stochastic gradient descent (SGD). Referred to as DP-SGD [ 4 , 5 , 6 , 7 ] , this algorithm adds random DP noise to gradients in the training process so that attackers cannot infer private data from model parameters with a high probability. However, a primary drawback of DP-SGD is the ineffective training process caused by the overwhelming noise, which extremely deteriorates the model efficiency. Although much attention [ 8 , 9 , 10 ] has been paid on reducing the noise scale, the majority of existing solutions, which numerically add DP noise to gradients, do not exploit the geometric nature of SGD (i.e., descending gradient to locate the optima). As reviewed in Section II-C , SGD exhibits a distinctive geometric property — the direction of a gradient rather than the magnitude determines the descent trend. By contrast, regular DP algorithms, such as the Gaussian mechanism [ 11 ] , was originally designed to preserve numerical (scalar) values rather than vector values. As such, there is a distinct gap between directional SGD and numerical DP perturbation, causing at least two limitations in DP-SGD. First, existing optimization techniques of SGD (i.e., fine-tuning clipping and learning rate) , which can effectively reduce the noise on the magnitude of a gradient, cannot alleviate the negative impact on the direction , as illustrated by Example 1 . Second, traditional DP introduces biased noise on the direction of a gradient , even if the total noise to the gradient is unbiased (proved in Lemma 1 ). As a result, the perturbation of traditional DP-SGD is only sub-optimal from a geometric perspective. Example 1 . Suppose that we have a two-dimensional gradient \boldsymbol{g}=(1,\sqrt{3}) with its direction \boldsymbol{\theta}=\arctan(\sqrt{3}/{1})=\pi/3 and magnitude \|\boldsymbol{g}\|=\sqrt{1+3}=2 . Given clipping threshold C_{1}=2 , we add noise \boldsymbol{n}_{1}=(0.3,0.15) to the clipped gradient \tilde{\boldsymbol{g}}_{1}=\boldsymbol{g}/\max\left\{1,\|\boldsymbol{g}\|/C_{1}\right\}=(1,\sqrt{3}) and derive the perturbed direction \boldsymbol{\theta}^{*}_{1}=\arctan\frac{\sqrt{3}+0.15}{1+0.3}\approx 0.97 . If C_{2}=1 , the clipped gradient and the noise would be \tilde{\boldsymbol{g}}_{2}=\boldsymbol{g}/\max\left\{1,\|\boldsymbol{g}\|/C_{2}\right\}=(\frac{1}{2},\frac{\sqrt{3}}{2}) and \boldsymbol{n}_{2}=\boldsymbol{n}_{1}/(C_{1}/C_{2})=(0.15,0.075) , respectively, as per DP-SGD [ 8 ] . Still, the perturbed direction is \boldsymbol{\theta}^{*}_{2}=\arctan\frac{\frac{\sqrt{3}}{2}+0.075}{\frac{1}{2}+0.15}\approx 0.97 . Although the noise scale is successfully reduced by gradient clipping ( \|\boldsymbol{n}_{2}\|<\|\boldsymbol{n}_{1}\| ), the perturbation on the direction of a gradient remains the same ( \boldsymbol{\theta}^{*}_{2}=\boldsymbol{\theta}^{*}_{1} ). Fig. 1: Comparing MSEs of GeoDP and DP on preserving directions and values of gradients under synthetic dataset (composed of gradients from CNN training, as introduced in Section VI-A ). While \theta and g label the MSE of perturbed directions and gradients themselves, experimental results confirm that GeoDP achieves smaller MSEs on perturbed directions (i.e., the red line is below the black one), while sacrificing the accuracy of perturbed gradients (i.e., the green line is above the blue one). In general, GeoDP better preserves directions of gradients while traditional DP only excels in preserving numerical values of gradients. In this paper, we propose a geometric perturbation strategy GeoDP to address these limitations. First, we theoretically derive the impact of DP noise on the efficiency of DP-SGD. Proved by this fine-grained analysis, the perturbation of DP-SGD, which introduces biased noise to the direction of a gradient, is actually sub-optimal. Inspired by this, we propose a geometric perturbation strategy GeoDP which perturbs both the direction and the magnitude of a gradient, so as to relieve the noisy gradient direction and optimize model efficiency with the same DP guarantee. Figure 1 illustrates empirical performances of GeoDP and DP to support the superiority of GeoDP in the perspective of geometry. Such experimental results can also be confirmed in our theoretical analysis. In summary, our main contributions are as follows: • To the best of our knowledge, we are the first to prove that the perturbation of traditional DP-SGD is actually sub-optimal from a geometric perspective. • Within the classic DP framework, we propose a geometric perturbation strategy GeoDP to directly add the noise on the direction of a gradient, which rigorously guarantees a better trade-off between privacy and efficiency. • Extensive experiments on public datasets as well as prevalent AI models validate the generality and effectiveness of GeoDP. The rest of this paper is organized as follows. Section II reviews the related literature. Section III introduces basic concepts as well as formulating problems. Section IV presents our theoretical analysis on deficiency of DP-SGD while Section V presents the perturbation strategy GeoDP . Experimental results are in Section VI , followed by a conclusion in Section VII . II Literature review In this section, we review related works from three aspects: DP, SGD and their crossover works DP-SGD. II-A Differential Privacy (DP) DP [ 11 , 12 ] is a framework designed to

Read the complete text