Forward Learning with Differential Privacy
Mingqian Feng, Zeliang Zhang, Jinyang Jiang, Yijie Peng, Chenliang Xu · 2025
Read Forward Learning with Differential Privacy by Mingqian Feng, Zeliang Zhang, Jinyang Jiang, Yijie Peng, Chenliang Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-00411.txt.
Introduction
Mingqian Feng and co-authors build a privacy-preserving training method for deep networks that learns forward only, in a paper from two thousand twenty-five. Standard private training clips gradients and adds noise during backward learning passes. Forward methods instead add noise up front and guess gradients from randomness, hinting at built-in privacy.
Their method adds a rejection-based batch sampling step with its own privacy proof. A controller adjusts noise each step to spend the privacy budget wisely. Tests matched the accuracy of standard private training at nearly the same privacy cost. The result opens a backward-free route to private learning.
Catalog record
| CREATOR | Mingqian Feng, Zeliang Zhang, Jinyang Jiang, Yijie Peng, Chenliang Xu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-00411
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Forward Learning with Differential Privacy Mingqian Feng, Zeliang Zhang, Jinyang Jiang, Yijie Peng, Chenliang Xu Abstract Differential privacy (DP) in deep learning is a critical concern as it ensures the confidentiality of training data while maintaining model utility. Existing DP training algorithms provide privacy guarantees by clipping and then injecting external noise into sample gradients computed by the backpropagation algorithm. Different from backpropagation, forward-learning algorithms based on perturbation inherently add noise during the forward pass and utilize randomness to estimate the gradients. Although these algorithms are non-privatized, the introduction of noise during the forward pass indirectly provides internal randomness protection to the model parameters and their gradients, suggesting the potential for naturally providing differential privacy. In this paper, we propose a privatized forward-learning algorithm, Differential Private Unified Likelihood Ratio (DP-ULR), and demonstrate its differential privacy guarantees. DP-ULR features a novel batch sampling operation with rejection, of which we provide theoretical analysis in conjunction with classic differential privacy mechanisms. DP-ULR is also underpinned by a theoretically guided privacy controller that dynamically adjusts noise levels to manage privacy costs in each training step. Our experiments indicate that DP-ULR achieves competitive performance compared to traditional DP training algorithms based on backpropagation, maintaining nearly the same privacy loss limits. Figure 1: Compared to traditional training algorithms, forward learning adds noise during the forward pass and estimates naturally randomized gradients, leading to a potential free lunch of differential privacy. 1 Introduction Deep neural networks have made substantial advancements across various domains, such as image recognition ( Meng et al., 2022 ; Dosovitskiy et al., 2020 ; Zhao et al., 2020 ) , natural language processing ( Deng & Liu, 2018 ; Meng et al., 2022 ; Han et al., 2021 ) , and autonomous driving ( Huang et al., 2018 ; Häuslschmid et al., 2017 ; Chen et al., 2015 ) . However, training these models often involves vast amounts of data, including personal data gathered from the Internet, exacerbating privacy concerns. It has been well-documented that neural networks do not merely learn from data but can also memorize specific instances ( Carlini et al., 2019 ; Carlini et al., 2021 ) . Differential privacy (DP) has emerged as a widely accepted metric for assessing the leakage of sensitive information in data ( Liu et al., 2024a ) . In the realm of model training, DP mechanisms (algorithms) aim to ensure that the presence or absence of any single data sample does not significantly influence the learned parameters. The most popular learning algorithm, Differentially Private Stochastic Gradient Descent (DP-SGD) ( Abadi et al., 2016 ) , employs a typical strategy to safeguard privacy: assessing algorithms’ sensitivity and introducing randomness by adding random noise to their final output. The manually introduced randomness breaks the deterministic of the computed gradient and protects privacy. However, there are many problems when deploying DP-SGD. First, it needs to compute the gradient of each sample individually, causing huge time consumption compared to traditional non-private algorithms. Second, it needs the full knowledge of the computational graph due to backpropagation, while any insertion of black-box modules in the pipeline would block the use of DP-SGD. Third, it needs all operations to be differentiable, while many advanced models use non-differentiable activations, such as spiking neural networks ( Tavanaei et al., 2019 ) . Different from deterministic backpropagation-based methods, forward-learning algorithms ( Peng et al., 2022 ; Hinton, 2022 ; Salimans et al., 2017 ) employ perturbation or Monte Carlo simulations to estimate the gradient directly, bypassing the need for backpropagation based on the chain rule. Compared to backpropagation-based methods, forward-learning algorithms offer several advantages, including high parallelizability, suitability for non-differentiable modules, and applicability in black-box settings ( Jiang et al., 2023 ) . Moreover, as depicted in Figure 1 , perturbation during the forward pass naturally breaks the deterministic optimizations and results in randomized converged parameters, providing a potential ”free lunch” for equipping the model with DP. Consequently, an intuitive question arises: How could we utilize the inherent randomness in forward-learning algorithms to achieve differential privacy? To answer this question, we investigate the state-of-the-art forward-learning algorithm, the Unified Likelihood Ratio (ULR) method ( Jiang et al., 2023 ) . The ULR algorithm adds noise to intermediate values, e.g., each layer logit, during the forward propagation and utilizes theoretical tools to estimate the parameter gradients. While ULR inherently provides randomized gradients, there is still a gap in fully achieving differentially private learning. In this paper, to address this gap, we propose a privatized forward-learning algorithm, Differentially Private Unified Likelihood Ratio (DP-ULR), and provide a theoretical analysis of its differential privacy guarantees. DP-ULR distinguishes itself from ULR and achieves DP by incorporating novel elements, including the sampling-with-rejection strategy and the theoretically guided differential privacy controller. Although not treating DP-ULR as a drop-in replacement for DP-SGD, our theoretical analysis and experimental findings reveal that DP-ULR demonstrates nearly the same differential privacy properties and competitive utility in practice compared to DP-SGD. Our contributions are summarized as follows: • We propose a novel sampling-with-rejection technique and theoretically analyze its impact on differential privacy in conjunction with the Gaussian mechanism. • We introduce DP-ULR, a forward-learning differential privacy algorithm that integrates our sampling-with-rejection strategy and a well-designed differential privacy cost controller. • We provide a comprehensive theoretical analysis of the differential privacy guarantees of our DP-ULR algorithm, establishing a general DP bound under typical conditions. • We validate the effectiveness of our algorithm with MLP and CNN models on the MNIST and CIFAR-10 datasets. 2 Background and Related Work 2.1 Differential Privacy Differential privacy ( Dwork, 2006 ; Dwork et al., 2006b ; Dwork et al., 2006a ) is the gold standard for data privacy in controlling the disclosure of individual information. It is formally defined as the following: Definition 2.1 ( (\epsilon,\delta) -DP ( Dwork et al., 2006a ) ) . A randomized mechanism \mathcal{M}\colon\mathcal{D}\rightarrow\mathcal{R} with domain \mathcal{D} and range \mathcal{R} , satisfies (\epsilon,\delta) -differential privacy if for any adjacent inputs D,D^{\prime}\in\mathcal{D} and any subset of outputs S\subseteq\mathcal{R} it holds that \text{Pr}[\mathcal{M}(D)\in S]\leq e^{\epsilon}\text{Pr}[\mathcal{M}(D^{\prime})\in S]+\delta. (1) The traditional privacy analysis of existing learning algorithms is obtained through Rényi Differential Privacy ( Mironov, 2017 ; Mironov et al., 2019 ) , which is defined with Rényi divergence. Definition 2.2 (Rényi divergence ( Mironov, 2017 ; Mironov et al., 2019 ) ) . Let P and Q be two distributions (random variables) defined over the same probability space, and let p and q be their respective probability density functions. The Rényi divergence of a finite order \alpha\neq 1 between P and Q is defined as \mathrm{D}_{\alpha}\left(P\;\middle\|\;Q\right)\coloneqq\frac{1}{\alpha-1}\ln\mathbb{E}_{x\sim q}\left(\frac{p(x)}{q(x)}\right)^{\alpha} (2) Rényi divergence at \alpha=1,\infty are defined by continuity. Definition 2.3 (Rényi differential privacy (RDP) ( Mironov, 2017 ; Mironov et al., 2019 ) ) . We say that a randomized mechanism \mathcal{M}\colon\mathcal{D}\to\mathcal{R} satisfies (\alpha,\gamma) -Rényi differential privacy (RDP) if for any two adjacent inputs D,D^{\prime}\in\mathcal{D} it holds that \mathrm{D}_{\alpha}\left(\mathcal{M}(D)\;\middle\|\;\mathcal{M}(D^{\prime})\right)\leq\gamma. (3) In this work, we use RDP to track privacy because of its outstanding composition property. Specifically, a sequence of (\alpha,\gamma_{i}) -RDP algorithms satisfies an additive RDP with (\alpha,\sum_{i}\gamma_{i}) . Moreover, the following proposition serves as a tool to transform the (\alpha,\gamma) -RDP to traditional (\epsilon,\delta) -DP. Proposition 2.4 (From (\alpha,\gamma) -RDP to (\epsilon,\delta)