Local Differential Privacy via Dynamic Quantization in Distributed Online Stochastic Optimization footnoteinfo
Zhiguo Zhang, Cheng Kui, Qian Ma, Dongrui Wu · 2026
Read Local Differential Privacy via Dynamic Quantization in Distributed Online Stochastic Optimization footnoteinfo by Zhiguo Zhang, Cheng Kui, Qian Ma, Dongrui Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29845.txt.
Introduction
Zhiguo Zhang, Cheng Kui, Qian Ma, and Dongrui Wu design distributed online learning that keeps each agent's messages private. A changing random quantizer masks data before it travels, so exchanges hide what each agent holds. The method still converges to the best answer and grants each agent local differential privacy even as rounds run on. It works fully spread out, with no center, on directed links between agents. Tests on mushrooms, digits, and brain signals back the design, the first to pair exact convergence with local privacy on directed graphs.
Catalog record
| CREATOR | Zhiguo Zhang, Cheng Kui, Qian Ma, Dongrui Wu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83540 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29845
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Local Differential Privacy via Dynamic Quantization in Distributed Online Stochastic Optimization footnoteinfo Zhiguo Zhang, Cheng Kui, Qian Ma, Dongrui Wu Abstract Distributed online stochastic optimization has received extensive attention in large-scale distributed learning and other related fields due to its unique advantage in processing streaming data. However, information exchange through the communication network during the optimization process may lead to privacy leakage. To address this issue, this paper proposes a locally differentially private distributed online stochastic optimization algorithm that employs an elaborately designed dynamic stochastic quantizer to mask the exchanged information prior to communication. Theoretical analysis shows that the proposed algorithm not only converges almost surely to the optimal solution but also achieves ( 0 , δ i ) (0,\delta^{i}) -local differential privacy for each agent i i even when the number of iterations tends to infinity. Furthermore, the algorithm is fully distributed and applicable to scenarios where the interaction network among agents is a directed graph. To the best of our knowledge, this is the first work on distributed online stochastic optimization that simultaneously achieves exact convergence and rigorous local differential privacy over a directed graph by exploiting quantization effects. Numerical experiments of distributed online training on the mushroom classification dataset, handwritten digits recognition dataset, and brain-computer interface dataset verify the effectiveness of the proposed method. keywords Distributed online stochastic optimization; local differential privacy; dynamic stochastic quantizer; directed graph. † † thanks: [ † † address: School of Automation, Nanjing University of Science and Technology, Nanjing 210094, China † † address: Key Laboratory of the Ministry of Education for Image Processing and Intelligent Control, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China footnoteinfo]The material in this paper was not presented at any conference. Corresponding author: Qian Ma. , , , 1 Introduction Distributed optimization has received considerable attention due to its significant role in smart grids, sensor networks, large-scale machine learning, and other areas [ 1 , 2 , 3 , 4 , 5 ] . In a typical distributed optimization problem, each agent cooperates with its neighbors by exchanging information to minimize (or maxmize) the sum of all local cost (or payoff) functions, where each agent has access only to its own local function. Note that precise gradients are often unavailable or computationally expensive in many practical applications, which has driven the development of distributed stochastic optimization. Many significant works have been proposed, see [ 6 , 7 , 8 , 9 , 10 ] and the references therein. Among them, reformulating distributed stochastic optimization as an empirical risk minimization (ERM) problem allows for the approximate estimation of the original optimal solution from observed data. However, the traditional ERM method requires all data to be available in advance, which makes it incapable of handling sequentially arriving data. This gave rise to distributed online stochastic optimization, and numerous achievements have been made in this field, such as [ 11 , 12 , 13 , 14 , 15 ] . Notably, the information exchange process over the communication network in distributed optimization may lead to privacy leakage. For example, while multiple power plants in a smart grid coordinate their generation capacities to minimize total electricity costs, they need to protect the privacy of their generating information, which is sensitive in energy sales bidding. In fact, attackers are able to recover the exact original data from the shared gradients or model updates in the absence of privacy-preserving mechanisms [ 16 ] . Therefore, it is of great significance to develop distributed optimization algorithms with privacy protection. A homomorphic encryption-based distributed projection gradient algorithm was proposed in [ 17 ] , allowing participants to keep the shared information encrypted throughout the optimization procedure. Neverthless, the homomorphic encryption technique involves complex ciphertext computations, leading to high computational and communication costs. In [ 18 ] , the privacy-preserving distributed optimization was achieved by adding a constant uncertain parameter to the projection step. In [ 19 ] , correlated noise was injected to obfuscate the information transmitted between agents, which reduces the risk of privacy leakage in distributed optimization. However, since the randomness introduced in [ 18 ] and [ 19 ] is interrelated, the level of the privacy protection is limited. Recently, differential privacy (DP) has gradually become the mainstream approach for privacy protection in distributed optimization due to its strong resistance to arbitrary post-processing and auxiliary information [ 20 ] . The common implementation of DP involves injecting irrelevant noise into the exchanged information to prevent eavesdroppers from accurately inferring the private information of individual agents. While significant progress has been made in differentially private distributed optimization (see [ 21 , 22 , 23 , 24 ] ), a common limitation of these works is the trade-off between convergence accuracy and privacy protection level. In other words, strong privacy protection is achieved at the expense of convergence accuracy. By introducing a weakening factor into iteration to mitigate the impact of DP noise, Wang et al. in [ 25 ] simultaneously achieved accurate convergence and a finite privacy budget, even with an infinite number of iterations. Subsequently, many other works have emerged based on this approach, as seen in [ 26 , 27 , 28 ] . More importantly, [ 28 ] adopted a local differential privacy (LDP) framework, which is a local (distributed) model of DP designed for scenarios where all communication channels may be compromised by malicious attackers and no agent is trustworthy. Compared with the traditional DP framework in [ 21 , 22 , 23 , 24 , 25 , 26 , 27 ] , this LDP framework provides a significantly more stringent privacy guarantee under a much weaker trust model. In addition to adding random noise, quantization effects offer another technical approach that not only achieves DP but also reduces communication overhead. In the pioneering work [ 29 ] , Wang et al. proposed a distributed stochastic optimization algorithm that achieves DP via quantization. Specifically, by introducing a random ternary quantizer to quantize any exchanged information into three numerical levels before transmission, precise convergence and strict (0,\delta) -DP guarantee at each iteration were achieved by the proposed algorithm. However, it is worth noting that this algorithm will degenerate to (0,1) -DP as the number of iterations tends to infinity, which is equivalent to directly outputting sensitive information. Moreover, the quantizer’s stepsize in [ 29 ] is required to be larger than the infinite norm of the decision variable, which is difficult to guarantee in practice. To address the privacy leakage in cooperative bandit games, a scheme combining stochastic quantization with a binary stochastic response was adopted in [ 30 ] to mask the action estimation before communication. This scheme achieves the same order of regret bound as the non-private setting while maintaining strict (\epsilon,0) -DP at each iteration. However, the aforementioned algorithm cannot ensure a finite privacy budget over infinite iterations, meaning that sensitive information may no longer be effectively protected as the iteration count grows. Furthermore, both [ 29 ] and [ 30 ] adopt the traditional DP framework, which implicitly assumes mutual trust among agents and the presence of a centralized data aggregator capable of determining the amount of injected noise.