Privacy-aware Berrut Approximated Coded Computing applied to general distributed learning
Xavier Martínez-Luaña, Manuel Fernández-Veiga, Rebeca P. Díaz-Redondo, Ana Fernández-Vilas · 2025
Read Privacy-aware Berrut Approximated Coded Computing applied to general distributed learning by Xavier Martínez-Luaña, Manuel Fernández-Veiga, Rebeca P. Díaz-Redondo, Ana Fernández-Vilas (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06759.txt.
Introduction
Xavier Martínez-Luaña and three co-authors present a 2025 paper on adding privacy to federated learning with coded computing. In federated learning, many parties train a shared model without pooling raw data. Coded computing can shield the math, but most schemes demand exact arithmetic and special function types. The team adapts a private approximate scheme, shortened to PBACC, to three learning setups of rising spread.
Their versions cover central gathering, central data with spread training, and fully spread data and training. Tests on image networks, generative models, and a medical survival model showed quality barely changed. Measured privacy leakage stayed under a fraction of one bit per participant. Encoding cost grows only with how spread the data are. The authors present the scheme as a general privacy tool for distributed learning.
Catalog record
| CREATOR | Xavier Martínez-Luaña, Manuel Fernández-Veiga, Rebeca P. Díaz-Redondo, Ana Fernández-Vilas |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-06759
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Privacy-aware Berrut Approximated Coded Computing applied to general distributed learning Xavier Martínez-Luaña, Manuel Fernández-Veiga, Rebeca P. Díaz-Redondo, Ana Fernández-Vilas Abstract Coded computing is one of the techniques that can be used for privacy protection in Federated Learning. However, most of the constructions used for coded computing work only under the assumption that the computations involved are exact, generally restricted to special classes of functions, and require quantized inputs. This paper considers the use of Private Berrut Approximate Coded Computing (PBACC) as a general solution to add strong but non-perfect privacy to federated learning. We derive new adapted PBACC algorithms for centralized aggregation, secure distributed training with centralized data, and secure decentralized training with decentralized data, thus enlarging significantly the applications of the method and the existing privacy protection tools available for these paradigms. Particularly, PBACC can be used robustly to attain privacy guarantees in decentralized federated learning for a variety of models. Our numerical results show that the achievable quality of different learning models (convolutional neural networks, variational autoencoders, and Cox regression) is minimally altered by using these new computing schemes, and that the privacy leakage can be bounded strictly to less than a fraction of one bit per participant. Additionally, the computational cost of the encoding and decoding processes depends only of the degree of decentralization of the data. I Introduction Coded computing has recently received attention as an effective solution to solve privacy and security problems in centralized and decentralized computing systems, especially in machine learning frameworks [ 1 , 2 , 3 , 4 , 5 ] . By using computations in the coded domain, these systems can work robustly against the presence of servers or clients that delay their responses or fail to finish a local computing task [ 5 ] (straggler nodes), can be protected against adversarial servers that corrupt the information that the learning algorithm uses [ 6 ] , and can enforce privacy guarantees to the input and output values in multi-party computation schemes [ 7 , 8 ] . Most of the existing coded computing techniques seek exact recovery of the outputs, where one or more servers attempt to obtain the exact value of some function from its encoded arguments. Examples of broad classes of functions that are amenable to this requirement of perfect recovery are typically structured computing tasks, like matrix multiplications [ 9 , 10 , 11 , 12 , 13 ] or polynomial evaluations [ 14 , 15 , 16 ] . However, these methods operate with the restriction that the input/output values must belong to a certain finite field, and additionally suffer from a crisp threshold for recovery, since exact values can be calculated only if the number of stragglers or malicious nodes is below a limit. Above such limit, the computing task fails and no useful value is produced [ 15 ] . These limitations are not well matched to the requirements of current distributed machine learning applications, in which many algorithms rely on computations lacking a specific structure or a decomposition property that simplifies the task. In these contexts, additionally, the computations often involve non-linear functions (e.g., ReLU units in a neural network [ 17 ] ) not supported by classical coded computing methods, and operate over real or complex numbers directly instead of on discrete or quantized samples. Moreover, when computations are performed over the real numbers domain, approximate values for both the input and output values suffice, because the algorithms are iterative and not particularly sensitive to small errors in each round [ 8 ] . In response to this, approximate coded computing has emerged as a generalized approach to handle computing problems over a wider class of real- and complex-valued functions and, with the relaxation consisting of performing only approximate computations, to reduce significantly the amount of computing resources needed for completion of the task [ 18 , 19 ] . While approximate recovery introduces errors in the computed function values, this error vanishes as the number of honest or non-straggler nodes increases, which is beneficial and practical for large distributed computing applications composed of hundreds of nodes. Two approaches, Berrut Approximated Coded Computing (BACC [ 4 ] ) and Learning Theoretic Coded Computing (LeTCC [ 20 ] ) have been proposed in the recent literature as general approximate coded computing solutions. BACC uses a barycentric approximation to evaluate the target function and has an approximation error that decreases quadratically in the number n of honest nodes. LeTCC, in contrast, adopts an original approach in which the encoding and decoding functions used for computations and recovery are learned under the constraint of minimizing a loss function. As a consequence of being formulated as an optimization problem, its approximation error is lower, it decreases as n^{-3} . However, neither BACC nor LeTCC provide input or output privacy guarantees to the approximately computed values. In our previous work [ 21 ] we extended BACC to support privacy, where the privacy metric is specified as a bound on the mutual information between the encoded inputs and the output values. Yet, although our PBACC (Private BACC) provides input privacy in federated learning (FL) scenarios, this is not sufficient for exploiting the advantages of generalized coded computing in other important distributed computing systems, like in distributed learning with or in learning over decentralized private data. In this paper, we solve the integration of PBACC in this broader setting, focusing on decentralized federated learning architectures with privacy-preserving training and aggregation. Specifically, • We extend and adapt PBACC to distributed computing tasks where data is decentralized, i.e., there are many data owners who in addition wish to preserve privacy on their data. The improved PBACC scheme can therefore be used for secure aggregation and for secure training in distributed learning systems. • PBACC is then integrated within Convolutional Neural Networks (CNN) and Variational Auto Encoders (VAE), including the loss function and gradient calculation. Thus, we demonstrate the usefulness of the scheme for arbitrary function evaluations. • Our extensive numerical experiments show that PBACC can actually be leveraged in a variety of distributed computing cases, both for centralized and decentralized data, and for secure aggregation of models or secure training at the clients as well. It also works efficiently for different machine learning models. The experimental tests comprise a variety of network configurations, where the main threat comes from a fraction of honest but curious nodes. The rest of the paper is organized as follows. Section II briefly reviews some relevant literature related to our work. Section III describes PBACC, the selected scheme to be integrated in the distributed learning scenarios, and this is generalized in Section IV to make it feasible and practical for different types of configurations and ML models. Section V presents in detail the different versions of our scheme as they have to be used into centralized aggregation, decentralized aggregation, and decentralized training. This is followed by a discussion on their privacy properties and the form that PBACC should be integrated in each case, in Section VI . In Section VII , we describe all the tests performed for PBACC, and we discuss the results obtained. To finish, Section VIII summarizes the main conclusions of this work,