FLRSP: Privacy-Preserving Federated Learning Using Randomly Selected Model Parameters Publication type: Original Paper
Sawada, Hiroto, Imaizumi, Shoko, Kiya, Hitoshi · 2026
Read FLRSP: Privacy-Preserving Federated Learning Using Randomly Selected Model Parameters Publication type: Original Paper by Sawada, Hiroto, Imaizumi, Shoko, Kiya, Hitoshi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01204.txt.
Introduction
Hiroto Sawada and two co-authors present FLRSP, a way to make federated learning safer. In federated learning, many clients train a shared model together without handing their data to a central server. The risk is that the updates clients share can leak: an attacker who intercepts them may rebuild the original training data. Past defenses against such attacks usually cost accuracy, so safety and quality traded off against each other.
FLRSP breaks that trade-off by sharing only a random subset of each client's model parameters. Each client computes its full update locally, sends a randomly chosen part of it, and the server folds those parts into the global model. In tests on image classification with a residual network and a vision transformer, under two standard federated rules, the method kept accuracy high while resisting leading reconstruction attacks better than earlier defenses.
Catalog record
| CREATOR | Sawada, Hiroto, Imaizumi, Shoko, Kiya, Hitoshi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.01204
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FLRSP: Privacy-Preserving Federated Learning Using Randomly Selected Model Parameters Publication type: Original Paper Sawada, Hiroto, Imaizumi, Shoko, Kiya, Hitoshi Abstract In this paper, we propose a method for privacy-preserving federated learning that uses randomly selected model parameters to update global models. High-quality deep neural networks (DNN) models require a huge amount of training data in general, but model training raises privacy concerns when dealing with sensitive or personal information. Federated learning is a distributed machine learning framework in which multiple clients and a server train a model collaboratively. However, if the shared updates are compromised, an attacker may reconstruct the original training data. In addition, previous methods for improving robustness generally reduce the accuracy. To overcome these issues, in our method called federated learning using randomly selected model parameters (FLRSP), model parameters computed in each local server are randomly selected and shared to update a global model in a central server. In experiments, image classification tasks were carried out on the ResNet34 architecture and the Vision Transformer (ViT) under the use of Federated Stochastic Gradient Descent (FedSGD) and Federated Averaging (FedAvg), and the results demonstrated our method’s effectiveness in terms of image classification accuracy and robustness against state-of-the-art attacks compared with previous methods. keywords FLRSP, federated learning, vision transformer, privacy preserving, gradient leakage attack 1]Chiba University, Japan 2]Tokyo Metropolitan University, Japan \issuevolumeyear 2025 \issuevolumenumber xx \issueelocation e \articledatabox Received xx xxxxx 2026; Revised xx xxxxx 2026 ISSN 2048-7703; DOI 10.1561/116.xxxxxxxx © 2026 H. Sawada, S. Imaizumi and H. Kiya \OAstatement This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence ( http://creativecommons.org/licenses/by-nc/4.0/ ), which permits unrestricted re-use, distribution, and reproduction in any medium, for non-commercial use, provided the original work is properly cited. \creditline *Corresponding author: Hitoshi Kiya, [email protected]. This study was partially supported by JSPS KAKENHI (Grant Number JP25K07750) and JST CREST (Grant NumberJPMJCR20D3). 1 Introduction Training a high-quality deep neural network (DNN) model requires a huge amount of training data, but model training raises privacy concerns because training data generally includes sensitive or personal information 29 ; 23 ; 26 ; 21 ; 15 . To collect a huge amount of training data, in centralized machine learning, each client prepares information on local data and sends it to a central server for model training. Federated learning (FL) 27 is a learning approach that allows multiple clients to collaboratively train a shared model while keeping their data decentralized and private. In FL, clients participate in the training process using their local data without sharing their raw data. However, several studies have pointed out that some attack methods infer training data from the updated information shared by clients 40 ; 46 ; 28 ; 19 ; 25 ; 17 ; 18 ; 44 ; 7 ; 11 ; 9 . Accordingly, several methods for improving the security of FL, (hereafter "security enhancement methods") have been studied to address this. For differential privacy 6 ; 35 ; 34 ; 14 ; 39 ; 41 ; 45 ; 20 ; 42 ; 1 ; 4 ; 36 ; 30 ; 22 , specific noise is added to updated information to make it more resistant to attacks; however, this degrades model accuracy. Additionally, Lu et al. proposed a security enhancement method that is robust to the gradient leakage attack called Attention PRIvacy Leakage (APRIL) 25 . An effective security enhancement method using perceptual encryption was also proposed 2 . However, both of these methods are only applicable to Vision Transformer (ViT)-based models. That is, they cannot be applied to convolutional neural networks (CNNs). In addition, the initial concept of using random binary weights was introduced in ViT and confirmed that the method is robust against APRIL 32 . It was shown in 32 that using randomly selected gradients makes image restoration attacks more difficult by not sharing a portion of the updated information, while the random selection mechanism is expected to update all parameters eventually. In 32 , information updated at each client is randomly selected at each epoch; therefore, all parameters of the global model are expected to be updated eventually as training proceeds. However, the discussion in 32 is limited to ViT and FedSGD. To address this problem, we expand the initial concept presented in 32 and confirm its effectiveness. We propose federated learning using randomly selected model parameters (FLRSP) as well in which each client randomly selects model parameters before sharing them with the server. The basic concept proposed in 32 is expanded and generalized in the present paper. The main additions include the use of FedAvg in addition to FedSGD, the use of ResNet in addition to ViT, a comparison with differential privacy protection methods, and an evaluation of resilience against image restoration based on adversarial optimization attacks. In experiments, image classification tasks are carried out on the ViT and ResNet34, and the results demonstrate the effectiveness of FLRSP in terms of model accuracy and attack resistance. The contributions of this paper are as follows. (a) We propose a novel FL method to defend against attackers by selecting randomly selected parameters of the global model computed at each local server. (b) We verify that the proposed method outperforms state-of-the-art methods in terms of robustness against attacks and classification accuracy on image classification tasks. The rest of this paper is structured as follows. Section 2 presents related studies on FL, attack methods, and security enhanced methods. Section 3 gives an overview and includes the details of the proposed method, FLRSP. Experiments verifying the effectiveness of the method, including classification accuracy, robustness against attacks, and discussion are presented in Section 4 , and Section 5 concludes this paper. 2 Related Work 2.1 Federated Learning Figure 1 : Overview of FL under FedSGD. FL is a distributed machine learning method that is executed by multiple clients holding datasets and a central server providing learning models, as shown in Fig. 1 27 . The procedure for standard FL is as follows. Step 1: A central server initializes a global model. Step 2: The central server distributes its current global model to each client. Step 3: Each client locally trains the global model with its own training data. Step 4: Each client sends information on the updated model to the server. Step 5: The server aggregates the updated information received from clients and updates the global model. The above steps 2 to 5 are repeated for model training. Each client only sends updated information such as gradients, weights, and bias values to the server, so the dataset is not shared. Here, we focus on Federated Stochastic Gradient Descent (FedSGD) and Federated Averaging (FedAvg) as key algorithms used in FL for updating the global model. In FedSGD, each client sends the gradients of their model back to the central server for each batch training. The server aggregates gradients received from clients and uses them to update the global model. In FedAvg, which is an extension of FedSGD, each client sends the weights and bias values of its model to the central server for each epoch of training. The server aggregates these parameters and computes their arithmetic mean to set as the parameters of the global model. 2.2 Image Restoration