SLVR: Securely Leveraging Client Validation for Robust Federated Learning Jihye Choi, Sai Rahul Rachuri, Ke Wang, Somesh Jha, Yizhen Wang Abstract Federated Learning (FL) enables collaborative model training while keeping client data private. However, exposing individual client updates makes FL vulnerable to reconstruction attacks. Secure aggregation mitigates such privacy risks but prevents the server from verifying the validity of each client update, creating a privacy-robustness tradeoff. Recent efforts attempt to address this tradeoff by enforcing checks on client updates using zero-knowledge proofs, but they support limited predicates and often depend on public validation data. We propose SLVR, a general framework that securely leverages clients’ private data through secure multi-party computation. By utilizing clients’ data, SLVR not only eliminates the need for public validation data, but also enables a wider range of checks for robustness, including cross-client accuracy validation. It also adapts naturally to distribution shifts in client data as it can securely refresh its validation data up-to-date. Our empirical evaluations show that SLVR improves robustness against model poisoning attacks, particularly outperforming existing methods by up to 50% under adaptive attacks. Additionally, SLVR demonstrates effective adaptability and stable convergence under various distribution shift scenarios. 1 Introduction Federated Learning (FL) is a widely used paradigm for training models across distributed data sources McMahan et al. (2017) . In FL, clients compute model updates locally on private data and send them to a central server. FL was originally designed with privacy in mind, aiming to share model updates instead of raw data, under the assumption that these updates would not leak sensitive information. However, recent attacks have shown that exposing client updates in the clear makes FL vulnerable to full-scale reconstruction attacks ( Zhu et al., 2019 ; Geiping et al., 2020 ) . In response to these privacy risks, FL has been combined with secure aggregation techniques such as multiparty computation (MPC) Bonawitz et al. (2017b) ; Bell et al. (2020b) ; Fereidooni et al. (2021) ; So et al. (2022) or zero-knowledge proofs (ZKPs) to ensure that the server only learns the aggregated update and not individual updates (Figure 1(a) ). However, this privacy guarantee comes at the cost of robustness — since the server no longer sees individual updates, it lacks a mechanism to verify their validity before aggregation. There is active research on Byzantine-robust defense mechanisms to filter out malformed updates in plaintext FL Sun et al. (2019) ; Steinhardt et al. (2017) ; Yin et al. (2018) ; Blanchard et al. (2017a) ; Cao et al. (2020) , but integrating these checks into secure aggregation is challenging. Since these checks are typically built in plaintext, it is generally the case that the server has access to data, or metadata about the updates that it would not have when using secure aggregation. This makes it difficult to translate these predicates to secure aggregation. (a) Secure aggregation without robustness against malicious clients updates. (b) Robust secure aggregation with simple model integrity check on public data. (c) SLVR (ours) with advanced validation check securely leveraging client private data. Figure 1: Previous methods vs. SLVR. Secure aggregation ( 1(a) ) lacks the means to check model integrity privately. Recent byzantine-robust secure aggregation schemes enable integrity checks with zero-knowledge proofs ( 1(b) ), but only support simple predicate ( e.g. , \ell_{2} norm of client update), and may rely on public datasets. SLVR securely leverages clients’ local data for integrity checks via MPC ( 1(c) ), supporting more powerful predicates without requiring public data. There are recent efforts to incorporate robustness checks into secure FL Franzese et al. (2023) , but they remain limited in terms of the flexibility of checks that are supported or the reliance on public validation data (Figure 1(b) ). Specifically, ZKP-based approaches Lycklama et al. (2023b) ; Rathee et al. (2023b) only support simple predicates, such as l_{2} and l_{\infty} norm bounds, while Eiffel Chowdhury et al. (2022) extends support to more predicates but relies on a public data to determine the predicate hyperparameters. In practice, public validation data may not always be available, and even when it exists, its utility depends on how well it represents the overall client distribution. As client data naturally evolves or new clients joining over time, maintaining an effective public dataset becomes non-trivial, particularly in secure FL setups. To this end, we attempt to resolve the dilemma of privacy vs. robustness of FL from a fresh angle by asking: • Can we leverage clients’ private data while preserving the privacy guarantee of secure aggregation? • Can leveraging private data enable more advanced checks that enhance robustness while overcome the reliance on public validation data? We present SLVR, a general framework for S ecurely L everaging clients’ private data to V alidate updates for R obust FL. Aided by MPC, SLVR can compute statistics over multiple clients’ private data that is otherwise impossible in previous secure FL work (Figure 1(c) ). These statistics, such as cross-client validation accuracy, can play a vital role in enhancing model robustness. The modular design of SLVR makes it compatible with existing MPC implementations, and thus allows flexible deployment in various threat models. Furthermore, SLVR naturally adapts to distribution shifts as it can securely refresh its validation data up-to-date. In summary, our contributions are as follows, 1. We propose the first framework that enables cross-client checks using private inputs from different clients, eliminating reliance on public validation data. Our approach is compatible with existing MPC protocols, allowing flexible customization based on the threat model and computational constraints. 2. We evaluate SLVR against model poisoning attacks, including an adaptive attack—the strongest possible under the threat model. SLVR demonstrates competitive robustness and outperforms prior work under adaptive attacks ( e.g. , by up to 50% on CIFAR-10). 3. We study various scenarios for client data distribution shift scenarios and empirically demonstrate the adaptability of SLVR. In contrast, prior works struggle, experiencing severe accuracy degradation ( e.g. , 30% drop from MNIST to SVHN) or failing to progress. 2 Related Work 2.1 Robust Federated Learning Robustness to Model Poisoning. Model poisoning is one of the most fundamental threats to FL. As formulated by Blanchard et al. (2017b) and Yin et al. (2018) , a set of Byzantine malicious clients can send manipulated model updates to the server to degrade the global model’s performance. To mitigate this, various defenses have been proposed, primarily through robust aggregation methods that aim to filter out malicious updates from the final aggregation Sun et al. (2019) ; Steinhardt et al. (2017) ; Yin et al. (2018) ; Blanchard et al. (2017a) ; Cao et al. (2020) . However, these approaches often fall short against adaptive attacks Fang et al. (2020) ; Lycklama et al. (2023a) or require access to a public dataset for validation Cao et al. (2020) , which may not always be available. Robustness to Distribution Shift. Another key challenge in FL is handling evolving client data distribution over communication rounds. Many approaches address this from the perspective of client heterogeneity, incorporating techniques such as transfer learning, multi-task learning, and meta-learning to mitigate distribution shifts across different domains and tasks Smith et al. (2017) ; Khodak et al. (2019) . More recent works study explicitly tackles evolving client distributions over time Yoon et al. (2021) or periodic client distribution shifts Zhu et al. (2022) . While these advances improve the robustness of FL, they are designed for standard (plaintext) FL, where model updates are exchanged in the clear. However, privacy-preserving federated learning (PPFL) introduces additional constraints, making it non-trivial to directly apply these techniques. Many existing robust FL methods rely on inspecting individual model updates, a process that is inherently difficult in PPFL due to encryption or secure aggregation mechanisms. Our work aims to bridge this gap by providing a unified framework for PPFL that enhances robustness against both model poisoning attacks and distribution shifts. 2.2 Privacy-preserving Federated Learning Various techniques have been proposed for PPFL, with key differences in their underlying security assumptions. One of the primary differentiators is whether a protocol relies on a single-server or a multi-server aggregator. Single-server protocols for secure aggregation include works like Bell et al. (2020a) ; Ma et al. (2023) ; Lycklama et al. (2023b) ; Chowdhury et al. (2022) , while Rathee et al. (2023a) ; Ben-Itzhak et al. (2024) represents some of the state-of-the-art approaches in the multi-server setting. These techniques typically involve one or more of the following methods: secret-sharing Ma et al. (2023) , homomorphic encryption (HE) Bonawitz et al. (2017a) , and zero-knowledge (ZK) Lycklama et al. (2023b) ; Chowdhury et al. (2022) . However, these methods generally focus on ensuring privacy and do not protect against adversarial behaviors such as model poisoning, as they do not validate client-submitted updates before aggregation. To address this, recent research has explored incorporating zero-knowledge proofs (ZKPs) to enable privacy-preserving validation of model updates. While initial approaches were computationally expensive, advancements in ZK SNARKs, such as Bulletproofs Bünz et al. (2018) , have significantly improved efficiency. ZK SNARKs offers small proof sizes and fast verification, making them particularly well-suited for FL, where clients often have bandwidth and computational constraints. Protocol Trust Model Input Validation Private Bound Dynamic Bound Single/Multi-Input Validation Distribution Shift Clear \circ ✓ \times \times Multi ✓ RoFL Lycklama et al. (2023a) \circ ✓ \times \times Single \times EIFFeL Chowdhury et al. (2022) \circ ✓ \times \times Single \times Elsa Rathee et al. (2023a) \circ\bullet ✓ \times \times Single \times Mario Nguyen et al. (2024) \circ\bullet ✓ \times \times Single \times SLVR (Ours) \circ\bullet ✓ ✓ ✓ Multi ✓ Table 1: Comparison of protocols based on trust model, input validation, bound computation, single/multi-input validation, and support for data distribution shifts. \circ represents a single-aggregator trust model (without privacy in the case of Clear), while \circ\bullet represents distributed trust with two or more entities. 2.3 Robust and Privacy-preserving Federated Learning Among existing approaches that integrate robustness and privacy in FL, RoFL Lycklama et al. (2023b) , EIFFeL Chowdhury et al. (2022) , and ELSA Rathee et al. (2023b) are the most relevant to our work. They aim to enhance the robustness of PPFL under various threat models while integrating secure aggregation. A common strategy in these works is to ensure that only valid model updates contribute to the global model by using predicate-based validation, where clients prove the validity of their updates through ZKPs. In contrast, our framework takes a different approach by leveraging secure multiparty computation (MPC) to compute useful robustness-related statistics on secret-shared data. This design allows for greater flexibility in defining validation checks, as opposed to relying solely on predefined ZKP predicates. In addition, SLVR allows the predicate to take multiple clients’ private data as inputs, which enables cross-client validation that is neither feasible in plaintext FL nor in previous works. We compare with the features provided by some of the state-of-the-art frameworks in Table 1 . Secure Multiparty Computation (MPC). Secure MPC is a well-established cryptographic technique that enables multiple parties to jointly compute a function over their private inputs while ensuring that no individual party learns anything beyond the output. There are a range of applications for which MPC could be applied, such as secure auctions Bogetoft et al. (2009) , privacy-preserving data analytics Corrigan-Gibbs & Boneh (2017) ; Bogdanov et al. (2012) , privacy-preserving secure training and inference Escudero et al. (2020) ; Mohassel & Rindal (2018) , to name a few. In this work, the two building blocks we will use are protocols for secure inference and randomness generation. 3 Problem Overview In this section, we introduce the FL setting (Section 3.1 ), followed by its threat analysis (Section 3.2 ) and an overview of our goal (Section 3.3 ). A comprehensive list of notataions used throughout the paper can be found in Table 4 . 3.1 Federated Learning with Secure Aggregation Federated learning with secure aggregation is a recent advancement in FL that attempts to enhance the security and privacy of FL. The clients no longer send plain-text model updates to the server for aggregation. Instead, the updates are aggregated via a secure computation protocol. We assume the existence of an aggregation committee to facilitate the secure aggregation. In some scenarios, such as peer-to-peer (P2P) learning, the aggregation committee could be sampled from the set of clients Ma et al. (2023) ; Bell et al. (2020a) , whereas in the multi-server federated learning setting, the aggregation committee could just be the servers. We abstract these differences away by assuming that there exists a set of MPC nodes, denoted by \mathcal{P}_{MPC} , that receive the updates from the clients and perform secure aggregation. Formally, we consider an FL setting in which m clients collaboratively train a global model \mathbf{f}_{\mathbf{w}}(\cdot) maintained on a single cloud server, \mathcal{S} , parameterized by \mathbf{w} . Each client \mathcal{C}_{i} has its own local training dataset \mathbf{D}_{i}=\{(\mathbf{x}_{j},y_{j})\}_{j=1}^{N_{i}} where N_{i}=|\mathbf{D}_{i}| , for i\in[m] . At the start of t -th communication round, the server broadcasts the current global model parameters \mathbf{w}^{(t)} to all the clients and the aggregation committee (of which the server may be a part of). Each client \mathcal{C}_{i} uses \mathbf{w}^{(t)} as the initial model, locally computes an update \mathbf{u}^{(t)}_{i} on its local data \mathbf{D}_{i} and then sends \mathbf{u}^{(t)}_{i} to \mathcal{P}_{MPC} in secret-shared form. \mathcal{P}_{MPC} run the validation protocol, aggregates using an aggregation function \mathcal{A} ( e.g. , weighted sum over the updates McMahan et al. (2017) ), and reconstructs the aggregated update \mathbf{u}_{\mathsf{aggr}}^{(t)}=\mathcal{A}(\mathbf{u}^{(t)}_{1},\mathbf{u}^{(t)}_{2},\dots,\mathbf{u}^{(t)}_{m}) to \mathcal{S} . \mathcal{S} updates the global model \mathbf{w}^{(t+1)} based on \mathbf{u}_{\mathsf{aggr}}^{(t)} 1 1 1 We refer to client model \mathbf{w}^{(t)}_{i} and update \mathbf{u}^{(t)}_{i} interchangeably because \mathbf{u}^{(t)}_{i}=\mathbf{w}^{(t)}_{i}-\mathbf{w}^{(t-1)} and the global model \mathbf{w}^{(t-1)} is public knowledge. . This process is repeated for T communication rounds. MPC. An MPC protocol enables a set of r parties, denoted by \mathcal{P}=\{P_{1},\ldots,P_{r}\} , to jointly compute a function f that they all agree upon, on their private inputs x_{1},\ldots,x_{r} . MPC guarantees that the parties only ever learn the final result of the computation, f(x_{1},\ldots,x_{r}) , and nothing else about the inputs is leaked by any intermediate value they may observe during the course of the computation. Secret-Sharing. When we say a value is secret-shared in this work, we assume it is shared via a linear secret-sharing scheme (LSSS). In an LSSS, a value x\in\mathbb{F}_{p} is said to be secret-shared among r parties if each P_{i} , for i\in[r] , holds \llbracket x\rrbracket_{i} such that x=\sum_{i=1}^{r}\llbracket x\rrbracket_{i}\mod p . Given two secret-shared values x , y , we can compute a linear combination z=a\cdot x+b\cdot y , where a,b are public constants, by carrying out the same operations on the respective shares; \llbracket z\rrbracket=a\cdot\llbracket x\rrbracket+b\cdot\llbracket y\rrbracket . Computing the product of two secret values, \llbracket z\rrbracket=\llbracket x\rrbracket\cdot\llbracket y\rrbracket , can also be done albeit more challenging. The guarantee secret-sharing schemes give is that, an adversary in possession of shares will not learn anything about the underlying secret, as long as the number of shares it possesses is below the reconstruction threshold. In our instantiation of the framework, we use the replicated secret-sharing scheme from Araki et al. (2016) . 3.2 Security Model Corruption. There are three entities in our system: (1) clients, submitting model updates and validation data, (2) \mathcal{P}_{MPC} , that work to verify the validity of the updates, and (3) the server that receives the aggregated update. We assume that up to half, or }{||u||_{2}||v||_{2}} . The threshold is computed as \tau=\lambda\times\cos(\mathbf{u}_{pubval},\mathbf{u}^{(t-1)}) , and again, can be computed by anyone in the communication. \lambda is a constant where a larger \lambda allows for more gradient updates, leading to faster convergence but reduced robustness. Attack baselines. We evaluate each aggregation method against the following attacks: 1. Additive Noise Li et al. (2019) adds Gaussian noise to a malicious client update. 2. Sign Flipping Damaskinos et al. (2018) flips the sign of a client update: \mathbf{u}^{\prime}_{i}=-\mathbf{u}_{i} , for a client \mathcal{C}_{i} . 3. Label Flipping Fang et al. (2020) is a data poisoning attack that flips the label of each training instance. Specifically, it flips a label l\in\{0,1,\dots,L-1\} into L-l-1 where L is the number of classes. 4. Adaptive Attack is considered the strongest attack adaptive to each aggregation as described in Section 5 . Table 2: Test accuracy against adversarial attacks by 10% malicious clients after 500 rounds. Robustness is determined by the lowest accuracy ( boldfaced ) across all attacks ( i.e. , the smallest value across the columns of each table). SLVR maintains its robustness even against the strongest adaptive attacks (“Adaptive”). Additive Noise Labeflip Signflip Adaptive Norm Bound (adaptive) 0.970 0.983 0.981 0.883 Norm Bound (public data) 0.976 0.976 0.976 0.454 Norm Ball 0.968 0.985 0.966 0.965 Cosine Similarity 0.981 0.964 0.947 0.863 SLVR(acc) 0.974 0.977 0.975 0.974 SLVR(prob) 0.973 0.977 0.974 0.970 (a) Additive Noise Labelflip Signflip Adaptive Norm Bound (adaptive) 0.872 0.873 0.867 0.709 Norm Bound (public data) 0.865 0.870 0.863 0.583 Norm Ball 0.870 0.872 0.866 0.798 Cosine Similarity 0.863 0.862 0.862 0.714 SLVR(acc) 0.870 0.873 0.865 0.830 SLVR(prob) 0.870 0.871 0.864 0.832 (b) Additive Noise Labeflip Signflip Adaptive Norm Bound (adaptive) 0.915 0.932 0.927 0.198 Norm Bound (public data) 0.921 0.923 0.919 0.189 Norm Ball 0.913 0.917 0.901 0.308 Cosine Similarity 0.844 0.919 0.886 0.431 SLVR(acc) 0.868 0.925 0.922 0.836 SLVR(prob) 0.874 0.927 0.920 0.855 (c) Additive Noise Labeflip Signflip Adaptive Norm Bound (adaptive) 0.778 0.791 0.789 0.218 Norm Bound (public data) 0.784 0.786 0.799 0.122 Norm Ball 0.771 0.798 0.779 0.291 Cosine Similarity 0.770 0.781 0.775 0.221 SLVR(acc) 0.772 0.781 0.776 0.733 SLVR(prob) 0.775 0.784 0.772 0.735 (d) 6.2 Robustness against Poisoning Attacks SLVR is more Byzantine-robust. Table 3(d) summarizes the robust accuracy of each aggregation method under attacks. According to our goal in Equation 2 , All aggregation methods demonstrate comparable robust accuracies against most cases of non-adaptive, common attack baselines ( i.e. , Additive Noise, Labelflip, and Signflip), varying by only a small margin of 2\mathchar 45\relax 3\% accuracy in each column. However, all other defense baselines suffer from significant accuracy drops under adaptive attacks, and the robustness gap compared to SLVR becomes more pronounced with more complex tasks. For example, while the accuracy gap on MNIST is relatively modest, it widens to approximately 50% on CIFAR-10. In other words, unlike other aggregation baselines that are more susceptible to certain attacks ( e.g. , Non-adaptive vs. Adaptive) or fail on certain data sets ( e.g. , Norm Ball on CIFAR-10), SLVR shows consistent robustness against all attacks on all data sets. Such consistency makes it a more desirable choice in real-world uncertainty. An adversary may employ the strongest possible attack, which is the adaptive attack in most cases, it is crucial to provide robustness even under those attacks; specifically, as in Figure 4 , in the worst case, the adversary can only pull down the performance of FL with SLVR to 97% on MNIST, 87% on FMNIST, 83% on SVHN, and 72% on CIFAR-10 after 1000 rounds. (a) LeNet-5, MNIST (b) LeNet-5, FMNIST (c) ResNet-20, SVHN (d) ResNet-20, CIFAR-10 Figure 4: Robustness against Adaptive Attack with 20% malicious clients. Both SLVR (acc) and SLVR (prob) demonstrate competitive convergence performance against adaptive attacks. In contrast, other baselines that rely on static public validation datasets ( e.g. , Norm Bound ( \mathcal{D}_{val} ), Norm Ball, Cosine Similarity) or those that are adaptive but rely on simple validation checks ( e.g. , Norm Bound (adaptive)) become vulnerable. Figure 6: Adaptability across the two distribution shift scenarios. We start with 100 clients working on MNIST data. Every 100 (or 250) rounds (marked by dotted lines), either 20 random clients transition to SVHN data ( 6(a) ), or an additional 20 clients with SVHN data join the communication ( 6(b) ). Our model consistently adapts and improves accuracy throughout the communication rounds, outperforming other aggregation protocols that struggle to adjust to distribution shifts. (a) Scenario 1: evolving clients (b) Scenario 2: new clients 6.3 Adaptability to Distribution Shifts In this section, we examine the adaptability of SLVR along with other baseline aggregation protocols in the face of distribution shifts. We take into account two practical scenarios that may frequently occur in real-world FL settings: 1. Scenario 1: evolving clients (Figure 6(a) ). Some clients involved in the communication send different data over time to the central server. Consider a cross-silo FL system for predicting patient outcomes in hospitals. Over time, a hospital’s patient demographic may shift due to various factors such as changes in the local population, disease outbreaks, or the introduction of new healthcare programs. This could lead to an evolution in the type of patient data the hospital, or a subset of hospitals send to the central server, reflecting these changes. 2. Scenario 2: new clients (Figure 6(b) ). Along with the existing clients, new clients join the communication, but their data differs slightly from the existing clients. For instance, in the above FL example for a healthcare application, the existing clients could be hospitals from a different geographic location, or specialized hospitals and clinics that want to join the system to solve the same task. The new clients’ data coming from such sources may differ due to their specialized nature of care, different patient demographics, or unique healthcare practices. We simulate these scenarios using MNIST for existing clients and SVHN for evolving or new clients, with LeNet-5 as the model. The server initially communicates with 100 MNIST clients and uses a static MNIST validation dataset. Distribution shifts occur every 100 or 250 rounds, where clients transition to SVHN (Scenario 1) or new SVHN clients join (Scenario 2). We measure global model accuracy on MNIST initially and on the combined MNIST-SVHN test set thereafter. Further details are provided in Appendix C.1 . We aim to evaluate how cross-client checks contribute to adaptability under changing data distributions. Therefore, we disable the norm-bound check in SLVR and rely exclusively on cross-client checks to address the occurrence of distribution shifts. SLVR can adapt to changing client data distributions. Figure 6 shows the convergence of the global model against the number of communication rounds. We observe that baseline aggregation protocols relying on a static public validation dataset suffer significant performance degradation under distribution shifts. Specifically, Norm Bound ( \mathcal{D}_{pubval} ) and Norm Ball reject every update from SVHN clients because the magnitude of updates computed on SVHN far exceeds the threshold determined on the static MNIST validation set. The same observation applies to Norm Bound (adaptive) that uses the median of gradient updates to adaptively set the threshold since the gradient updates computed with new SVHN data are likely to fall above the median. One could relax the threshold by multiplying larger constant values to the computed median of gradients, but again, this highlights that appropriate threshold parameter setting is crucial to ensure robustness and adaptability under changing distributions, which requires non-trivial efforts, especially in secure FL settings. On the contrary, SLVR is capable of dynamically incorporating the new shifted local data into validation. Consequently, its choice of updates balances the performance on both MNIST and SVHN, which leads to much stronger adaptability without any parameter tuning. 6.4 MPC Benchmarks We benchmark the computation and communication overhead of our MPC implementation. The framework is instantiated using building blocks from MP-SPDZ Keller (2020a) . Benchmarks were conducted on a MacBook Pro with an Apple Silicon M4 Pro processor and 48 GB RAM. We simulated the network setup locally, and ran all the parties on the same machine, with 4 threads. For the LAN case, we simulated a network with 1 Gbps bandwidth, and 1 ms latency, and for WAN, we used 200 Mbps and 20 ms respectively. We benchmark the three components of our MPC protocol – the norm bound check, the cross-client check, and selecting the top- k model updates separately. In reality, the normbound and cross-client check can be run in parallel, with top- k run on the outputs of these checks. All the components are instantiated using a semi-honest 3PC protocol from MP-SPDZ, specifically, replicated-ring-party.x which implements the replicated secret-sharing based protocol from Araki et al. (2016) . The protocols are run with a 128-bit ring, although the larger ring size compared to the typical 64-bit ring is only to the size of the norm. It is possible to operate over a 64-bit ring, and switch to a 128-bit ring only for the norm, although we do not implement this optimization. Table 3: MPC benchmarks. With m_{c}=10\% corruptions, 2m_{c}+1 validation pairs, validation dataset size of 10. Normbound Cross-client check (acc) Cross-client check (prob) Top-k filtering LAN WAN LAN WAN LAN WAN LAN WAN LeNet-5, 10 clients time (s) 1.22 6.73 13.14 109.62 7.10 60.67 2.64 23.46 data (MB) 26.40 42.32 21.51 0.25 LeNet-5, 20 clients time (s) 1.78 8.92 20.20 174.90 10.89 93.39 2.65 23.53 data (MB) 84.10 70.08 35.40 0.73 ResNet-18, 10 clients time (s) 207.26 418.55 261.78 2084.90 131.30 1056.52 2.64 23.46 data (MB) 4791.75 2010.03 1098.59 0.25 ResNet-18, 20 clients time (s) 370.49 818.43 429.15 3471.01 217.45 1746.22 2.65 23.53 data (MB) 9583.53 2150.21 1137.50 0.73 We report the MPC benchmarks in Table 3 . Compared to previous FL schemes, SLVR unsurprisingly incurs increasing overhead as it supports private collection and computation of richer information via cross-client check. Nevertheless, the checks can be completed in reasonable time. Moreover, a large portion of the computations, e.g. , \mathsf{scr}^{j}_{i} for different (i,j) pairs, are highly parallelizable, suggesting substantial speed-ups with more powerful infrastructure than our lab computer. 7 Conclusions and Future Work To the best of our knowledge, our work is the first to take advantage of clients’ private data via secure MPC for FL. We demonstrate massive potential of this class of checks at enhancing FL robustness and adaptability to distribution shifts, while preserving privacy. Moreover, the capability of securely computing statistics over multiple data sources has its use beyond robust FL. It can help more applications such as data appraisal, personalized FL and etc. We do note that our work has significant room for improvement especially in scalability. Currently, scaling our protocol to more clients and larger models or datasets remains computationally intensive. In addition to developing more efficient secure inference techniques, especially for larger models, we hope that more robustness checks based on statistics computed with private client data will be proposed. Integrating our work with differential privacy is also an interesting direction, to provide output privacy. We welcome the community to join our effort. Appendices Symbol Description m number of all clients m_{c} number of malicious clients t communication round T total number of communication rounds between the clients and the server \mathcal{S} server \mathcal{C}_{i} i th client \mathbf{D}_{i} i th client’s local training dataset N_{i} number of i th client’s local training data, N_{i}=|\mathbf{D}_{i}| \mathbf{u}_{i}^{(t)} i -th client’s local update \mathbf{w}_{i}^{(t)} i -th client’s local model after local training with \mathbf{D}_{i} at t \mathbf{f}_{\mathbf{w}}(\cdot) a neural network classifier parameterized by \mathbf{w} \mathcal{P}_{MPC} a set of MPC nodes r number of parties in \mathcal{P}_{MPC} \mathcal{C}_{check,i} check committee of size 2m_{c}+1 for the i th client \mathbf{D}^{\mathsf{val}}_{i} i -th client’s validation data (a random subset of \mathbf{D}_{i} that is secret-shared to the MPC nodes) \mathsf{scr}^{j}_{i} validation score for i -th client computed with j -th client’s validation data \mathsf{scr}_{i} aggregated validation score for i -th client \mathsf{Chk}_{acc} check function based on accuracy difference \mathsf{Chk}_{prob} check function based on softmax probability outputs \mathcal{F}_{\mathsf{Sec\mathchar 45\relax Inf}},\mathcal{F}_{\mathsf{Sort}},\mathcal{F}_{\mathsf{Mult}},\mathcal{F}_{\mathsf{Rand}} Functionality for secure inference, oblivious sort, multiplication, sampling common random values \Pi_{\mathsf{Share}},\Pi_{\mathsf{Recon}} Protocol for secret-sharing, reconstruction k parameter in trimmed mean, 1-m_{c}/m \alpha Dirichlet distribution parameter that controls data heterogeneity across clients \mathcal{D}_{pubval} public validation data L number of classes Table 4: Symbols and notations used in the paper. Appendix A Details of \Pi_{\mathsf{Sec\mathchar 45\relax Agg}} and \Pi_{\mathsf{Check}} We found the best performance of our framework when we used both a norm bound and the accuracy function as ways to achieve robustness, as shown in Section 6 . Both the checks can be instantiated from off-the-shelf MPC protocols, owing to their use of standard building blocks. We combine both the checks by carefully using the subprotocols required. We use subprotocols for secure inference, multiplication, oblivious sorting, while assuming a shared key setup. There has been a lot of interest in proposing efficient instantiations of sorting and secure inference in the recent years Araki et al. (2021) ; A et al. (2023) ; Koti et al. (2022) ; Mohassel & Rindal (2018) ; Dalskov et al. (2021) ; Keller & Sun (2022) , offering protocols at various levels of security. The only restriction we have in terms of using these different frameworks is that, we require the secret-sharing to have an access structure such that the honest parties can reconstruct the secret. The variants of replicated secret-sharing Furukawa et al. (2016) that have been used in the recent PPML works, including the ones mentioned above, satisfy these criteria. We refer the readers to these, along with MP-SPDZ Keller (2020b) for detailed descriptions of the input sharing, \Pi_{\mathsf{Share}} , and reconstruction protocols, \Pi_{\mathsf{Recon}} . For completeness, we provide the functionality for using the maximum softmax value in Appendix B , but we do not report numbers from experiments with this function. As mentioned earlier, our secure aggregation protocol assumes there exists a set of parties that can run MPC, denoted by \mathcal{P}_{MPC} . For ease of description, one could assume that \mathcal{P}_{MPC} constitutes the servers that want to train the FL model together, as is the case in multi-server FL. However, it is possible to form an aggregation committee by sampling from the clients, as shown in works such as Ma et al. (2023) ; Bell et al. (2020a) . We leave it as a potential future direction to integrate our check into a protocol with a changing set of parties constituting \mathcal{P}_{MPC} . We assume that the nodes run a Setup phase, which establishes shared PRF keys between every pair of parties, as well as a common PRF key between all of them. These keys can be used to generate common random values by keeping track of a counter, and incrementing it every time the function is called. In every round, \mathcal{P}_{MPC} use the keys to generate a set of 2m_{c}+1 random IDs for each client, \mathcal{C}_{i} , i\in\{1,m\} . Each client’s model will be checked against validation data from the set of random IDs assigned to it. In addition to the features we strive to achieve, such as not relying on public datasets, we also placed an emphasis on making the MPC implementation-friendly. Since secure inference is often part of the system when training an FL model, reusing that building block to also perform a robustness check makes the system easier to deploy. We describe high level details of the protocol below. Each round t , begins with each client \mathcal{C}_{i} , for i\in[1,m] , secret-sharing its model update to \mathcal{P}_{MPC} using \Pi_{\mathsf{Share}} . \mathcal{P}_{MPC} call \mathcal{F}_{\mathsf{Sec\mathchar 45\relax Inf}} (Fig. 10 ) with the client’s model, the global model from the previous round, and each of the validation datasets in \mathcal{C}_{check,i} . As mentioned before, there are 2m_{c}+1 client datasets against which the model is checked, where m_{c} is the total number of corrupted clients. \mathcal{P}_{MPC} receive \llbracket\mathsf{Acc}^{\mathsf{new},j}_{i}\rrbracket , for j\in\mathcal{C}_{check,i} and \llbracket\mathsf{Acc}^{\mathsf{prev},j}_{i}\rrbracket , which denote the accuracy of the client \mathcal{C}_{i} ’s model and the global model of the previous round, against the validation client’s data respectively. The difference between the two accuracies is denoted by \mathsf{diff}^{j}_{i} . These values are then sorted by calling \mathcal{F}_{\mathsf{Sort}} (Fig. 8 ), which sorts the array obliviously. \mathcal{P}_{MPC} then compute the trimmed mean of this vector. Since it is known to all parties that they need to trim the top and bottom m_{c}/2 elements from this array, they can do the computation locally and compute the mean of the remaining ones. The result of the trimmed mean is denoted by \mathsf{scr}_{i} for each client \mathcal{C}_{i} . \mathcal{P}_{MPC} compute the score for each client, to get a secret-sharing of the list of scores, \{\mathsf{scr}_{i}\}_{i\in m} . In order to eliminate the lowest-performing updates, the parties sort the scores and select the top k\% of them, where k is a parameter picked by the server at the start of the protocol, that is known to all the parties. In parallel, \mathcal{P}_{MPC} also compute the norm of the model updates received, and set the bound to be \lambda times the median of all norm values of the updates. Here \lambda is a non-zero constant to control the tightness of the bound. The final updates to be aggregated are the ones that pass both the accuracy check, and the norm bound check. \mathcal{P}_{MPC} then use \Pi_{\mathsf{Recon}} to reconstruct the aggregated update, \mathbf{u}_{\mathsf{aggr}} . The formal description of the protocol appears in Fig. 2 . In order to use \mathcal{F}_{\mathsf{Max\mathchar 45\relax Soft}} , we only need to replace the calls to \mathcal{F}_{\mathsf{Sec\mathchar 45\relax Inf}} with \mathcal{F}_{\mathsf{Max\mathchar 45\relax Soft}} , in Fig. 2 . Appendix B Security of \Pi_{\mathsf{Sec\mathchar 45\relax Agg}} We prove our framework secure in the real-world/ideal-world simulation paradigm Lindell (2016) . Security is argued by showing that whatever an adversary can do in the real world, it can do in the ideal world, where it interacts with an ideal functionality (trusted third party). In the ideal world, parties send their inputs to the ideal functionality, which then computes the desired function, and returns the output. In the real world, parties run the steps of the protocol. The adversary is modeled as a probabilistic polynomial time (PPT) algorithm, that corrupts t , an honest minority of parties, among the parties involved in the protocol ( \mathcal{P}) in the real world. We define an ideal functionality, \mathcal{F}_{\mathsf{Sec\mathchar 45\relax Agg}} , as follows. It receives the models and the test data from the parties at the start of each round, computes the accuracy of the models on the test data, applies and the predicate \mathsf{Valid}() on them. It then filters out the bad predicates, aggregates the rest, and returns the output to the parties. The formal description appears in Fig. 7 . Functionality \mathcal{F}_{\mathsf{Sec\mathchar 45\relax Agg}} Parameters: Parties \mathcal{P}=\{P_{1},\ldots,P_{m}\} , number of corrupt parties m_{c} . Description of a check function, represented by \mathsf{Chk} . Run: On receiving (\llbracket{\mathbf{m}}\rrbracket,\llbracket{\mathbf{m}}^{\prime}\rrbracket,\llbracket{\mathbf{D}}\rrbracket) from each party, where {\mathbf{m}} is the updated local model, and {\mathbf{m}}^{\prime} is the model before the update, do the following: 1. Reconstruct the models {\mathbf{m}}=\Sigma\llbracket{\mathbf{m}}\rrbracket , {\mathbf{m}}^{\prime}=\Sigma\llbracket{\mathbf{m}}^{\prime}\rrbracket , and the test data {\mathbf{D}}=\Sigma\llbracket{\mathbf{D}}\rrbracket . 2. Compute the inference of each of the models, \mathsf{Acc}_{i}=\mathsf{Chk}({\mathbf{m}}_{i},{\mathbf{D}}) , and \mathsf{Acc^{\prime}}_{i-1}=\mathsf{Chk}({\mathbf{m}}^{\prime}_{i},{\mathbf{D}}) for i\in[1,m] . Compute \mathsf{Chk}_{i}=\mathsf{Acc}_{i}-\mathsf{Acc}^{\prime}_{i} , for i\in[1,m] . 3. Sort the vector of \mathsf{Chk} values, and apply a trimmed mean on them by deleting the top m_{c}/2 and bottom m_{c}/2 scores. Denote the final score for {\mathbf{m}}_{i} is denoted as \mathsf{scr}_{i} . 4. Select the models corresponding to the top k scores across the m parties. 5. Compute the norms of these models, \mathsf{norm}_{i} , for i\in[1,m-k] . Set the value \mathsf{bound} to be 1.5 times the median of the norms. 6. Aggregate all models such that \mathsf{norm}_{i}\leq\mathsf{bound} as m_{\mathsf{agg}} . 7. Send m_{\mathsf{agg}} to \mathcal{A} . If \mathcal{A} sends \mathsf{abort} , send \mathsf{abort} to all the parties. Else, send m_{\mathsf{agg}} . Output to the adversary: Send \llbracket m_{\mathsf{agg}}\rrbracket to \mathcal{A} , and wait for it to respond. If \mathcal{A} sends \mathsf{abort} , send \mathsf{abort} to all the parties. Otherwise, send \llbracket m_{\mathsf{agg}}\rrbracket to all the parties. Figure 7: Functionality for Robust Secure Aggregation Functionality \mathcal{F}_{\mathsf{Sort}} Parameters: Parties \mathcal{P}=\{P_{1},\ldots,P_{m}\} . 1. On receiving a sharing of a vector of elements, \llbracket{\mathbf{u}}\rrbracket_{i} , from all the parties reconstruct {\mathbf{u}}=\Sigma_{i=1}^{m}\llbracket{\mathbf{u}}\rrbracket_{i} . 2. Define the sorted array as {\mathbf{u}}^{\prime} . Send \llbracket{\mathbf{u}}^{\prime}\rrbracket to all the parties. Figure 8: Functionality for Oblivious Sort Functionality \mathcal{F}_{\mathsf{Rand}} Parameters: Parties \mathcal{P}=\{P_{1},\ldots,P_{m}\} . A pseudorandom function (PRF) F . 1. Sample pairwise PRF keys, \kappa_{ij} for each pair of parties (P_{i},P_{j}) , for i,j\in[1,m] . Sample a common key \kappa for all the parties. 2. Send all \kappa,\kappa_{ij} , where P_{i} is controlled by \mathcal{A} , to \mathcal{A} . If \mathcal{A} sends \mathsf{abort} , send \mathsf{abort} to all the parties. Else, send \kappa and the respective keys to all the parties. Figure 9: Functionality to Sample Common Random Values Functionality \mathcal{F}_{\mathsf{Sec\mathchar 45\relax Inf}} Parameters: Parties \mathcal{P}=\{P_{1},\ldots,P_{m}\} , a neural network architecture N . 1. On receiving (\llbracket{\mathbf{w}}\rrbracket,\llbracket{\mathbf{D}}\rrbracket) from all the parties, reconstruct {\mathbf{w}}=\Sigma_{i=1}^{m}\llbracket{\mathbf{w}}\rrbracket and {\mathbf{D}}=\Sigma_{i=1}^{m}\llbracket{\mathbf{D}}\rrbracket . 2. Compute inference using the weights {\mathbf{w}} , on the dataset D , for a neural network N , to get \mathsf{Acc} . 3. Send \llbracket\mathsf{Acc}\rrbracket to \mathcal{A} and wait for it to respond. If \mathcal{A} sends \mathsf{abort} , send \mathsf{abort} to all the parties. Else, send \llbracket\mathsf{Acc}\rrbracket . Figure 10: Functionality for Secure Inference Functionality \mathcal{F}_{\mathsf{Mult}} Parameters: Parties \mathcal{P}=\{P_{1},\ldots,P_{m}\} . 1. Receives secret-shared values \llbracket x\rrbracket,\llbracket y\rrbracket from \mathcal{P} , and reconstructs x,y . 2. Computes z=x\cdot y , and sends it to \mathcal{A} . 3. Depending on what \mathcal{A} replies with, sends either \llbracket z\rrbracket to the parties, or \mathsf{abort} . Figure 11: Functionality for Multiplication Functionality \mathcal{F}_{\mathsf{Max\mathchar 45\relax Soft}} Parameters: Parties \mathcal{P}=\{P_{1},\ldots,P_{m}\} , a classifier f , with L classes. 1. On receiving (\llbracket{\mathbf{w}}\rrbracket,\llbracket{\mathbf{D}}\rrbracket) from all the parties, reconstruct {\mathbf{w}}=\Sigma_{i=1}^{m}\llbracket{\mathbf{w}}\rrbracket and {\mathbf{D}}=\Sigma_{i=1}^{m}\llbracket{\mathbf{D}}\rrbracket . 2. Compute \mathsf{MSft}=\frac{1}{|\mathbf{D}|}\sum_{(\mathbf{x}_{k},y_{k})\in\mathbf{D}}\max f(\mathbf{x}_{k};\mathbf{w}) , where f(\mathbf{x}_{k};\mathbf{w})\in\mathbb{R}^{L} is the predicted softmax probability over L classes, which is an output by the classifier f parameterized with \mathbf{w} . 3. Send \llbracket\mathsf{MSft}\rrbracket to \mathcal{A} and wait for it to respond. If \mathcal{A} sends \mathsf{abort} , send \mathsf{abort} to all the parties. Else, send \llbracket\mathsf{MSft}\rrbracket . Figure 12: Functionality for Maximum Softmax Theorem 4 . Protocol \Pi_{\mathsf{Sec\mathchar 45\relax Agg}} securely realises the functionality \mathcal{F}_{\mathsf{Sec\mathchar 45\relax Agg}} in the presence of a malicious adversary that can statically corrupt up to m_{c}