Enhancing Federated Learning Privacy with QUBO

1 st Andras Ferenczi, 2 nd Sutapa Samanta, 3 rd Dagen Wang, 4 th Todd Hodges · 2025

Read Enhancing Federated Learning Privacy with QUBO by 1 st Andras Ferenczi, 2 nd Sutapa Samanta, 3 rd Dagen Wang, 4 th Todd Hodges (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-02785.txt.

Introduction

Andras Ferenczi, Sutapa Samanta, Dagen Wang, and Todd Hodges aim to cut privacy leakage in federated learning. In that setup, many clients train a shared model without sending raw data, yet each round of updates can leak a bit about who took part and what their data holds. Attacks can infer membership, traits, or even rebuild inputs.

Their 2025 method frames client choice as a QUBO problem, a quantum-inspired optimization, and picks only the most useful updates each round. On MNIST with three hundred clients over twenty rounds, per-round exposure fell by about 95 percent and total exposure by about half, while accuracy held or improved. Nearly half the clients were never used at all. A smaller CINIC-10 test showed similar gains.

Catalog record

CREATOR1 st Andras Ferenczi, 2 nd Sutapa Samanta, 3 rd Dagen Wang, 4 th Todd Hodges
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-02785

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhancing Federated Learning Privacy with QUBO 1 st Andras Ferenczi, 2 nd Sutapa Samanta, 3 rd Dagen Wang, 4 th Todd Hodges Abstract Federated learning (FL) is a widely used method for training machine learning (ML) models in a scalable way while preserving privacy (i.e., without centralizing raw data). Prior research shows that the risk of exposing sensitive data increases cumulatively as the number of iterations where a client’s updates are included in the aggregated model increase. Attackers can launch membership inference attacks (MIA; deciding whether a sample or client participated), property inference attacks (PIA; inferring attributes of a client’s data), and model inversion attacks (MI; reconstructing inputs), thereby inferring client-specific attributes and, in some cases, reconstructing inputs. In this paper, we mitigate risk by substantially reducing per client exposure using a quantum computing–inspired quadratic unconstrained binary optimization (QUBO) formulation that selects a small subset of client updates most relevant for each training round. In this work, we focus on two threat vectors: (i) information leakage by clients during training and (ii) adversaries who can query or obtain the global model. We assume a trusted central server and do not model server compromise. This method also assumes that the server has access to a validation/test set with global data distribution. Experiments on the MNIST dataset with 300 clients in 20 rounds showed a 95.2% per-round and 49% cumulative privacy exposure reduction, with 147 clients’ updates never being used during training while maintaining in general the full-aggregation accuracy or even better. The method proved to be efficient at lower scale and more complex model as well. A CINIC-10 dataset-based experiment with 30 clients resulted in 82% per-round privacy improvement and 33% cumulative privacy. I Introduction and Motivation Federated learning (FL) is a method of training a global model by aggregating local updates and re-distributing an aggregated model across multiple rounds [ 1 ] . FL is not immune to common privacy risks, including gradient inversion attacks (GIA) [ 2 ] , membership inference attacks (MIA) [ 3 ] , property inference attacks (PIA) [ 4 ] , and model inversion attacks (MI) [ 5 ] , which may result in leakage of sensitive data. Access to per-round global model snapshots enables multi-snapshot membership inference that extracts signals unavailable from a single final model, thereby amplifying leakage as more snapshots accumulate [ 6 , 7 ] . The scenarios in scope of this study include an honest server that does the aggregation, with potential semi-honest and curious clients (FL participants) that have access to the global model snapshot after each round. Slope-based auditing shows that tracking the logit and loss for a particular example of its true class results in a steeper slope than for non-member samples [ 6 ] . Subject-level black-box inference attacks are effective on the final global model but even more so if the attacker has access to snapshots after each round; Suri et al. conclude that the efficacy of such attacks increases with the number of rounds [ 7 ] . Clients included more frequently have a higher influence on the aggregated model and hence are more vulnerable. In general, theory shows that combining information from successive releases strengthens membership inference [ 8 ] . Paper [ 9 ] proposes FedInverse, a method that reconstructs training data in FL by placing the attacker in the participant role and using Generative Adversarial Network (GAN)-based model. Authors of [ 10 ] , also point out that exposure grows with participation frequency. We propose a novel approach that leverages Quadratic Unconstrained Binary Optimization (QUBO) [ 11 ] to reduce participation frequency in FL through strategic client selection. The key insight in this proposal is that client selection can be optimized in such manner as not to impact the quality of the training, thus reducing exposure to privacy attacks by men-in-the-middle or curious training participants, assuming trusted server scenarios. As QUBO formulations are particularly well-suited for quantum annealers, the proposal offers potential at scale as quantum hardware matures. Our contributions are threefold: (1) We formulate federated learning client selection as a QUBO optimization problem that balances client relevance, diversity, and redundancy; (2) We introduce ten distinct QUBO strategies spanning the exploration-exploitation spectrum, from consensus-focused approaches to diversity-maximizing selections; (3) We provide comprehensive experimental evaluation on MNIST [ 12 ] with 300 clients and CINIC-10 [ 13 ] with 30 clients across varying data heterogeneity settings using Dirichlet distribution [ 14 ] , demonstrating client selection efficiency while maintaining similar accuracy to the standard aggregated global model. The remainder of this paper is organized as follows: Section II provides background on FL, surveys related work in FL client selection, motivation for choosing optimization-based client selection, and introduction to QUBO. Section III details our proposed QUBO-based client selection approach. Experimental methodology and results were discussed in Section IV . Section V discusses implications and limitations of our experiments and conclude with future research directions. II Background II-A Federated Learning (FL) FL is a method used to train a common “global” model by aggregating gradient updates from distributed clients that train their copies of the model using local data [ 1 ] . A central server maintains global parameters \mathbf{w}^{t} at round t . Client i receives the global model, performs local training on its data \mathcal{D}_{i} , and computes parameter updates \Delta\mathbf{w}_{i}^{t}=\mathbf{w}_{i}^{t+1}-\mathbf{w}^{t} . The server aggregates client updates using weighted averaging: \mathbf{w}^{t+1}=\mathbf{w}^{t}+\sum_{i\in\mathcal{S}_{t}}\frac{|\mathcal{D}_{i}|}{|\mathcal{D}|}\Delta\mathbf{w}_{i}^{t}, where \mathcal{S}_{t} is the set of selected clients in round t , |\mathcal{D}_{i}| is the number of samples at client i , and |\mathcal{D}|=\sum_{i\in\mathcal{S}_{t}}|\mathcal{D}_{i}| . Local training typically minimizes the loss function \mathcal{L}_{i}(\mathbf{w})=\frac{1}{|\mathcal{D}_{i}|}\sum_{(\mathbf{x},y)\in\mathcal{D}_{i}}\ell(\mathbf{w};\mathbf{x},y), where \ell is the sample-wise loss function. II-B Efficient Client Selection in FL Extensive literature exists on methods for efficient client selection, most of which aim to speed up training and reduce communication rounds, minimize network bandwidth usage, or select trustworthy updates in Byzantine settings. The original FedAvg paper [ 1 ] proposes random selection of clients to reduce processing and network overhead. In contrast, Power-of-choice client selection [ 15 ] describes a method in which a central server pools a random set of clients for their training loss and selects a subset with the highest loss, favoring clients with the highest loss (i.e., “harder” clients) to speed up convergence. The problem with this method is that it fails to ensure convergence, especially when training data is heterogeneous across clients, in which case the authors reduce the loss-based selection criteria. FedNova [ 16 ] is pointing out that in “regular” FL the server computes FedAvg irrespective of the number of epochs performed by each client, thus using the incorrect objective function. The paper proposes that each client sends a normalized update, which in simplest case, consists of the sum of gradients over multiple epochs divided by the number of epochs. Even though the authors don’t provide customization based on statistical heterogeneity, they point out that their solution works as it optimizes the correct objective function. Oort [ 17 ] also uses self-reported loss based on the pre-defined loss function, plus benchmarks of client network communications efficiency to define the statistical utility of a client: U(i)=|\mathcal{D}_{i}|\,\sqrt{\frac{1}{|\mathcal{D}_{i}|}\sum_{k\in\mathcal{D}_{i}}\bigl(\mathrm{Loss}(k)\bigr)^{2}}, (1) where i indexes clients, \mathcal{D}_{i} is client i ’s dataset, |\mathcal{D}_{i}| is

Read the complete text