FLOSS: Federated Learning with Opt-Out and Straggler Support Conference: Workshop on Practical Adoption Challenges of ML for Systems; Seoul, South Korea;

David J. Goetze, Dahlia J. Felten, Jeannie R. Albrecht, and Rohit Bhattacharya · 2025

Read FLOSS: Federated Learning with Opt-Out and Straggler Support Conference: Workshop on Practical Adoption Challenges of ML for Systems; Seoul, South Korea; by David J. Goetze, Dahlia J. Felten, Jeannie R. Albrecht, and Rohit Bhattacharya (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-23115.txt.

Introduction

David Goetze, Dahlia Felten, Jeannie Albrecht, and Rohit Bhattacharya present a system for shared model training that respects user opt-outs, in a paper from twenty twenty-five. In federated learning, phones and other devices train a shared model without sending raw data away. Privacy work has mostly covered users who agree to share.

Real users may use a service yet refuse data sharing, and slow devices add further gaps in the data. Both gaps bias the model and drag down its quality. The system, named FLOSS, is built to soften those harms. Tests in simulation show it holds up better than standard training when opt-outs and slow devices are common.

Catalog record

CREATORDavid J. Goetze, Dahlia J. Felten, Jeannie R. Albrecht, and Rohit Bhattacharya
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-23115

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FLOSS: Federated Learning with Opt-Out and Straggler Support Conference: Workshop on Practical Adoption Challenges of ML for Systems; Seoul, South Korea; David J. Goetze, Dahlia J. Felten, Jeannie R. Albrecht, and Rohit Bhattacharya Abstract . Previous work on data privacy in federated learning systems focuses on privacy-preserving operations for data from users who have agreed to share their data for training. However, modern data privacy agreements also empower users to use the system while opting out of sharing their data as desired. When combined with stragglers that arise from heterogeneous device capabilities, the result is missing data from a variety of sources that introduces bias and degrades model performance. In this paper, we present FLOSS, a system that mitigates the impacts of such missing data on federated learning in the presence of stragglers and user opt-out, and empirically demonstrate its performance in simulations. 1. Introduction Federated learning (FL) is a privacy-preserving form of machine learning in which a model is trained across a distributed set of clients, eliminating the need for individual users to share their data with a central server ( McMahan et al. 2017 ) . Instead, each participant trains a local model and sends only weights or gradients back to the server. The server aggregates these to update the central model and broadcasts it back to the clients in each training round. Since sensitive data are not sent to the server, this approach helps mitigate privacy risks associated with centralized data storage and transfer. While FL systems offer advantages with respect to privacy, their distributed nature introduces several challenges related to missing data. Some gradients may be lost or delayed due to problems with the devices or network. The presence of these stragglers in distributed computing is a well-studied problem ( Dean and Ghemawat 2004 ; Albrecht et al. 2006 ) that causes missing data in FL systems ( Lai et al. 2021 ; Abdelmoniem et al. 2023 ; Li et al. 2020 ) . However, beyond just infrastructure-level connectivity issues, users of FL systems may also decide to opt out of gradient/weight sharing for increased privacy. Modern data privacy agreements give users the ability to change their mind and opt in or opt out as desired at any point during training. As shown in Figure 1 , some participants may elect to withhold their data, thus preventing the central model from using it in model updates. When this occurs, the model may become biased and its accuracy may suffer as a result. (a) (b) (c) Figure 1 . (a) A prompt allowing users to opt out of training, and (b) a prompt asking for user feedback. In addition to stragglers, either of these can lead to missing data when users select the red option. (c) This affects the FL system, as some gradients g_{i} are systematically missing, introducing bias into the model’s weights ( \theta ) at each update step. Although model training is typically robust to missing completely at random (MCAR) data, missing at random (MAR) and missing not at random (MNAR) data are more problematic. MAR in the FL context implies that the likelihood of user data being excluded is not related to the missing data itself, but still systematically different based on observable device or network properties. For example, straggling participants in rural areas with poor network connectivity may be excluded from training. MNAR implies that the tendency for data to be excluded is related to the missing data itself. For instance, participants from a specific demographic class who possess data not represented elsewhere may opt out of training. Thus, it is generally not safe to assume that data are MCAR in FL systems, and the selection bias from MAR and MNAR data can negatively impact the performance of the model. Our work aims to address this problem. Specifically, we leverage modern theory in inverse probability weighting (IPW) ( Horvitz and Thompson 1952 ; Seaman and White 2013 ) and missing data graphical models ( Mohan and Pearl 2021 ; Miao et al. 2024 ; Nabi et al. 2025 ) in order to reweight the gradient aggregation in FL systems and mitigate the impacts of MCAR, MAR, and MNAR missing data while preserving user privacy, thereby improving the overall usability of FL for practical applications. To this end, we present FLOSS : a privacy-preserving FL system for mitigating the impacts of missing data without forcing additional data collection or violating user data-sharing agreements. We present a formal model of missing data in FL systems, and describe how we support opt-out user privacy policies using reweighted selection. We also provide preliminary results from a prototype implementation that evaluates our ability to correct for missing data. 2. Notation and Problem Setup We set up the notation used in our paper as follows. \displaystyle X:\text{a set of features used for generating predictions}. \displaystyle Y:\text{the outcome of interest (real-valued or categorical)}. \displaystyle D:\text{user info collected at sign-up---{\it e.g.}, age + device specs}. \displaystyle S:\text{user satisfaction with system and model performance}. \displaystyle R:\text{binary indicator of responsiveness to server requests} \displaystyle\text{\hskip 11.38092pt $R=0$ for stragglers/users opting out; $R=1$ otherwise}. In a typical FL setup, we have a set of n users \U , each with their own private dataset consisting of multiple realizations of the features X and outcome Y . A model h_{\theta}:x\mapsto y is then trained in a decentralized manner to minimize the expected loss E[L(x,y,\theta)] , often approximated by the empirical risk \frac{1}{n}\sum_{i=1}^{n}L(x_{i},y_{i},\theta) , over multiple rounds. Moving forward, we suppress dependence of the loss and gradient functions on the data x,y for brevity. At each step t , the central server samples a subset of users \U^{\prime} of size k , and requests gradients G(\theta^{(t)}) of the loss function evaluated over their private datasets. Each sampled device uploads their gradients g_{1}(\theta^{(t)}),\dots,g_{k}(\theta^{(t)}) , or noisy and clipped versions of them to add differential privacy ( Abadi et al. 2016 ; Birrell et al. 2024 ; Das et al. 2025 ) . The central server then aggregates these gradients to obtain \overline{g}(\theta^{(t)}) and updates the model as \theta^{(t+1)}\leftarrow\theta^{(t)}-\eta\cdot\overline{g}(\theta^{(t)}) , where \eta is the learning rate. Note we assume equal-sized datasets for brevity of notation, but our methodology generalizes in a straightforward manner. Finally, the updated model h_{\theta^{(t+1)}} is broadcast to all users u\in{\U} , and the process repeats. Two key issues arise in the above process that lead to missing data: (i) Some devices, known as stragglers ( Albrecht et al. 2006 ; Dean and Ghemawat 2004 ) , may fail to upload their gradients in a reasonable time frame and the server is forced to perform the aggregation step without them, and (ii) certain users may decline to share their data for training as part of a data-sharing agreement, so not all devices can be prompted for their gradients. Both of these issues can lead to systematic , rather than completely random, missingness of gradients, resulting in degraded accuracy of the final learned model if not appropriately accounted for. In the following, we formalize the kind of data-sharing agreements we support in FLOSS, which reflects mandatory user privacy agreements that are ubiquitous across modern machine learning applications ( Das et al. 2025 ) . Data-sharing agreement

Read the complete text