On the Tradeoffs of On-Device Generative Models in Federated Predictive Maintenance Systems
Usevalad Milasheuski, Piero Baraldi, Enrico Zio, Stefano Savazzi · 2026
Read On the Tradeoffs of On-Device Generative Models in Federated Predictive Maintenance Systems by Usevalad Milasheuski, Piero Baraldi, Enrico Zio, Stefano Savazzi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-07860.txt.
Introduction
Usevalad Milasheuski and three co-authors sort out how generative models should be shared in federated maintenance. Factories keep sensor data on site but want shared anomaly detection for time series. Autoencoders, GANs, and diffusion models each offer unsupervised detection, yet federated versions face bandwidth limits and mismatched data across sites.
Comparing full federation, where whole models are shared, with partial federation, where only parts move, they find distinct trade-offs in utility, stability, and scale. Full federation stabilized the GAN setups but they stayed least robust; for diffusion models, sharing only the decoder beat sharing everything in bandwidth-tight, uneven data settings. The paper proposes a scheme making partial sharing a sound route to tailoring.
Catalog record
| CREATOR | Usevalad Milasheuski, Piero Baraldi, Enrico Zio, Stefano Savazzi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.07860
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On the Tradeoffs of On-Device Generative Models in Federated Predictive Maintenance Systems Usevalad Milasheuski, Piero Baraldi, Enrico Zio, Stefano Savazzi Abstract Federated Learning (FL) has emerged as a promising paradigm for preserving client data ownership and control over distributed Internet of Things (IoT) environments. While discriminative models dominate most FL use cases, recent advances in generative models — such as Variational Autoencoders (VAE), Generative Adversarial Networks (GAN), and Diffusion Models (DM) — offer new opportunities for unsupervised anomaly detection in time series analysis, with relevant applications in predictive maintenance (PdM) in critical industrial infrastructures. In this work, we present a comprehensive analysis of VAEs, GANs, and DMs in the context of federated PdM. We analyze their performance and communication overhead under both full and partial federation setups, where only subsets of model components are shared. Building on this analysis, the paper proposes a novel taxonomy for federated generative models that formalizes partial component sharing as a principled mechanism for model personalization. Our experiments over a real-world time series dataset reveal distinct trade-offs in model utility, stability, and scalability, especially in heterogeneous and bandwidth-constrained FL settings. For the evaluated GAN-based configurations, full federation improves training stability relative to independent local training, although the model remains less robust than the VAE- and DDPM-based alternatives. For DMs, however, partial federation—especially decoder sharing—can outperform full federation in bandwidth-constrained, non-IID settings. I Introduction Predictive maintenance (PdM) has emerged as a cornerstone of the Industrial Internet of Things (IIoT), playing a key role in the transition toward the next generation of industry (Industry 5.0) [ 40 , 58 ] . By leveraging data-driven insights to anticipate equipment failures, PdM shifts operations from reactive or preventive maintenance to a proactive, condition-based approach. This paradigm aims to reduce costs and improve safety by preventing catastrophic system failures. The core enabling technology behind these PdM systems is Anomaly Detection (AD). Broadly defined as the identification of patterns that deviate from expected behavior, AD in time series (TS) is increasingly important across domains such as manufacturing [ 26 ] , cybersecurity [ 15 ] , and healthcare [ 46 ] . By monitoring parameters such as temperature, vibration, and pressure, AD algorithms help PdM systems detect deviations from normal operating conditions, enabling timely interventions, reducing downtime, and extending machinery lifespan. The effectiveness of AD depends on models capable of identifying anomalous patterns in large TS streams. Traditional methods, such as statistical tests, autoregressive models, and density-based techniques, often struggle to capture the complex temporal dependencies and multivariate interactions typical of streaming sensor data [ 29 ] . Deep Learning (DL) models have therefore been widely adopted for PdM. For example, recurrent neural networks (RNN), long short-term memory (LSTM), and convolutional neural networks (CNN) have been used in various time-series anomaly detection (TSAD) scenarios. Although DL methods improve on classical approaches by learning hierarchical temporal representations, they often fail to capture the full data distribution, especially under non-stationary or evolving conditions. Fig. 1: Problem Setup for PdM TSAD. During the training stage, clients train the local model and transmit shared weight \mathbf{w}_{c}^{s} to the server for multiple rounds. The validation stage individually estimates personalized anomaly threshold \epsilon_{c} for each client. Finally, during testing , the clients evaluate the performance on the new time series data. Recently, generative models emerged as powerful tools for unsupervised AD. These models learn sensor data under normal operating conditions and flag deviations through high anomaly score or low likelihood. Compared with discriminative models, this approach can better map realistic sensor patterns, augment limited datasets, and provide richer probabilistic insights [ 6 ] . However, deploying generative AD models in industrial settings must address three main challenges: • Data ownership and confidentiality . Sensor streams often reveal sensitive operational details, and centralizing raw data from multiple plants may be infeasible because of IP or compliance constraints [ 14 ] . • Heterogeneous and non-IID distributions . Different machines or plants often follow different dynamics (e.g., age, operating environment, load, wear), resulting in non-identically and independently distributed (non-IID) data [ 33 ] . As a result, a centrally trained model may perform poorly on local data or dilute localized anomalies when aggregating parameters from divergent distributions. • Resource, bandwidth, and energy constraints . IoT edge devices and local gateways often have limited computation, energy, storage, and bandwidth, constraining the transfer of large models or frequent updates [ 1 ] . These challenges motivate the integration of generative AD with ownership-preserving data management and communication-efficient training paradigms — most notably, Federated Learning (FL) [ 38 , 13 ] . While FL has been studied widely for classification or regression tasks, its adaptation to generative models - and in particular, for time series AD - remains largely unexplored [ 55 , 39 ] . This gap highlights the need for a systematic evaluation of generative modeling in federated settings tailored to industrial IoT and PdM scenarios. Such an evaluation should consider not only detection performance, but also training stability, communication overhead, personalization, and robustness to heterogeneity. I-A Related works The paradigm of AD has shifted from traditional unsupervised or self-supervised statistical boundary methods, such as One-class Support Vector Machines (OC-SVM) and Isolation Forest (IF), toward deep generative models [ 48 ] . These models learn the probability distribution of normal data P_{data}(\mathbf{x}) [ 24 ] , and identify anomalies either as samples in low-density regions of the learned distribution. PdM has attracted considerable attention over the past decade because it is closely linked to TSAD [ 40 , 34 ] . Its primary goal is to identify deviations from expected operational patterns, enabling early intervention and risk mitigation. By anticipating equipment failures before they occur, PdM shifts maintenance from reactive or preventive schedules to proactive, condition-based strategies. Through continuous monitoring of critical parameters such as temperature, vibration, and pressure [ 57 ] , PdM systems can detect subtle deviations, reduce downtime, extend machinery lifespan, and lower costs. In this context, AD seeks to model nominal system behavior in order to detect deviations. Generative modeling has emerged as an effective approach because it learns compact representations of input distributions and detects anomalies through reconstruction- or likelihood-based criteria. Among the most widely studied generative models for AD are Variational Autoencoders (VAEs) [ 27 ] , Generative Adversarial Networks (GANs) [ 19 ] , and Diffusion Models (DMs) [ 22 ] . Variational Autoencoders (VAEs) [ 27 ] learn compressed representations that remain informative enough to reconstruct the input data. Several works have applied VAEs to industrial PdM AD. In [ 42 ] , the authors replace the standard feed-forward layers of a VAE with LSTM units to capture temporal dependencies and sequential patterns in sensor data. The model in [ 32 ] enhances the standard sequential VAE by adding a smoothness-inducing term to the loss, encouraging smooth latent transitions. In contrast, [ 36 ] uses a standard VAE to compress short data windows into low-dimensional embeddings, and then trains an LSTM on these latent representations to predict future embeddings. Generative Adversarial Networks (GANs) [ 19 ] originally gained popularity in image generation. In the context of time-series AD, works such as [ 5 , 31 , 18 ] show promising adaptations of