Discovering Collaboration from Novelty: Random Network Distillation for Clustered Federated Learning
Davide Domini, Gianluca Aguzzi, Ivana Dusparic, Danilo Pianini, Mirko Viroli · 2026
Read Discovering Collaboration from Novelty: Random Network Distillation for Clustered Federated Learning by Davide Domini, Gianluca Aguzzi, Ivana Dusparic, Danilo Pianini, Mirko Viroli (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30499.txt.
Introduction
Davide Domini and four colleagues let federated learning clients discover their natural collaborators before training even starts. Federated learning trains shared models without pooling raw data. When client data differ sharply, one global model fits nobody well. Clustered federated learning trains a specialist model per group instead. Existing methods assign clusters inside the training loop itself. That inflates computation and communication costs substantially.
Their approach decouples clustering from learning entirely. Each client trains a small novelty detector on its own data. Random Network Distillation supplies that detector cheaply. Prediction error acts as a novelty signal between clients. Clients compare signals to estimate who resembles whom. Meaningful groups emerge before any federated training begins. Neither the number of clusters nor their structure is fixed beforehand. The method suits autonomous large-scale distributed systems. It is task-agnostic and adds little overhead overall.
Catalog record
| CREATOR | Davide Domini, Gianluca Aguzzi, Ivana Dusparic, Danilo Pianini, Mirko Viroli |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30499
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Discovering Collaboration from Novelty: Random Network Distillation for Clustered Federated Learning Davide Domini, Gianluca Aguzzi, Ivana Dusparic, Danilo Pianini, Mirko Viroli Abstract FL often suffers under non-IID data, where a single global model may fail to represent the diversity of client distributions. CFL mitigates this issue by training specialized models for groups of similar clients, but existing approaches often couple cluster assignment with the main training loop, increasing computational and communication costs. We propose a lightweight clustering approach based on RND . Each client trains a compact RND predictor on its local data and uses its prediction error as a novelty signal to estimate similarity with other clients. This enables the discovery of meaningful client groups before federated training, without sharing raw data or repeatedly evaluating the main model. Crucially, the resulting federations emerge from local novelty estimates at runtime, making the method suitable for autonomous large-scale distributed systems where neither the number of clusters nor the collaboration structure can be specified a priori. Overall, by decoupling clustering from learning, the method provides a task-agnostic and efficient mechanism for autonomous collaboration under non-IID data. I Introduction FL ( FL ) [ 15 ] has emerged as a prominent paradigm for collaborative model training in privacy-sensitive distributed settings, enabling devices to jointly learn shared models without exposing raw local data. While FL achieves strong performance under homogeneous data conditions, real-world deployments frequently exhibit non-IID ( non-IID ) data across devices, leading to degradation in model accuracy and convergence [ 13 , 11 ] . This challenge becomes particularly severe in large-scale distributed systems comprising numerous devices that must learn and adapt over time. In many settings, data heterogeneity is not random but structured. Spatially distributed systems provide a clear example: devices in spatial proximity tend to observe similar phenomena, while devices in different regions exhibit statistically divergent distributions [ 8 ] . This naturally gives rise to group-level non-IID patterns, where clusters of devices share similar local distributions internally, while distributions differ significantly across clusters. Furthermore, in such autonomous settings, manually specifying who should collaborate with whom or how many collaboration groups should exist is often unrealistic, since the number and structure of latent clusters are typically difficult to know in advance. CFL ( CFL ) [ 14 ] addresses this by partitioning devices into groups and training a specialized model per cluster, rather than a single global model. Algorithms such as IFCA [ 9 ] and PSFL [ 6 ] have demonstrated that cluster-aware training substantially improves accuracy under non-IID conditions. However, these methods share a fundamental limitation: at each round, cluster assignment requires evaluating one or more instances of the full model being trained. In IFCA, every device must evaluate all cluster models on its local data and select the one yielding the lowest loss; in PSFL, devices continuously exchange and evaluate neighbors’ models to maintain coherent federations. This per-round evaluation is computationally expensive, communication-intensive, and may be prohibitive on resource-constrained devices. In this paper, we argue that clustering need not be entangled with the main learning loop. In many practical scenarios, the cluster structure is either stable or changes slowly relative to the learning timescale. It is therefore sufficient to perform clustering once (or periodically) using lightweight auxiliary models, entirely decoupled from the primary learning task. Toward this goal, we propose leveraging RND ( RND ) [ 1 ] as a mechanism for estimating data uncertainty and computing inter-device similarity for clustering. RND was originally introduced to quantify epistemic uncertainty in MARL ( MARL ) for exploration and TL ( TL ) [ 2 ] , where the prediction error of a randomly initialized fixed network serves as a proxy for novelty with respect to an agent’s experience. We find this formulation remarkably well-suited to the federated clustering problem: devices can train small RND models on their local data and exchange them with neighbors to estimate distributional divergence–without sharing any raw data—enabling a lightweight, privacy-preserving clustering phase. Concretely, our approach introduces a modular, plug-and-play pre-clustering phase applicable to existing FL algorithms. Devices first train compact RND networks (significantly smaller than the primary task model), exchange them within the network, and use the resulting uncertainty estimates to identify cluster membership. The primary learning phase then proceeds within the discovered clusters using any standard aggregation algorithm such as FedAvg [ 16 ] . When data distributions shift over time, the clustering phase can be re-triggered periodically. To the best of our knowledge, this is the first work to apply RND for cluster discovery in FL . We validate our approach on well-known computer vision benchmarks augmented with synthetic noise to simulate feature skewness, a realistic and underexplored form of non-IID heterogeneity, demonstrating that RND uncertainty estimates effectively separate devices into meaningful clusters prior to any model training. II Background and Related Works II-A Federated Learning FL ( FL ) [ 15 ] is a distributed learning paradigm in which multiple clients collaboratively train machine learning models while keeping their raw data locally stored. In the standard server-based formulation, clients perform local optimization on private datasets and periodically send model updates to a central server, which aggregates them to produce an updated global model. The most common aggregation strategy is FedAvg [ 16 ] , where the global model is obtained by averaging the parameters or updates received from the participating clients. While standard FL is effective when client data are sufficiently homogeneous, its performance can degrade under non-IID ( non-IID ) data. In such settings, local updates may be biased toward different client-specific objectives, making their aggregation less stable and reducing the quality of the resulting global model [ 14 , 11 ] . This issue has motivated several extensions of FL aimed at improving robustness under statistical heterogeneity. CFL ( CFL ) addresses data heterogeneity by replacing the single global model with multiple specialized models. Clients are partitioned into clusters according to some notion of similarity, and each cluster trains a separate federated model. This formulation is particularly useful when the client population is composed of groups with internally similar but mutually different data distributions. Representative CFL approaches include IFCA [ 9 ] , which alternates between assigning clients to the model that best fits their local data and updating cluster-specific models, and proximity-aware approaches such as PSFL [ 6 ] , where client federations are formed and maintained according to local similarity estimates among neighboring devices. II-B Data Heterogeneity Fig. 1: Clustered data heterogeneity. Each node represents a device, and each background region denotes a different underlying feature distribution. Devices within the same cluster collect data from the same distribution, whereas devices across different clusters observe non-IID data. Data heterogeneity is one of the main challenges in FL [ 17 ] , since clients usually collect data through different devices, sensors, users, or environmental conditions rather than sampling from a single shared distribution. In real-world deployments, two clients may observe the same task from different perspectives: for instance, images of the same classes may be captured under different lighting conditions, cameras, backgrounds, styles, or noise patterns. Similarly, sensing devices deployed in different environments may measure the same type of phenomenon while being exposed to different local dynamics. Such