Topological Federated Clustering via Gravitational Potential Fields under Local Differential Privacy

Yunbo Long, Jiaquan Zhang, Xi Chen, Alexandra Brintrup · 2025

Read Topological Federated Clustering via Gravitational Potential Fields under Local Differential Privacy by Yunbo Long, Jiaquan Zhang, Xi Chen, Alexandra Brintrup (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-00849.txt.

Introduction

Yunbo Long, Jiaquan Zhang, Xi Chen, and Alexandra Brintrup tackle private clustering across sites in a 2025 paper. Federated clustering groups data held by many owners without pooling it. Local differential privacy adds noise at each site to protect individual records before anything is shared.

The challenge is keeping clusters accurate under strong noise and uneven data, without many rounds of communication. Older one-shot methods lean on unstable pairwise distances or rankings and degrade badly. The team's topological method uses gravitational potential fields to guide cluster centers. A steadier method could let hospitals or banks cluster jointly without exposing raw data.

Catalog record

CREATORYunbo Long, Jiaquan Zhang, Xi Chen, Alexandra Brintrup
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-00849

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Topological Federated Clustering via Gravitational Potential Fields under Local Differential Privacy Yunbo Long, Jiaquan Zhang, Xi Chen, Alexandra Brintrup Abstract Clustering non-independent and identically distributed (non-IID) data under local differential privacy (LDP) in federated settings presents a critical challenge: preserving privacy while maintaining accuracy without iterative communication. Existing one-shot methods rely on unstable pairwise centroid distances or neighborhood rankings, degrading severely under strong LDP noise and data heterogeneity. We present Gravitational Federated Clustering (GFC), a novel approach to privacy-preserving federated clustering that overcomes the limitations of distance-based methods under varying LDP. Addressing the critical challenge of clustering non-IID data with diverse privacy guarantees, GFC transforms privatized client centroids into a global gravitational potential field where true cluster centers emerge as topologically persistent singularities. Our framework introduces two key innovations: (1) a client-side compactness-aware perturbation mechanism that encodes local cluster geometry as ”mass” values, and (2) a server-side topological aggregation phase that extracts stable centroids through persistent homology analysis of the potential field’s superlevel sets. Theoretically, we establish a closed-form bound between the privacy budget ϵ \epsilon and centroid estimation error, proving the potential field’s Lipschitz smoothing properties exponentially suppress noise in high-density regions. Empirically, GFC outperforms state-of-the-art methods on ten benchmarks, especially under strong LDP constraints ( ϵ < 1 \epsilon<1 ), while maintaining comparable performance at lower privacy budgets. By reformulating federated clustering as a topological persistence problem in a synthetic physics-inspired space, GFC achieves unprecedented privacy-accuracy trade-offs without iterative communication, providing a new perspective for privacy-preserving distributed learning. The code is available at https://github.com/Yunbo-max/Topological˙Federated˙Clustering . Introduction Federated learning (FL) has emerged as a crucial privacy-preserving paradigm for training machine learning models on decentralized data ( 10 ) . Although initially developed for supervised tasks, FL is increasingly being adapted to unsupervised learning scenarios, particularly clustering, to analyze distributed unlabeled data. Standard federated clustering methods, such as federated k-means ( 4 ) , exchange aggregated data representations (e.g., cluster centroids) rather than raw client data ( 5 ) . While this prevents direct exposure of individual data points, it fails to provide formal privacy guarantees. For example, a hospital with few pediatric cancer patients may publish a centroid so close to individual records that adversaries can reconstruct original diagnoses, e.g. in extreme conditions only one patient is recorded, hence the centroid is this individual’s data. Differential privacy (DP) provides rigorous privacy guarantees by injecting calibrated noise into computations. While centralized DP ( 2 ) protects only the final aggregated output, local differential privacy (LDP) ( 17 ) enforces privacy at the client level by requiring data randomization before any communication occurs. This is critical for federated learning scenarios where the server cannot be trusted. However, LDP poses significant challenges for clustering algorithms: the client-side noise required to achieve strong privacy ( \varepsilon<1.0 ) often disrupts the geometric relationships between points that clustering relies upon, leading to degraded utility. Figure 1: Gravitational Federated Clustering Pipeline. Recently, FedDP-KMeans demonstrated the effectiveness of federated clustering under differential privacy by proposing an improved cluster initialization method combined with DP-Lloyds ( 14 ) . However, its multi-round communication exacerbates privacy costs due to composition, as each Lloyd’s iteration requires fresh client-server interaction. This results in increased latency and bandwidth overhead. Such constraints explain the preference for one-shot methods in production FL systems, where communication efficiency is critical—especially given heterogeneous client connectivity. For instance, K-FED ( 4 ) clusters local centroids to derive global ones, while MUFC ( 12 ) enhances performance on imbalanced, non-IID data. The key challenge for one-shot federated clustering lies in accurately estimating global centroids under varying privacy budgets while limiting communication to a single round—eliminating the possibility of iterative refinement. Existing theoretical guarantees rely heavily on the assumption that geometric properties(connectedness and distance) remain intact after noise injection ( 16 ) . However, this assumption breaks down in practical settings with strict privacy budgets (e.g., \epsilon<1 ), where the noise magnitude becomes large enough to severely distort the underlying data structure, as evidenced by the catastrophic failure of baseline methods in Figure 3 . Therefore, we propose Gravitational Federated Clustering (GFC), a one-shot federated clustering method designed to handle varying Local Differential Privacy (LDP) constraints. Unlike existing approaches that rely on noise-corrupted distance metrics or raw centroids, GFC reformulates clustering as a dynamic topological feature extraction process for global centroid search. By constructing a gravitational potential field from privatized client data (augmented with synthetic data), GFC robustly adapts to privacy budgets ranging from \epsilon=1000 (weak privacy) to \epsilon=0.01 (extremely strong privacy). To summarize, our main contributions are as follows: • We propose the first one-shot federated clustering method GFC, that effectively handles varying LDP by modeling clustering as a topological persistence problem within a gravitational potential field. This avoids reliance on noise-sensitive distance metrics. • We provide a theoretical analysis of topological feature extraction via homotopy equivalence and introduce an efficient tree-splitting algorithm to recover cluster structures from the potential field. The final centroids are then derived from the leaves of the constructed tree. • Extensive experiments on ten real-world federated benchmarks show that GFC outperforms state-of-the-art one-shot methods under varying differential privacy (DP) constraints, particularly for small privacy budgets ( \varepsilon<1 ). We further present a privacy-accuracy boundary analysis to quantify the relationship between centroid accuracy and the privacy budget. (a) 3D Plot (b) Contours (c) 2D Gravitational Field (d) Clustering Figure 2: Examples of Topological Analysis for GFC on MNIST Data Visualized via UMAP Projection Related Work Our work addresses the central challenge of achieving accurate clustering under Local Differential Privacy (LDP) in federated settings. Federated Clustering Federated clustering enables decentralized data analysis by preserving privacy, avoiding raw data centralization. Early iterative methods like federated k-means required many communication rounds to refine centroids ( 5 ) . To enhance efficiency, one-shot methods became standard, where clients perform local clustering and send results (e.g., centroids or density cores) to the server for a single aggregation. Key examples include K-FED ( 4 ) , MUFC ( 12 ) , and NNFC ( 1 ) , which use advanced aggregation to handle non-IID and imbalanced data. To address data heterogeneity, Clustered FL (CFL) groups clients by distribution to train specialized models ( 13 ; 6 ; 8 ) , enhancing performance and fairness ( 18 ; 7 ) . However, these methods are vulnerable under strong privacy constraints. Differential Privacy in Federated Clustering In differential privacy, bounded sensitivity is enforced by clipping each data point to satisfy |\mathbf{x}_{i}|_{1}\leq\Delta , where \Delta controls the maximum influence of any single sample and \epsilon determines the privacy-utility trade-off. Clients then release privatized data as \tilde{\mathbf{x}}_{i}=\mathbf{x}_{i}+\boldsymbol{\eta}_{i} , with \boldsymbol{\eta}_{i}\sim\text{Laplace}(0,\Delta/\epsilon) , and we refer to \epsilon -differential privacy as DP with noise \eta\sim\text{Laplace}(0,1/\epsilon) . To ensure formal privacy guarantees in federated clustering with an untrusted server, we adopt client-level local differential privacy (LDP), which treats the entire client dataset \mathcal{D}_{m} as the privacy unit, following ( 14 ) . Unlike data-point-level DP, which protects individual samples, client-level LDP safeguards the whole dataset without scaling noise per data point, simplifying sensitivity control. However, this stronger privacy model introduces a conflict with clustering accuracy: under small \epsilon , the injected noise dominates pairwise distances, scaling with \mathcal{O}(d/\epsilon^{2}) and

Read the complete text