Deep Leakage with Generative Flow Matching Denoiser
Isaac Baglin, Xiatian Zhu, Simon Hadfield · 2026
Read Deep Leakage with Generative Flow Matching Denoiser by Isaac Baglin, Xiatian Zhu, Simon Hadfield (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15049.txt.
Introduction
Isaac Baglin, Xiatian Zhu, and Simon Hadfield test how private data can leak from shared model updates. Their 2026 arXiv paper deals with federated learning, where many devices train one model together. In a deep leakage attack, a foe rebuilds a client's raw data from its updates.
Past attack methods can be unstable or blurry. They also fare poorly under realistic settings. The authors pair the attack with a generative flow matching denoiser. The denoiser cleans the rebuilt data, which tests just how strong and how sharp such leaks can get.
Catalog record
| CREATOR | Isaac Baglin, Xiatian Zhu, Simon Hadfield |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-15049
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Deep Leakage with Generative Flow Matching Denoiser Isaac Baglin, Xiatian Zhu, Simon Hadfield Abstract Federated Learning (FL) has emerged as a powerful paradigm for decentralized model training, yet it remains vulnerable to deep leakage (DL) attacks that reconstruct private client data from shared model updates. While prior DL methods have demonstrated varying levels of success, they often suffer from instability, limited fidelity, or poor robustness under realistic FL settings. We introduce a new DL attack that integrates a generative Flow Matching (FM) prior into the reconstruction process. By guiding optimization toward the distribution of realistic images (represented by a flow matching foundation model), our method enhances reconstruction fidelity without requiring knowledge of the private data. Extensive experiments on multiple datasets and target models demonstrate that our approach consistently outperforms state-of-the-art attacks across pixel-level, perceptual, and feature-based similarity metrics. Crucially, the method remains effective across different training epochs, larger client batch sizes, and under common defenses such as noise injection, clipping, and sparsification. Our findings call for the development of new defense strategies that explicitly account for adversaries equipped with powerful generative priors. 1 Introduction FL has emerged as a decentralized paradigm for training Machine Learning (ML) models across multiple clients without requiring direct access to raw data ( McMahan et al. 2017 ) . Instead of pooling sensitive information on a central server, each client performs local training on its private dataset and communicates only the resulting model updates, typically gradients or parameters, to a coordinating server. The server then aggregates these updates to produce a global model that benefits from diverse data sources while ostensibly preserving user privacy. Two widely adopted aggregation schemes in FL are FedSGD and FedAvg ( McMahan et al. 2017 ) . In FedSGD, clients transmit gradient updates after every local iteration, enabling frequent synchronization but introducing significant communication overhead. By contrast, FedAvg allows clients to perform several local training steps before sharing updated model weights, thereby reducing communication costs. However, this comes at the expense of potential model staleness due to delayed synchronization ( Rodio & Neglia 2024 ; Karimireddy et al. 2021 ) . Despite the privacy-preserving promise of FL, it remains susceptible to gradient-based privacy attacks. Notably, Deep Leakage, in which adversaries optimize dummy inputs so that their gradients align with those shared by clients, ultimately reconstructing training samples that closely resemble the originals ( Zhu et al. 2019 ) . Such attacks can succeed under different threat models, including a man-in-the-middle adversary who intercepts communications ( Zhao et al. 2022 ) and an honest-but-curious (HbC) server that faithfully executes the FL protocol but inspects updates to extract sensitive information ( Geiping et al. 2020 ) . The HbC server is assumed to have full access to client updates, knowledge of the model architecture, loss function, and training procedure. By leveraging this information, the server can solve an inverse optimization problem to reconstruct private training samples. Figure 1 : Left: Traditional deep leakage attacks rely on denoising, which oversmooth and remove fine details. Right: Our method leverages a flow-matching prior to denoise while preserving realism and guiding reconstructions toward natural image distributions. While existing deep leakage attacks have made important progress, they still face a fundamental trade-off between realism and faithfulness. Classical inversion methods that rely heavily on traditional denoising tend to oversmooth the reconstruction, suppressing high-frequency details and producing blurry images that lack semantic clarity ( Sun & Simon 2021 ) . In contrast, recent approaches that incorporate generative priors such as GAN or diffusion-based models often succeed in producing visually realistic samples ( Jeon et al. 2021 ; Li et al. 2024 ) . However, these reconstructions frequently drift away from the actual training data, yielding images that are class-consistent but not faithful to the original private sample. This deviation undermines the privacy risk, since the adversary recovers “plausible” images rather than the true sensitive information. Our method directly addresses both of these limitations by reformulating a flow matching foundation model as a learned denoiser, and integrating it into the inversion process ( Lipman et al. 2023 ) . Unlike conventional denoising, which indiscriminately smooths out detail, our approach regularizes reconstructions toward the natural image distribution while still anchoring them closely to the gradient information contained in model updates ( Sun & Simon 2021 ; Geiping et al. 2020 ) . This dual guidance enables reconstructions that are both realistic and faithful, preserving fine-grained structure without drifting into unrelated but visually plausible modes. Our key contributions are as follows: • Generative flow matching prior for leakage attacks. We are the first to incorporate a generative flow matching prior into DL attacks. While previous methods have relied on GANs, diffusion models, or classical denoising priors ( Sun & Simon 2021 ; Jeon et al. 2021 ) , our FM approach uniquely models vector-field trajectories to guide reconstruction, resulting in both realistic and faithful reconstructions, a direction that, to the best of our knowledge, has not been explored in the context of DL privacy attacks. • Cross-distribution applicability. Unlike prior generative approaches, which assume access to sufficient data from the private distribution to train high-quality diffusion or GAN models, our method leverages a flow matching foundation model trained on an unrelated dataset ( Li et al. 2024 ; Li et al. 2022 ) . This relaxes attacker assumptions while still enabling high-fidelity reconstructions, significantly broadening the practicality of DL attacks. • A reproducible evaluation framework under realistic FL settings. We verify the viability of our attack across practical federated learning scenarios (different training epochs, models, batch sizes, State-Of-The-Art (SOTA) attacks and defenses) and provide a reproducible framework that can serve as a benchmark for future work on developing and evaluating much-needed defenses. 2 Related Work The Deep Leakage from Gradients (DLG) attack, introduced by Zhu et al., was the first approach to reconstruct images from gradients ( Zhu et al. 2019 ) . In this attack, a dummy image is iteratively optimized to minimize the Euclidean distance between its gradients and the real gradients available to an attacker. By leveraging L-BFGS to refine the dummy image, DLG was able to recreate images from a variety of datasets but was limited to working with gradients from randomly initialized networks ( Krizhevsky et al. ; Huang et al. 2007 ) . This reliance on untrained networks restricted its practical applications. Geiping et al. introduced the Inverting Gradients approach, which incorporated total variation (TV) regularization to denoise reconstructed images ( Geiping et al. 2020 ) . This advancement enabled successful attacks on trained networks, which typically present gradients with smaller magnitudes that complicate reconstruction. While TV improves stability, it also tends to oversmooth reconstructions, suppressing high-frequency details and leading to blurry results ( Sun & Simon 2021 ) . Building upon these ideas, Yin et al. developed DeepInversion, implementing more sophisticated regularization methods by combining \ell_{2} norm regularization with a novel batch normalization (BN) regularization term, which utilized the mean and variance of feature maps for improved recovery ( Yin et al. 2020 ) . In their subsequent work on GradInversion, they integrated these regularization techniques with a unique group consistency term, which optimized multiple random seeds concurrently to create a consensus image ( Yin