The Double-edged Sword of LLM-based Data Reconstruction: Understanding and Mitigating Contextual Vulnerability in Word-level Differential Privacy Text Sanitization Conference: Proceedings of the 2025 Workshop on Privacy in the Electronic Society; October 13–17, 2025; Taipei, Taiwan Proceedings of th
Stephen Meisenbacher, Alexandra Klymenko, Andreea-Elena Bodea, Florian Matthes · 2025
Read The Double-edged Sword of LLM-based Data Reconstruction: Understanding and Mitigating Contextual Vulnerability in Word-level Differential Privacy Text Sanitization Conference: Proceedings of the 2025 Workshop on Privacy in the Electronic Society; October 13–17, 2025; Taipei, Taiwan Proceedings of th by Stephen Meisenbacher, Alexandra Klymenko, Andreea-Elena Bodea, Florian Matthes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-18976.txt.
Introduction
Stephen Meisenbacher and co-authors study a privacy risk in cleaned text in a 2025 paper. Word-level differential privacy scrambles words to give provable privacy, yet the cleaned text can keep contextual clues from the original. Large language models can exploit those clues to rebuild private details.
The authors call this power a double-edged sword: the same reconstruction skill that fixes garbled text can undo privacy work. They examine the vulnerability and ways to reduce it. Their findings matter for anyone publishing sanitized text, from hospitals to social platforms, under a privacy promise.
Catalog record
| CREATOR | Stephen Meisenbacher, Alexandra Klymenko, Andreea-Elena Bodea, Florian Matthes |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 104 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-18976
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Double-edged Sword of LLM-based Data Reconstruction: Understanding and Mitigating Contextual Vulnerability in Word-level Differential Privacy Text Sanitization Conference: Proceedings of the 2025 Workshop on Privacy in the Electronic Society; October 13–17, 2025; Taipei, Taiwan Proceedings of the 2025 Workshop on Privacy in the Electronic Society (WPES ’25), October 13–17, 2025, Taipei, Taiwan DOI: 10.1145/3733802.3764058 ISBN: 979-8-4007-1898-4/2025/10 CCS: Security and privacy Privacy protections CCS: Security and privacy Data anonymization and sanitization CCS: Computing methodologies Natural language processing Stephen Meisenbacher, Alexandra Klymenko, Andreea-Elena Bodea, Florian Matthes Abstract . Differentially private text sanitization refers to the process of privatizing texts under the framework of Differential Privacy (DP), providing provable privacy guarantees while also empirically defending against adversaries seeking to harm privacy. Despite their simplicity, DP text sanitization methods operating at the word level exhibit a number of shortcomings, among them the tendency to leave contextual clues from the original texts due to randomization during sanitization – this we refer to as contextual vulnerability . Given the powerful contextual understanding and inference capabilities of Large Language Models (LLMs), we explore to what extent LLMs can be leveraged to exploit the contextual vulnerability of DP-sanitized texts. We expand on previous work not only in the use of advanced LLMs, but also in testing a broader range of sanitization mechanisms at various privacy levels. Our experiments uncover a double-edged sword effect of LLM-based data reconstruction attacks on privacy and utility: while LLMs can indeed infer original semantics and sometimes degrade empirical privacy protections, they can also be used for good , to improve the quality and privacy of DP-sanitized texts. Based on our findings, we propose recommendations for using LLM data reconstruction as a post-processing step, serving to increase privacy protection by thinking adversarially. † † cc-license: by 1. Introduction The application of Differential Privacy (DP) ( Dwork 2006 ) in Natural Language Processing (NLP) has been actively pursued by researchers in recent years, particularly to bring the robust guarantees promised by DP into the realm of language data processing, where the prevalence of sensitive data is particularly high. Incorporating DP guarantees directly on text data itself, referred to as differentially private text sanitization ( Yue et al. 2021 ) , offers direct privacy guarantees on potentially sensitive texts, but the application of DP is not as straightforward as with more structured domains ( Klymenko et al. 2022 ) . Concretely, the discrete yet highly creative nature of language ( Brown et al. 2022 ) , the high dimensionality required to represent language numerically ( Feyisetan et al. 2021 ) , and the procedures required to augment representations to adhere to the DP framework ( Igamberdiev and Habernal 2023 ) , all lead to unique challenges in achieving DP NLP. An early and intuitive class of solutions to fuse DP into NLP began at the base unit of language: the word ( Feyisetan et al. 2020 ) . Word-level DP text sanitization approaches typically involve mapping an input word to a “noisy” output word that fulfills DP guarantees according to a chosen \varepsilon parameter, known as the privacy budget . This guarantee can be fulfilled in a number of ways, primarily either by adding noise to word embedding representations, or by using the Exponential Mechanism to randomize among a set of candidate replacement words ( Hu et al. 2024 ) . Here, it is important to note that the privacy guarantee (i.e., adhering to DP) is given per word , and that nearly all relevant literature leverages the notion of metric local DP (MLDP), where sanitization is performed locally by the user ( Meisenbacher et al. 2024b ) . A potential practical problem arises when considering the fact that word-level guarantees are not entirely useful in isolation, and that NLP tasks often necessitate full texts for implementing downstream tasks ( Yue et al. 2021 ) . Fortunately, DP allows for a transition from word-level to document-level guarantees, in that the property of compositionality can be leveraged to reason about how word-level guarantees can be composed ( Feyisetan et al. 2020 ; Meisenbacher et al. 2025b ) . In particular, sanitizing all the n tokens in a given document with privacy budget \varepsilon=3 can be composed for a document-level budget of 3n , leading to a unified, albeit weaker, guarantee from component sanitization steps. The major downside with respect to privacy when leveraging such compositionality was revealed in a recent work by Tong et al. 2025 , who highlight the vulnerabilities introduced to word-level DP text sanitization when considering context . The specific risks lie in the fact that while single word-level perturbations are performed in isolation, sanitizing (privatizing) an entire document leaves contextual clues which may aid a capable attacker in deducing both the overall original meaning, as well as in inferring original words based on context. This only exacerbates the challenges of word-level DP methods, which have already been criticized for their lack of contextual awareness ( Mattern et al. 2022 ) , wherein this limitation also opens the door to adversarial inference attacks. Despite the important vulnerabilities demonstrated by Tong et al. 2025 , we highlight three major limitations of the work. (1) Firstly, the authors only consider two mechanisms from a particular subclass of word-level DP mechanisms leveraging the Exponential Mechanism, namely SanText ( Yue et al. 2021 ) and CusText ( Chen et al. 2023 ) , thereby leaving it unknown how vulnerable other DP methods may be. (2) Secondly, according to our understanding of the work, in the execution of the sanitization steps, the authors do not set uniform document-level budgets, but instead choose word-level \varepsilon values that are applied in an unbounded fashion to all texts (more on this in Section 4.1 ), thereby not ensuring a fair comparison across all texts in a dataset. (3) Finally, the authors rely on BERT-based inference attacks, not exploring the inferential abilities of more advanced generative LLMs. We address these key limitations, with the goal of extending the findings of Tong et al. 2025 and broadening the understanding and extent of contextual vulnerability in word-level DP text sanitization methods. Following an initial reproduction case study with SanText , we implement LLM-based adversarial inference attacks on three additional word-level DP methods across a variety of \varepsilon budgets, with the ultimate goal of (original) data reconstruction. We test the vulnerability of all four methods on three datasets, measuring privacy vulnerability using semantic and task-based metrics. Based on these results, we conduct a critical analysis, leading to recommendations for the field going forward. Our findings reveal that although LLM-based data reconstruction attacks on DP-sanitized texts can serve to recapture semantics, degrade utility, and sometimes increase attacker performance, doing so also can prove to be beneficial as a post-processing step after sanitization. In particular, we find that in some settings, using LLMs after DP text sanitization strengthens defense against adversarial attacks, increases plausible deniability , and improves the privacy-utility trade-off , while always significantly improving text coherence. These results ground an analysis of the dangers and merits of DP text sanitization, leading to a set of practical recommendations. We advance DP text privatization by widening the understanding of the contextual vulnerability of word-level MLDP. Specifically: (1)