Augmenting Anonymized Data with AI: Exploring the Feasibility and Limitations of Large Language Models in Data Enrichment

Stefano Cirillo, Domenico Desiato, Giuseppe Polese, Monica Maria Lucia Sebillo, Giandomenico Solimando · 2025

Read Augmenting Anonymized Data with AI: Exploring the Feasibility and Limitations of Large Language Models in Data Enrichment by Stefano Cirillo, Domenico Desiato, Giuseppe Polese, Monica Maria Lucia Sebillo, Giandomenico Solimando (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03778.txt.

Introduction

Stefano Cirillo and four co-authors test AI enrichment of anonymized data in twenty twenty-five. Data archives hold sensitive, identifying details about people. Anonymization techniques such as k-anonymity protect subjects, but they also thin the data. Thinner data weakens the predictive processes that use it.

The authors ask whether large language models can enrich anonymized sources. The enrichment must add value without breaking anonymity. They designed custom prompt templates for that delicate task. Feasibility and limits are both explored in the study. Readers in data governance get a careful look at a tempting idea: using generative AI to restore utility that privacy protection removed, without restoring the risk.

Catalog record

CREATORStefano Cirillo, Domenico Desiato, Giuseppe Polese, Monica Maria Lucia Sebillo, Giandomenico Solimando
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-03778

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Augmenting Anonymized Data with AI: Exploring the Feasibility and Limitations of Large Language Models in Data Enrichment Stefano Cirillo, Domenico Desiato, Giuseppe Polese, Monica Maria Lucia Sebillo, Giandomenico Solimando Abstract Large Language Models (LLMs) have demonstrated advanced capabilities in both text generation and comprehension, and their application to data archives might facilitate the privatization of sensitive information about the data subjects. In fact, the information contained in data often includes sensitive and personally identifiable details. This data, if not safeguarded, may bring privacy risks in terms of both disclosure and identification. Furthermore, the application of anonymisation techniques, such as k-anonymity, can lead to a significant reduction in the amount of data within data sources, which may reduce the efficacy of predictive processes. In our study, we investigate the capabilities offered by LLMs to enrich anonymized data sources without affecting their anonymity. To this end, we designed new ad-hoc prompt template engineering strategies to perform anonymized Data Augmentation and assess the effectiveness of LLM-based approaches in providing anonymized data. To validate the anonymization guarantees provided by LLMs, we exploited the pyCanon library, designed to assess the values of the parameters associated with the most common privacy-preserving techniques via anonymization. Our experiments conducted on real-world datasets demonstrate that LLMs yield promising results for this goal. 1 Introduction The advances in information technology have led to numerous benefits and opportunities for industries, individuals, and society due to the increasing availability of data. The use of analytics approaches has led to the development of increasingly sophisticated applications, spanning from personalized medicine and e-commerce to crowd management and fraud detection. However, these applications have also introduced new privacy and ethical challenges. Data typically holds large amounts of personally identifiable information, e.g., criminal records, shopping habits, credit and medical history, enabling mass surveillance and profiling programs and raising several privacy issues. To prevent these issues from arising, data protection and privacy frameworks usually define strict requirements for the collection and processing of personally identifiable information. The General Data Protection Regulation (GDPR) has required organizations to collect, process, and share personal data only for legitimate and lawful purposes and to identify privacy risks that can affect data subjects periodically. Employing all measures and procedures to protect personally identifiable information can be costly and may lead to degradation of the quality of the information. Although anonymisation approaches reduce the risk of re-identification, they can significantly degrade the utility of the data. The resulting loss of data and the introduction of noise mean that predictive models trained on such anonymised datasets often perform poorly in comparison to those trained on raw data. Therefore, it is necessary to define approaches for augmenting data by ensuring their anonymisation. In this context, large language models (LLMs) offer promising capabilities in generating data for augmenting anonymised data sources. These models can generate synthetic datasets maintaining the statistical properties of the original data without compromising individual privacy. By creating high-fidelity synthetic data, LLMs can provide datasets that retain the utility required for effective machine learning while ensuring anonymity. In this work, we investigate the ability of LLMs to generate and augment anonymized datasets. In particular, we aim to provide insights into the effectiveness of LLM-based approaches to enrich anonymized data using new ad-hoc prompting template engineering strategies. To verify the anonymization guarantees offered by LLMs, we adopt a well-known Python library called pyCanon [ 13 ] that assesses the values of the parameters associated with the most common privacy-preserving techniques via anonymization. The main contributions of the proposed study are summarized as follows: • A new multimodal prompt engineering approach for interacting with LLMs by including real datasets in the prompts; • A formalization of the problem of augmenting anonymized data with LLMs; • A large evaluation of the most recent LLMs, such as ChatGPT and Claude 3 models, in generating data by preserving the anonymity of the data. The remainder of the paper is organized as follows. Section 2 discusses recent related work in the area. Section 3 provides an overview of the datasets, the Large Language Models, and the Anonymization Techniques used in our study. Section 4 describes the proposed strategy for augmenting anonymized data using LLMs, whereas Section 5 presents experimental results. Finally, Section 6 provides the conclusion and directions for future work. 2 Related Work Several anonymization techniques have been proposed to facilitate the sharing of sensitive data [ 12 ] . One of the most-known techniques is the k -anonymity [ 14 ] , which requires each record in the data to be indistinguishable from at least k-1 other records. k -anonymity is commonly achieved through generalization, which involves replacing attribute values with more general values based on an attribute taxonomy, and suppression, which entails deleting or masking attribute values [ 12 ] . Different approaches utilize various generalization strategies and schemes. The process of generalization can be applied to data either globally or locally [ 21 ] . Global schemes involve using the same level of generalization for all attributes, while local schemes allow for different levels of generalization to be applied to each attribute. While ensuring the privacy of individual records in the data, generalization leads to loss of information [ 7 ] . While k -anonymity protects against identity disclosure, often it does not guarantee sufficient protection against the disclosure of sensitive attributes. As a result, several other anonymization techniques have been defined, such as \ell -diversity, t -closeness, m -confidentiality, and p -probabilistic [ 21 ] that take into account the semantic closeness and distribution of the values of sensitive attributes. Mondrian has been extended to use value generalization hierarchies [ 9 ] and enable l -diversity [ 1 ] . A data anonymization algorithm ensuring k -anonymity and differential privacy was introduced in [ 2 ] , using attribute taxonomies and randomized best-first search through generalization hierarchies. The top-down greedy (TDG) anonymization approach [ 19 ] iteratively performs binary data partitioning, using a heuristic to split data into equivalence classes and the normalized certainty penalty (NCP) to evaluate information loss. Access to high-quality data is critical for successful AI model training. These issues make it difficult to achieve optimal results in a variety of AI applications, and can significantly reduce the development and performance of deep learning models. In this context, it is crucial to investigate strategies to perform anonymized Data Augmentation in order to mitigate the low availability of data. In [ 15 ] the authors propose two strategies to generate synthetic medical images with the use of a Generative Adversarial Network (GAN) to train deep learning models. In particular, proposes a method to generate synthetic magnetic resonance imaging (MRI) with brain tumours, to address the imbalance of the available medical imaging datasets in the literature. The results achieved demonstrate the effectiveness of the strategies by improving the performance of the models. In [ 3 ] the authors investigate the application of GANs for skin lesion analysis, addressing the challenge of limited training data. They investigate GAN utilization for both data augmentation and anonymization. The results show the effectiveness of the approach in addressing the challenges of in-distribution anonymised sets that can support the availability of limited anonymised data. The proposed study explores

Read the complete text