Large Language Model Empowered Privacy-Protected Framework for PHI Annotation in Clinical Notes
Guanchen Wu, Linzhi Zheng, Han Xie, Zhen Xiang, Jiaying Lu, Darren Liu, Delgersuren Bold, Bo Li, Xiao Hu, Carl Yang * · 2025
Read Large Language Model Empowered Privacy-Protected Framework for PHI Annotation in Clinical Notes by Guanchen Wu, Linzhi Zheng, Han Xie, Zhen Xiang, Jiaying Lu, Darren Liu, Delgersuren Bold, Bo Li, Xiao Hu, Carl Yang * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-18569.txt.
Introduction
Guanchen Wu and nine co-authors build a privacy safe way to scrub patient details from clinical notes in a 2025 paper. Records must lose names and other private marks before release, yet rule based and learned scrubbers generalize poorly or need big tagged sets. Language models read well enough to help, but cloud models risk leaks and local ones cost dearly.
Their frame, LPPA, tunes a model locally on fake notes, so real records never leave the building. The tuned model then tags private spans in real notes for removal. Wide tests show high tagging accuracy with strong privacy kept. The authors pitch the blend as a scalable path for hospitals that cannot ship data out. English notes are the target in this version.
Catalog record
| CREATOR | Guanchen Wu, Linzhi Zheng, Han Xie, Zhen Xiang, Jiaying Lu, Darren Liu, Delgersuren Bold, Bo Li, Xiao Hu, Carl Yang * |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-18569
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Large Language Model Empowered Privacy-Protected Framework for PHI Annotation in Clinical Notes Guanchen Wu, Linzhi Zheng, Han Xie, Zhen Xiang, Jiaying Lu, Darren Liu, Delgersuren Bold, Bo Li, Xiao Hu, Carl Yang * Abstract . The de-identification of private information in medical data is a crucial process to mitigate the risk of confidentiality breaches, particularly when patient personal details are not adequately removed before the release of medical records. Although rule-based and learning-based methods have been proposed, they often struggle with limited generalizability and require substantial amounts of annotated data for effective performance. Recent advancements in large language models (LLMs) have shown significant promise in addressing these issues due to their superior language comprehension capabilities. However, LLMs present challenges, including potential privacy risks when using commercial LLM APIs and high computational costs for deploying open-source LLMs locally. In this work, we introduce LPPA, an L LM-empowered P rivacy-protected P HI A nnotation framework for clinical notes, targeting the English language. By fine-tuning LLMs locally with synthetic notes, LPPA ensures strong privacy protection and high PHI annotation accuracy. Extensive experiments demonstrate LPPA’s effectiveness in accurately de-identifying private information, offering a scalable and efficient solution for enhancing patient privacy protection. 1 1 footnotetext: Corresponding author: [email protected] 1. Introduction Clinical notes ( Boag et al. 2018 ) are unstructured text records that document patient encounters during healthcare, commonly including types such as discharge notes, nursing notes, ECG reports, and radiology reports. Discharge notes, in particular, provide detailed accounts of a patient’s hospital stay, capturing physicians’ observations, patient interactions, social and behavior determinants of health ( Fu et al. 2024 ) , and other clinical nuances. These details go beyond the commonly used structured information ( e.g. diagnosis, medication, procedures, etc.) stored in Electronic Health Records (EHR), offering insights that are critical for understanding patient conditions and optimizing treatment decisions. The increased sharing of clinical notes holds significant potential to advance healthcare by facilitating more comprehensive studies of disease patterns and accelerating data-driven research through access to richer and more detailed patient data. In this work, we utilize the most comprehensive discharge notes as the major data source, but our proposed methods can be generalized to other types of clinical notes. Figure 1. Illustration of existing de-identification methods and our proposed de-identification framework. However, the sharing of clinical notes across medical and research institutions faces a critical challenge due to patient privacy, as these notes often contain highly sensitive Protected Health Information (PHI) ( Moore and Frye 2019 ) . PHI includes identifiable details such as patient names and Social Security Numbers, which can be used to trace specific individuals. For instance, a clinical note might read: “ John Doe, a 45-year-old male, was diagnosed with hypertension on May 3, 2023 ” where the name, age, and diagnosis date are all PHI. In accordance with the Health Insurance Portability and Accountability Act (HIPAA) ( Cohen and Mello 2018 ) , PHI must be thoroughly removed or masked before clinical notes can be shared, posing significant challenges in efficiently sharing the high-utility clinical notes at scale. Most existing methods for de-identifying private information in text utilize sequence tagging techniques, ranging from rule-based ( Gupta et al. 2004 ) to learning-based approaches ( Guo et al. 2006 ; Li et al. 2016 ) , each with limitations. Rule-based systems, which rely on predefined patterns, struggle with the variability and complexity of clinical text, limiting their scalability. Learning-based methods, including traditional machine learning models like Support Vector Machines (SVMs) and Conditional Random Fields (CRFs), as well as deep learning models such as Recurrent Neural Networks (RNNs) and Long Short-Term Memory networks (LSTMs), improve performance by learning features from data. However, they require large annotated datasets, manual feature selection, and may risk overfitting with limited data. More recently, pre-trained language models (PLMs) like BERT and large language models (LLMs) such as GPT have shown promise in PHI annotation ( Rezayi et al. 2022 ; Liu et al. 2023 ) , but they face challenges with domain-specific language, high computational costs, and data privacy concerns, especially in healthcare under regulations like HIPAA. In this work, we propose a framework of L LM-empowered P rivacy-protected P HI A nnotation (LPPA), designed to address key limitations of existing de-identification methods, including data scarcity and privacy concerns. Our framework offers two significant contributions: 1) it leverages the flexibility of pre-trained LLMs and few-shot learning to generate synthetic clinical notes, thereby eliminating the need for manual feature engineering and large annotated datasets while capturing the language complexity of real-world clinical notes, and 2) it ensures robust data privacy by fine-tuning a locally hosted LLM for PHI annotation, thus mitigating reliance on external APIs and reliably protecting sensitive information. We evaluate the proposed framework on both real-world and synthetic clinical notes, benchmarking its performance against a rule-based approach and various LLMs. Our method achieves an F1 score of 0.57 on the real-world clinical note dataset, closely approaching the performance of state-of-the-art LLMs. This result underscores the framework’s comparable accuracy while offering additional advantages, such as greater efficiency, scalability, and almost-zero reliance on annotated datasets, making it a practical and privacy-conscious solution for PHI annotation. 2. Related Work Current approaches to de-identification of medical records span from traditional rule-based systems to learning-based methods and more recent LLMs, each facing unique limitations and challenges. Rule-Based Systems. Traditional approaches for private information annotation, such as rule-based systems, rely on predefined patterns and domain-specific dictionaries for PHI extraction ( Gupta et al. 2004 ; Uzuner et al. 2007 ) . The PhysioNet de-identification software package ( Neamatullah et al. 2008 ) , for instance, uses lexical look-up tables, regular expressions, and simple heuristics to identify PHI in free-text medical records. This system demonstrated high recall and precision but remains limited in scalability and adaptability to unstructured clinical narratives. While effective for structured text, rule-based methods often falter when dealing with the variability and complexity of unstructured clinical narratives, leading to inconsistent results. Additionally, maintaining and scaling these systems, particularly across datasets in different languages, is labor-intensive and inefficient. Learning-Based Methods. Machine learning techniques, such as SVMs and CRFs, address some limitations by learning features from annotated datasets ( Guo et al. 2006 ; Li et al. 2008 ) . However, SVMs struggle with high-dimensional feature spaces, and while CRFs are more effective for sequential data, they require extensive manual feature engineering. Additionally, both models often fail to generalize across domains due to variations in data annotation and structure, limiting their broader applicability. Deep learning models, including RNNs ( Li et al. 2016 ; Dernoncourt et al. 2017 ) and LSTMs ( Khin et al. 2018 ; Madan et al. 2018 ) , advance PHI annotation by automatically extracting features, reducing reliance on manual feature selection. However, they also require large annotated datasets to prevent overfitting. Moreover, the computational resources needed for training and inference add complexity, making these models difficult to scale in resource-constrained environments. The 2014 i2b2/UTHealth shared task demonstrated the effectiveness of hybrid approaches combining CRFs with rule-based systems ( Stubbs et al. 2015 ) . This task focused on de-identifying longitudinal clinical narratives, expanding PHI categories beyond HIPAA standards to include professions and full dates