OpenDeID Pipeline for Unstructured Electronic Health Record Text Notes Based on Rules and Transformers: Deidentification Algorithm Development and Validation Study
Jiaxing Liu, Shalini Gupta, Aipeng Chen, Chen-Kai Wang, Pratik Mishra, Hong-Jie Dai, Zoie Shui-Yee Wong, Jitendra Jonnagaddala, Taiane de Azevedo Cardoso, Pei-fu Chen, Stephane Meystre · 2023
Read OpenDeID Pipeline for Unstructured Electronic Health Record Text Notes Based on Rules and Transformers: Deidentification Algorithm Development and Validation Study by Jiaxing Liu, Shalini Gupta, Aipeng Chen, Chen-Kai Wang, Pratik Mishra, Hong-Jie Dai, Zoie Shui-Yee Wong, Jitendra Jonnagaddala, Taiane de Azevedo Cardoso, Pei-fu Chen, Stephane Meystre (2023) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-10733816.txt.
Description
Jiaxing Liu, Shalini Gupta, and their co-authors built OpenDeID, a tool that strips private details from free text hospital notes so the notes can be used in research. Their 2023 study notes that health records hold rich information, but names and other sensitive facts must be removed first. Rule based tools and learning based tools each work, yet few studies had combined modern transformer models with rules.
The team built a corpus of 2,100 Australian health records from several centers as the base. Their pipeline mixes hand written rules with transformer language models. The study also tests how pretrained word representations and transformer models change the results. The finished tool is offered openly for other groups to use and check.
Catalog record
| CREATOR | Jiaxing Liu, Shalini Gupta, Aipeng Chen, Chen-Kai Wang, Pratik Mishra, Hong-Jie Dai, Zoie Shui-Yee Wong, Jitendra Jonnagaddala, Taiane de Azevedo Cardoso, Pei-fu Chen, Stephane Meystre |
|---|---|
| YEAR | 2023 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |