A Hybrid AI-based and Rule-based Approach to DICOM De-identification: A Solution for the MIDI-B Challenge DOI: 10.59275/j.melba.2024-AAAA Volume: 2

\firstname Hamideh \surname Haghiri \aff 1 (ORCID: 0009-0006-7308-4235 ), \firstname Rajesh \surname Baidya \aff 1 (ORCID: 0009-0003-5235-1769 ), \firstname Stefan \surname Dvoretskii \aff 1 (ORCID: 0000-0001-7769-0167 ), \firstname Klaus H. \surname Maier-Hein \aff 1,2 (ORCID: 0000-0002-6626-2463 ) · 2025

Read A Hybrid AI-based and Rule-based Approach to DICOM De-identification: A Solution for the MIDI-B Challenge DOI: 10.59275/j.melba.2024-AAAA Volume: 2 by \firstname Hamideh \surname Haghiri \aff 1 (ORCID: 0009-0006-7308-4235 ), \firstname Rajesh \surname Baidya \aff 1 (ORCID: 0009-0003-5235-1769 ), \firstname Stefan \surname Dvoretskii \aff 1 (ORCID: 0000-0001-7769-0167 ), \firstname Klaus H. \surname Maier-Hein \aff 1,2 (ORCID: 0000-0002-6626-2463 ) (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-00437.txt.

Introduction

Hamideh Haghiri, Rajesh Baidya, Stefan Dvoretskii, Klaus H. Maier-Hein, and Marco Nolden present a hybrid framework in 2025 for de-identifying medical imaging files. DICOM is the standard format for medical images and their metadata. Safe sharing requires stripping personal identifiers from both structured fields and text burned into images.

A rule-based component follows the DICOM standard and archive best practices for structured data. PaddleOCR extracts text from image pixels, and a fine-tuned RoBERTa model finds and removes personal and health identifiers in free text. The hybrid was built for the MIDI-B challenge on medical image de-identification. Combining rules with learned models covers both tidy fields and messy embedded text.

Catalog record

CREATOR\firstname Hamideh \surname Haghiri \aff 1 (ORCID: 0009-0006-7308-4235 ), \firstname Rajesh \surname Baidya \aff 1 (ORCID: 0009-0003-5235-1769 ), \firstname Stefan \surname Dvoretskii \aff 1 (ORCID: 0000-0001-7769-0167 ), \firstname Klaus H. \surname Maier-Hein \aff 1,2 (ORCID: 0000-0002-6626-2463 )
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-00437

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Hybrid AI-based and Rule-based Approach to DICOM De-identification: A Solution for the MIDI-B Challenge DOI: 10.59275/j.melba.2024-AAAA Volume: 2 \firstname Hamideh \surname Haghiri \aff 1 (ORCID: 0009-0006-7308-4235 ), \firstname Rajesh \surname Baidya \aff 1 (ORCID: 0009-0003-5235-1769 ), \firstname Stefan \surname Dvoretskii \aff 1 (ORCID: 0000-0001-7769-0167 ), \firstname Klaus H. \surname Maier-Hein \aff 1,2 (ORCID: 0000-0002-6626-2463 ), \firstname Marco \surname Nolden \aff 1,2 (ORCID: 0000-0001-9629-0564 ) Abstract Ensuring the de-identification of medical imaging data is a critical step in enabling safe data sharing. This paper presents a hybrid de-identification framework designed to process Digital Imaging and Communications in Medicine (DICOM) files . Our framework adopts a modified, pre-built rule-based component, updated with The Cancer Imaging Archive (TCIA)’s best practices guidelines, as outlined in DICOM PS 3.15, for improved performance. It incorporates PaddleOCR, a robust Optical Character Recognition (OCR) system for extracting text from images, and RoBERTa, a fine-tuned transformer-based model for identifying and removing Personally Identifiable Information (PII) and Protected Health Information (PHI). Initially, the transformer-based model and the rule-based component were integrated to process for both structured data and free text. However, this coarse-grained approach did not yield optimal results. To improve performance, we refined our approach by applying the transformer model exclusively to free text, while structured data was handled only by rule-based methods. In this framework the DICOM validator dciodvfy was leveraged to ensure the integrity of DICOM files after the deID process. Through iterative refinement, including the incorporation of custom rules and private tag handling, the framework achieved a de-identification accuracy of 99.91% on the MIDI-B test dataset. The results demonstrate the effectiveness of combining rule-based compliance with AI-enabled adaptability in addressing the complex challenges of DICOM de-identification. Our code is available at https://github.com/MIC-DKFZ/miccai2024_midi-b-submission . \melbaid YYYY:NNN \melbaauthors Haghiri et al. \firstpageno 1 \melbayear 2025 \datesubmitted 2025-04-30 \datepublished yyyy-m2-d2 \melbaspecialissue Medical Imaging with Deep Learning (MIDL) 2020 \melbaspecialissueeditors Marleen de Bruijne, Tal Arbel, Ismail Ben Ayed, Hervé Lombaert \ShortHeadings A Hybrid AI-based and Rule-based Approach to DICOM De-identificationHaghiri et al. \affiliations \num 1 \addr Division of Medical and Biological Informatics, German Cancer Research Center, Heidelberg, Germany \num 2 \addr Pattern Analysis and Learning Group, Department of Radiation Oncology, Heidelberg University Hospital, Heidelberg, Germany keywords DICOM De-identification, AI-based de-identification, Rule-based de-identification, Protected Health Information (PHI), Personally Identifiable Information, RoBERTa model, PaddleOCR 1 Introduction Imaging plays a crucial role in numerous areas of medical and laboratory research, as well as clinical practice ( Daoud and Otair 2020 ) . The growing access to medical images presents significant opportunities for research and development in healthcare. However, protecting patient privacy remains critical. This is where medical image de-identification becomes important. It involves removing or obscuring Personally Identifiable Information (PII) and Protected Health Information (PHI) from medical images and their related metadata ( Saint-Clair 2022 ) . PII includes direct identifiers such as names and birth dates, while PHI encompasses additional health-related identifiers such as medical record numbers and diagnostic codes ( NCI 2023 ) . By effectively de-identifying medical images, we can safely share data for research, algorithm development, and other valuable purposes without compromising patient confidentiality ( Saint-Clair 2022 ) . This paper presents our approach to the Medical Image De-Identification Benchmark (MIDI-B) challenge. MIDI-B offers a platform for developing and evaluating state-of-the-art de-identification of Digital Imaging and Communications in Medicine (DICOM) files using a large-scale, diverse data set aimed at accelerating progress in this critical domain ( Rutherford et al. 2021 ) . 2 Related Works De-identification of medical images is a crucial step in ensuring privacy and compliance with data protection regulations such as the Health Insurance Portability and Accountability Act (HIPAA) and the General Data Protection Regulation (GDPR). Existing de-identification processes can be broadly classified into two main categories: DICOM header de-identification and pixel-level PII and PHI removal ( Shahid et al. 2022 ) . To prevent re-identification, these attributes must be de-identified while preserving data utility and compliance with DICOM standards ( NEMA 2023 ) From the literature, we identify three main approaches to develop de-identification methods: 2.1 Rule-Based DICOM De-identification Rule-based approaches have traditionally been the most widely used methods for de-identifying DICOM metadata. Free DICOM de-identification tools have been extensively analyzed in previous studies, such as Aryanto et al. ( Aryanto et al. 2015 ) , where ten noncommercial DICOM toolkits were evaluated for their effectiveness in removing PHI from DICOM headers. The study found that only five tools could fully de-identify required elements, with four requiring careful customization. This highlights the limitations of rule-based approaches in ensuring complete de-identification, as different tools apply varying de-identification profiles with inconsistent results. While rule-based methods offer high interpretability and compliance with DICOM standard, they often lack adaptability when dealing with unstructured or non-standard metadata. Additionally, they require ongoing maintenance to ensure compliance with evolving regulatory standards. 2.2 AI-based De-identification Recent advancements in machine learning (ML) and natural language processing (NLP) have facilitated AI-driven de-identification techniques. A systematic review by ( Kovačević et al. 2024 ) analyzed AI-based de-identification methods for electronic health records (EHRs) from 2010 to 2023, covering 69 studies. The findings indicate that ML and hybrid models dominate the field, while rule-based approaches are less frequently used. The i2b2/UTHealth corpus, a widely recognized dataset, remains the most commonly used benchmark for de-identification research. Earlier AI-based methods relied on feature engineering and hybrid rule-ML approaches, whereas recent advancements leverage attention-based neural networks, achieving F1-scores exceeding 98% on certain datasets. However, these models face challenges in generalizing across diverse clinical domains without additional manually labeled training data, raising concerns about their reliability in real-world applications. The study emphasizes the importance of improving evaluation metrics and expanding training data diversity to enhance the robustness of AI-driven de-identification. Beyond text-based de-identification, deep learning methods have been applied to pixel-level PHI removal, particularly for burned-in PHI (e.g., embedded text in medical images). ( Khosravi et al. 2023 ) demonstrated the effectiveness of object detection models for radiographic marker removal while preserving essential medical annotations. However, AI-based de-identification also introduces challenges such as false positives, lack of interpretability, and regulatory concerns regarding automated data manipulation. 2.3 Hybrid AI-based and Rule-Based De-identification Hybrid approaches that combine rule-based and AI-driven techniques have been explored to enhance automation, accuracy, and regulatory compliance in de-identification. These approaches typically apply rule-based logic to structured metadata fields, while leveraging machine learning for unstructured or ambiguous cases. A recent example is MedDiSC, an open-source tool that integrates rule-based metadata de-identification, AI-based pixel data processing using Optical Character Recognition (OCR), and automated DICOM curation and segmentation ( Dimoulakis et al. 2024 ) . In MedDiSC, AI is primarily applied to the image level to detect and remove burned-in text, while metadata de-identification is handled through predefined rule sets. Our work adopts a hybrid approach that incorporates AI components for both metadata and pixel data de-identification, alongside rule-based mechanisms. This design reflects an effort to address unstructured information across multiple parts of the DICOM file, while maintaining alignment with existing standards. Further details are described in the following sections. 3 Methods 3.1 Overview Our framework adopts a hybrid design, integrating a modified prebuilt rule-based component, a robust OCR system, and a fine-tuned transformer-based model to handle both metadata and

Read the complete text