A General Knowledge Injection Framework for ICD Coding
Xu Zhang, Kun Zhang, Wenxin Ma, Rongsheng Wang , Chenxu Wu , Yingtai Li , S. Kevin Zhou · 2025
Read A General Knowledge Injection Framework for ICD Coding by Xu Zhang, Kun Zhang, Wenxin Ma, Rongsheng Wang , Chenxu Wu , Yingtai Li , S. Kevin Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18708.txt.
Introduction
Xu Zhang and co-authors present a 2025 framework that feeds medical code knowledge into an AI coder. Hospitals tag each case with ICD codes, and machines that assign the codes face a long tail of rare codes with scant proof in the text. Past fixes each tapped one kind of code knowledge with bespoke parts, which clashed and scaled poorly. The new design pours in three kinds at once: code descriptions, code synonyms, and the code family tree.
No special modules are needed, so the parts blend cleanly. Tests on standard coding data sets put the method at or near the top on most scores. The team released the code in the open. A single pipe for many knowledge kinds may lift other medical text tasks too.
Catalog record
| CREATOR | Xu Zhang, Kun Zhang, Wenxin Ma, Rongsheng Wang , Chenxu Wu , Yingtai Li , S. Kevin Zhou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18708
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A General Knowledge Injection Framework for ICD Coding Xu Zhang, Kun Zhang, Wenxin Ma, Rongsheng Wang , Chenxu Wu , Yingtai Li , S. Kevin Zhou Abstract ICD Coding aims to assign a wide range of medical codes to a medical text document, which is a popular and challenging task in the healthcare domain. To alleviate the problems of long-tail distribution and the lack of annotations of code-specific evidence, many previous works have proposed incorporating code knowledge to improve coding performance. However, existing methods often focus on a single type of knowledge and design specialized modules that are complex and incompatible with each other, thereby limiting their scalability and effectiveness. To address this issue, we propose GKI-ICD , a novel, general knowledge injection framework that integrates three key types of knowledge, namely ICD Description, ICD Synonym, and ICD Hierarchy, without specialized design of additional modules. The comprehensive utilization of the above knowledge, which exhibits both differences and complementarity, can effectively enhance the ICD coding performance. Extensive experiments on existing popular ICD coding benchmarks demonstrate the effectiveness of GKI-ICD, which achieves the state-of-the-art performance on most evaluation metrics. Code is available at https://github.com/xuzhang0112/GKI-ICD . 1 Introduction International Classification of Diseases (ICD) 1 1 1 https://www.who.int/standards/classifications/classification-of-diseases is a globally used medical classification system, developed by the World Health Organization to classify diseases, symptoms, procedures, and external causes. The ICD coding task aims to assign the most accurate ICD codes to clinical texts, typically discharge summaries, for further medical billing and clinical research. Two main challenges arise in the ICD coding process Edin et al. (2023) . First, there is a tremendous number of ICD codes to assign in clinical practice, whose distribution is extremely long-tailed, and most of which are lacking in enough training samples. Second, as shown in Figure 1 , the occurrence of multiple ICD codes within a long medical document makes it hard for models to accurately link each ICD code with its corresponding evidence fragments. Human coders do not annotate the evidence of the ICD codes assigned by them, due to the complexity of this operation, only leaving document-level annotations to each medical document. Figure 1: An example of ICD coding: Occurrence of multiple codes and noisy content in a long medical text document makes it hard to link each ICD code to its corresponding evidence (marked in same color), explaining the necessity of incorporating code-specific knowledge. In recent years, numerous studies Ji et al. (2024) have explored the incorporation of ICD code-related knowledge to assist models in precisely locating evidence fragments related to specific ICD codes, thereby effectively and efficiently improving coding performance. Generally, three types of knowledge are involved in ICD coding: ICD Description, ICD Synonym, and ICD Hierarchy . Specifically, 1) ICD Description refers to the meaning of each ICD code, which is directly related to the coding process. Language models can leverage semantic mapping to identify the most relevant evidence fragments within a long medical text document, facilitating accurate classification. 2) ICD Synonym addresses the diversity of medical terminology, as a single ICD code may have multiple linguistic expressions. Incorporating synonyms helps the model recognize different variants of the same code, enhancing its robustness. 3) ICD Hierarchy organizes the relationships between codes. With tens of thousands of codes in ICD-9, these codes are not entirely independent. ICD Hierarchy provides a structured relationship between codes, particularly grouping rare codes with more common ones. Inherently, these three types of knowledge exhibit both differences and complementarity. However, existing methods typically focus on only one of these different types of knowledge and design specialized network architectures accordingly, making it hard to integrate other complementary knowledge. To utilize synonym knowledge, current approaches often employ a multi-synonym-attention mechanism, where each query corresponds to a synonym Yuan et al. (2022) ; Gomes et al. (2024) . To incorporate hierarchical knowledge, methods primarily rely on graph neural networks, treating the hierarchical structure as an adjacency matrix to aggregate code representations Xie et al. (2019) ; Ge et al. (2024) . Since these methods design specialized modules for individual knowledge types, the complexity of these modules makes it difficult to scale to advanced models. More importantly, the incompatibility between these specialized modules hinders their integration into a unified model, preventing the comprehensive utilization of all knowledge types. To address the above issue, we propose GKI-ICD, a novel synthesis-based multi-task learning fr to inject knowledge. In contrast to existing methods that often struggle with complex architectural designs and integration challenges, our method jointly leverages all types of knowledge without relying on specialized modules. Specifically, GKI-ICD consists of two key components: guideline synthesis and multi-task learning. The guideline synthesis incorporates ICD code knowledge to synthesize a guideline, ensuring that all the knowledge relevant to the raw sample is embedded within the guideline. Meanwhile, the multi-task learning mechanism requires the model to not only correctly classify the original samples but also make accurate predictions based on the synthesized guidelines. Additionally, it encourages the model to align the information extracted from the raw samples with that from the provided guidelines as closely as possible, thereby facilitating effective knowledge integration. Our main contributions are summarized as: \bullet To our knowledge, we are the first to inject ICD code knowledge without requiring any additional specially-designed networks or prompts , thus being able to integrate the three kinds of ICD code knowledge separately utilized before. \bullet We propose a novel synthesis-based multi-task learning mechanism, including guideline synthesis and multi-task learning, to inject ICD code knowldge into the coding model. \bullet We achieve state-of-the-art performance on most evaluation metrics on the ICD coding benchmarks MIMIC-III and MIMIC-III-50, proving not only the effectiveness of our knowledge injection framework, but also the necessity of multiple knowledge integration. 2 Related Work 2.1 ICD Coding Network The automatic ICD coding task is well established in the healthcare domain, and most of the approaches fisrt encode the discharge summary with a text encoder, and then use a label attention mechanism to attend, aggregate, and make predictions. Text encoder. Early ICD coding methods Mullenbach et al. (2018) ; Vu et al. (2021) ; Li and Yu (2020) ; Liu et al. (2021) primarily utilized convolutional neural networks (CNNs), recurrent neural networks (RNNs), and their variants as backbones, while recent approaches Huang et al. (2022) ; Edin et al. (2024) have been based on pretrained language models (LMs). Besides, large language models (LLMs) have been proved to perform worse on this task Boyle et al. (2023) , compared to fine-tuned small models. Label attention. Instead of making predictions based on a pooled vector, label attention use a linear layer to compute relationships between each ICD code and each token in the clinical text, aggregate different information for different codes and then make predictions Mullenbach et al. (2018) . Subsequently, this linear layer was replaced by a multilayer perceptron Vu et al. (2021) , and was finally replaced by the standard cross attention Edin et al. (2024) , both improving the training stability and slightly enhancing its performance. 2.2 Knowledge Injection Considering the rich prior knowledge in biomedical domain, many efforts have been made to incorporate medical knowledge to enhance model performance on ICD coding tasks. Knowledge injection methods