Data Augmentation Techniques for Chinese Disease Name Normalization

Wenqian Cui, Xiangling Fu, Shaohui Liu, Mingjun Gu, Xien Liu, Ji Wu, Irwin King · 2025

Read Data Augmentation Techniques for Chinese Disease Name Normalization by Wenqian Cui, Xiangling Fu, Shaohui Liu, Mingjun Gu, Xien Liu, Ji Wu, Irwin King (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-01195.txt.

Introduction

Wenqian Cui and colleagues attack the data famine behind Chinese disease name normalization with a battery of augmentation techniques. Normalization maps the many written forms of a disease onto one standard name, a foundation of smart healthcare systems. Training data for the Chinese version of the task are severely scarce. Their approach synthesizes more, through a series of augmentation methods backed by supporting modules.

Extensive experiments span several baseline models and training objectives. The augmented training improves performance significantly across the board. Gains are largest exactly where the problem bites, in limited-data scenarios. The paper treats augmentation as a system, not a single trick: multiple generators plus the plumbing that keeps their output useful. For medical language processing in lower-resource settings, the recipe generalizes beyond one language or one task.

Catalog record

CREATORWenqian Cui, Xiangling Fu, Shaohui Liu, Mingjun Gu, Xien Liu, Ji Wu, Irwin King
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-01195

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Data Augmentation Techniques for Chinese Disease Name Normalization Wenqian Cui, Xiangling Fu, Shaohui Liu, Mingjun Gu, Xien Liu, Ji Wu, Irwin King Abstract Disease name normalization is an important task in the medical domain. It classifies disease names written in various formats into standardized names, serving as a fundamental component in smart healthcare systems for various disease-related functions. Nevertheless, the most significant obstacle to existing disease name normalization systems is the severe shortage of training data. Consequently, we present a novel data augmentation approach that includes a series of data augmentation techniques and some supporting modules to help mitigate the problem. Through extensive experimentation, we illustrate that our proposed approach exhibits significant performance improvements across various baseline models and training objectives, particularly in scenarios with limited training data 1 1 1 We recommend you to read the full version of this paper at https://arxiv.org/abs/2306.01931 . I Introduction Disease names play a pivotal role in modern intelligent healthcare systems as it is involved in diverse tasks such as intelligent consultation [ 1 ] , auxiliary diagnosis [ 2 , 3 ] , automated International Classification of Diseases (ICD) coding [ 4 , 5 , 6 ] , Diagnosis-Related Groups prediction [ 7 , 8 ] , etc. However, in clinical settings, doctors often write disease names according to their own habits and preferences, leading to numerous variations for the same disease. Therefore, to carry out additional operations on disease names, it is necessary to normalize them into standard names. As a result, disease name normalization, which entails classifying the diagnosis terms in clinical documents to standard names or classifications, plays a critical role in the ecosystem. One of the main challenges in the disease normalization task is data scarcity. Specifically, a substantial proportion of disease names and concepts are typically not covered in the training set, leading to few-shot or zero-shot scenarios in the normalization process. For example, in CHIP-CDN dataset [ 9 ] , only about 25% of all the diseases are provided. In this case, it is extremely difficult for the models to gain comprehensive knowledge about the disease system. Although collecting more data seems to be a natural solution to address this challenge, it is more difficult to perform in the medical field due to privacy concerns and the requirement for expertise. Hence, in this work, we utilize data augmentation as a workaround to address the data scarcity problem. We design a novel data augmentation approach including a set of data augmentation methods and some supporting modules for Chinese disease name normalization tasks called Disease Data Augmentation (DDA). Our data augmentation methods are designed to provide the models with an extensive understanding of disease names, particularly those that are absent in the original training set. Our experiments demonstrate that our DDA approach outperforms all other data augmentation counterparts and effectively enhances the performance of various disease name normalization baselines. Furthermore, our approach can perform much better with smaller datasets and can achieve nearly 80% of the full performance even when no data from the training set is provided. Fig. 1: Illustration of our proposed data augmentation techniques. The upper portion of the figure depicts the Axis-word Replacement methods, and the lower portion depicts the Multi-Granularity Aggregation methods. II Proposed Methodology This section introduces the task definition of disease name normalization and our proposed data augmentation approach. Definition 1 (Disease Name Normalization) . Let D=\{d_{1},d_{2},...,d_{n}\} be the set of extracted disease terms from clinical documents, and S=\{s_{1},s_{2},...,s_{m}\} be the set of standard disease names, we define disease name normalization as N(d_{i})=\arg\max_{s_{j}\in S}P(s_{j}|d_{i}) . Definition 2 (Axis Word) . Axis words are the word components within disease names. We define three main axis words used in our approach. Disease Center: The minimal term that describes the nature of a disease. Anatomical Region: A part of the human body that has actual meaning in anatomy. Disease Characteristic: The characteristic of a disease that indicates the subtype or the cause of the disease. Take “ 增生性毛发囊肿” (Proliferative Trichilemmal Cyst) as an example, 囊肿(Cyst), 毛发(Trichilemmal), and 增生性(Proliferative) are its Disease Center, Anatomical Region, and Disease Characteristic, respectively. II-A Named Entity Recognition Module The first module of our approach is a named entity recognition (NER) system to locate and identify the axis words from all the input disease names. To build the NER system, we select 5,000 diseases from the International Classification of Diseases (ICD) system 2 2 2 We use ICD as the standard disease classification system. [ 10 ] and ask doctors to annotate the labels (i.e., the three axis words) in BIO format [ 11 ] . We use the traditional “BiLSTM + CRF” as the NER model architecture. Specifically, there are three BiLSTM layers [ 12 ] with a hidden dimension of 100, a fully connected layer, and a CRF layer [ 13 ] . The model achieves a 0.794 micro F1 score in our final evaluation. II-B Data Augmentation Module The data augmentation module consists of four data augmentation methods, and they are divided into two main categories: Axis-word Replacement (AR) and Multi-Granularity Aggregation (MGA). The main purpose of our data augmentation methods is to provide the model with additional knowledge, so we focus on exploring the components and relationships within diseases to give the model a comprehensive understanding of the various components and the hierarchical classification system of disease names. Figure 1 illustrates the two categories and four types of data augmentation methods 3 3 3 We have open-sourced the augmentation code on GitHub at https://github.com/dreamtheater123/disease_name_dataset . . II-B 1 Axis-word Replacement (AR) Axis-word Replacement method is designed based on the assumption that disease names exhibit Structural Invariance property. This means that replacing an axis word in a disease name with another word of the same type still results in a meaningful disease name. For example, when the anatomical region “ 髂(Iliac)” of the disease “ 髂总动脉夹层(Common iliac artery dissection)” is replaced by another region “ 颈(Carotid)”, we derive a name with the same type of disease but locates in another region “ 颈总动脉夹层”(Common carotid artery dissection)”. Since there are often matches of axis words between an unnormalized disease name and a standard disease name in the disease name normalization task, simultaneously replacing the same axis word in both the unnormalized name and the standard name can typically ensure that the newly generated pair will still match. We leverage both the ICD and task data (data from the disease name normalization training set) to perform Axis-word Replacement. The detailed descriptions of each category of Axis-word Replacements are as follows: • AR1 (Figure 1 , top left corner): First, we select a pair of diseases (disease A and disease B) that share one or more axis words (axis1 in the figure) but differ in another axis word (axis2 in the figure). Then, we replace axis2 in disease A with the same axis2 in disease B. • AR2 (Figure 1 , top right corner): First, we select a pair of unnormalized-standard diseases from the disease name normalization training set. Let the unnormalized disease be disease A, and the standard disease be disease B. Then, find disease C from the ICD system that shares one or more axis words (axis1 in

Read the complete text