KU_AIGEN_ICL_EDI@BC8 Track 3: Advancing Phenotype Named Entity Recognition and Normalization for Dysmorphology Physical Examination Reports
Hajung Kim 1, Chanhwi Kim 1, Jiwoong Sohn 1, Tim Beck 5, Marek Rei 6, Sunkyu Kim 3, T Ian Simpson 4, Joram M Posma 2, Antoine Lain 2,4, Mujeen Sung 1, Jaewoo Kang 1,3,∗ · 2025
Read KU_AIGEN_ICL_EDI@BC8 Track 3: Advancing Phenotype Named Entity Recognition and Normalization for Dysmorphology Physical Examination Reports by Hajung Kim 1, Chanhwi Kim 1, Jiwoong Sohn 1, Tim Beck 5, Marek Rei 6, Sunkyu Kim 3, T Ian Simpson 4, Joram M Posma 2, Antoine Lain 2,4, Mujeen Sung 1, Jaewoo Kang 1,3,∗ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-09744.txt.
Introduction
Kim and co-authors present a system, published in 2025, for pulling medical findings out of doctors' exam reports and matching them to standard terms. Their challenge entry concerns reports on unusual physical features, the specialty called dysmorphology. The same finding can be written in many wordings, which makes automatic matching hard. The team's pipeline first spots the findings in the text. It then maps each one to its term in a standard human phenotype vocabulary.
To strengthen the matching step, they enriched training data with synonyms, so the model learns that different wordings mean the same finding. Their pipeline scored 2.6 percent higher on exact extraction and matching than the prior best in the shared task. Clean, standardized findings feed research on rare genetic conditions. The work shows a practical route from free-text notes to usable data.
Catalog record
| CREATOR | Hajung Kim 1, Chanhwi Kim 1, Jiwoong Sohn 1, Tim Beck 5, Marek Rei 6, Sunkyu Kim 3, T Ian Simpson 4, Joram M Posma 2, Antoine Lain 2,4, Mujeen Sung 1, Jaewoo Kang 1,3,∗ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 12 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-09744
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
KU_AIGEN_ICL_EDI@BC8 Track 3: Advancing Phenotype Named Entity Recognition and Normalization for Dysmorphology Physical Examination Reports Hajung Kim 1, Chanhwi Kim 1, Jiwoong Sohn 1, Tim Beck 5, Marek Rei 6, Sunkyu Kim 3, T Ian Simpson 4, Joram M Posma 2, Antoine Lain 2,4, Mujeen Sung 1, Jaewoo Kang 1,3,∗ Abstract \institutes 1 Department of Computer Science and Engineering, Korea University, 2 Department of Metabolism, Digestion and Reproduction, Imperial College London, 3 AIGEN Sciences, 4 Institute for Adaptive and Neural Computation, School of Informatics, University of Edinburgh, 5 School of Medicine, University of Nottingham, 6 Department of Computer Science, Imperial College London Abstract The objective of BioCreative8 Track 3 is to extract phenotypic key medical findings embedded within EHR texts and subsequently normalize these findings to their Human Phenotype Ontology (HPO) terms. However, the presence of diverse surface forms in phenotypic findings makes it challenging to accurately normalize them to the correct HPO terms. To address this challenge, we explored various models for named entity recognition and implemented data augmentation techniques such as synonym marginalization to enhance the normalization step. Our pipeline resulted in an exact extraction and normalization F1 score 2.6% higher than the mean score of all submissions received in response to the challenge. Furthermore, in terms of the normalization F1 score, our approach surpassed the average performance by 1.9%. These findings contribute to the advancement of automated medical data extraction and normalization techniques, showcasing potential pathways for future research and application in the biomedical domain. Introduction Medical examinations describing physical dysmorphology involve documenting subtle variations observable in a patient’s facial and bodily morphology. Despite the importance of these medical findings, they are often recorded as unstructured free text within electronic health records (EHR). This mode of recording imposes limitations on the utility of the data for extracting insightful inferences and conclusions. Thus, converting into standard vocabularies, such as the human phenotype ontology (HPO) 1 , renders the data accessible for subsequent computational analysis. Earlier works, such as Doc2HPO 2 , have leaned on dictionary-based matching. This approach utilizes a dictionary formulated from the HPO essential for identifying phenotypic terms. However, it falls short in dealing with unseen words that are absent from the preliminary dictionary. Recently, deep-learning based methods have shown improved performance compared to dictionary-based methods. Phenotagger 3 , a hybrid method that combines both dictionary and deep-learning methods, and the PhenoBERT 4 , a deep-learning model, have achieved great improvements in the recognition of phenotype entities. Nevertheless, the performances of these works show limitations. All phenotype descriptions cannot be described continuously. Instead, one observation is scattered throughout a patient’s record. For example, the observation “long fingers and toes” contains two phenotype terms, where ‘long’ and ‘toes’ are separated by an intervening word. Features like these make it difficult for computer systems to recognize and understand phenotype terms. Extracting information from these types of text records and then normalising them to HPO terms necessitates the use of sophisticated Natural Language Processing (NLP) techniques. Materials and Methods The organizers provided the participants with two sets of data composed of observations extracted from dysmorphology physical examinations. The training set had 2,767 phenotype observations mapped to 1,716 unique consultations while the validation set had 734 phenotype observations mapped to 454 unique consultations. To solve this task we decomposed our pipeline into two parts: named entity recognition (NER) and named entity normalization (NEN). A. Named Entity Recognition The first part of our pipeline aimed to identify HPO entities present in the input text using NER. Looking at the 1,716 unique clinical consultations provided by the organizer for training, we identified four edge cases: observations with normal findings (i.e. normal lips), observations with no finding, discontinuous observations, and observations with only continuous findings. We split the data 70%/30% taking into account the same proportion for every edge case to generate our training and validation sets. The validation set provided by the organizer was kept as such for testing. After analysing the data, we selected multiple models that showed state-of-the-art (SOTA) performance for biomedical NER (BioBERT 5 , SciBERT 6 ), NER for HPO (PhenoTagger 3 , PhenoBERT 4 ) and discontinuous NER (TransE 7 , ChatGPT, W2NER 8 ). Following our optimization of each of these models we realized that ChatGPT and W2NER outperformed the other methods for both continuous and discontinuous cases and decided to focus on them only. For our first NER model, we used the ChatGPT Finetuning API to finetune ChatGPT on our training dataset. Upon analyzing the characteristics of the dataset, we found that many sentences contained abbreviations, and some included mathematical symbols. The context for the abbreviations isn’t included in the text, and the corpus trained on ChatGPT is not specialized enough to infer biomedical abbreviations, presenting a limitation. Therefore, we converted abbreviations into their full names. For sentences with statistical mathematical symbols, it is necessary to infer their meanings. We expanded these into full sentences; for example, “HC < 1% for age” was expanded to “Head Circumference is below the 1st percentile for age.” The extraction part using finetuned ChatGPT was conducted in two steps. The first step involved extracting all findings, regardless of whether they were key or normal. The second step consisted of classifying the extracted findings into their corresponding categories. For our second NER model, we did a grid search to optimize the initial performance of W2NER 8 by fine-tuning the hyper-parameters. The choice of pre-trained BERT model used in the first layer of the W2NER architecture had the biggest impact on model performance. We evaluated BioBERT, SciBERT, PubMedBERT and ClinicalBERT. ClinicalBERT showed the best performance with an improvement of 6.5% F1 score over the worst performing model. The rest of the grid search resulted in training our model using 15 epochs, batch size of 8, learning rate of 0.001, BERT learning rate of 5e-5, and dropout of 0.3. W2NER was trained to extract only the key findings. B. Named Entity Normalization To map entities that NER model found to correct HPO Term, we have to normalize those entities. Our NEN pipeline uses embedding models, dictionary expansion, synonym marginalization, pre-finetuning, and additive synonym incorporation during marginalization. Our experiments showed that when combined these methods play a crucial role in enhancing entity normalization for biomedical text. We detail our approach and findings below. To enhance entity normalization, we experimented with SapBERT 9 . SapBERT is a pre-training scheme that self-aligns the representation space of biomedical entities. This is pre-trained with the UMLS 2020AA dataset. SapBERT achieved SOTA on six Medical Entity Linking datasets as reported in the original paper. Thus it led us to adopt SapBERT as our baseline embedding model. To make a generalisable representation and incorporate more synonyms of medical key findings, we used the HPO dictionary released on (2022/06/22 . We flattened this dictionary and eliminated unobservable HPO terms, creating a more comprehensive dictionary for this challenge. We employed the finetuning method, BioSyn 10 which used synonym marginalization to enhance our research. BioSyn maximizes the marginal likelihood of synonyms from the top candidates predicted by the model based on a dictionary. It iteratively updates candidates to include more challenging negative samples. For the training of BioSyn, we utilized the Biocreative