Classification of kinetic-related injury in hospital triage data using NLP
Midhun Shyam, Jim Basilakis, Kieran Luken, Steven Thomas, John Crozier, Paul M. Middleton, X. Rosalind Wang · 2025
Read Classification of kinetic-related injury in hospital triage data using NLP by Midhun Shyam, Jim Basilakis, Kieran Luken, Steven Thomas, John Crozier, Paul M. Middleton, X. Rosalind Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-04969.txt.
Introduction
Hospital triage notes hold rich detail about injuries, but privacy rules and limited hardware block easy analysis. Midhun Shyam, lead author with six co-authors, present a pipeline for classifying kinetic-related injury in triage data in a 2025 paper. Natural language processing must run on site, and expert labelling is slow and costly.
Their pipeline fine-tunes a pretrained language model first on a small open dataset using a graphics processor. It then fine-tunes further on a smaller hospital-specific dataset using only a central processor. Careful dataset curation lets the approach classify triage records successfully with limited compute, offering a template for other hospitals.
Catalog record
| CREATOR | Midhun Shyam, Jim Basilakis, Kieran Luken, Steven Thomas, John Crozier, Paul M. Middleton, X. Rosalind Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-04969
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Classification of kinetic-related injury in hospital triage data using NLP Midhun Shyam, Jim Basilakis, Kieran Luken, Steven Thomas, John Crozier, Paul M. Middleton, X. Rosalind Wang Abstract Triage notes, created at the start of a patient’s hospital visit, contain a wealth of information that can help medical staff and researchers understand ED patient epidemiology and the degree of time-dependent illness or injury. Unfortunately, applying modern NLP and ML techniques to analyse triage data faces some challenges: Firstly, hospital data contains highly sensitive information that is subject to privacy regulation thus need to be analysed on site; Secondly, most hospitals and medical facilities lack the necessary hardware to fine-tune a LLM ( LLM ), much less training one from scratch; Lastly, to identify the records of interest, expert inputs are needed to manually label the datasets, which can be time-consuming and costly. We present in this paper a pipeline that enables the classification of triage data using LLM and limited compute resources. We first fine-tuned a pre-trained LLM with a classifier using a small (2k) open sourced dataset on a GPU; and then further fine-tuned the model with a hospital specific dataset of 1000 samples on a CPU. We demonstrated that by carefully curating the datasets and leveraging existing models and open sourced data, we can successfully classify triage data with limited compute resources. AI Artificial Intelligence ANN Artificial Neural Networks AUC Area Under Curve CALD culturally and linguistically diverse CEDRIC The Comprehensive Epidemiological Database for Research, Innovation and Collaboration CNN Convolutional Neural Networks ED Emergency Department EHR Electronic Health Record ML Machine Learning NLP Natural Language Processing LLM Large Language Model ROC Receiver Operating Characteristic SDOH Social Determinants of Health SWERI South Western Emergency Research Institute SWSLHD South Western Sydney Local Health District MIMIC Medical Information Mart for Intensive Care NSW New South Wales BERT Bidirectional Encoder Representations from Transformers NIH National Institutes of Health BCB Bio-Clinical BERT CH Classification Head NN Neural Network NN1 Neural Network 1 NN2 Neural Network 2 NN3 Neural Network 3 DS1 Dataset 1: MIMIC-III Train Dataset HPC High Performance Computing MVA Motor Vehicle Accident BCBC Bio-Clinical BERT Classifier REGEX Regular Expression HREC Human Research Ethics Committee SM Supplementary Material 1 Introduction Triage is the process of assessing patients, and assigning a level of urgency to be seen by medical staff. Triage notes are free-text clinical documentation created by a triage nurse, at the start of a patient’s visit to an ED ( ED ). They contain a short paragraph reflecting the nurse’s assessment of the presenting complaint and the condition of the patient; thus they contain vital information about a patient’s visit and risk stratification of their needs. Moreover, triage notes are completed for all ED patients, representing more than half the clinical cases that a hospital sees. This wealth of information can help us understand ED patient epidemiology and the degree of time-dependent illness or injury, as well as the underlying characteristics of the general population. In this study, we aimed to apply modern NLP ( NLP ) LLM with ML ( ML ) classification to classify triage data to identify patients who presented to hospital with a specific complaint. Specifically, we were interested in patients who had a kinetic energy related vehicular trauma, such as injury within a vehicle, collision with and falls from a moving vehicle. Results from the study could inform policy decisions such as road safety legislation that aims to achieve zero road-related fatalities and serious injuries. A recent review [ 5 ] of the application of NLP on triage records identified 20 publications, most of which applied NLP to free text notes to predict outcomes that exist within the structured data associated with each patient. For our work however, we required labels that were not a part of the EHR ( EHR ) in any form. The primary objective of this study was to develop and implement a highly accurate context-based text classification model for categorising triage notes, which are contained in a linkage and analytic healthcare platform known as CEDRIC ( CEDRIC ) database 1 1 1 Maintained by SWERI ( SWERI ) and represents EHR data derived from the SWSLHD ( SWSLHD ) hospitals. . Specifically, we aimed to classify emergency cases into kinetic-related accident cases and non-kinetic-related accident cases. This is often not straightforward; for example, an incident where a seizure or heart attack occurs while driving is more accurately classified as a case of seizure or heart attack rather than a general trauma MVA case. Therefore, accurate classification of these cases demonstrates the ability of models to understand semantics. To this end, we adopted a BERT model [ 2 ] that was trained specifically with clinical data — BCB ( BCB ) [ 1 ] — for the purpose of classifying triage data. Using a pre-trained model significantly reduced the computational resources needed for our task. Importantly, triage notes differ from most medical text data in their use of jargon, acronyms, and shorthand. Despite these specialised aspects, we demonstrate that by fine-tuning the BCB model with small manually labelled datasets for our specific purpose, we could still achieve good results. To our knowledge, this is the first work to classify triage data by fine-tuning a pre-trained model with a small manually labelled dataset. 2 Methods 2.1 Data MIMIC ( MIMIC )-III data The MIMIC -III Clinical Database [ 4 , 3 ] comprises observations with presenting problems of over 40,000 critical care patients between 2001 and 2012. We used the table NOTEEVENTS that contains various de-identified clinical notes, for this paper. We created from this table a dataset — henceforth called MIMIC data — containing 1309 positive kinetic-related vehicular injury cases and 1132 negative cases. Full description of the data pre-processing is in the SM ( SM ) in the project GitHub repository. CEDRIC data CEDRIC database captures and links data from ED presentations in SWSLHD since 2005. For this work, we concentrated on the ED triage comments in CEDRIC , and created two data sets (full details in SM ): 1. CEDRIC One: positive cases from 2022 and both cases from 2021, resulting in 447 kinetic injury cases and 553 others. 2. CEDRIC Two: positive cases from 2023 and both cases from 2022, resulting in 413 kinetic injury cases and 587 others. Ethics The MIMIC -III data is publicly available and does not require Ethics approval. The CEDRIC data is under the approval for the Multicultural Emergency Medicine Epidemiology (MEME) study (HREC Reference: LNR/17/LPOOL/432; SSA Reference: LNRSSA/17/LPOOL/433; Project number: HE17/234) Data Availability The labelled MIMIC data is available in the GitHub repository for this work. The CEDRIC data sets used are not available to the public due to ethics considerations and privacy regulations. 2.2 Deep Learning Classifier In this work, we leveraged the pre-trained BCB model [ 1 ] as a base for the NLP embedding, due to the model’s small size (100 million parameters) and computational efficiency. For our downstream classification task, we appended a two - dimensional sequence CH ( CH ) to BCB ’s encoder for binary output. This model was referred to as BCBC ( BCBC ) , and was fine-tuned in three different configurations: 1. NN1 ( NN1