A Deep Multi-Modal Method for Patient Wound Healing Assessment

Subba Reddy Oota, Vijay Rowtula, Shahid Mohammed, Jeffrey Galitz, Minghsun Liu, Manish Gupta · 2026

Read A Deep Multi-Modal Method for Patient Wound Healing Assessment by Subba Reddy Oota, Vijay Rowtula, Shahid Mohammed, Jeffrey Galitz, Minghsun Liu, Manish Gupta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-09315.txt.

Introduction

A 2026 paper led by Subba Reddy Oota, with five co-authors, proposes a deep learning method for judging how a patient's wound is healing and whether hospital care may become necessary. Wound care grows costly when treatment is delayed, when patients struggle to follow care plans, or when other illnesses complicate recovery. The goal is to spot trouble early, while simpler care can still help.

The method reads two kinds of evidence together: measured wound details and photographs of the wound itself. Built with transfer learning, it predicts both the wound's measurable features from its images and the likely healing path over time. Earlier work had tended to track healing separately for each wound type, while this approach treats image and measurement jointly. The authors argue that earlier warnings could shorten diagnosis time for clinicians and give patients a better chance of avoiding hospital admission.

Catalog record

CREATORSubba Reddy Oota, Vijay Rowtula, Shahid Mohammed, Jeffrey Galitz, Minghsun Liu, Manish Gupta
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE10 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-09315

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Deep Multi-Modal Method for Patient Wound Healing Assessment Subba Reddy Oota, Vijay Rowtula, Shahid Mohammed, Jeffrey Galitz, Minghsun Liu, Manish Gupta Abstract Hospitalization of patients is one of the major factors for high wound care costs. Most patients do not acquire a wound which needs immediate hospitalization. However, due to factors such as delay in treatment, patient’s non-compliance or existing co-morbid conditions, an injury can deteriorate and ultimately lead to patient hospitalization. In this paper, we propose a deep multi-modal method to predict the patient’s risk of hospitalization. Our goal is to predict the risk confidently by collectively using the wound variables and wound images of the patient. Existing works in this domain have mainly focused on healing trajectories based on distinct wound types. We developed a transfer learning-based wound assessment solution, which can predict both wound variables from wound images and their healing trajectories, which is our primary contribution. We argue that the development of a novel model can help in early detection of the complexities in the wound, which might affect the healing process and also reduce the time spent by a clinician to diagnose the wound. 1 Introduction In recent years, the outstanding performance of deep learning in computer vision-based tasks has resulted into its extensive application for medical image analysis. The applications include detection, diagnosis, and segmentation of pathology in cancer by 6 , retinal by 5 , brain by 9 , and wound images by 4 ; 3 ; 8 ; 2 . However, fewer practical applications were built that can help clinicians to detect wound types and anticipate the wound’s healing trajectory. In current clinical practice, the evaluation of different wound ulcers consists of wound specific tasks which help in early diagnosis of wounds. Keeping track of development and treatment procedure for each particular case depends on wound type. Moreover, many of the wound findings are documented via visual assessment by clinicians. Some of the challenges for the clinicians in terms of cost of treatment include (i) frequent assessments of a patient, (ii) entry of wound attributes in the database, and (iii) applying the right diagnosis. The clinician’s assessment of the wound with its surrounding skin depends on various wound variables such as wound ulcer types, location, stage, margin, yellow slough, and granulation. We are motivated by the fact that deep learning methods have proven to perform well for object classification and recognition tasks with sufficiently large data. We tried to automatically assess various factors required for clinician’s review, thereby providing semi-supervised wound variable classification. In this paper, we attempt to detect the wound type and other factors from the wound image. We further investigated the applicability of predicted wound variable to predict patient’s hospitalization risk. We also show that our models comprising of deep convolutional neural networks (CNNs) provide better performance than a human expert. Figure 1 shows a sample of wound ulcer type images labeled by clinicians. Figure 1: Manually labeled wound ulcer type images 2 Our Method The essential aspects of wound assessment comprise of reliable and accurate wound documentation. To provide consistent wound assessments, we implemented a method comprising a mixture of deep neural networks, a simpler machine learning model, and clinicians’ expertise to overcome inherent flaws in human wound observations. Given a wound image as input, the aim is to predict the patient’s hospitalization risk. To achieve this, we first predict the “Ulcer Type", “Location", “Stage", “Joint Necrosis", and “Ligament Necrosis Exposed" attributes of a wound. In practice, it is a laborious task to train a convolution neural network model from scratch with randomly initialized weights. Moreover, a large number of samples are required to create accurate neural models, as too little data would result in model overfit. Here, we employ pre-trained CNN Xception architecture weights ( 1 ) to fine-tune the model on the five heuristic wound variables. These five predictions are combined with other 16 clinician-filled variables like “BMI", “Tunneling", “Age", and “Gender", etc. (by visual observation) to train a multi-modal binary hospitalization risk (or heal/no-heal) LGBM (Light Gradient Boosted Machines) classifier ( 7 ) . 2.1 Dataset and Experimental Results Wound Dataset: We experiment with the patients’ wound image dataset, which was accumulated from several years of patients’ wound care. To the best of our knowledge, this is the only dataset providing all types of wound variables annotated and verified by clinicians. The dataset contains images corresponding to 20 ulcer types with 80% of the images from 5 types: “Diabetic Ulcer", “Pressure Ulcer", “Surgical Wound", “Trauma Wound", and “Venous Ulcer". The dataset details are displayed in Tables 3 , 3 , and 3 . In this work, we mainly focused on the five wound variables to build the deep learning models. We used the data provided by clinicians on other wound heuristics to train the final heal/no-heal model jointly with outputs of deep models. Ulcer Type #Samples Diabetic Ulcer 19773 Pressure Ulcer 47541 Surgical Wound 12238 Trauma Wound 13667 Venous Ulcer 32492 Table 1: Images by Ulcer Type Wound Location #Samples Lower Leg 31775 Sacral 20501 Foot 12753 Heel 11226 Ankle 10375 GreatToe 4547 Table 2: Images by Location Ulcer Stage #Samples Full Thickness 47849 Grade 2 20501 Stage-3 12753 Stage-4 11226 Unstageable 10375 Table 3: Images by Stage Challenges: We faced the following challenges during the training process: (i) occlusion - wound blocked by either scale or doctor’s hand when taking the picture, (ii) illumination - wound images have been captured from smartphone in different lighting conditions, (iii) imbalanced data - not all ulcers are having equal number of samples, (iv) similarity - images in one of the wound ulcer looks very similar to images of the other wound ulcers, and (v) deformation - same wound image appears in different forms. Experimental Setup: We trained the heal/no heal model in two-steps. We first created five different CNN models created for the wound variables such as “Wound Ulcer Type", “Wound Location", “Wound Stage", “Joint Necrosis Exposed", and “Bone Necrosis Exposed" using our wound image dataset. We created single-task models on Wound Ulcer Type, and Location, whereas multi-task models on remaining factors (Wound Stage, Joint Necrosis Exposed, and Bone Necrosis Exposed) due to their dependency on Wound Ulcer Type. The dataset was split into 70% for training, 10% for validation, and 20% for testing. We perform a 5-fold cross-validation technique for each wound variable. In the second step, we create a heal/no heal model using the five features extracted from the first step and other features like “Wound Area", “Wound Volume", “BMI", “Patient’s Age", etc. filled by a clinician. Due to space constraints, we only discuss details of the wound ulcer type prediction model and the heal/no-heal model. Wound Ulcer Type Prediction To create the wound ulcer type model on wound image dataset, we used a pre-trained Xception architecture and fine-tuned the model. We used softmax based output classifier as the prediction layer with a size equal to the number of class labels. The dataset details are provided in Table 3 , where we can observe the class imbalance problem even within the five classes. We applied the dataset augmentation pre-processing step to deal with the problem. For the CNN-Xception model, we set the number of

Read the complete text