Risk Estimation of Knee Osteoarthritis Progression via Predictive Multi-task Modelling from Efficient Diffusion Model using X-ray Images
David Butler, Adrian Hilton, Gustavo Carneiro · 2025
Read Risk Estimation of Knee Osteoarthritis Progression via Predictive Multi-task Modelling from Efficient Diffusion Model using X-ray Images by David Butler, Adrian Hilton, Gustavo Carneiro (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-14560.txt.
Introduction
David Butler, Adrian Hilton, and Gustavo Carneiro present an interpretable method to estimate the risk that knee osteoarthritis will worsen. X-rays help doctors judge the disease, but black box predictors give little insight. Earlier methods that imagine future joint images were complex and slow.
Their system forecasts a future X-ray with an efficient diffusion model, then reads both severity and joint landmarks from it. Seeing the predicted image helps explain the risk call. On a large public data set, accuracy beat the prior best by two points, with a score of point seven one. Inference also ran about nine percent faster. The authors aim at tools clinicians can actually use.
Catalog record
| CREATOR | David Butler, Adrian Hilton, Gustavo Carneiro |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-14560
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Risk Estimation of Knee Osteoarthritis Progression via Predictive Multi-task Modelling from Efficient Diffusion Model using X-ray Images David Butler, Adrian Hilton, Gustavo Carneiro Abstract Medical imaging plays a crucial role in assessing knee osteoarthritis (OA) risk by enabling early detection and disease monitoring. Recent machine learning methods have improved risk estimation (i.e., predicting the likelihood of disease progression) and predictive modelling (i.e., the forecasting of future outcomes based on current data) using medical images, but clinical adoption remains limited due to their lack of interpretability. Existing approaches that generate future images for risk estimation are complex and impractical. Additionally, previous methods fail to localize anatomical knee landmarks, limiting interpretability. We address these gaps with a new interpretable machine learning method to estimate the risk of knee OA progression via multi-task predictive modelling that classifies future knee OA severity and predicts anatomical knee landmarks from efficiently generated high-quality future images. Such image generation is achieved by leveraging a diffusion model in a class-conditioned latent space to forecast disease progression, offering a visual representation of how particular health conditions may evolve. Applied to the Osteoarthritis Initiative dataset, our approach improves the state-of-the-art (SOTA) by 2%, achieving an AUC of 0.71 in predicting knee OA progression while offering 9× faster inference time 1 1 1 This work was partly supported by the Engineering and Physical Sciences Research Council (EPSRC) through grant EP/Y018036/1. . 1 Introduction Knee osteoarthritis (OA) is a degenerative joint disease characterised by cartilage breakdown, bone remodelling, and joint inflammation [ 1 ] . It is a leading cause of disability in older adults, resulting in pain, stiffness, and reduced function. The Kellgren-Lawrence (KL) scale is commonly used to grade osteoarthritis severity, ranging from 0 to 4 based on joint space narrowing, osteophytes, sclerosis, and bone remodelling [ 2 ] , as shown in Fig. 1 . Early diagnosis enables treatment to alter the disease course [ 3 ] . Medical imaging plays a central role in knee osteoarthritis (OA) risk estimation [ 4 ] by analysing tissue changes over time. Machine learning techniques compute the likelihood of disease progression [ 5 , 6 , 7 , 8 , 9 ] , but most methods generate only numerical scores, offering little visual explanation for clinicians [ 10 ] . Figure 1: (Left) Example of a 0 KL grade. (Right) Example of a 4 KL grade with osteophytes (red), sclerosis (blue), and bone remodelling (green). For instance, if a model predicts OA progression based on X-rays, it is crucial to understand which features, such as OA severity or anatomical landmarks, contribute to this prediction. Predictive modelling has been rarely explored, except for [ 11 ] , which employed a highly complex image generation process, limiting clinical practicality and lacking anatomical landmark localization. Combining predictive modelling with future image generation and anatomical landmark detection enhances interpretability, fosters trust, and supports informed decision-making. This paper presents a new interpretable multi-task machine learning method for estimating the risk of knee OA progression by predicting future OA severity grade and anatomical knee landmark localisation from efficiently generated future images. Such image generation leverages an efficient diffusion model using a class-conditioned latent space to forecast disease progression, offering a visual representation of how such particular health conditions may evolve. Our key contributions include: • A new interpretable machine learning method for knee OA risk estimation via multi-task prediction modelling for KL classification and anatomical knee landmark localisation using future images generated by a diffusion model; • A novel, compact, and efficient diffusion model that can generate high quality future OA X-ray images conditioned only by current images. Experiments show that our proposed method has state-of-the-art (SOTA) results on the Osteoarthritis Initiative (OAI) dataset [ 4 ] , a study on knee osteoarthritis, delivering superior risk estimation AUC of 0.71 while being \sim 9\times faster at inference than the previous SOTA [ 11 ] that has 0.69 AUC. 2 Related Work Risk Estimation and Predictive Modelling methods assess risk by predicting clinical events [ 5 , 6 , 7 , 8 , 9 ] or forecasting future features [ 12 , 13 , 14 , 15 , 16 ] . While event prediction is useful, it lacks interpretability, as it does not explain underlying causes. For instance, multiple plausible progression pathways could lead to mortality, yet these models often do not differentiate between them. Similarly, feature prediction models estimate disease onset [ 12 , 13 , 14 , 15 ] or severity [ 16 ] , often using biomarkers [ 15 , 17 ] and imaging data [ 17 , 13 ] . However, their opaque reasoning limits clinical adoption [ 10 ] . Future image synthesis methods use StyleGAN [ 11 , 18 , 19 ] , VAEs [ 20 ] , flow-based models [ 21 , 22 ] , and diffusion models [ 23 ] . Some rely on an input image and patient information [ 18 , 19 , 20 , 21 , 22 , 24 , 11 , 25 ] , while others omit non-image data like biomarkers [ 21 , 22 , 24 , 11 , 25 ] . Diffusion models now surpass GANs in image quality [ 1 ] but remain computationally demanding and underutilized for disease progression risk estimation [ 23 ] . In knee OA research, StyleGAN has achieved SOTA accuracy [ 11 ] , yet diffusion models offer superior image quality [ 1 ] . However, [ 11 ] does not generate anatomical knee landmarks, limiting interpretability. 3 Methodology Let \mathcal{D}=\{\mathbf{x}_{i}^{0},\mathbf{x}_{i}^{12},\mathbf{y}_{i}^{0},\mathbf{y}_{i}^{12},\{\mathbf{l}_{i,j}\}_{j=1}^{L}\}_{i=1}^{\left|\mathcal{D}\right|} represent the OAI dataset, where \mathbf{x}^{0},\mathbf{x}^{12}\in\mathcal{X}\subset\mathbb{R}^{H\times W} are knee X-ray images of a patient at an arbitrary point in time, and 12 months afterwards, respectively. Corresponding one-hot 5-class KL classifications are \mathbf{y}^{0},\mathbf{y}^{12}\in\mathcal{Y}\subset\{0,1\}^{5} . The set of L anatomical knee landmarks at \mathbf{x}^{0} is \{\mathbf{l}_{i,j}\}_{j=1}^{L}\in\mathcal{L} , with each landmark \mathbf{l}_{i,j}\in\{1,\dots,H\}\times\{1,\dots,W\} . Our model comprises: 1) VQ-VAE for latent image generation, 2) a conditional diffusion model for future latent images, and 3) a multi-task classifier for OA severity prediction and anatomical knee landmarks localization (Fig. 2 ). Figure 2: Overview of the method. (Top Left) VQ-VAE training. (Top Right) Diffusion model training. (Bottom) Classifier training & inference with predicted future image \mathbf{\hat{x}^{12}} and the risk estimated from the KL grades predicted by p_{\gamma_{0}} and p_{\gamma_{12}} . VQ-VAE: Future image generation for risk estimation leverages diffusion models, which perform better in latent spaces than in image spaces [ 26 ] . To generate this latent space, we use VQ-VAE, as it offers superior reconstruction quality and efficiency compared to VQ-GAN [ 27 ] . VQ-VAE consists of an encoder \mathsf{e}_{\theta_{E}}:\mathcal{X}\to\mathcal{Z} and decoder \mathsf{d}_{\theta_{D}}:\mathcal{Z}\to\mathcal{X} , with \mathcal{Z}\subset\mathbb{R}^{Z} as the latent space, parameterised by \theta=\{\theta_{E},\theta_{D}\}\in\Theta . Following [ 26 ] , we enhance perceptual quality and classification by integrating a classifier p_{\gamma}:\mathcal{Z}\to\Delta^{4} for 5-class KL classification, forming a multi-task autoencoder [ 28 ] . The model is trained with: \begin{split}\ell_{VQVAE}(\theta,\gamma)=\mathbb{E}_{\mathbf{x},\mathbf{y}\sim\mathcal{D}}\Big[&\log(p(\mathbf{x}|\mathbf{z}_{q}(\mathbf{x})))+||sg(\mathbf{z}_{e}(\mathbf{x}))-\mathbf{e}||_{2}^{2}\\ &+\beta||\mathbf{z}_{e}(\mathbf{x})-sg(\mathbf{e})||_{2}^{2}-\alpha\sum\mathbf{y}^{T}\log(p_{\gamma}(\mathbf{z}_{e}(\mathbf{x})))\Big],\end{split} (1) where \mathbf{x} is the input image, \mathbf{z}_{e}(\mathbf{x})=\mathsf{e}_{\theta_{E}}(\mathbf{x}) is its embedding, \mathbf{z}_{q}(\mathbf{x}) the quantised embedding, sg(.) the stop-gradient operator, \mathbf{e} the nearest codebook entry, \beta controls adherence to the nearest codebook entry, \alpha weights the classification term, \mathbf{y} is the one-hot class label, and p_{\gamma}(.) the classifier operating in the latent space