Learning Disease State from Noisy Ordinal Disease Progression Labels
Gustav Schmidt, Holger Heidrich, Philipp Berens, Sarah Müller · 2025
Read Learning Disease State from Noisy Ordinal Disease Progression Labels by Gustav Schmidt, Holger Heidrich, Philipp Berens, Sarah Müller (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-10440.txt.
Introduction
Gustav Schmidt, Holger Heidrich, Philipp Berens, and Sarah Muller present a computing paper from 2025 on eye disease. The disease harms the center of the retina in older adults. Doctors label pairs of scans as better, worse, or stable between visits. Those labels are ranked but noisy.
The team asked if a model could learn the disease state from such weak labels alone. They shaped the model to encode each scan on its own and to respect the rank order of the labels. They also taught it to doubt noisy labels and weigh them less. The learned features sorted disease activity from single scans with few examples. The model never saw direct activity labels in training. The authors say weak visit-to-visit labels can carry rich signal.
Catalog record
| CREATOR | Gustav Schmidt, Holger Heidrich, Philipp Berens, Sarah Müller |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-10440
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Disease State from Noisy Ordinal Disease Progression Labels Gustav Schmidt, Holger Heidrich, Philipp Berens, Sarah Müller Abstract Learning from noisy ordinal labels is a key challenge in medical imaging. In this work, we ask whether ordinal disease progression labels ( better , worse , or stable ) can be used to learn a representation allowing to classify disease state. For neovascular age-related macular degeneration (nAMD), we cast the problem of modeling disease progression between medical visits as a classification task with ordinal ranks. To enhance generalization, we tailor our model to the problem setting by (1) independent image encoding, (2) antisymmetric logit space equivariance, and (3) ordinal scale awareness. In addition, we address label noise by learning an uncertainty estimate for loss re-weighting. Our approach learns an interpretable disease representation enabling strong few-shot performance for the related task of nAMD activity classification from single images, despite being trained only on image pairs with ordinal disease progression labels 1 1 1 https://github.com/berenslab/Learning-Disease-State . 1 Introduction Changes apparent in medical images can be informative about the progression of a disease, playing a critical role in guiding clinical decision making, particularly for conditions requiring timely interventions. One such example is the treatment of neovascular age-related macular degeneration (nAMD) with anti-vascular endothelial growth factor (anti-VEGF) therapy. Here, the treatment is guided by the presence and extent of exudative signs, such as intraretinal and subretinal fluid as relevant biomarkers [ 16 ] . These are best assessed with optical coherence tomography (OCT) imaging. Accurate prediction of disease progression in this context could help to optimize treatment schedules and improve patient outcomes. Different deep learning approaches have been proposed to analyze AMD based on OCT B-scans (i.e. individual images), including disease activity classification [ 1 , 12 ] , biomarker identification [ 11 , 8 ] , and disease progression modeling [ 15 , 4 ] . Figure 1: Overview figure of the proposed approach. (a) Our Siamese model analyses two OCT B-scans (c), outputs the probability of being ungradable ( \hat{y}_{\textrm{o}} ), and predicts the disease progression ( \hat{y}_{\textrm{d}} ). (b) For disease progression prediction our model internally learns a disease state space ( z_{\textrm{d}} ) for each image. (d) Moreover, we fit an uncertainty estimate for each image pair to account for label noise. \sigma(\cdot) is the sigmoid function. Interestingly, judging disease progression between OCT B-Scan pairs is generally believed to be easier and less biased for clinicians than assigning categorical severity scores to individual B-Scans used in the studies cited above, as it is closer to the clinical task performed in a routine assessment. Here, we ask whether we can use such coarse, ordinal information about whether nAMD has improved, worsened, or remained stable between two visits (Fig. 1 c ) to learn about the underlying disease state. While ordinal regression has been explored in machine learning [ 3 , 18 , 7 ] and medical imaging [ 2 , 19 , 6 , 14 , 10 ] , learning from noisy ordinal disease progression labels about the underlying disease state remains unexplored. To this end, we used the MARIO challenge dataset [ 20 ] from MICCAI 2024, which consists of matched, labeled image pairs indicating the relative disease state or disease progression between two patient visits. We frame disease progression between medical visits as a classification task with ordinal ranks (Fig. 1 a,b ), akin to ordinal regression. To enhance generalization and interpretability, we tailored our model to the problem setting using four key steps: 1. Independent image encoding : We encode disease-related features for each image independently (Fig. 1 a ) to ensure that even though the model is trained only on labeled image pairs, it retains meaningful individual image representations for disease state (Fig. 1 b ). 2. Antisymmetric logit space equivariance : Since disease progression labels primarily capture differences between image pairs, we directly model these differences in the logit space (Fig. 1 b ). By representing the differences along a continuous scale, we are able to better capture the continuous nature of disease progression. 3. Ordinal scale awareness : Unlike conventional ordinal regression, our method accounts not only for the relative ordering of ordinal variables but also for the known symmetric distances between labels, leading to a more structured and interpretable representation of disease progression. 4. By uncertainty-aware loss re-weighting [ 17 ] we mitigate the impact of label noise (Fig. 1 d ). This accounts for different sources of label noise, allowing the model to better capture inherent ambiguities in clinical grading. We then show that the learned representation leads to strong few-shot out-of-distribution performance on an in-house OCT dataset labeled for nAMD activity. 2 Methods 2.1 Dataset and Preprocessing For training and evaluating our models, we worked with the MARIO challenge data [ 20 ] . We used the development data consisting of 14,496 labeled OCT B-scan pairs from 68 patients, with up to 10 visits per patient. All OCT volumes were acquired with Heidelberg Spectralis and volumes were registered between consecutive visits using the Spectralis follow-up option. To standardize the input dimension, we padded all images to match the largest resolution occurring in the dataset ( 496\times 1024 ). Furthermore, we applied training-time data augmentation, ensuring that the same augmentations were applied for both images out of a pair. Augmentations included random resize cropping between 20%-100% of the original size, resized to 224\times 385 , and random horizontal flipping. We split our dataset patient-wise in 85% for training (5-fold cross-validation) and 15% for testing. 2.2 Problem Setting The B-scan image pairs were annotated by ophthalmologists into seven initial classes, which were later simplified into three disease progression classes better , worse , stable , and one other category for ungradable image pairs (Fig. 1 c ). Therefore, the challenge framed the task as a 4-class classification problem, where the disease progression labels are on an ordinal scale with symmetric distances – the stable class is between better and worse . 2.3 Obtaining Disease State from Coarse Progression Labels We used a Siamese neural network to process labeled B-scan pairs (Fig. 1 a ). However, instead of naïvely training the Siamese network with a categorical cross-entropy loss for the 4-class problem, we tailored our model to the problem setting. Because the other class is a very different category than the disease progression categories, we separated disease information and the other class with two independent heads ( \boldsymbol{z}_{\textrm{d}} and \boldsymbol{z}_{\textrm{o}} in Fig. 1 b ) and treated both heads as independent classification tasks. This has the advantage that our model predicts disease embeddings z_{\textrm{d}} for each B-scan individually, even though we only train it on labeled B-scan pairs. Then, we reasoned that disease progression prediction was mainly about the difference between the image pairs. In theory, we could subtract registered B-scan pairs from each other and operate on difference images, however, to be more robust to possible registration errors and other noise differences between visits, we decided to compute the differences in the logit (unnormalized log probability) space. Therefore, we predicted the disease progression with \hat{y}_{\textrm{d}}(\boldsymbol{x}_{1},\boldsymbol{x}_{2})=\sigma(\Delta_{\textrm{d}})=\frac{1}{1+e^{-\Delta_{\textrm{d}}}},\,\Delta_{\textrm{d}}=z_{\textrm{d},1}-z_{\textrm{d},2}. (1) Estimating disease progression is akin to a binary classification task with the two classes \textit{worse}\mathrel{\hat{=}}0 and \textit{better}\mathrel{\hat{=}}1 . However,