Minimum Data, Maximum Impact: 20 annotated samples for explainable lung nodule classification
Luisa Gallée, Catharina Silvia Lisson, Christoph Gerhard Lisson, Daniela Drees, Felix Weig, Daniel Vogele, Meinrad Beer, Michael Götz · 2025
Read Minimum Data, Maximum Impact: 20 annotated samples for explainable lung nodule classification by Luisa Gallée, Catharina Silvia Lisson, Christoph Gerhard Lisson, Daniela Drees, Felix Weig, Daniel Vogele, Meinrad Beer, Michael Götz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00639.txt.
Introduction
Luisa Gallée and co-authors grow training data for explainable lung nodule sorting in a paper from two thousand twenty-five. Models that also name the visual traits behind a call earn more trust from doctors. Such trait-labeled scans are scarce, though, which holds the approach back.
The team tuned a diffusion image generator with trait labels, training it on just twenty labeled nodule samples from a public data set. Synthetic trait-labeled images then joined the training of an explainable model. Trait prediction accuracy rose by over thirteen points, and the main diagnosis call also improved slightly. The authors present synthetic data as a way around small labeled sets in medical imaging.
Catalog record
| CREATOR | Luisa Gallée, Catharina Silvia Lisson, Christoph Gerhard Lisson, Daniela Drees, Felix Weig, Daniel Vogele, Meinrad Beer, Michael Götz |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-00639
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Minimum Data, Maximum Impact: 20 annotated samples for explainable lung nodule classification Luisa Gallée, Catharina Silvia Lisson, Christoph Gerhard Lisson, Daniela Drees, Felix Weig, Daniel Vogele, Meinrad Beer, Michael Götz Abstract Classification models that provide human - interpretable explanations enhance clinicians’ trust and usability in medical image diagnosis. One research focus is the integration and prediction of pathology-related visual attributes used by radiologists alongside the diagnosis, aligning AI decision-making with clinical reasoning. Radiologists use attributes like shape and texture as established diagnostic criteria and mirroring these in AI decision - making both enhances transparency and enables explicit validation of model outputs. However, the adoption of such models is limited by the scarcity of large-scale medical image datasets annotated with these attributes. To address this challenge, we propose synthesizing attribute-annotated data using a generative model. We enhance the Diffusion Model with attribute conditioning and train it using only 20 attribute-labeled lung nodule samples from the LIDC-IDRI dataset. Incorporating its generated images into the training of an explainable model boosts performance, increasing attribute prediction accuracy by 13.4% and target prediction accuracy by 1.8% compared to training with only the small real attribute-annotated dataset. This work highlights the potential of synthetic data to overcome dataset limitations, enhancing the applicability of explainable models in medical image analysis. 1 Introduction When working with a medical dataset containing diagnosis labels, such as malignant or benign tumors, a straightforward approach is to train a classification model to predict tumor malignancy. However, for physicians, merely predicting a disease is insufficient to establish trust in the model and consequently adopt it in clinical practice. Instead, a more trustworthy approach involves integrating the same diagnostic criteria that radiologists use when making decisions into the model. Why does the model classify the tumor as malignant? Which criteria does it consider fulfilled? To facilitate such discussion, the model’s training dataset must include annotations for these decision criteria alongside the disease labels. In radiological diagnosis, these criteria correspond to visually identifiable attributes of the pathology, including appearance characteristics such as shape and texture. However, obtaining such annotations requires additional effort, as they are not routinely recorded in standard radiology reports. As a result, large-scale datasets with these annotations are scarce, limiting their applicability for explainable deep learning models. In this paper, we explore a method for handling such incomplete datasets, using the LIDC-IDRI dataset [ 25 ] to classify the malignancy of lung nodules while incorporating their visual characteristics as reasoning attributes. We evaluate a two-step approach: first, augmenting medical images using a generative model conditioned on the attributes; second, adding these synthetic images to the training of explainable image classification models, thereby mitigating the scarcity of human-annotated images, as depicted in Figure 1 . Figure 1 : Large clinical datasets with disease labels are feasible to extract from routine data. However, diagnostic attributes require extra annotation, limiting dataset size. Synthetic augmentation can expand annotated datasets, enabling models to learn attribute-based reasoning in disease prediction. The generation of medical images has been explored in research for various motivations, including reducing the cost and time required for data acquisition, enabling digital twin technology, handling diverse patient populations, representing multimodal datasets, and ensuring patient data privacy [ 1 , 2 , 3 , 4 , 5 ] . Related work most relevant to our task, focusing on generative AI for lung nodule images, utilizes some nodule characteristics such as size [ 6 ] as conditioning criteria to improve the quality of the generated images [ 7 ] . Research on using generated images for training classification models, both with attribute conditioning [ 10 , 11 ] and without [ 8 , 9 ] , demonstrates performance benefits when these images are used as pre-training data. While some attributes of lung nodules have been incorporated into generative AI models, their use has been limited to improving image quality for disease classification, without providing any insight into the diagnostic reasoning behind the predictions. Our focus is on investigating how recent advancements in generative models can support the development of explainable AI algorithms. We generate images that satisfy combinations of multiple non-binary attributes and use them to train explainable downstream classification models. The explainability of these models includes both target prediction and attribute prediction. Methodologically, we employ a Diffusion Model for image synthesis [ 12 ] . Compared to Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs), Diffusion Models have demonstrated superior robustness and performance [ 14 , 15 , 16 ] . The conditioning capabilities of Diffusion Models were demonstrated by Rombach et al. [ 13 ] , who introduced cross-attention mechanisms for conditioning on various modalities. Prior research on multi-label conditioning in Diffusion Models has primarily focused on binary [ 17 ] or nominal [ 18 ] attributes in general-domain images. The novelties presented in this work are summarized as follows: • Attribute-Conditional Generative AI : We present a Diffusion Model with conditioning on comprehensive diagnostic criteria (attributes) for medical image synthesis. • Semi-Conditional Training : Using labeled and unlabeled data to train the Diffusion Model improves the quality of generated images. • Substituting Sparse Datasets : We leverage the generated annotated data to train SOTA explainable classification models, improving performance on a sparsely annotated subset of the LIDC-IDRI medical benchmark dataset. The code is publicly available at https://github.com/XRad-Ulm/Attribute-Conditional-Diffusion-Model . 2 Methods 2.1 Attribute-Conditional Diffusion Model For this work, we employ an attribute-conditional Diffusion Model that processes an image alongside conditioning inputs in the form of multiple metric attributes. The model generates new images that satisfy specific attribute combinations, allowing for the synthesis of an attribute-annotated dataset. The architecture builds upon an existing unconditional Diffusion Model introduced by Ho et al. [ 12 ] . We utilize a convolution-based U-Net, structured with two encoder blocks, a central bottleneck, and two decoder blocks. Each block incorporates residual bottlenecks, following the design described by Ma et al. [ 19 , 21 ] . The conditioning mechanism is applied within the network’s bottleneck. The attribute vector comprising a single continuous value in the range [0,1] for each attribute (margin, sphericity, spiculation, etc.) is first projected onto the bottleneck dimensionality via a linear transformation. This transformed attribute latent vector is then integrated with the image data’s latent representation through a cross-attention mechanism [ 20 ] , employing a single-token cross-attention approach without residual connections to reduce parameter count. Figure 2 : Generative Model A Diffusion Model for synthesis of attribute-labeled images. Semi-conditional training incorporates both labeled and unlabeled samples by dynamically activating or deactivating cross-attention. Semi-Conditional Training The cross-attention mechanism provides flexibility for semi-conditional training (see Figure 2 ). On one hand, attribute conditioning is achieved by passing the latent vector from cross-attention to the decoder. On the other hand, samples without attribute labels are processed without the attention; their latent representations are directly passed to the decoder. This semi-conditional learning approach is motivated by the limited availability of attribute-labeled samples, which alone may be insufficient for Diffusion Models to generate high-quality images. Unlabeled images, which are relatively easy to obtain in clinical routine, can effectively contribute to this process. 2.2 Attribute-Explainable Classification Model To evaluate the effect of our synthetic dataset on explainable AI performance, we train two hierarchical