DiffSegLung: Diffusion Radiomic Distillation for Unsupervised Lung Pathology Segmentation
Rezkellah Noureddine KHIATI, Pierre-Yves BRILLET and Catalin FETITA · 2026
Read DiffSegLung: Diffusion Radiomic Distillation for Unsupervised Lung Pathology Segmentation by Rezkellah Noureddine KHIATI, Pierre-Yves BRILLET and Catalin FETITA (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11758.txt.
Introduction
Rezkellah Noureddine Khiati, Pierre-Yves Brillet, and Catalin Fetita segment lung disease in CT scans without any labeled cases. Their DiffSegLung system uses hand-made radiomic measures as a teacher. The teacher shapes a 3D diffusion network through a contrast goal, then core features are grouped at run time with Hounsfield-unit guidance. On 190 expert-labeled slices from four CT cohorts, it beat label-free rivals on all four disease classes.
Catalog record
| CREATOR | Rezkellah Noureddine KHIATI, Pierre-Yves BRILLET and Catalin FETITA |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17675 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.11758
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DiffSegLung: Diffusion Radiomic Distillation for Unsupervised Lung Pathology Segmentation Rezkellah Noureddine KHIATI, Pierre-Yves BRILLET and Catalin FETITA Abstract Unsupervised segmentation of pulmonary pathologies in CT remains an open challenge due to the absence of annotated multi pathology cohorts and the failure of existing diffusion-based methods to exploit the quantitative Hounsfield Unit (HU) signal that physically distinguishes tissue classes. To address this, we propose DiffSegLung , a framework that introduces Diffusion Radiomic Distillation, in which handcrafted radiomic descriptors serve as a physics grounded teacher to shape the bottleneck of a 3D diffusion U-Net via a contrastive objective, transferring pathology discriminative structure into the learned representation without any annotations. At inference, the teacher is discarded and multitimestep bottleneck features are clustered by a Gaussian Mixture Model with HU-guided label assignment, followed by Sobel-Diffusion Fusion for boundary refinement. Evaluated on 190 expert-annotated axial slices drawn from four heterogeneous CT cohorts, DiffSegLung improves segmentation across all four pathology classes over unsupervised baselines and improves generation fidelity over prior CT diffusion models. Code is available at https://anonymous.4open.science/r/DiffLungSeg-CEF1/README.md . 1 Introduction Diffusion probabilistic models have recently demonstrated strong generative performance in medical imaging [ 5 , 6 ] . Beyond generation, their U-Net backbone encodes rich intermediate representations that transfer to segmentation tasks [ 3 ] , yet its application to thoracic CT remains largely unexplored. Segmenting pulmonary pathologies—emphysema, fibrosis, consolidation, and cavitary lesions simultaneously in an unsupervised manner is particularly challenging because annotated cohorts covering all four classes are practically unavailable. Expert annotation is selective and time-consuming, cohorts are small, and class imbalance is severe. These constraints make supervised and semi supervised approaches [ 9 ] impractical for this setting, and fully unsupervised segmentation a necessity. Existing diffusion-based segmentation methods do not account for the physical properties of CT data. Each pulmonary pathology is characterized by a distinct Hounsfield Unit (HU) attenuation range [ 14 ] . Training on 8-bit normalized images, as in prior CT diffusion models [ 7 ] , discards this quantitative information. Radiomic descriptors have long been shown to discriminate these tissue classes [ 4 , 1 ] , yet no existing method incorporates such descriptors as a training signal for diffusion representation learning. We propose DiffSegLung , a framework for unsupervised lung pathology segmentation that introduces Diffusion Radiomic Distillation. For each training patch, a 34-dimensional radiomic feature vector is projected to a shared embedding space through a radiomic projection head, serving as a physics-grounded teacher. The U-Net bottleneck is simultaneously projected to the same space through a student projection head. An InfoNCE contrastive objective then aligns the two projections: patch pairs with high radiomic cosine similarity are treated as positives and pulled together, while dissimilar pairs are pushed apart. A warmup schedule prevents the distillation loss from collapsing the bottleneck before meaningful texture representations are established. At inference, the radiomic projection head is discarded and segmentation is obtained by applying Gaussian Mixture Model clustering to the student embeddings, followed by Sobel-Diffusion Fusion boundary refinement and a physics-aware HU compatibility loss. The contributions of this work are threefold.(i) the first radiomic teacher-student distillation scheme for diffusion representation learning, requiring no annotations; (ii) HU-preserving 3D DDPM training that produces physically meaningful bottleneck representations; and (iii) improved unsupervised segmentation coherence and generation fidelity through radiomic distillation. 2 Related Work 2.1 Diffusion Models for Segmentation Baranchuk et al. [ 3 ] showed that intermediate activations of the DDPM reverse-process U-Net are effective pixel-level representations for label-efficient segmentation. This observation was extended to zero-shot unsupervised segmentation through the exploitation of self-attention maps in pre-trained stable diffusion [ 11 ] . In remote sensing, DDPM backbones have been used as frozen feature extractors for change detection [ 2 ] . In medical imaging, diffusion models have been applied to supervised segmentation conditioned on noisy label maps [ 13 ] and to CT synthesis for augmenting downstream training [ 6 , 7 ] . No prior work addresses fully unsupervised multi pathology segmentation in thoracic CT through diffusion representation learning, and none preserves the quantitative HU information required for tissue discrimination. 2.2 Knowledge Distillation in Medical Image Segmentation Knowledge distillation transfers learned representations from a teacher to a student network through soft supervision [ 15 ] . In medical image segmentation, this paradigm has been applied to model compression and to propagating pseudo-supervision under annotation scarcity [ 10 ] . In DiffSegLung, the teacher is not a neural network but a set of handcrafted physical descriptors, and distillation is applied during generative pre-training rather than to a supervised segmentation head. This is a fundamentally different use of the distillation principle. 2.3 Radiomic Features for Lung Pathology CT-based radiomic features, including GLCM texture descriptors, first-order HU statistics, LBP histograms, and Gabor filter responses, have been shown to reliably characterize emphysema, fibrosis, and consolidation in supervised settings [ 4 , 1 ] . In DiffSegLung, these well-established descriptors are repurposed as an unsupervised teacher signal to impose physical structure on the latent space of a generative model, rather than serving as direct classifiers. 3 Method 3.1 Overall Framework We address fully unsupervised segmentation of four lung pathologies from unlabelled 3D CT volumes. The overview of DiffSegLung is shown in Fig. 1 , consisting of two stages. Training: a 3D pixel-space DDPM [ 5 ] is trained on native HU-preserved patches while handcrafted radiomic descriptors serve as a non-differentiable physics teacher, shaping the bottleneck via an InfoNCE contrastive objective without any annotations. Inference: the frozen encoder is run with a DPM-Solver [ 8 ] at 250 steps; multi-timestep bottleneck features are clustered by a GMM and refined by Sobel-Diffusion Fusion with HU-guided label assignment to produce the final pathology masks. Figure 1: Training: \epsilon_{\theta} is trained on HU-preserved patches via \mathcal{L}_{\mathrm{diff}} ; radiomic descriptors \mathbf{r}\in\mathbb{R}^{34} align student embeddings via InfoNCE (discarded at inference). Inference: multi-timestep features \mathbf{f}_{\mathrm{seg}} are clustered by GMM and refined by Sobel-Diffusion. 3.2 Diffusion-Radiomic Distillation The bottleneck of \epsilon_{\theta} produces a feature vector \mathbf{f}\in\mathbb{R}^{B\times 256} per mini-batch of B patches. Without explicit guidance, this representation organises around generative rather than discriminative structure. We introduce a teacher-student contrastive distillation scheme using handcrafted physical descriptors as supervision. Radiomic teacher. For each patch x_{0}^{(i)} , we extract a 34-dimensional radiomic vector \mathbf{r}^{(i)}\in\mathbb{R}^{34} comprising GLCM statistics (14 features), LBP histograms (8 features), Gabor filter responses (8 features), and first-order HU statistics (4 features) [ 4 ] . These descriptors are non-differentiable; no gradient flows into them. \mathbf{r}^{(i)} is projected to a 128-dimensional embedding via \phi_{r}:\mathbb{R}^{34}\rightarrow\mathcal{S}^{128} : \mathbf{z}_{\mathrm{radio}}^{(i)}=\ell_{2}\!\left(W_{2}\,\sigma\!\left(W_{1}\,\mathbf{r}^{(i)}\right)\right). (1) where W_{1}\in\mathbb{R}^{128\times 34} , W_{2}\in\mathbb{R}^{128\times 128} , \sigma is ReLU, and \ell_{2}(\cdot) denotes \ell_{2} normalisation onto \mathcal{S}^{128} . Diffusion student. The bottleneck \mathbf{f}^{(i)} is projected via \phi_{s}:\mathbb{R}^{256}\rightarrow\mathcal{S}^{128} : \mathbf{z}_{\mathrm{diff}}^{(i)}=\ell_{2}\!\left(V_{2}\,\sigma\!\left(V_{1}\,\mathrm{Flatten}\!\left(\mathrm{AvgPool3D}(\mathbf{f}^{(i)})\right)\right)\right). (2) Radiomic similarity as continuous supervision. Let s_{ij}=\langle\mathbf{z}_{\mathrm{radio}}^{(i)},\mathbf{z}_{\mathrm{radio}}^{(j)}\rangle denote the cosine similarity between radiomic embeddings. Pair (i,j) is positive if s_{ij}>\tau ( \tau=0.5 ), negative otherwise. The contrastive loss is: \mathcal{L}_{\mathrm{InfoNCE}}=-\frac{1}{B}\sum_{i=1}^{B}\log\frac{\sum_{j\neq i}\mathbf{1}[s_{ij}>\tau]\,\exp\!\left(\langle\mathbf{z}_{\mathrm{diff}}^{(i)},\mathbf{z}_{\mathrm{diff}}^{(j)}\rangle/\kappa\right)}{\sum_{k\neq i}\exp\!\left(\langle\mathbf{z}_{\mathrm{diff}}^{(i)},\mathbf{z}_{\mathrm{diff}}^{(k)}\rangle/\kappa\right)}, (3) with temperature \kappa=0.07 . Warmup schedule. To prevent bottleneck collapse, \mathcal{L}_{\mathrm{InfoNCE}} is introduced gradually via: \lambda(t_{\mathrm{step}})=\lambda_{\max}\cdot\left(\frac{t_{\mathrm{step}}-T_{w}}{T_{\mathrm{ramp}}}\right)^{\!\!+}, (4) with T_{w}=5000 , T_{\mathrm{ramp}}=5000 , \lambda_{\max}=0.5 . The total objective is: \mathcal{L}=\mathcal{L}_{\mathrm{diff}}+\lambda(t_{\mathrm{step}})\cdot\mathcal{L}_{\mathrm{InfoNCE}}. (5) At the end of training, \phi_{r} is discarded; only \epsilon_{\theta} and \phi_{s} are retained for inference. 3.3 Feature Extraction and Clustering At inference, \epsilon_{\theta} is run with a DPM-Solver [