ImmunoDiff : A Diffusion Model for Immunotherapy Response Prediction in Lung Cancer
Moinak Bhattacharya, Judy Huang, Amna F. Sher, Gagandeep Singh Chao Chen, Prateek Prasanna · 2025
Read ImmunoDiff : A Diffusion Model for Immunotherapy Response Prediction in Lung Cancer by Moinak Bhattacharya, Judy Huang, Amna F. Sher, Gagandeep Singh Chao Chen, Prateek Prasanna (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23675.txt.
Introduction
Moinak Bhattacharya and five co-authors present ImmunoDiff, an anatomy aware diffusion model that forecasts immunotherapy response in non small cell lung cancer. Exact response forecasts remain a key unmet need. Their work came out in twenty twenty-five.
Past models read only pre care scans and output class labels, missing how tumors reshape under therapy. ImmunoDiff instead builds post care CT scans from base scans, guided by lobe and vessel structure. A fresh adapter module keeps image and clinical data in step. Clinical inputs span age and sex, blood marks, and PD-L1 levels. On a local cohort, forecasts of response and survival both improved.
Catalog record
| CREATOR | Moinak Bhattacharya, Judy Huang, Amna F. Sher, Gagandeep Singh Chao Chen, Prateek Prasanna |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-23675
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ImmunoDiff : A Diffusion Model for Immunotherapy Response Prediction in Lung Cancer Moinak Bhattacharya, Judy Huang, Amna F. Sher, Gagandeep Singh Chao Chen, Prateek Prasanna Abstract Accurately predicting immunotherapy response in Non-Small Cell Lung Cancer (NSCLC) remains a critical unmet need. Existing radiomics and deep learning-based predictive models rely primarily on pre-treatment imaging to predict categorical response outcomes, limiting their ability to capture the complex morphological and textural transformations induced by immunotherapy. This study introduces ImmunoDiff , an anatomy-aware diffusion model designed to synthesize post-treatment CT scans from baseline imaging while incorporating clinically relevant constraints. The proposed framework integrates anatomical priors, specifically lobar and vascular structures, to enhance fidelity in CT synthesis. Additionally, we introduce a novel cbi-Adapter, a conditioning module that ensures pairwise-consistent multimodal integration of imaging and clinical data embeddings, to refine the generative process. Additionally, a clinical variable conditioning mechanism is introduced, leveraging demographic data, blood-based biomarkers, and PD-L1 expression to refine the generative process. Evaluations on an in-house NSCLC cohort treated with immune checkpoint inhibitors demonstrate a 21.24% improvement in balanced accuracy for response prediction and a 0.03 increase in c-index for survival prediction. Code will be released soon. 1 Introduction Non-small cell lung cancer (NSCLC) is the most prevalent form of lung cancer, accounting for approximately 85% of cases worldwide [ 37 ] . Despite advances in early detection and treatment, NSCLC remains a leading cause of cancer-related mortality, with a five-year survival rate of approximately 28% in the United States. Immunotherapy, particularly immune checkpoint inhibitors (ICIs) targeting Programmed cell death protein/ligand 1 (PD-1/PD-L1), has been shown to significantly improve patient outcomes [ 32 , 7 , 10 , 12 ] . However, response to immunotherapy varies widely, necessitating the development of predictive models that can anticipate treatment outcomes based on pre-treatment imaging and clinical data. Clinical Motivation: Measuring immunotherapy response in lung computed tomography (CT) involves using criteria such as RECIST or iRECIST. Existing radiomics and deep learning-based response prediction methods [ 18 , 35 , 23 , 31 ] primarily encode pre-treatment imaging data to predict these hard labels (progression vs stable disease vs response). This presents notable limitations. To comprehensively characterize treatment response, it is essential to analyze the phenotype changes brought about by the ICIs - specifically the structural and textural transformation of the tumor and the lymph nodes from pre- to post-treatment. Therefore, rather than relying solely on pre-treatment imaging for response prediction, a more informative approach would involve studying the feature mapping between pre- and post-treatment scans in an image-to-image translation manner [ 19 , 17 , 42 , 44 ] . Technical Motivation: Using generative modeling, image-to-image translation can be effectively achieved through learned high-dimensional mappings between source and target domains. Diffusion models, in particular, provide a powerful framework for learning high-fidelity mappings between imaging domains [ 13 , 33 , 46 ] and have demonstrated their effectiveness in medical image generation [ 8 , 29 , 47 , 5 , 6 ] . Controllable diffusion models allow for incorporation of control factors to guide image generation with desired structures and shapes [ 16 , 22 , 48 , 30 ] . This approach naturally extends to the medical domain, where clinical constraints can enhance the fidelity of generated images. Notably, integrating such constraints has improved 3D lung CT synthesis [ 45 ] and enabled CXR generation using lung segmentation masks and radiomics texture filters [ 5 ] . In order to generate CT image of the lung region, lung vessels and lobes can be used as anatomical controls as these are the main structures visible in a CT scan. Previous studies have identified lobar features as relevant biomarkers for various lung diseases [ 20 , 28 ] . Additionally, vascular features, such as blood vessel morphology, have been shown to be valuable indicators for predicting treatment response [ 2 ] . Furthermore, several studies have demonstrated that cancer treatments induce structural changes in the vasculature [ 36 , 24 ] . Similarly, key clinical variables in immuno-oncology, such as demographics, blood biomarkers, and PD-L1 status, have been used as clinical baselines for response prediction but have not been explored as controls to a diffusion model. Contributions. Based on these insights, we design an anatomy-guided diffusion model to generate post-treatment CT images and fine-tune this model for downstream immunotherapy response and survival prediction tasks. The main contributions of this work are as follows: (1) We propose an anatomy-guided diffusion model, incorporating lobar and vascular structures as control embeddings to improve CT image synthesis. (2) To generate post-treatment CT images from pre-treatment scans, we introduce a clinical variable guidance mechanism, where demographics, blood biomarkers, and PDL-1 status are integrated as additional controls alongside pre-treatment image embeddings. (3) We extract features from the clinical variable-guided diffusion model for immunotherapy response and survival prediction. To the best of our knowledge, this is the first anatomy-guided diffusion model for post-treatment CT image generation that integrates pre-treatment imaging and clinical variables as controls, providing a novel framework for both image synthesis and predictive modeling in NSCLC. 2 Method Figure 1 presents an overview of the proposed ImmunoDiff architecture. The architecture consists of two stages: (a) Anatomy-Guided Training (Stage 1) and (b) Clinical Variable-Guided Response Prediction (Stage 2). In Stage 1, we train a vessel and lobe (VL) encoder using a contrastive learning approach (Fig. 1 .A). Next, we train a denoising diffusion probabilistic model (DDPM) on a publicly available cohort of NSCLC patients from TCIA (details in Sec. 3 )(Fig. 1 .B). The trained encoders are then frozen and used as conditioning inputs for anatomy-guided ControlNet training (Fig. 1 .C). In Stage 2, we compute attention between various patient-specific clinical variables—including age, sex, blood parameters, and PD-L1 status—using the cbi-Adapter (Fig. 1 .E). This adapter is then used as a conditioning input for the ControlNet, which generates post-treatment CT images from pre-treatment scans and clinical variables (Fig. 1 .D). Additionally, features extracted from the upblocks of the U-Net are leveraged for immunotherapy response prediction (Fig. 1 .F). The following subsections provide a detailed discussion of each stage and its components. Figure 1: ImmunoDiff pipeline. (A) Vessels and lobes masks are pre-trained in a contrastive manner. (B) A DDPM model is trained on a large cohort of NSCLC patient CT images. (C) A ControlNet is trained with the vessel and lobe as controls. (D) Clinical variables are used as controls in addition with pre-treatment CT images to generate post-treatment CT images. (E) cbi-Adapter architecture. (F) The trained diffusion model is used for immunotherapy response prediction tasks (responder vs. non-responder classification and survival prediction). Preliminary. Diffusion models first transfer the data distribution x {}_{0}\sim q( x {}_{0}) into Gaussian noise \epsilon ( forward process ) and learn to recover the data distribution by reversing the forward process. The forward process is denoted by q( x {}_{t}| x {}_{0})=\mathcal{N}( x {}_{t};\sqrt{\alpha_{t}} x {}_{0},(1-\alpha_{t})\textbf{I}) , where x {}_{t}=\sqrt{\alpha_{t}} x {}_{0}+\sqrt{1-\alpha_{t}}\epsilon , \epsilon\sim\mathcal{N}(0,\textbf{I}) , \alpha_{t} is the noise scale at each timestep t\in T , and \mathcal{N} is the normal distribution. For the reverse process, the posterior distribution q( x {}_{t-1}| x {}_{t}, x {}_{0}) is learned where x t-1 is recovered from x t by training a