Unsupervised Adaptation from FDG to PSMA PET/CT for 3D Lesion Detection under Label Shift

Xiaofeng Liu, Menghua Xia, Yanis Chemli, Georges El Fakhri, Chi Liu, Jinsong Ouyang · 2026

Read Unsupervised Adaptation from FDG to PSMA PET/CT for 3D Lesion Detection under Label Shift by Xiaofeng Liu, Menghua Xia, Yanis Chemli, Georges El Fakhri, Chi Liu, Jinsong Ouyang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13666.txt.

Introduction

Xiaofeng Liu and co-authors propose unsupervised adaptation from FDG to PSMA PET/CT for 3D lesion detection under label shift. Cross-tracer adaptation faces label shift in lesion size mix and lesions per subject. Their self-training framework models that shift with two mechanisms. Detection anchor shapes adapt from target pseudo labels by exponential moving average, raising coverage for small PSMA lesions. Size bin quotas for pseudo-label selection follow the estimated target histogram instead of a fixed threshold. On AutoPET 2024 the method beat baselines.

Catalog record

CREATORXiaofeng Liu, Menghua Xia, Yanis Chemli, Georges El Fakhri, Chi Liu, Jinsong Ouyang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20097
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.13666

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Unsupervised Adaptation from FDG to PSMA PET/CT for 3D Lesion Detection under Label Shift Xiaofeng Liu, Menghua Xia, Yanis Chemli, Georges El Fakhri, Chi Liu, Jinsong Ouyang Abstract In this work, we propose an unsupervised domain adaptation (UDA) framework for 3D volumetric lesion detection that adapts a detector trained on labeled FDG PET/CT to unlabeled PSMA PET/CT. Beyond covariate shift, cross tracer adaptation also exhibits label shift in both lesion size composition and the number of lesions per subject. We introduce self-training with two mechanisms that explicitly model and compensate for this label shift. First, we adaptively adjust the detection anchor shapes by re-estimating target domain box scales from selected pseudo labels and updating anchors with an exponential moving average. This increases positive anchor coverage for small PSMA lesions and stabilizes box regression. Second, instead of a fixed confidence threshold for pseudo-label selection, we allocate size bin-wise quotas according to the estimated target domain histogram over lesion volumes. The self-training alternates between supervised learning with prior-guided pseudo labeling on PSMA and supervised learning on labeled FDG. On AutoPET 2024, adapting from 501 labeled FDG studies to 369 18 F-PSMA studies, the proposed method improves both AP and FROC over the source-only baseline and conventional self-training without label-shift mitigation, indicating that modeling target lesion prevalence and size composition is an effective path to robust cross-tracer detection. † † address: Yale Biomedical Imaging Institute and Department of Radiology & Biomedical Imaging, Yale University, New Haven, CT 06520, USA 1 Introduction PET/CT imaging is important for cancer diagnosis and treatment planning, offering combined metabolic and anatomic information for detecting malignant lesions. Deep learning models have shown promise for automated 2D [ 10 ] , 2.5D [ 11 ] , or 3D [ 2 , 13 , 8 ] lesion detection in PET/CT. However, precisely annotating every lesion for a newly developed tracer can be costly, and a model trained on one tracer often fails to generalize to another due to domain shift [ 9 ] . Figure 1: (a-b) Examples of FDG and PSMA scans. (c) Lesion size distribution per subject for FDG vs. PSMA. On average, each PSMA subject contains more small lesions, whereas FDG has slightly more very large lesions ( \geq 150 cc). All volumes are resampled to 4\times 4\times 5 mm spacing. The domain shift is particularly challenging for cross PET tracers applications. For example, a detection model trained on fluorodeoxyglucose (FDG) PET scans may underperform on prostate-specific membrane antigen (PSMA) PET scans because tracer uptake patterns and typical lesion characteristics differ significantly. Specifically, FDG highlights glucose-avid tumors, but also produces high physiological uptake in the brain and myocardium, while PSMA targets prostate cancer metastases with intense uptake in salivary glands and kidneys [ 3 ] . Although co-scanned CT can provide the corresponding location information, the prevalence and size distribution of the lesions can vary between cohorts of patients imaged with these different tracers, leading to a possible label shift in the frequency and characteristics of the lesions (Fig. 1 ). Developing techniques to adapt models across such domains is critical to leverage knowledge from large scale labeled FDG datasets to new tracers like PSMA, where annotated examples can be scarce. Unsupervised domain adaptation (UDA) methods can be a promising solution aimed at transfer of knowledge from a labeled source domain to a different unlabeled target domain [ 9 ] . Recently, in the field of general computer vision, UDA has been applied to 2D image detection and 3D LiDAR point clouds detection [ 12 ] , but these have not been translated into 3D volumetric lesion detection. More importantly, conventional UDA usually assumes that only the input appearance changes and that the label distribution remains consistent across domains. This assumption has led to a series of covariate shift UDA methods [ 9 ] . However, the distribution of lesion detection bounding boxes differs markedly between FDG and PSMA PET/CT, which highlights the need to mitigate label shift together with appearance shift. Recently, the label shift has been explored in classification tasks [ 6 , 7 ] . However, to our knowledge, no prior work has addressed the label shift in UDA detection. In this work, we propose a 3D UDA framework for lesion detection in whole-body PET/CT, adapting a RetinaNet detector from labeled FDG to unlabeled PSMA tracer. We use the multimodal 3D RetinaNet (M3DRetinaNet) [ 8 ] as our detection backbone, which is a one-stage object detector with a focal loss to address sparse objects as well as multi-scale pyramid features for diverse object sizes [ 5 ] . Since each pyramid feature level has \geq 1,000 anchor box proposals to be processed, it is not efficient to configure a discriminator at each level as adversarial UDA [ 9 ] . Instead, we adapt the self-training UDA to generate the pseudo-label in target domain and alternating the supervised training in labeled source domain and pseudo-labeld target domains. We explicitly mitigate the label shift by incorporating prior knowledge on lesion size and prevalence, utilizing the target domain predictions to estimate the target label distribution. Then we are able to adjust the pseudo-parameter of anchor size used in M3DRetinaNet as well as the size bin-wise threshold for pseudo-label selection accordingly. Our contributions can be summarized as follows: \bullet To our knowledge, this is the first attempt of unsupervised domain adaptation for 3D volumetric lesion detection. \bullet In addition to the conventional covariate shift, we design a novel self-training scheme with prior knowledge of label distribution shift, which has not been explored in UDA detection. \bullet The pseudo-parameter of size distributions and lesion prevalence in target domains are adaptively estimated to refine the pseudo-label selection. We demonstrate its effectiveness on cross-tracer PET/CT (FDG to PSMA) lesion detection on AutoPET2024 dataset. 2 Methodology Let the labeled source set be \mathcal{D}^{s}=\{(x_{i}^{s},y_{i}^{s})\}_{i=1}^{N^{s}} from FDG PET/CT and the unlabeled target set be \mathcal{D}^{t}=\{x_{i}^{t}\}_{i=1}^{N^{t}} from PSMA PET/CT. Each input is a dual-modality 3D volume x\in\mathbb{R}^{2\times H\times W\times Z} formed by stacking PET and CT after a common resampling. The source label y_{i}^{s}=\{(b_{ij},c_{ij})\}_{j=1}^{M_{i}} lists axis-aligned boxes b_{ij}\in\mathbb{R}^{6} with one lesion class c_{ij}=1 . The goal is to learn a detector f_{\theta} that performs well on \mathcal{D}^{t} without target training labels. Since the unknown target label distribution differs in lesion sizes and the number of lesions, we explicitly estimate the target domain priors of anchor-shape set \mathcal{S} as well as size-density prior composed of a global mean \mu (lesions per subject) and normalized histogram h over B volume bins. 2.1 3D detector and source pretraining We adopt the multimodal 3D RetinaNet (M3DRetinaNet) [ 8 ] with a 3D ResNet backbone and a 3D feature pyramid network [ 1 ] operating on concatenated PET and CT channels. The detector relies on defining 3D anchor shapes \{\mathbf{s}_{k}\}_{k=1}^{K} . We apply the anchor boxes at each point in multiscale features, and the head predicts classification logits and box regressions to match ground truth box. With a mini-batch \mathcal{B} and anchor index set \mathcal{A}(\mathcal{B}) , the detection loss is \mathcal{L}_{\mathrm{det}}(\theta;\mathcal{B})=\sum_{a\in\mathcal{A}(\mathcal{B})}\mathrm{FL}(p_{a},c_{a})+\!\!\sum_{a\in\mathcal{A}_{+}(\mathcal{B})}\ell_{\mathrm{reg}}(t_{a},\hat{t}_{a}), (1) where \mathrm{FL} is focal loss [ 5 ] for classification, \ell_{\mathrm{reg}} is a smooth-L1-type regression loss, p_{a} is the predicted lesion probability for anchor a , c_{a}\in\{0,1\} is its

Read the complete text