Uncovering Latent Pathological Signatures in Pulmonary CT via Cross-Window Knowledge Distillation
Bo Peng ∗, Wujian Xu ∗, Kun Wang, Ximing Liao, Na Wang, Daqian Shi, Tian Li, Jing Gao, Johan Thygesen, Yingqun Ji, Honghan Wu † · 2026
Read Uncovering Latent Pathological Signatures in Pulmonary CT via Cross-Window Knowledge Distillation by Bo Peng ∗, Wujian Xu ∗, Kun Wang, Ximing Liao, Na Wang, Daqian Shi, Tian Li, Jing Gao, Johan Thygesen, Yingqun Ji, Honghan Wu † (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12562.txt.
Introduction
Peng and ten colleagues use teacher-student learning across CT windows to reveal hidden lung disease signs. Multi-window CT captures complementary clues across tissue densities, yet most deep models fuse windows only late, missing cross-density links. Their framework trains student encoders on latent clinical priors from a teacher that saw the most informative window. On three cohorts covering COPD, pulmonary embolism and a local data set, distillation lifts per-window AUC by ten to sixteen points, with ensemble AUC reaching 0.996 on the COPD cohort.
Catalog record
| CREATOR | Bo Peng ∗, Wujian Xu ∗, Kun Wang, Ximing Liao, Na Wang, Daqian Shi, Tian Li, Jing Gao, Johan Thygesen, Yingqun Ji, Honghan Wu † |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67781 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.12562
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Uncovering Latent Pathological Signatures in Pulmonary CT via Cross-Window Knowledge Distillation Bo Peng ∗, Wujian Xu ∗, Kun Wang, Ximing Liao, Na Wang, Daqian Shi, Tian Li, Jing Gao, Johan Thygesen, Yingqun Ji, Honghan Wu † Abstract . Purpose: Multi-window CT imaging captures complementary pathological information from anatomical structures of differing densities. Existing deep learning approaches analyse windows independently and fuse representations only at later stages, failing to capture pathological nuances arising from systemic interplay between regions of differing densities. This study developed a cross-window knowledge distillation framework that learns latent feature representations. Materials and Methods: The method was retrospectively evaluated on three cohorts: COPD-CT-DF (n=719), an RSNA PE subset (n=1,433), and an in-house CTPA dataset (n=161) for chronic thromboembolic pulmonary disease (CTEPD). Five CT windows were pre-computed per scan. A teacher encoder was identified through performance benchmarks on individual windows; student encoders were then trained via cross-window knowledge distillation to internalise the teacher’s clinical priors. Mechanistic insights were validated through a clinician survey, evaluating how the model captures latent, cross-window anatomical and pathological signatures that resolve diagnostic ambiguity. Results: On COPD-CT-DF, cross-window distillation significantly improved students’ AUCs by 10.1-16.5 percentage points over baselines (all P < .001 P<.001 ), from 0.75-0.81 to 0.90-0.94. An ensemble of the teacher and distilled students achieved accuracy 0.94 and AUC 0.9960 (vs. 0.77 and 0.8936 baseline). Distilled models corrected 21-24 misclassifications per window, capturing pathological signatures invisible to students. On the RSNA PE dataset, per-window AUC improved from 0.80-0.83 to 0.90-0.92. For CTEPD, fine-tuned adaptation achieved AUC 0.7481 vs. 0.6264 for supervised pretraining. Conclusion: Cross-window knowledge distillation internalises pathological information invisible to traditional supervised approaches. By resolving feature interference and facilitating integrated pathological reasoning, it provides a generalisable approach for multi-window medical imaging analysis. † † footnotetext: ∗ These authors contributed equally to this work. † † footnotetext: † Corresponding author: [email protected] † † footnotetext: MSC2020: Primary 00A05, Secondary 00A66. 1 Introduction Deep learning in medical image analysis relies heavily on effective data representation. Unlike natural images, information extraction from medical images, particularly computed tomography (CT) scans, is highly dependent on the choice of imaging parameters ( 20 ) . CT window settings are fundamentally a feature selection process: by controlling the mapping from Hounsfield Units (HU) to grayscale intensities, different windows extract tissue information from distinct density ranges within the same raw data. Lung windows (level: -600 HU) enhance low-density regions to visualize emphysema and airways, mediastinal windows (level: 20 HU) highlight vascular and soft-tissue structures, and bone windows (level: 250 HU) display osseous details ( 18 ) . These window settings correspond to different pathological dimensions of disease: the manifestations of a single disease are often distributed across distinct density ranges, as exemplified by chronic obstructive pulmonary disease (COPD) and pulmonary embolism (PE). The former simultaneously involves parenchymal, vascular, and thoracic alterations, while the latter requires the assessment of intravascular filling defects alongside secondary parenchymal and pleural findings ( 21 ; 2 ) . The radiologist’s diagnostic process is precisely the synthesis of this complementary information, yet this cognitive workflow has not been adequately modeled in existing deep learning approaches. Existing deep learning approaches to multi-window information utilization follow two main patterns, neither fully exploiting inter-window complementarity. The first category employs fixed window settings or HU value ranges as static parameters determined during preprocessing. For instance, Hu et al.’s pulmonary embolism detection model uses a fixed HU range ( 9 ) , Yin et al.’s COVID-19 identification system ( 22 ) preprocesses to lung windows. This design rests on an implicit assumption: that some “optimal” window can sufficiently express disease features, thereby neglecting the complementary value of other windows. The second category attempts to fuse multi-window information, but primarily through input-level multi-channel stacking. For example, Hemalakshmi et al.’s PE-Ynet model ( 7 ) uses lung, mediastinal, and bone windows as three-channel CNN input for pulmonary embolism detection, analogous to processing RGB images. While this shallow fusion strategy allows models to access multi-window information, it treats window integration as a data representation problem rather than a knowledge integration problem. By mixing disparate voxel densities at the network’s lowest level, these models suffer from feature interference, limiting each window’s ability to independently develop deep semantic representations. The more fundamental issue lies in these approaches’ understanding of window information, overlooking a critical fact: different windows correspond not to different observations of the same pathological process, but to orthogonal dimensions of the disease phenotype space. Parenchymal changes, vascular abnormalities, and structural deformations represent relatively independent pathological processes, each most clearly visible in different windows. Ideal multi-window learning should allow each window to develop its specific feature extractor, then integrate these heterogeneous features at higher semantic levels. Existing methods either abandon this complexity through single-window analysis or force premature fusion (i.e., before representation learning), failing to capture the systemic interplay between anatomical structures. Knowledge Distillation (KD) provides a transformative pathway to address this challenge. While traditionally used for model compression ( 5 ) , the core mechanism of distillation reveals possibilities for cross-representation knowledge transfer ( 17 ; 11 ) . When teacher and student process different input representations, distillation forces the student to internalise the teacher’s high-level clinical priors rather than raw pixel information. This creates “cross-window intuition” where a student model (e.g., on Lung window) can be trained to identify latent pathological signatures - features that are effectively invisible to traditional models or human observers because they serve as proxies for systemic pathology usually restricted to the teacher’s domain (e.g. on Mediastinal window). By operating in the feature space, KD achieves deep anatomical reasoning, allowing the model to resolve diagnostic ambiguity through integrated expertise. Table 1. Characteristics of the three cohorts used in this study. Continuous variables are presented as mean \pm standard deviation; categorical variables as n (%). For all three datasets, the positive class corresponds to the disease or adverse outcome: Chronic obstructive pulmonary disease (COPD), acute Pulmonary embolism (PE), and progression to Chronic thromboembolic pulmonary disease (CTEPD), respectively. (a) Three cohorts for three diagnostic tasks. COPD-CT-DF was used as the derivation and internal validation data for COPD classification models. A subset of RSNA PE was used as the derivation and internal validation data for PE classification models. The CTPA dataset was used for validating the transferability of PE models’ in predicting Chronic thromboembolic pulmonary disease (CTEPD) in 3-6 months. Characteristic COPD-CT-DF RSNA PE CTPA Data source and acquisition Source Single-center Multi-center (5 countries) Single-center Disease / classification task COPD diagnosis Pulmonary embolism diagnosis Pulmonary embolism outcome Imaging protocol Standard chest CT CT pulmonary angiography CT pulmonary angiography Slice thickness (mm) 1.0–1.25 2.5–3.0 1.0–1.25 Cohort composition Total cases (n) 719 1,433 (random subset) 161 Training / Validation / Test (n) 526 / 93 / 100 712 / 356 / 365 129 / 32 / – Positive cases, n (%) 365 (50.8) 533 (37.2) 118 (73.3) Negative cases, n (%) 354 (49.2) 900 (62.8) 43 (26.7) (b) Clinical characteristics of the COPD-CT-DF cohort, stratified by COPD diagnosis. Characteristic COPD (n=365) Non-COPD (n=354) Demographics Age (years) 71.3 \pm 10.2 66.5 \pm 12.8 Male, n (%) 273 (74.8) 186 (52.5) BMI (kg/m 2 ) 23.1 \pm 3.6 24.3 \pm 6.9 Smoking history, n (%) Current