CXR-LT 2026 Challenge: Multi-Center Long-Tailed and Zero Shot Chest X-ray Classification
Hexin Dong, Yi Lin, Pengyu Zhou, Fengnian Zhao, Alan Clint Legasto, Juno Cho, Dohui Kim, Justin Namuk Kim, Mingeon Kim, Sunwoo Kwak, Gabriel Moyà-Alcover, Ky Trung Nguyen, Thanh-Huy Nguyen, Ha-Hieu Pham, Huy-Hieu Pham, Huy Le Pham, Nikhileswara Rao Sulake, Aina Tur-Serrano, Ruichi Zhang, Ang Zu, Adam E. Flanders, Zhiyong Lu, Ronald M. Summers, Mingquan Lin, Hao Chen, Yuzhe Yang, George Shih, Yifan Peng · 2026
Read CXR-LT 2026 Challenge: Multi-Center Long-Tailed and Zero Shot Chest X-ray Classification by Hexin Dong, Yi Lin, Pengyu Zhou, Fengnian Zhao, Alan Clint Legasto, Juno Cho, Dohui Kim, Justin Namuk Kim, Mingeon Kim, Sunwoo Kwak, Gabriel Moyà-Alcover, Ky Trung Nguyen, Thanh-Huy Nguyen, Ha-Hieu Pham, Huy-Hieu Pham, Huy Le Pham, Nikhileswara Rao Sulake, Aina Tur-Serrano, Ruichi Zhang, Ang Zu, Adam E. Flanders, Zhiyong Lu, Ronald M. Summers, Mingquan Lin, Hao Chen, Yuzhe Yang, George Shih, Yifan Peng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15555.txt.
Introduction
Dong and 27 colleagues present the CXR-LT 2026 challenge, a multi-center benchmark for chest X-ray classification under long tails and unseen classes. It draws on more than 145,000 images from PadChest and NIH sets, with development and test sets newly labeled by radiologists. Two tasks follow: robust classification on 30 known classes and open-world generalization to 6 unseen rare diseases. Vision-language foundation models improve both settings, but rare findings under center shift stay hard.
Catalog record
| CREATOR | Hexin Dong, Yi Lin, Pengyu Zhou, Fengnian Zhao, Alan Clint Legasto, Juno Cho, Dohui Kim, Justin Namuk Kim, Mingeon Kim, Sunwoo Kwak, Gabriel Moyà-Alcover, Ky Trung Nguyen, Thanh-Huy Nguyen, Ha-Hieu Pham, Huy-Hieu Pham, Huy Le Pham, Nikhileswara Rao Sulake, Aina Tur-Serrano, Ruichi Zhang, Ang Zu, Adam E. Flanders, Zhiyong Lu, Ronald M. Summers, Mingquan Lin, Hao Chen, Yuzhe Yang, George Shih, Yifan Peng |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50096 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.15555
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CXR-LT 2026 Challenge: Multi-Center Long-Tailed and Zero Shot Chest X-ray Classification Hexin Dong, Yi Lin, Pengyu Zhou, Fengnian Zhao, Alan Clint Legasto, Juno Cho, Dohui Kim, Justin Namuk Kim, Mingeon Kim, Sunwoo Kwak, Gabriel Moyà-Alcover, Ky Trung Nguyen, Thanh-Huy Nguyen, Ha-Hieu Pham, Huy-Hieu Pham, Huy Le Pham, Nikhileswara Rao Sulake, Aina Tur-Serrano, Ruichi Zhang, Ang Zu, Adam E. Flanders, Zhiyong Lu, Ronald M. Summers, Mingquan Lin, Hao Chen, Yuzhe Yang, George Shih, Yifan Peng Abstract Chest X-ray (CXR) interpretation is hindered by the long-tailed distribution of pathologies and the open-world nature of clinical environments. Existing benchmarks often rely on closed-set classes from a single institution, failing to capture the prevalence of rare diseases or the appearance of novel findings. To address this, we present the CXR-LT challenge. The first event, CXR-LT 2023, established a large-scale benchmark for long-tailed multi-label CXR classification and identified key challenges in rare disease recognition. CXR-LT 2024 further expanded the label space and introduced a zero-shot task to study generalization to unseen findings. Building on the success of CXR-LT 2023 and 2024, this third iteration of the benchmark introduces a multi-center dataset comprising over 145,000 images from PadChest and NIH Chest X-ray datasets. Additionally, all development and test sets in CXR-LT 2026 are annotated by radiologists, providing a more reliable and clinically grounded evaluation than report-derived labels. The challenge defines two core tasks this year: (1) Robust Multi-Label Classification on 30 known classes and (2) Open-World Generalization to 6 unseen (out-of-distribution) rare disease classes. This paper summarizes the overview of the CXR-LT 2026 challenge. We describe the data collection and annotation procedures, analyze solution strategies adopted by participating teams, and evaluate head-versus-tail performance, calibration, and cross-center generalization gaps. Our results show that vision-language foundation models improve both in-distribution and zero-shot performance, but detecting rare findings under multi-center shift remains challenging. Our study provides a foundation for developing and evaluating AI systems in realistic long-tailed and open-world clinical conditions. keywords Chest X-ray Long-tailed Learning Zero-shot Generalization Multi-center Benchmark 1 Introduction Chest X-ray (CXR) is one of the most widely used imaging modalities in clinical practice. However, the distribution of abnormal findings in CXR datasets is highly imbalanced, with a small number of common abnormalities accounting for most observations, whereas many clinically important abnormalities occur rarely [ 34 ] . Such an imbalance poses a fundamental challenge for standard deep learning methods, which tend to bias predictions toward frequent classes while underperforming on rare but critical “tail” classes [ 10 ] . Although numerous methods have been proposed to address class imbalance, most existing studies focus on algorithmic improvements under fixed datasets [ 32 , 33 , 31 , 13 ] . In contrast, comparatively little attention has been given to benchmark design that captures the combined challenges of long-tailed distributions, open-world conditions, and real-world data variability. In practice, clinical models must not only recognize common abnormalities, but also generalize to infrequent and previously unseen abnormalities, often across institutions and imaging settings [ 21 ] . To advance research in this direction, we established the CXR-LT challenge series. The first edition (CXR-LT 2023 [ 9 , 11 ] ) introduced a benchmark for long-tailed multi-label classification. It provided a large-scale training dataset derived from radiology reports and evaluated model performance across a diverse set of abnormal findings with highly imbalanced prevalence. The primary goal was to identify the limitations of existing deep learning models, particularly their difficulty in accurately recognizing infrequent diseases and handling multi-label predictions. The second event (CXR-LT 2024 [ 16 ] ) expanded the benchmark in two major directions. First, it significantly increased both the dataset scale and label diversity, comprising over 377,000 CXRs annotated with 45 disease categories, including 19 newly introduced rare findings. Second, it introduced a zero-shot learning task to evaluate the model’s ability to recognize previously unseen abnormalities without direct supervision. This addition explicitly studied open-world settings, where models must handle diseases not observed during training. Building on these efforts, CXR-LT 2026 further advances the benchmark to better reflect real-world clinical conditions. First, we introduce a multi-center dataset by combining PadChest [ 2 ] and NIH Chest X-ray data [ 26 ] , enabling cross-center evaluation while addressing recent access restrictions of prior datasets [ 12 ] . Second, we improve label quality by using radiologist-annotated development and test sets, providing more reliable ground truth than report-derived labels in previous challenges. Third, we define two complementary tasks that jointly evaluate long-tailed classification of known findings and open-world generalization to unseen findings. This paper presents a comprehensive overview of the CXR-LT 2026 challenge. We detail the dataset construction and label collection, summarize methods developed by participating teams, and provide in-depth performance analyses, including head-to-tail behavior, robustness under input perturbations, and cross-center generalization. The results highlight persistent challenges in long-tailed and open-world CXR analysis and offer insights for developing more robust and clinically applicable AI systems. 2 Challenge description 2.1 Task description 2.1.1 Task 1: Long-Tailed Multi-Label Classification (a) (b) Figure 1 : The dataset of CXR-LT 2026. (a) The co-occurrence of labels in the training set. (b) The label distributions in the training set, the development and test sets of Task 1, and the development and test sets of Task 2. The first task evaluates models’ ability to recognize common CXR findings under a long-tailed class distribution. In this task, participants are required to predict the presence or absence of 30 “seen” disease categories. The label set was constructed based on two criteria. First, we retained 20 classes from previous CXR-LT editions to ensure longitudinal consistency. Second, we added 10 additional findings from the PadChest dataset to better capture clinically common abnormalities. The final label set, therefore, reflects a broad and realistic spectrum of thoracic findings: (1) Alveolar Pattern, (2) Aortic Atheromatosis, (3) Aortic Elongation, (4) Atelectasis, (5) Azygos Lobe, (6) Bronchiectasis, (7) Cardiomegaly, (8) Calcified Densities, (9) Central Venous Catheter, (10) Emphysema, (11) Fracture, (12) Hemidiaphragm Elevation, (13) Hernia, (14) Hydropneumothorax, (15) Hyperinflated Lung, (16) Hypoexpansion, (17) Interstitial Pattern, (18) Kyphosis, (19) Mass, (20) Nodule, (21) Normal, (22) Pleural Effusion, (23) Pleural Thickening, (24) Pneumothorax, (25) Pneumoperitoneum, (26) Sternotomy, (27) Subcutaneous Emphysema, (28) Support Devices, (29) Vascular Hilar Enlargement, (30) Vertebral Degenerative Changes. These categories cover structural abnormalities, pulmonary diseases, and medical devices, spanning both frequent and infrequent findings. Models were trained using the large-scale PadChest training dataset with report-derived labels. Evaluation was conducted on the radiologist-annotated PadChest-GR dataset [ 7 ] to ensure a more reliable assessment compared to prior editions. 2.1.2 Task 2: Open-World Generalization The second task evaluates models’ ability to recognize previously unseen disease categories without explicit supervision. The label set was derived from PadChest-GR and built upon the out-of-distribution (OOD) taxonomy introduced in Task 3 of the CXR-LT 2024. To maintain comparability, we retained the same five OOD categories and introduced one additional finding, Goiter. The final set includes: (1) Adenopathy, (2) Bulla, (3) Goiter, (4) Infarction, (5) Osteopenia, (6) Scoliosis. During training, models used the same dataset as in Task 1 but did not receive labels for these six findings. The goal is to assess whether models can leverage learned visual representations to generalize to new disease categories. This setup reflects a realistic clinical deployment