Loss Design and Architecture Selection for Long-Tailed Multi-Label Chest X-Ray Classification

Nikhileswara Rao Sulake · 2026

Read Loss Design and Architecture Selection for Long-Tailed Multi-Label Chest X-Ray Classification by Nikhileswara Rao Sulake (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02294.txt.

Introduction

Nikhileswara Rao Sulake tunes chest X-ray classification for rare diseases in this 2026 study. Chest scans carry many labels at once, and rare findings appear in few images. Models can then ignore rare classes while scoring well overall. The work tests loss functions, network designs, and post-training tricks on a large benchmark.

The benchmark holds about one hundred forty thousand images with thirty disease labels. A loss that boosts rare classes late in training beat standard and lopsided rivals. Among network designs, a large modern convolutional model scored best alone. Retraining the classifier head and averaging test views lifted scores further. On the official test board, the entry placed fifth among sixty-eight teams, and the author candidly discusses the drop from local scores.

Catalog record

CREATORNikhileswara Rao Sulake
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17959
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.02294

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Loss Design and Architecture Selection for Long-Tailed Multi-Label Chest X-Ray Classification Thanks: Corresponding Author: [email protected] Nikhileswara Rao Sulake Abstract Long-tailed class distributions pose a significant challenge for multi-label chest X-ray (CXR) classification, where rare but clinically important findings are severely underrepresented. In this work, we present a systematic empirical evaluation of loss functions, CNN backbone architectures and post-training strategies on the CXR-LT 2026 benchmark, comprising approximately 143K images with 30 disease labels from PadChest. Our experiments demonstrate that LDAM with deferred re-weighting (LDAM-DRW) consistently outperforms standard BCE and asymmetric losses for rare class recognition. Amongst the architectures evaluated, ConvNeXt-Large achieves the best single-model performance with 0.5220 mAP and 0.3765 F1 on our development set, whilst classifier re-training and test-time augmentation further improve ranking metrics. On the official test leaderboard, our submission achieved 0.3950 mAP, ranking 5th amongst all 68 participating teams with total of 1528 submissions. We provide a candid analysis of the development-to-test performance gap and discuss practical insights for handling class imbalance in clinical imaging settings. Code is available at https://github.com/Nikhil-Rao20/Long_Tail . † † address: Department of Computer Science and Engineering, Rajiv Gandhi University of Knowledge Technologies, Nuzvid, India 1 Introduction Chest X-rays (CXRs) remain the most widely performed diagnostic imaging examination across the world, serving as the primary tool for detecting a broad range of thoracic abnormalities. However, the distribution of clinical findings in CXR datasets inherently follows a long-tailed pattern, conditions like cardiomegaly and pleural effusion are observed frequently, whereas findings such as pneumothorax and emphysema occur relatively rarely. This severe class imbalance poses a fundamental challenge for deep learning based classification systems, since conventional loss functions tend to get biased towards the head classes, resulting in models that fail to adequately recognise rare but clinically significant pathologies. Further complicating this, CXR interpretation is inherently a multi-label problem as a single patient can simultaneously present multiple co-occurring findings. Unlike single-label tasks common in computer vision, models here must learn complex label co-occurrence patterns whilst handling severe imbalance across all findings simultaneously. Several approaches have been proposed to tackle class imbalance in long-tailed settings. Class-balanced loss [ 6 ] re-weights sample contributions based on the effective number of samples per class. Asymmetric Loss [ 17 ] , designed for multi-label classification, applies different focusing parameters for positive and negative samples to down-weight easy negatives. Label-Distribution-Aware Margin (LDAM) loss [ 4 ] enforces larger decision margins for minority classes, and when combined with deferred re-weighting (DRW), applies class-balanced weights only after the network has learnt initial feature representations. Beyond loss design, two-stage training that decouples representation learning from classifier optimisation has shown benefits [ 13 ] , and graph convolutional networks have been explored for modelling label co-occurrence in CXR [ 5 ] . In the medical imaging domain, recent works have investigated memory-augmented architectures [ 8 ] , counterfactual augmentation [ 2 ] and improved ranking losses [ 10 ] . The CXR-LT challenge series [ 14 ] has been instrumental in benchmarking these techniques on real-world long-tailed thoracic data. Despite these individual advancements, there is a lack of systematic evaluation that jointly examines the interplay between loss function choice, backbone architecture capacity and post-training strategies specifically for long-tailed multi-label CXR classification. Most prior works tend to evaluate these components in isolation making it hard for practitioners to determine which combinations are most effective. The CXR-LT 2026 Challenge [ 7 ] , built on the PadChest dataset [ 3 ] with over 160K CXR images across 30 disease labels, provides an ideal testbed for such a study. Our aim is to conduct a thorough empirical evaluation investigating how loss functions, architecture selection, classifier re-training (cRT), test-time augmentation (TTA) and model ensembling interact under long-tailed conditions. Our key contributions are as follows: 1. Systematic comparison of loss functions (BCE, Asymmetric, LDAM-DRW) across multiple CNN architectures from ResNet to ConvNeXt, showing that LDAM-DRW consistently benefits rare class recognition 2. Evidence that modern architectures, specially ConvNeXt, achieve substantially better performance than conventional backbones, with ConvNeXt-Large attaining the best single-model mAP of 0.5220 3. Evaluation of post-training strategies including cRT, TTA, calibration and ensembling, analysing their effects on both ranking and instance-level metrics 4. A candid analysis of our 5th place submission to the CXR-LT 2026 test leaderboard, including an examination of the development-to-test performance gap 2 Methodology 2.1 Problem Formulation Given a chest X-ray image \mathbf{x} , the goal is to predict a binary label vector \mathbf{y}\in\{0,1\}^{C} where C=30 represents the number of disease classes. This multi-label setting allows multiple findings to co-occur in a single image. The evaluation metric is macro-averaged mAP, computed as the mean of per-class Average Precision scores. 2.2 Loss Functions for Long-Tailed Data We investigated several loss functions designed to handle class imbalance: LDAM-DRW Loss. The Label-Distribution-Aware Margin loss [ 4 ] enforces larger margins for minority classes: \mathcal{L}_{\text{LDAM}}=-\log\frac{e^{z_{y}-\Delta_{y}}}{e^{z_{y}-\Delta_{y}}+\sum_{j\neq y}e^{z_{j}}} (1) where \Delta_{j}=C/n_{j}^{1/4} and n_{j} is the number of samples for class j . While the original formulation targets single-label softmax classification, we adapt it for the multi-label setting by applying per-class LDAM margins within a binary cross-entropy framework, treating each of the 30 classes as an independent binary classification. In the deferred re-weighting (DRW) scheme, training begins with uniform weights and transitions to class-balanced weights after an initial warm-up period, allowing the model to first learn general representations before focusing on the tail classes. Asymmetric Loss. Designed for multi-label classification [ 17 ] , this loss applies asymmetric focusing: \mathcal{L}_{\text{ASL}}=\sum_{i}\left[y_{i}L_{+}+(1-y_{i})L_{-}\right] (2) where L_{+} and L_{-} use different focusing parameters \gamma_{+} and \gamma_{-} , with probability shifting applied to negative samples. 2.3 Network Architectures We evaluate several CNN architectures spanning different design philosophies and model capacities 1 1 1 Values in parentheses denote approximate parameter count in millions. : ResNet-50 (25M) and ResNet-101 (44M) [ 11 ] as foundational baselines with residual connections; DenseNet-121 (8M) and DenseNet-169 (14M) [ 12 ] for their dense connectivity and feature reuse, which has been widely adopted in CXR analysis; EfficientFormerV2-S (22M) [ 18 ] as a parameter-efficient alternative; and ConvNeXt-Base (89M) and ConvNeXt-Large (198M) [ 15 ] , which modernise the pure CNN paradigm by incorporating Transformer-inspired design principles like patchified stems, large kernels and layer normalisation. All models were initialised with ImageNet-pretrained weights and equipped with a classification head consisting of global average pooling, layer normalisation, dropout and a linear layer outputting 30 logits. 2.4 Post-Training Strategies: cRT, TTA and Ensemble Following Kang et al. [ 13 ] , we explored classifier re-training (cRT) as a two-stage approach. In the first stage, the full network is trained end-to-end with LDAM-DRW loss. In the second stage, we freeze the backbone and re-initialise only the classifier head, which is then trained with class-balanced sampling to better handle infrequent classes. This effectively decouples representation learning from classifier optimisation. For test-time augmentation (TTA), we average predictions over augmented versions of each test image using horizontal flipping and small rotations ( \pm 5^{\circ} ). For ensembling, we combine predictions from multiple models through weighted averaging, assigning higher weights to models with better validation performance. 3 Experiments 3.1 Dataset and Preprocessing The CXR-LT 2026 dataset is derived from PadChest [ 3 ] , comprising 160,845 chest X-ray images annotated with 30 disease labels.

Read the complete text