DCSNet: Multiscale Feature Aggregation for Small Medical Object Segmentation with Detection-guided Hierarchical Cropping
Shanfeng Zhang, Bo Gou, Yue Cao, Lei Zhang, Zhang Yi, Tao He · 2026
Read DCSNet: Multiscale Feature Aggregation for Small Medical Object Segmentation with Detection-guided Hierarchical Cropping by Shanfeng Zhang, Bo Gou, Yue Cao, Lei Zhang, Zhang Yi, Tao He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28402.txt.
Introduction
Shanfeng Zhang, Bo Gou, Yue Cao, Lei Zhang, Zhang Yi, and Tao He segment tiny objects in medical images, where sparse lesions drown in background and their borders blur. Global networks scanning the whole scan at once often miss such micro-targets or trace their edges badly, a serious flaw when the target is an early lesion.
Zhang and colleagues propose DCSNet, which turns the job into local refinement. A detection stage proposes regions and crops around them hierarchically, filtering out most background and easing the class imbalance. Inside those purified windows, a multiscale module blends transformer context with pixel-adaptive fusion to keep fine detail and sharp borders. Across three diverse medical datasets, DCSNet beat existing state-of-the-art methods by substantial margins, especially in boundary precision.
Catalog record
| CREATOR | Shanfeng Zhang, Bo Gou, Yue Cao, Lei Zhang, Zhang Yi, Tao He |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.28402
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DCSNet: Multiscale Feature Aggregation for Small Medical Object Segmentation with Detection-guided Hierarchical Cropping Shanfeng Zhang, Bo Gou, Yue Cao, Lei Zhang, Zhang Yi, Tao He Abstract Small object segmentation in medical imaging is primarily hindered by class imbalance and inherent boundary complexity. Consequently, conventional global networks frequently fail to detect sparse targets or suffer from severe edge degradation. To overcome these limitations, we propose the Detection-guided Cropping Segmentation Network (DCSNet), an end-to-end framework that transforms global dense prediction into a localized refinement process. This framework integrates two core components, namely Detection-guided Hierarchical Cropping (DGHC) and Multiscale Feature Aggregation (MSFA). The DGHC module leverages region proposals to dynamically extract object-centric features, effdataectively filtering out massive background interference to mitigate class imbalance. Subsequently, the MSFA module operates strictly within these purified regions, synergizing a Transformer encoder with a pixel-adaptive fusion strategy. This mechanism dynamically aggregates multiscale features to capture both semantic context and fine-grained details for sharp boundary delineation. Extensive experiments across three diverse medical datasets demonstrate that DCSNet significantly outperforms existing state-of-the-art methods, yielding substantial improvements in boundary precision and offering a highly robust solution for clinical micro-lesion segmentation. 1 Introduction Medical image segmentation, as a core part of Computer-Aided Diagnosis (CAD), plays an irreplaceable role in disease screening, treatment planning and efficacy monitoring 39 . It is widely applied in the analysis of various medical imaging modalities, including CT, MRI, and endoscopic imaging 26 . Small object segmentation specifically refers to a low proportion in the image or small-sized anatomical structures. These small objects are the key evidence for early disease diagnosis, and segmentation accuracy directly decides the clinical application values of CAD systems. However, small object segmentation in medical images faces two primary inherent challenges. First, severe class imbalance. Small targets occupy a minuscule fraction of the overall spatial area compared to the background tissue. Following established criteria 25 , we define small objects as targets occupying less than 1% of the total image pixels. This extreme disparity forces models to heavily bias towards the background during optimization, leading to inadequate feature learning for small objects. As shown in Fig. 1 (a) and (b), such optimization bias causes conventional models like UNet 40 to fail in capturing sparse foreground features, manifesting false negatives. Second, inherent boundary complexity. Small medical objects naturally exhibit irregular shapes, blurred boundaries, and poor separability from surrounding tissues. The inherently low contrast in diverse imaging modalities acts as a direct catalyst that further exacerbates this poor separability 41 . Consequently, segmentation models struggle to extract discriminative features and accurately delineate target edges. This deficiency directly translates into various segmentation errors, resulting in severe boundary leakage into surrounding tissues as illustrated in Fig. 1 (c), and edge degradation as illustrated in Fig. 1 (d), where highly irregular jagged contours are severely shrunken. To tackle the dual challenges of extreme class imbalance and inherent boundary complexity, existing methods have explored numerous strategies but still remain the core bottleneck. Mainstream CNN-based architectures, particularly UNet and its variants 40 , 58 , 9 , attempt to preserve shallow details through feature extraction and skip connections. However, due to the localized receptive fields of standard convolutions, the representations of small objects are easily overwhelmed by dominant background features or nearby large tissues, leaving these models highly susceptible to extreme class imbalance. To overcome the localized limitations of CNNs and establish global contextual awareness, Vision Transformers and hybrid architectures 6 , 3 have been subsequently introduced into the field. By leveraging self attention mechanisms 43 , Transformer-based models can effectively build global semantic correlations. Nevertheless, this global modeling paradigm inherently lacks local inductive biases, severely compromising its ability to capture the fine-grained structural details essential for precise boundary delineation 6 , 15 . Fig. 1: Visual comparison between UNet and DCSNet. All foreground targets occupy less than 1% of total image pixels. Extreme class imbalance induces segmentation failures (e.g., false negatives) in (a-b). Inherent boundary complexity causes boundary-level contour distortions (e.g., severe leakage and shrunken edges) in (c-d). In contrast, our method achieves more complete and precise segmentation. Fig. 2: Illustration of the three data-level settings in our preliminary study. (a) Original: global segmentation on original high-resolution images. (b) Resized: global segmentation on directly downsampled images. (c) Cropped: local segmentation utilizing oracle bounding boxes effectively mitigates background interference. Notably, clinical diagnosis naturally follows a paradigm of localizing the target region prior to detailed morphological analysis. To empirically validate whether such spatial constraints benefit neural networks, we conducted a preliminary study comparing standard global segmentation with strictly localized cropping as illustrated in Fig. 2 . Result in Table 1 demonstrates that explicitly constraining the input to cropped target regions yields significant improvements in both Dice and IoU metrics compared to global paradigms. This substantial performance gain demonstrates that effectively filtering out massive background noise is the primary catalyst for accuracy enhancement, a principle that conceptually aligns with coarse-to-fine cascade strategies in computer vision. Table 1: Quantitative results of the preliminary study on the Brain Tumor dataset. The comparison across different input resolutions demonstrates that explicitly cropping the target region significantly improves performance by mitigating background interference. Methodology Paradigm Resolution Dice \uparrow IoU \uparrow Global (Original) 512\times 512 75.79 67.46 Global (Resized) 256\times 256 75.58 67.51 Local (Cropped) 256\times 256 77.26 69.43 Despite this theoretical alignment, directly deploying decoupled two-stage cascade architectures exposes severe architectural bottlenecks 56 . Rigid image-level cropping inherently prevents feature sharing across stages, incurring immense computational redundancy 30 . More critically, the lack of end-to-end joint optimization inevitably triggers irreversible error accumulation 21 . Any spatial misalignment during initial localization strictly upper-bounds the subsequent segmentation performance and cannot be dynamically corrected 15 . To break these bottlenecks, we propose an end-to-end Detection-guided Cropping Segmentation Network (DCSNet). The main contributions of this work are summarized as follows: 1. We propose DCSNet, a novel end-to-end framework tailored for small object segmentation in medical images. Rather than relying on disconnected image-level separation, it seamlessly integrates detection-driven localization with hierarchical feature-level region cropping and subsequent fine-grained segmentation. This fully differentiable architecture transforms an overwhelmingly difficult global task into a highly focused localized refinement problem, effectively bypassing the irreversible error accumulation of conventional two-stage methods. 2. We design a Detection-guided Hierarchical Cropping (DGHC) module to tackle the severe class imbalance. By leveraging region proposals with a scale aware jitter strategy and hierarchical RoIAlign, this module restricts the segmentation attention to object-centric regions, which effectively filters out massive background interference and improves robustness to localization errors. 3. We develop a Multiscale Feature Aggregation (MSFA) module to overcome boundary complexity. This module hierarchically extracts and adaptively fuses multiscale features, enabling the model to simultaneously capture local fine-grained details for sharp boundary delineation and global semantic correlations for structural consistency. 2 Related Work 2.1 Object Detection R-CNN 12 was the first to introduce convolutional neural networks into region based detection. It generates candidate regions through selective search and extracts features, but it has the shortcomings of repetitive computation, slow inference, and module fragmentation 17 . To address the efficiency issue, Fast R-CNN 13 adopted feature sharing of the entire image and the Region of Interest (RoI) Pooling technique to achieve end to end training for classification and