When CNNs Outperform Transformers and Mambas: Revisiting Deep Architectures for Dental Caries Segmentation
Aashish Ghimire, Jun Zeng, Roshan Paudel, Nikhil Kumar Tomar, Deepak Ranjan Nayak, Harshith Reddy Nalla, Vivek Jha, Glenda Reynolds, Debesh Jha · 2025
Read When CNNs Outperform Transformers and Mambas: Revisiting Deep Architectures for Dental Caries Segmentation by Aashish Ghimire, Jun Zeng, Roshan Paudel, Nikhil Kumar Tomar, Deepak Ranjan Nayak, Harshith Reddy Nalla, Vivek Jha, Glenda Reynolds, Debesh Jha (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14860.txt.
Introduction
Aashish Ghimire, Jun Zeng, and seven co-authors benchmark twelve modern networks for finding tooth decay in panoramic X-rays. Early and exact outlines of decay guide treatment, but low contrast, varied shapes, and scarce labeled scans make the task hard. The study trains rival designs under the same settings on a shared data set.
Against the trend toward attention-heavy models, a convolutional design called DoubleU-Net scored best on the main overlap measures. Transformer and state-space models trailed in this test. The result is a useful caution for medical imaging: newer and larger designs do not always win, and careful head-to-head tests still matter for clinical tools.
Catalog record
| CREATOR | Aashish Ghimire, Jun Zeng, Roshan Paudel, Nikhil Kumar Tomar, Deepak Ranjan Nayak, Harshith Reddy Nalla, Vivek Jha, Glenda Reynolds, Debesh Jha |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-14860
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
When CNNs Outperform Transformers and Mambas: Revisiting Deep Architectures for Dental Caries Segmentation Aashish Ghimire, Jun Zeng, Roshan Paudel, Nikhil Kumar Tomar, Deepak Ranjan Nayak, Harshith Reddy Nalla, Vivek Jha, Glenda Reynolds, Debesh Jha Abstract Accurate identification and segmentation of dental caries in panoramic radiographs are critical for early diagnosis and effective treatment planning. Automated segmentation remains challenging due to low lesion contrast, morphological variability, and limited annotated data. In this study, we present the first comprehensive benchmarking of convolutional neural networks, vision transformers and state-space mamba architectures for automated dental caries segmentation on panoramic radiographs through a DC1000 dataset. Twelve state-of-the-art architectures, including VMUnet, MambaUNet, VMUNetv2, RMAMamba-S, TransNetR, PVTFormer, DoubleU-Net, and ResUNet++, were trained under identical configurations. Results reveal that, contrary to the growing trend toward complex attention based architectures, the CNN-based DoubleU-Net achieved the highest dice coefficient of 0.7345, mIoU of 0.5978, and precision of 0.8145, outperforming all transformer and Mamba variants. In the study, the top 3 results across all performance metrics were achieved by CNN-based architectures. Here, Mamba and transformer-based methods, despite their theoretical advantage in global context modeling, underperformed due to limited data and weaker spatial priors. These findings underscore the importance of architecture-task alignment in domain-specific medical image segmentation more than model complexity. Our code is available at: https://github.com/JunZengz/dental-caries-segmentation . Introduction Dental caries is among the most common chronic diseases worldwide ( 1 ; 17 ) . Although largely preventable, dental caries remains a leading cause of tooth loss and oral discomfort ( 10 ) . Epidemiological data show that untreated dental caries affects over one-third of the global population. In children, tooth decay is the most common chronic dental condition, impacting approximately 514 million individuals worldwide ( 6 ) . Therefore, early and accurate detection of carious lesions is crucial. Conventional diagnostic methods, such as visual-tactile examination, intraoral radiography, approximal tooth separation, caries-detection dyes, fiber-optic transillumination (FOTI), and indices such as DMFT, are widely used. These approaches, however, are limited by subjective interpretation, inter-examiner variability, low sensitivity to early enamel lesions, false-positive staining, and difficulties in detecting early-stage or overlapping lesions ( 1 ; 26 ; 2 ) . Figure 1: Variation in dental panoramic X-ray structures across the DC1000 dataset, showing patients with full dentition, missing teeth, and braces. Table 1: Representative studies on DL approaches for dental segmentation. Reported performance corresponds to each study’s best model configuration. Paper (Year) Modality Architecture Dataset (Size) Results Park et al. (2022), BMC Oral Health ( 20 ) Teeth / intraoral photographs U-Net + ResNet-18 + Faster R-CNN(Combined) In-house dataset: 2,348 images from 445 patients Segmentation-based DL improved accuracy 0.813, AUC 0.837, Precision 0.874, Sensitivity 0.890. Zhu et al. (2022), Neural Comput. Appl. ( 32 ) Teeth / panoramic radiographs CariesNet (U-shape CNN with FSAA module) 1,159 images, 3,217 annotated caries lesions CariesNet reached Dice 93.64% and accuracy 93.61% for caries detection. Asci et al. (2024) ( 3 ) Teeth / Pediatric panoramic radiographs U-Net (CNN) 6,075 images (ages 4–14, mixed dentition) U-Net achieved Sensitivity 0.827, Precision 0.912, F1-score 0.867. Hao et al. (2024) ( 8 ) Teeth / Panoramic radiographs SemiTNet (Transformer- based, semi-supervised) TSI15k: 1,589 labeled + 14,728 unlabeled ( \sim 16k total) SemiTNet achieved IoU 94.41% and Dice 95.45% leveraging unlabeled data. Lim et al. (2025), Med. Image Anal. ( 18 ) Teeth / Panoramic radiographs Dual-CNN: Faster R-CNN + U-Net (EfficientNet-B0) 597 images (443 train, 50 val, 100 test) Dual-CNN obtained Dice 0.743, IoU 0.608, Recall 0.731, Precision 0.788. Damrongsri et al. (2025), Clin. Oral Imaging ( 21 ) Teeth / Panoramic radiographs YOLOv5 + Attention U-Net 500 images, 14,997 teeth (clinically validated GT) Attention U-Net - Dice 0.85, IoU 0.75, Recall 0.96, Precision 0.77, Accuracy 0.93. Abbreviations: FSAA – Full-Scale Axial Attention; GT – Ground Truth Deep neural networks have transformed medical image analysis in recent years. Convolutional Neural Networks (CNNs) have been especially successful in segmentation tasks (e.g., U-Net ( 23 ) and its variants), due to their ability to learn rich hierarchical features from images. More recently, Vision Transformers (ViTs) ( 5 ; 4 ) with self-attention mechanisms have emerged, showing promise in capturing global context dependencies and improving long-range reasoning. In parallel, a new family of state-space models has emerged and its medical adaptations, such as VM-UNet ( 25 ) , VM-UNetV2 ( 31 ) and Rmamba-s ( 30 ) , aim to balance efficiency and global modeling through selective state-space recurrence. There are studies in the literature that have exhibited strong performance. But most of them only use CNNs and do not systematically compare with Transformers, and Mamba-based models. In this field, it remains unclear whether architectural complexity truly translates into better performance for dental applications. To study the research question, we perform a comprehensive benchmark on the DC1000 dataset to rigorously study different segmentation architectures under the same experimental settings. Figure 1 shows the structural variability across the dataset, showcasing cases with full dentition, missing teeth, and orthodontic appliances. These examples highlight the real-world challenges of panoramic radiographs, where anatomical variation, metallic artifacts, and inconsistent contrast complicate automatic caries detection. The main contributions of this work are as follows: • Comprehensive benchmark: This work presents a comprehensive benchmark evaluation of 12 segmentation architectures, spanning from CNNs, transformers, and Mamba-based models, on the DC1000 panoramic radiograph dataset for automated caries segmentation on the DC1000 dataset. • Results: Our analysis reveals contrasting results, where convolutional networks consistently outperform Transformers and Mamba-based methods in dice coefficient, mIoU, precision and inference speed. Here, DoubleU-Net achieved the highest dice coefficient of 0.7345 and mIoU of 0.5978, while Mamba-based RMAMamba-S achieved mDSC of 0.6583 and transformer-based PVTFormer achieved the mDSC of 0.6733, establishing a comprehensive benchmark for dental caries segmentation. The 9% higher mDSC with significantly fewer parameters and faster inference highlights the importance of spatial inductive priors in data-limited medical imaging. • Clinical relevance and translational potential: With this work, we highlight the relevance and translational potential of this problem into computer-aided dental diagnosis. We identify some of the strengths and limitations of current algorithms with qualitative and quantitative results, informing clinicians about key considerations in adopting AI-based diagnostic systems. Related Works Deep Learning is one of the fundamental components that aid automated diagnosis of dental imaging, especially for segmenting dental caries in panoramic X-rays. Initial research on the field has focused on convolutional architectures such as U-Net ( 23 ) and its variants. For instance, Park et al. (2022) ( 20 ) used a U-Net to segment the tooth surface from Intraoral photograph and then passed the segmented output to the ResNet-18 ( 9 ) for caries image classification, and utilized Faster R-CNN ( 22 ) for the localization of carious lesions with improved accuracy from 0.758 to 0.813, and AUC from 0.731 to 0.837. Similarly, Asci et al.(2024) ( 3 ) used a U-Net model on more than 6000 pediatric radiographs, indicating consistent performance across primary, mixed, and permanent dentitions. Moreover, to tackle the challenge of automated diagnosis in panoramic x-rays, Hamamci et al. (2023) ( 7 ) introduced the DENTEX benchmark, which is the publicly available hierarchically annotated dataset to support abnormal tooth detection through panoramic X-rays. However, it does not focus on segmentation tasks, and evaluation