Comparative Analysis of Custom CNN Architectures versus Pre-trained Models and Transfer Learning: A Study on Five Bangladesh Datasets
Ibrahim Tanvir, Alif Ruslan, Sartaj Solaiman · 2026
Read Comparative Analysis of Custom CNN Architectures versus Pre-trained Models and Transfer Learning: A Study on Five Bangladesh Datasets by Ibrahim Tanvir, Alif Ruslan, Sartaj Solaiman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04352.txt.
Introduction
Ibrahim Tanvir, Alif Ruslan, and Sartaj Solaiman run a head-to-head contest for image classification in Bangladesh in a 2026 arXiv paper. Small convolutional networks built from scratch against two famous pre-trained models, ResNet-18 and VGG-16, used either as frozen feature extractors or finetuned. The testbeds are five local datasets covering footpaths, auto rickshaws, mangoes, paddy varieties, and road damage.
Transfer learning with finetuning wins consistently, they report, beating the other approaches by margins that vary widely by dataset, and reaching perfect accuracy on the road damage set with a finetuned ResNet-18. The homemade networks still earn a place: they are far smaller than the pre-trained models and train efficiently on simpler tasks. The paper closes with practical guidance on choosing an approach given data size, computing budget, and the accuracy actually needed.
Catalog record
| CREATOR | Ibrahim Tanvir, Alif Ruslan, Sartaj Solaiman |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-04352
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Comparative Analysis of Custom CNN Architectures versus Pre-trained Models and Transfer Learning: A Study on Five Bangladesh Datasets Ibrahim Tanvir, Alif Ruslan, Sartaj Solaiman Abstract This study presents a comprehensive comparative analysis of custom-built Convolutional Neural Networks (CNNs) against popular pre-trained architectures (ResNet-18 and VGG-16) using both feature extraction and transfer learning approaches. We evaluated these models across five diverse image classification datasets from Bangladesh: Footpath Vision, Auto Rickshaw Detection, Mango Image Classification, Paddy Variety Recognition, and Road Damage Detection. Our experimental results demonstrate that transfer learning with fine-tuning consistently outperforms both custom CNNs built from scratch and feature extraction methods, achieving accuracy improvements across different datasets. Notably, ResNet-18 with fine-tuning achieved perfect 100% accuracy on the Road Damage BD dataset. While custom CNNs offer advantages in model size (3.4M parameters vs. 11-134M for pre-trained models) and training efficiency on simpler tasks, pre-trained models with transfer learning provide superior performance, particularly on complex classification tasks with limited training data. This research provides practical insights for practitioners in selecting appropriate deep learning approaches based on dataset characteristics, computational resources, and performance requirements. keywords Convolutional Neural Networks, Transfer Learning, Pre-trained Models, Image Classification, Deep Learning, Computer Vision, Bangladesh Datasets 1 Introduction Deep learning, particularly Convolutional Neural Networks (CNNs), has revolutionized computer vision tasks over the past decade. However, practitioners face a critical decision when developing image classification systems: should they build a custom CNN architecture from scratch, use pre-trained models for feature extraction, or employ transfer learning with fine-tuning? This choice significantly impacts model performance, training time, computational resources, and deployment feasibility. Pre-trained models such as ResNet and VGG, trained on large-scale datasets like ImageNet, have become de facto standards in computer vision. These models capture generalizable features from millions of images, potentially reducing the need for extensive training data and computational resources. However, custom CNNs designed specifically for a task may offer advantages in terms of model size, inference speed, and adaptation to domain-specific characteristics. This study addresses the research question: How do custom CNN architectures compare against pre-trained models (using feature extraction and transfer learning) across diverse image classification tasks? We evaluate three distinct approaches: 1. Custom CNN (Scratch Training) : A lightweight CNN architecture designed and trained from scratch 2. Pre-trained Models (Feature Extraction) : ResNet-18 and VGG-16 with frozen convolutional layers 3. Transfer Learning (Fine-Tuning) : ResNet-18 and VGG-16 with trainable layers Our evaluation encompasses five datasets representing real-world applications in Bangladesh: footpath encroachment detection, auto-rickshaw identification, mango variety classification, paddy variety recognition, and road damage assessment. These datasets vary in complexity, number of classes, and image characteristics, providing a robust testbed for comparing modeling approaches. 1.1 Research Contributions This research makes the following contributions: • Comprehensive empirical comparison of custom CNNs versus pre-trained models across five diverse datasets • Systematic evaluation of feature extraction versus fine-tuning approaches for transfer learning • Analysis of trade-offs between model performance, size, and training efficiency • Practical recommendations for selecting appropriate deep learning approaches based on dataset characteristics • Insights into transfer learning effectiveness on domain-specific Bangladesh datasets 2 Related Work Transfer learning has become a cornerstone of modern deep learning, enabling practitioners to leverage knowledge from large-scale datasets for specialized tasks. Yosinski et al. yosinski2014transferable demonstrated that features learned by CNNs on ImageNet are transferable to other visual recognition tasks, with early layers learning general features and later layers learning task-specific features. Several studies have compared custom architectures against pre-trained models. Rawat and Wang rawat2017deep provide a comprehensive survey of deep CNN architectures, highlighting the evolution from AlexNet to ResNet and the increasing depth of successful architectures. He et al. he2016deep introduced ResNet with residual connections, addressing the degradation problem in very deep networks and achieving state-of-the-art results across multiple benchmarks. For resource-constrained applications, Sandler et al. sandler2018mobilenetv2 developed MobileNetV2, demonstrating that efficient architectures can achieve competitive accuracy with significantly fewer parameters. This trade-off between model size and performance remains a critical consideration in practical applications. Research on transfer learning for specialized domains has shown mixed results. Kornblith et al. kornblith2019better found that better ImageNet performance generally translates to better transfer learning performance, but the correlation varies by target task. Raghu et al. raghu2019transfusion questioned conventional transfer learning wisdom, showing that when sufficient data is available, training from scratch can match transfer learning performance. Limited research exists on comparative studies using Bangladesh-specific datasets. This study fills this gap by systematically evaluating different modeling approaches on diverse local datasets, providing insights relevant to practitioners working on similar regional applications. 3 Methodology 3.1 Datasets We evaluated our models on five diverse image classification datasets from Bangladesh: Footpath Vision Dataset : Binary classification of footpath encroachment, distinguishing between encroached and unencroached footpaths. This dataset addresses urban planning and accessibility concerns. Auto Rickshaw Detection Dataset : Multi-class classification of different types of auto-rickshaws, relevant for transportation studies and traffic management. Mango Image BD Dataset : Classification of mango varieties commonly found in Bangladesh, supporting agricultural applications and quality control. Paddy Variety BD Dataset : Multi-class classification of rice (paddy) varieties, crucial for agricultural research and crop management in Bangladesh. Road Damage BD Dataset : Classification of road surface conditions and damage types, applicable to infrastructure monitoring and maintenance planning. Each dataset was pre-split into training, validation, and test sets to ensure consistent evaluation across all models. Table 1 provides a comprehensive overview of all five datasets used in this study. Table 1: Overview of the five Bangladesh datasets used in this study. Dataset Application Classes Type Train/Val/Test Source Footpath Vision Urban Planning 2 Binary Pre-split footpath Auto Rickshaw Transportation Multi Multi-class Pre-split autorickshaw Mango Image BD Agriculture Multi Multi-class Pre-split mango Paddy Variety BD Agriculture Multi Multi-class Pre-split paddy Road Damage BD Infrastructure Multi Multi-class Pre-split roaddamage 3.2 Model Architectures 3.2.1 Custom CNN Architecture Our custom CNN was designed to be lightweight yet effective, consisting of four convolutional blocks with progressive channel expansion (32 \rightarrow 64 \rightarrow 128 \rightarrow 256 channels). Each block contains: • Two 3×3 convolutional layers with batch normalization and ReLU activation • Max pooling (2×2) for spatial dimension reduction • Dropout (0.1 to 0.3, progressively increasing) for regularization The feature extractor is followed by adaptive average pooling and a three-layer fully connected classifier (512 \rightarrow 256 \rightarrow num_classes) with dropout (0.5 and 0.3). The architecture was initialized using Kaiming initialization and trained from random weights. • Total parameters: 3.40M • Trainable parameters: 3.40M 3.2.2 Pre-trained Models We employed two popular CNN architectures pre-trained on ImageNet: ResNet-18 : A residual network with 18 layers featuring skip connections that enable training of very deep networks. The architecture contains residual blocks with identity shortcuts, batch normalization, and ReLU activations. • Total parameters: 11.18M • Trainable parameters (feature extraction): \sim 0.00M (classifier only) • Trainable parameters (fine-tuning): 11.18M (all layers) VGG-16 : A deep network with 16 weight layers featuring small (3×3) convolution filters and a simple architecture design. The network consists of five convolutional blocks followed by three fully connected layers. • Total parameters: 134.27M • Trainable parameters (feature extraction): \sim 0.01M (classifier only) • Trainable parameters (fine-tuning): 134.27M (all layers) 3.3 Training Approaches We evaluated three distinct training approaches: 1. Custom CNN (Scratch Training) : The custom architecture was trained from randomly