CNN and ViT Efficiency Study on Tiny ImageNet and DermaMNIST Datasets
Aidar Amangeldi 1 , Angsar Taigonyrov 2 , Muhammad Huzaid Jawad 1 , Chinedu Emmanuel Mbonu 2 · 2025
Read CNN and ViT Efficiency Study on Tiny ImageNet and DermaMNIST Datasets by Aidar Amangeldi 1 , Angsar Taigonyrov 2 , Muhammad Huzaid Jawad 1 , Chinedu Emmanuel Mbonu 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08259.txt.
Description
Amangeldi and three co-authors compared convolutional networks with vision transformers for image classification in twenty twenty-five. Convolutional networks are the established workhorse; transformers, borrowed from language models, are challengers. The practical question is efficiency: which gives acceptable accuracy with lower latency and fewer parameters on modest hardware?
Using ResNet-18 as the baseline, the team fine-tuned four sizes of vision transformer, from tiny to large, on a skin image dataset and on Tiny ImageNet. Systematic tuning of training settings showed the transformers could match or beat the baseline while running faster and carrying fewer parameters. The authors conclude that properly fine-tuned vision transformers are viable for deployment in resource-constrained settings like clinics and edge devices.
Catalog record
| CREATOR | Aidar Amangeldi 1 , Angsar Taigonyrov 2 , Muhammad Huzaid Jawad 1 , Chinedu Emmanuel Mbonu 2 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08259