CNN and ViT Efficiency Study on Tiny ImageNet and DermaMNIST Datasets

Aidar Amangeldi 1 , Angsar Taigonyrov 2 , Muhammad Huzaid Jawad 1 , Chinedu Emmanuel Mbonu 2 · 2025

Read CNN and ViT Efficiency Study on Tiny ImageNet and DermaMNIST Datasets by Aidar Amangeldi 1 , Angsar Taigonyrov 2 , Muhammad Huzaid Jawad 1 , Chinedu Emmanuel Mbonu 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08259.txt.

Description

Amangeldi and three co-authors compared convolutional networks with vision transformers for image classification in twenty twenty-five. Convolutional networks are the established workhorse; transformers, borrowed from language models, are challengers. The practical question is efficiency: which gives acceptable accuracy with lower latency and fewer parameters on modest hardware?

Using ResNet-18 as the baseline, the team fine-tuned four sizes of vision transformer, from tiny to large, on a skin image dataset and on Tiny ImageNet. Systematic tuning of training settings showed the transformers could match or beat the baseline while running faster and carrying fewer parameters. The authors conclude that properly fine-tuned vision transformers are viable for deployment in resource-constrained settings like clinics and edge devices.

Catalog record

CREATORAidar Amangeldi 1 , Angsar Taigonyrov 2 , Muhammad Huzaid Jawad 1 , Chinedu Emmanuel Mbonu 2
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-08259

Browse the full library · About the Tower of Babel