BornoViT: A Novel Efficient Vision Transformer for Bengali Handwritten Basic Characters Classification PubID: pubid: 979-8-3315-1909-4/24/$31.00 ©2024 IEEE

Rafi Hassan Chowdhury 1 , Naimul Haque 1 , Kaniz Fatiha 1 · 2026

Read BornoViT: A Novel Efficient Vision Transformer for Bengali Handwritten Basic Characters Classification PubID: pubid: 979-8-3315-1909-4/24/$31.00 ©2024 IEEE by Rafi Hassan Chowdhury 1 , Naimul Haque 1 , Kaniz Fatiha 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00755.txt.

Introduction

Chowdhury, Haque, and Fatiha build BornoViT, a light Vision Transformer for Bengali handwritten characters and digits, a hard task for resource limited languages. A simple deep conv net backbone cuts compute burden, with well under a million weights and a model under a megabyte. Tested on the BanglaLekha Isolated set, the model reaches nearly 96 percent accuracy, beating existing rivals on efficiency.

Catalog record

CREATORRafi Hassan Chowdhury 1 , Naimul Haque 1 , Kaniz Fatiha 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24166
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.00755

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

BornoViT: A Novel Efficient Vision Transformer for Bengali Handwritten Basic Characters Classification PubID: pubid: 979-8-3315-1909-4/24/$31.00 ©2024 IEEE Rafi Hassan Chowdhury 1 , Naimul Haque 1 , Kaniz Fatiha 1 Abstract Handwritten Character Classification in Bengali script is a significant challenge due to the complexity and variability of the characters. The models which are used often, to classify characters are computationally expensive and data-hungry which are not suitable for the resource limited languages such as Bengali. In this experiment, we proposed a novel, efficient and lightweight Vision Transformer model that can classify Bengali handwritten basic characters & digits effectively, addressing some of the shortcomings of traditional methods. The proposed solution utilizes deep convolutional neural network (DCNN) in a more simplified mannar than in traditional DCNN with the aim of lowering the computational burden. With only 0.65 million parameters, 0.62 MB of model size and 0.16 GFLOPs, our model BornoViT is much lighter than the current state-of-the-art models, making our model more favorable for resource limited environment, which is quite necessary for Bengali handwritten character classification. Our model BornoViT was evaluated on BanglaLekha Isolated dataset achieving an accuracy of 95.77%, which significantly outperforms current state-of-the-art models in terms of efficiency. Furthermore, the model was evaluated using our own captured dataset, Bornomala , consisting of around 222 samples from different age groups, achieving accuracy of 91.51%. \ps@headings I Introduction Bangla is the seventh most spoken language in the world, yet Handwritten Character Rcognition (HCR) in Bangla scripts still requires further research because of its complex nature and characteristic. The Bangla letters have complex and distinct patterns, making it challenging for models to achieve high accuracy when classifying a wide range of different handwriting patterns. Traditional machine learning techniques that rely on engineered descriptors often fall short in addressing these complexities. Moreover, most of existing models are computationally expensive, which are not suitable for low end devices. Additionally, template matching methods are not suitable because of the feature variations, writing pattern of different people and inter-class similarity in Bengali handwritten characters. While convolutional Neural Networks (CNNs) in deep learning models are able to overcome certain challenges, but they fall behind in terms of identifying spatial patterns effectively. This is where Vision Transformers (ViTs) become valuable, as they utilize attention mechanisms to learn from global spatial features. As a result, this approach is useful to classify salient features and patterns in context, without the need of expensive computations. Such method is particularly useful for tasks like Bengali handwritten character recognition. Our work introduces a novel, lightweight model called BornoViT, proposed specifically for the efficient classification of Bengali handwritten basic characters. Our model, based on simplified Vision Transformer (ViT) architecture, focusing on reducing computational complexity without compromising classification accuracy. BornoViT has significantly low parameter count, GFLOPs and model size compared to existing models, while achieving higher accuracy and being less resource-hungry, which makes it suitable for real-time applications in low-end devices. We have evaluated our model on the existing BanglaLekha-Isolated dataset [ 2 ] , and it outperformed the current state-of-the-art accuracy in terms of parameter count, model size and FLOPs count. Along with that, our model performed good on our own dataset, Bornomala. II Literature Review Bangla handwritten character recognition has achieved remarkable progress owing to the implementation of various machine learning methods. VashaNet, developed by Raquib et al (2024) [ 15 ] where the 26-skeleton deep Convolutional Neural Network model is aimed at looking for Bengali handwritten characters. VashaNet recorded an accuracy of 94.60% on a primary data set and 94.43% accuracy in the CMATERdb data set. Previously, in their work, Chauhan et al. (2024) [ 4 ] introduced HCR-Net, a deep learning-based script-independent handwritten character recognition network, aimed at improving recognition accuracy across various languages through transfer learning and image augmentation techniques which achieved performance improvements of up to 11% over existing models, making it a computationally efficient solution for handwritten character recognition, especially on smaller datasets. Similarly, in the context of Bangla character recognition, Opu et al. (2021) [ 11 ] proposed a lightweight deep learning model using CNNs which consisted of 74 layers and five blocks, was designed for resource-constrained devices, achieving competitive accuracy with a reduced model size and faster computation times. Previously, in their work, Sarkhel et al (2016) [ 17 ] discussed a low-cost method on Bangla character recognition using Support Vector Machines which was tested on the dataset CMATERdb where the model was quite promising from the computational effectiveness perspective but had challenges when operating large and complex datasets. Further development was reported by Rabby et al. (2020), [ 13 ] who developed the Borno multiclass CNN based architecture trained on a million images from several datasets where the model reached the impressive level of 92.61 percent of accuracy but it demands high computation resources and so it was difficult to deploy in real-time applications and in settings with low computation resources. Das et al. (2021) [ 6 ] explored recognition for Bangla handwriting consonants based on either syllabic or consonantal framing or both, by means of a CNN equiped model and this provides accuracy rates of 93.18% for vowels and 92.25% for consonants, thus displaying the capabilities of CNNs against the different portions of Bangla script. Maitra et al. (2015) [ 9 ] implemented CNN models in the tasks of numeral recognition in various scripts including Bangla where they managed to detect these numerals but this study was insufficient in analyzing the complexity of recognizing the entire Bangla character set [ 9 ] . CNN-Bengali [ 1 ] introduced a simple and efficient CNN framework designed to effectively classify handwritten Bangla characters, including simple characters, compound characters, and numerals where their model demonstrated fast execution, required fewer training epochs, and achieved high validation accuracy across different datasets. III Methodology At the beginning of our experiment, we have pre-trained our proposed BornoViT using Ekush dataset [ 12 ] . After that We have conducted experiment on our Own Dataset Bornomala and BanglaLekha-Isolated [ 2 ] . We have utilized k-fold cross validation for each dataset, where value of k was five. Each time, three folds were used for training, one fold for validation and one for testing split. Validation split was used for early stopping to overcome overfitting of the model. We have trained each fold for at most 100 epochs and our model was converged within 60 to 70 epochs. To stop early we triggered patience if the average validation loss is less than the best validation loss. If patience is triggered for continuous ten times, the training will be stopped. III-A Datasets To conduct this experiment, we have collected our own dataset and also utilized BanglaLekha-Isolated [ 2 ] and Ekush [ 12 ] dataset. Our dataset includes total 13318 images of 60 classes Bengali Handwritten Characters, which are grouped into three main categories: 11 vowels (Shorborno), 39 consonants (Benjonborno), and 10 Bengali digits. A total of 222 participants took part, involving students at different levels of education, family members and other professionals as well as spanning all age groups. This in itself makes it rich as the handwriting of humans is naturally variant and varies in stroke thickness, character forms, writing style and this

Read the complete text