CHARACTER RECOGNITION OF NEPALI NUMBER PLATE

Satyasa Khadka 1, Sandhya Baral 1, Sudip Tiwari 1, Sharad Kumar Ghimire 1 · 2026

Read CHARACTER RECOGNITION OF NEPALI NUMBER PLATE by Satyasa Khadka 1, Sandhya Baral 1, Sudip Tiwari 1, Sharad Kumar Ghimire 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28946.txt.

Introduction

Khadka, Baral, Tiwari and Ghimire build an automatic number plate reader tuned for Nepal, where plates use the Devanagari script. Reading plates automatically supports traffic management, but systems trained on Latin letters fail on these characters. Their pipeline first uses YOLO-based detectors, fast object-spotting models, to find the plate and then the individual characters on it.

A convolutional neural network, the standard image-classifying architecture, then recognises each character, trained on 34 Devanagari classes. Training drew on two public datasets spanning varied lighting, fonts and plate structures. Extra augmentation and training on embossed plates, whose characters are raised, improved how well the system generalised to new images. The finished system reached recognition accuracy of up to 93 percent under real-world conditions. The authors present it as a scalable tool for Nepal's traffic management, where plate designs differ enough from global norms to need a dedicated system.

Catalog record

CREATORSatyasa Khadka 1, Sandhya Baral 1, Sudip Tiwari 1, Sharad Kumar Ghimire 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE11 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.28946

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CHARACTER RECOGNITION OF NEPALI NUMBER PLATE Satyasa Khadka 1, Sandhya Baral 1, Sudip Tiwari 1, Sharad Kumar Ghimire 1 Abstract This paper presents a robust Automatic Number Plate Recognition (ANPR) system tailored for Nepali license plates written in Devanagari script. In this paper, a pipelined model was used that integrates YOLO-based models for license plate and character detection, followed by a CNN classifier trained on 34 Devanagari characters. Two publicly available data sets were used that incorporate diverse lighting, fonts, and structural variations. Data augmentation and additional training on embossed plates enhanced the generalizability of the model. The system achieved a recognition accuracy of up to 93%, demonstrating strong performance under real-world conditions and providing a scalable solution for traffic management in Nepal. † † tocauthor: Satyasa Khadka, Sandhya Baral, Sudip Tiwari and Sharad Kumar Ghimire † † institute: Pulchowk Campus, Institute of Engineering, Lalitpur, Nepal 1 1 Introduction Automatic Number Plate Recognition (ANPR) has become an essential component of modern traffic surveillance and control systems. These systems integrate computer vision and machine learning algorithms to localize and recognize vehicle license plates from images. While significant progress has been made in ANPR technologies for standardized plate formats, adapting such systems to regional scripts and structures remains a challenge. In the Nepali context, number plates contain Devanagari characters and exhibit high variability in terms of layout, font style, font size, and alignment. Plates may appear in one, two, or three rows, lack of standardization and, due to manual painting, lead to inconsistencies in spacing and character forms. These factors hinder the effectiveness of conventional ANPR pipelines, which often assume Latin-script-based, uniformly spaced characters. Existing ANPR models trained on Latin character datasets are inadequate for recognizing Devanagari license plates due to script-specific complexities and positional character semantics. Moreover, many models assume fixed-length character sequences and uniform font styling, assumptions that do not hold in the Nepali setting. So, a customized system is needed that is suitable for Nepali license plates in Devanagari script. The main objective of our study is to recognize the Nepali license plates in Devanagari script. To address this requirement, we prepared a robust ANPR system tailored for Nepali number plates using Convolutional Neural Networks (CNNs). Our approach includes plate detection, structure-aware character segmentation, and recognition using script-specific CNN models. The system is trained and validated on a custom-built dataset of Nepali plates, encompassing variations in ownership classes, row structures, and plate appearances. 2 Literature Review Automatic Number Plate Recognition (ANPR) has been extensively studied, evolving from traditional machine learning approaches to deep learning-based pipelines. Early systems focused on hand-crafted features and classical classifiers, while recent methods leverage Convolutional Neural Networks (CNNs) to achieve higher robustness across variable conditions. Pant et al. pant2015automatic developed one of the first Nepali ANPR systems using Histogram of Oriented Gradients (HoG) features and a Support Vector Machine (SVM) classifier. Although effective on a limited dataset, the system struggled with variations in plate structure, achieving 75% accuracy. Recent work by Pandey et al. pandey2023cnn applied CNN-based object detection with SSD MobileNet for plate localization and super-resolution techniques to enhance recognition. Character segmentation was handled using bounding boxes, resulting in 93% recognition accuracy. Dawadi et al. dawadi2023approach proposed a comprehensive pipeline for Devanagari license plate detection, classification, and recognition using IWPOD-NET and nested Random Forest classifiers. Their approach addressed the complexity of Nepal’s multi-row, multilingual, and color-coded plates. Character recognition was performed using two dedicated CNN models trained on a custom dataset. Their system demonstrated high performance on both stationary and dynamic vehicle imagery, validating the model’s applicability in real-world scenarios. 3 Methodology Figure 1 : System design of Nepali Number Plate Recognition System The general flow of the system is shown in figure 1 which is explained further below. 3.1 Datasets Description This work utilizes two publicly available datasets from Kaggle, specifically tailored to the Nepali number plate recognition task: • Nepali Vehicles Number Plate Dataset vehicle_dataset : This dataset contains approximately 2,500 vehicle images with annotated bounding boxes of license plates, captured under diverse environmental and lighting conditions. It serves as the primary source for training and evaluating plate detection and character segmentation models. • Nepali Number Plate Characters Dataset character_dataset : This dataset comprises 26,537 labeled images of the 34 unique Devanagari characters used on Nepali license plates. Data augmentation techniques such as rotation, scaling, and noise injection were applied to enhance model generalizability. 3.2 License Plate Detection and Segmentation License plate detection was initially performed using a pre-trained YOLO model, chosen for its real-time detection capabilities and demonstrated efficacy across diverse operational contexts. The model predicts bounding boxes around license plates within vehicle images, enabling precise cropping of the plate region for subsequent processing. For character-level segmentation, a YOLOv8 model was custom-trained on the Nepali license plate dataset. This approach facilitated accurate localization and extraction of individual characters, which were then forwarded to the recognition module. The adoption of YOLOv8 for segmentation substantially improved the system’s resilience to variations in character spacing, font styles, and background noise. 3.3 Character Recognition Extracted character regions were classified using a Convolutional Neural Network (CNN) specifically trained to recognize the 34 Devanagari characters employed in Nepali license plates. The CNN architecture was meticulously optimized through grid search, guided by evaluation metrics such as classification accuracy and F1-score to ensure optimal model selection. To address the challenge posed by embossed license plates—underrepresented in the primary datasets—a VGG-16-based CNN model was additionally trained using supplementary license plate images sourced from India and the United States. This augmentation enhances the system’s robustness, enabling reliable recognition across a wider spectrum of license plate types encountered in real-world scenarios. 4 Results 4.1 Dataset The license plate detection and character recognition components were trained using the datasets previously described in Section 3.1. Augmentation techniques such as brightness variation and perspective transformation were employed to enhance robustness under real-world conditions. Examples from license plate dataset is shown in figure 2 . Figure 2 : Vehicles Dataset Collection The character recognition model was trained on the 34 unique Devanagari characters used in Nepali license plates, as described in Section 3.1. The dataset, comprising 26,537 labeled samples, was partitioned into training, validation, and test sets. Figure 3 illustrates the distribution of character classes. Data augementation strategies applied during training have improved the generalizability of the model and addressed class imbalance, contributing to overall recognition accuracy. Figure 3 : Character Dataset Distribution 4.2 Performance Evaluation With the help of a pre-trained YOLO model, we have successfully detected the license plate from the image of a vehicle. The detected license plate was then fed into our trained YOLO model, which generated bounding boxes around the characters identified on the license plate. Figure 4 shows the confusion matrix of our trained YOLO model. Figure 4 : Confusion matrix of Trained YOLO Model The detected characters were cropped using the bounding boxes created by the YOLO model and subsequently fed into our CNN model for recognition. Figure 5 illustrates the accuracy and loss graphs of the CNN model during the training. (a) Training VS Validation accuracy (b) Training VS Validation loss Figure 5 : Training metrics Finally, to demonstrate the methodology of this study, we developed a simple

Read the complete text