YOLO for Knowledge Extraction from Vehicle Images: A Baseline Study

Saraa Al-Saddik, Manna Elizabeth Philip, Ali Haidar · 2025

Read YOLO for Knowledge Extraction from Vehicle Images: A Baseline Study by Saraa Al-Saddik, Manna Elizabeth Philip, Ali Haidar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-18966.txt.

Introduction

Saraa Al-Saddik, Manna Elizabeth Philip, and Ali Haidar benchmark YOLO vision models on police vehicle photos, in a 2025 study. Officers need make, color, and body shape read from real roadside images, which are messy: bad angles, glare, partial views. The photos came from New South Wales highway patrol cars in the field.

Three model families competed on datasets of over a hundred thousand images per task, then faced a held-out set tied to eighteen hundred plates. A multi-view trick, pooling several photos of the same vehicle, proved necessary for usable accuracy. The best models named the make in about ninety-four percent of cases and color in about eighty-five. Detection-style models beat the pure classifier. The paper sets a baseline for forensic vehicle reading.

Catalog record

CREATORSaraa Al-Saddik, Manna Elizabeth Philip, Ali Haidar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-18966

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

YOLO for Knowledge Extraction from Vehicle Images: A Baseline Study Saraa Al-Saddik, Manna Elizabeth Philip, Ali Haidar Abstract Accurate identification of vehicle attributes such as make, colour, and shape is critical for law enforcement and intelligence applications. This study evaluates the effectiveness of three state-of-the-art deep learning approaches YOLO-v11, YOLO-World, and YOLO-Classification on a real-world vehicle image dataset. This dataset was collected under challenging and unconstrained conditions by NSW Police Highway Patrol Vehicles. A multi-view inference (MVI) approach was deployed to enhance the performance of the models’ predictions. To conduct the analyses, datasets with 100,000 plus images were created for each of the three metadata prediction tasks, specifically make, shape and colour. The models were tested on a separate dataset with 29,937 images belonging to 1809 number plates. Different sets of experiments have been investigated by varying the models sizes. A classification accuracy of 93.70%, 82.86%, 85.19%, and 94.86% was achieved with the best performing make, shape, colour, and colour-binary models respectively. It was concluded that there is a need to use MVI to get usable models within such complex real-world datasets. Our findings indicated that the object detection models YOLO-v11 and YOLO-World outperformed classification-only models in make and shape extraction. Moreover, smaller YOLO variants perform comparably to larger counterparts, offering substantial efficiency benefits for real-time predictions. This work provides a robust baseline for extracting vehicle metadata in real-world scenarios. Such models can be used in filtering and sorting user queries, minimising the time required to search large vehicle images datasets. Keywords: YOLO, MANPR, Vehicles Metadata Extraction, Object Detection 1 Introduction The New South Wales Police Force (NSWPF) highway patrol vehicles are equipped with special cameras capable of detecting and reading vehicle number plates. This system, introduced in late 2009, is known as the Mobile Automatic Number Plate Recognition (MANPR) system. The MANPR system works by scanning the surrounding number plates and associated vehicles. For each record, the extracted number plate text, number plate image, vehicle image, time and location details are stored. A large dataset with millions of vehicle images has been established, with hundreds of thousands of new records processed daily. The total number of records processed daily in April 2025 is shown in Figure 1 , highlighting the high number of images processed within the system. Figure 1: Total number of MANPR records per day in April 2025. The MANPR system covers the whole state, as shown in Figure 2 . The MANPR data are used in investigating serious crimes, including murder, kidnapping, public place shootings, and arson during the bushfire season. NSW police force employees with the right access details can use the dataset for different tasks. One common use case involves searching the MANPR dataset through a secure web-based interface, where investigators can retrieve vehicle records by entering a number plate. Figure 2: MANPR coverage on a single day across NSW. In real-world investigations, it is often necessary to perform complex user queries, such as searching for vehicles based on attributes like make, colour, or shape, even when specific number plate details are unknown or unavailable. However, the current search capabilities are limited and officers cannot search an area for a vehicle based on its metadata such as make, colour, and shape. For example, a search for a ’red’ vehicle in a selected area is still not possible. Since not all the vehicles metadata are available, the user must go through all the images in a searched area to find the targeted image if it was captured by the MANPR system. In addition, other metadata queries related to vehicles make and model, shape, damaged parts, accessories, and text on vehicles are still not possible. The MANPR dataset contains valuable visual information that, if properly mined, could reveal patterns and insights beneficial to policing operations. Although the data exists, officers and analysts are unable to retrieve relevant images based on these descriptive attributes, limiting the effectiveness of data-driven investigations and image-based vehicle tracking. An approach to addressing this limitation is to use the recognised number plates to retrieve vehicle metadata such as make, shape, or colour from national vehicle registration databases [ 1 ] . However, this is not always feasible with large records required for analysis. Bulk searches to such databases are restricted due to various constraints. With the emergence of intelligent transportation systems (ITS), different artificial intelligence (AI) techniques have been proposed and evaluated across vehicle metadata tasks such as vehicle type recognition (VTR), vehicle logo recognition (VLR), vehicle make recognition (VMR), vehicle make and model recognition (VMMR), and vehicle detection [ 2 , 3 , 4 , 5 ] . Specifically, in the domain of deep learning, AI systems have shown strong performance in various computer vision applications since the release of AlexNet, the artificial neural network (ANN) that achieved state-of-the-art results in the ImageNet challenge in 2012 [ 6 ] . However, identifying vehicle metadata remains challenging due to the high degree of inter-class similarity. That is, many vehicles from different makes or models share similar designs and visual patterns, making it difficult to distinguish between them reliably [ 7 ] . Nevertheless, in cases where number plate information is unclear or unavailable, these AI-based systems offer an effective alternative by enabling the extraction of descriptive attributes- such as vehicle make, shape, and colour directly from the image. The problem of identifying vehicle attributes such as make, shape, and colour can be originally framed as an image classification task. In image classification, the objective is to assign a single label to the entire image, assuming that the object of interest dominates the frame. The task of classifying vehicle metadata relies on establishing rich and representative features that allow the distinction between different classes or labels. Most studies in this area have adopted pre-trained ANN architectures as the backbone of their systems. A pre-trained model refers to a neural network trained on a large general-purpose dataset, such as ImageNet, to learn discriminative visual features. These models are then adapted to specific downstream tasks like vehicle metadata classification. Common pre-trained architectures used in this domain include AlexNet, TResNet-L, SE-ResNetXt50, EfficientNet B3, ResNet101, VGG19, Xception, and DenseNet201 [ 3 , 5 , 8 ] . In support of these efforts, several large-scale datasets have been developed for vehicle-related tasks [ 8 , 9 , 10 , 11 , 12 , 13 , 14 ] . These include the Stanford Cars dataset, which contains 196 vehicle classes, as well as VMMRdb, CompCars, and the MIT Traffic dataset. Traditional supervised learning methods for vehicle metadata classification involve training a model on a labelled dataset, where each image is annotated with a single class label. Convolutional Neural Networks (CNNs) have been extensively used for this purpose due to their ability to learn rich visual features. Numerous studies have demonstrated high performance on benchmark datasets using a range of CNN architectures. Early work employed the AlexNet architecture to classify vehicle make and model in the CompCars Surveillance and On-Road Vehicle datasets [ 15 , 16 ] . Subsequently, the GoogleNet was shown to outperform the AlexNet on the same benchmark, achieving higher classification accuracy [ 17 ] . Similarly, Lee et al. proposed a residual SqueezeNet model that achieved

Read the complete text