Object detection characteristics in a learning factory environment using YOLOv8

Toni Schneidereit, Stefan Gohrenz, Michael Breuß · 2025

Read Object detection characteristics in a learning factory environment using YOLOv8 by Toni Schneidereit, Stefan Gohrenz, Michael Breuß (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-10356.txt.

Introduction

Toni Schneidereit, Stefan Gohrenz, and Michael Breuß probe how backgrounds fool object spotting in a model factory in a 2025 paper. The test bed mimics a smart works, with parts of many stuffs: clear, shiny, and matte. Ninety-two spotter models were trained, one per stuff and set size, with looks the lone change.

Some background bits with a trait got flagged as parts, while twins with the same trait did not. Like stuffs behaved in unlike ways, and some results broke the team's hunch. The set of photos and the care in the write-up aim to help others tune spotters and dodge overfit.

Catalog record

CREATORToni Schneidereit, Stefan Gohrenz, Michael Breuß
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-10356

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Object detection characteristics in a learning factory environment using YOLOv8 Toni Schneidereit, Stefan Gohrenz, Michael Breuß Abstract AI-based object detection, and efforts to explain and investigate their characteristics, is a topic of high interest. The impact of, e.g., complex background structures with similar appearances as the objects of interest, on the detection accuracy and, beforehand, the necessary dataset composition are topics of ongoing research. In this paper, we present a systematic investigation of background influences and different features of the object to be detected. The latter includes various materials and surfaces, partially transparent and with shiny reflections in the context of an Industry 4.0 learning factory. Different YOLOv8 models have been trained for each of the materials on different sized datasets, where the appearance was the only changing parameter. In the end, similar characteristics tend to show different behaviours and sometimes unexpected results. While some background components tend to be detected, others with the same features are not part of the detection. Additionally, some more precise conclusions can be drawn from the results. Therefore, we contribute a challenging dataset with detailed investigations on 92 trained YOLO models, addressing some issues on the detection accuracy and possible overfitting. Keywords: object detection, dataset construction, complex background, YOLO characteristics, YOLO heatmaps, learning factory 1 Introduction Artificial intelligence (AI) is of fundamental importance in Industry 4.0. The analysis of sensor data with AI can be utilised for the reliable recognition of complex patterns in real time, which is often a challenging task for humans [ 1 ] . For example, in predictive maintenance, AI may in this way help to identify and replace machine parts before they break. More generally, main goals in predictive maintenance are to reduce production downtime and lowering the risk of damages in a factory [ 2 , 3 , 4 ] , which may require an exact monitoring of the status of the factory and its processing of workpieces. Other possible applications of AI in Industry 4.0 include robot automatisation, supply chain optimisation and quality control [ 5 , 6 ] . The latter is significant to maintain a high-level standard and to ensure that there are no harmful components or substances introduced into a production process. Companies are facing the challenge of adopting the concepts of Industry 4.0 in their operations. To foster this development, the use of learning factories may be considered. A learning factory is a model in which learners can develop an understanding of practical problems from the real world, without tinkering with a real factory process [ 7 ] . In addition, to support teaching or training, such a factory may also be used to evaluate theoretical concepts from research before employing them in an industrial environment. The learning factories exist in different sizes and can be designed for different applications [ 7 , 8 ] . Related work Especially in the context of predictive maintenance tasks and in optical quality control, vision-based methods and, more specifically, object detection techniques have been recognised as useful tools in manufacturing [ 19 , 20 , 21 , 22 ] . Object detection is the computer vision task of localising and classifying objects in an image. AI-based detectors nowadays are oftentimes variants of convolutional neural networks and can be categorised into one-stage and two-stage detectors. Two-stage detectors, such as region-based Convolutional Neural Networks (R-CNNs) [ 14 ] (including important variants like, e.g., Mask R-CNN [ 15 ] ), first extract region proposals and then classify them. This two-stage process (region proposal, classification) results in potentially very high accuracy at the expense of computational time. In contrast, one-stage detectors, such as YOLO (You Only Look Once) [ 16 , 17 ] , approach the object detection task as a regression problem. YOLO uses a single CNN-based framework that takes the entire image as input. Then YOLO simultaneously computes bounding boxes (localisation) and predicts class probabilities (classification) in a single pass. By doing this, YOLO models may achieve significantly higher computational efficiency compared to the two-stage process. For real-world applicability, one-stage detectors with the ability of real-time performance can be highly desirable. Therefore, the focus in this paper is on the YOLO model. The performance of a CNN is highly dependent on the availability of training data [ 23 , 27 ] . The amount of images required can be reduced if the training set shows similar characteristics as the evaluation data. This was shown in an experiment in which the behaviour of sheep in a barn was observed [ 24 ] . The same camera angle was used for recording and evaluating the data, while also the background did not change. If it is not possible to collect sufficient data, datasets can be artificially expanded using augmentations [ 25 , 26 ] . This involves manipulating the original image, for example, by applying blur effects, noise or changes to the colour contrast, which can improve the robustness of a model [ 28 ] . The recognition of small objects has been identified as a major challenge for deep learning algorithms in several studies. One study compared the recognition accuracy of diseased rice plants with different YOLO models [ 29 ] . The reason for the difficulties in recognizing small objects was found to be the small number of pixels, the image quality and a complicated background. As a result, only little information can be extracted. Problem statement and contribution Our aim is to build upon and extend previous investigations on using the YOLO framework for object detection in a learning factory. More specifically, the authors of [ 28 ] explore the suitability of several YOLO architectures distinguished in terms of size and complexity to monitor the process flow across a Fischertechnik Industry 4.0 application. An important issue studied in that work is the impact of different augmentation techniques in the construction of training datasets on detection quality. It turns out that a major point of interest is about the possible colour correlations between workpieces and factory background, influenced by interaction with lighting and light reflections as it is unavoidable in realistic scenarios. In this paper, we consider a selection of workpieces that feature highly challenging characteristics for object detection in an industrial environment. In addition to standard plastic workpieces in red, blue and white as employed in [ 28 ] , we consider additional colours, as well as metallic, wooden and transparent materials. As in [ 28 ] , the setting is a Fischertechnik Industry 4.0 learning factory, which represents an interesting setting and a controlled environment for studying computer vision applications like object detection [ 45 ] . Our contribution is a detailed study and analysis of the YOLO framework for use with datasets constructed at hand of this broad selection of workpieces in an Industry 4.0 learning factory environment. For this purpose, we have recorded a systematic and challenging dataset for each of the workpieces. There is only one parameter that differs between individual images of the datasets, which enables us to perform meaningful investigations. For the latter, a total of 92 YOLO models has been trained and evaluated. Possible overfitting and the explainability of different characteristics with, e.g., heatmaps, is part of the analysis. The

Read the complete text