A Synthetic Data Pipeline for Supporting Manufacturing SMEs in Visual Assembly Control

Jonas Werheid* 1 , Shengjie He 1 , Aymen Gannouni 1 , Anas Abdelrazeq 1 , Robert H. Schmitt 1 · 2025

Read A Synthetic Data Pipeline for Supporting Manufacturing SMEs in Visual Assembly Control by Jonas Werheid* 1 , Shengjie He 1 , Aymen Gannouni 1 , Anas Abdelrazeq 1 , Robert H. Schmitt 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-13089.txt.

Introduction

Jonas Werheid, Shengjie He and three co-authors pipe fake image data for assembly checks in small factories in 2025. Vision checks cut faults, but photos, labels, and training cost block small firms. Fake data can cut that load if it transfers to real views.

Scenes are built from CAD files and fed to a detector. On fake gear parts scores near the top were reached. On real camera tests scores stayed high, above nine in ten. The pipe saves time and fits plant floors with ease. Small firms gain a lean path to vision control.

Catalog record

CREATORJonas Werheid* 1 , Shengjie He 1 , Aymen Gannouni 1 , Anas Abdelrazeq 1 , Robert H. Schmitt 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-13089

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Synthetic Data Pipeline for Supporting Manufacturing SMEs in Visual Assembly Control Jonas Werheid* 1 , Shengjie He 1 , Aymen Gannouni 1 , Anas Abdelrazeq 1 , Robert H. Schmitt 1 Abstract Quality control of assembly processes is essential in manufacturing to ensure not only the quality of individual components but also their proper integration into the final product. To assist in this matter, automated assembly control using computer vision methods has been widely implemented. However, the costs associated with image acquisition, annotation, and training of computer vision algorithms pose challenges for integration, especially for small- and medium-sized enterprises (SMEs), which often lack the resources for extensive training, data collection, and manual image annotation. Synthetic data offers the potential to reduce manual data collection and labeling. Nevertheless, its practical application in the context of assembly quality remains limited. In this work, we present a novel approach for easily integrable and data-efficient visual assembly control. Our approach leverages simulated scene generation based on computer-aided design (CAD) data and object detection algorithms. The results demonstrate a time-saving pipeline for generating image data in manufacturing environments, achieving a mean Average Precision ([email protected]:0.95) up to 99,5% for correctly identifying instances of synthetic planetary gear system components within our simulated training data, and up to 93% when transferred to real-world camera-captured testing data. This research highlights the effectiveness of synthetic data generation within an adaptable pipeline and underscores its potential to support SMEs in implementing ressource-efficient visual assembly control solutions. I Introduction An assembly process combines parts and materials involving machines, equipment, or workers in a defined sequence to create a finished product [ 1 ] . Assembly control procedures play an important role in manufacturing environments to ensure the final product quality for customers [ 2 ] . As human operators are labor-intensive and manual inspection is time-consuming when handling complex and repetitive tasks [ 3 ] , technology is often used to automate quality control procedures. For example, computer vision methods are common for visual quality control of parts or materials, and also whole assembly procedures [ 4 ] . To implement these methods effectively, a training process is required to enable the algorithms to recognize relevant patterns and detect defects. This training typically relies on large amounts of labeled image data, which are acquired through camera-based setups and annotated manually [ 5 ] . However, camera-based image acquisition is resource-intensive, particularly due to the effort required for the manual annotation, and comes with additional limitations, such as inconsistent image quality and limited data diversity, especially in cases of imbalanced defect classes [ 6 ] . Therefore, for example, small- and medium-sized enterprises (SMEs) with limited technical and financial resources are often at a disadvantage when it comes to implementing computer vision technologies [ 7 ] . In contrast to traditional data collection methods, recent state-of-the-art research explores synthetic data generation for a wide range of industrial tasks involving both discrete (e.g., binary data, point clouds) and continuous manufacturing process data types (e.g., time-series, images, video) [ 8 ] . For image data generation, various techniques are presented in research, including generative adversarial networks (GANs) [ 9 ] , domain randomization [ 10 ] , and computer graphics tools, along with CAD files, as input data [ 11 ] . Common computer graphics tools, such as Blender [ 12 ] , can be used for synthetic data generation with CAD files for defect detection [ 13 , 14 ] , object segmentation [ 15 ] , and pose tracking [ 16 ] . Within Blender, the open source library Blenderproc is frequently used in research to enable automated scene generation within Python code [ 17 ] . In addition, previous work demonstrated the usage of Blender for synthetic data generation, particularly in the context of assembly tasks. For example, Conrad et al [ 18 ] used Blender for synthetic data generation to identify error states in manual cable assembly. In comparison to other solutions, various error states can be detected by the presented object detection approach [ 18 ] . Due to differences between simulations and the real world, a performance drop, commonly referred to as the Sim2Real gap, occurs when models trained on synthetic data are applied to real-world scenarios [ 19 ] . [ 20 ] presented a quantitative evaluation of object detection and semantic segmentation tasks, reporting Sim2Real gaps for various synthetically created objects, with real-world performance differences ranging from 1.7% to 37.9%. Ratal et al [ 21 ] showed BlenderProc with domain adaption techniques to reduce the gap from synthetic training to real inference in visual assembly control. Wu et al [ 22 ] proposed Blender-based approaches adapted to certain domains, such as disassembly of electric motors to enable easier direct transfer from simulation to reality. Another approach involved generating assembly instructions based on CAD data rendered in Blender [ 23 ] . Existing approaches do not provide a complete, easily integrable assembly pipeline suitable for real-world adoption by SMEs. Existing approaches often lack an integrated and easily deployable pipeline for visual assembly control that is practical for smaller companies and their internal teams. We present CAD-driven synthetic data generation with Blender and BlenderProc, linked to an open-source object detection model for automated data generation, annotation, and algorithm training as a synthetic data-based visual assembly control pipeline. Within an experimental use case, the pipeline is demonstrated for assembly control of planetary gear components, including individual component detection and verification of correct assembly combinations. Furthermore, to enable low-barrier adoption by SMEs and their internal teams, all components are seamlessly integrated into a single, ready-to-use pipeline, accompanied by source code, and video documentation. Firstly, Section II describes the synthetic data-based pipeline, and Section III presents its application within an experimental use case. Subsequently, Section IV presents the results alongside a discussion. Finally, Section V concludes the work, outlines its impact for SMEs, and discusses future directions. II Synthetic Data-Based Pipeline The visual assembly control pipeline consists of two parallel paths: a partially automated workflow for synthetic data generation and model training, and a manual workflow for real-world training and testing data evaluation. Figure 1 illustrates the pipeline in Unified Modelling Language (UML) as an activity diagram [ 24 ] . The process begins with CAD data of the assembly, which is often available in manufacturing companies. Alternatively, it can be manually created using CAD software. The data is then imported into Blender in formats such as Standard Triangle Language (STL) or STandard for the Exchange of Product data (STEP). Once imported, the CAD models serve as the basis for generating 3D scenes within Blender, forming the environment required for rendering synthetic image data. Scene generation in Blender involves several key substeps including simulating a background plane that serves as the support surface for object placement, constructing scene collections that each comprise multiple components corresponding to annotated classes, and assigning material properties such as material type, color, and texture to all elements within the scene collections. Further details on these steps can be found in the official Blender documentation [ 25 ] . Next, BlenderProc is used to automatically generate synthetic images based on the created scene and predefined settings within

Read the complete text