A Synthetic Dataset for Manometry Recognition in Robotic Applications

Pedro Antonio Rabelo Saraiva, Enzo Ferreira de Souza, João Manoel Herrera Pinheiro, Thiago H. Segreto, Ricardo V. Godoy, Marcelo Becker · 2025

Read A Synthetic Dataset for Manometry Recognition in Robotic Applications by Pedro Antonio Rabelo Saraiva, Enzo Ferreira de Souza, João Manoel Herrera Pinheiro, Thiago H. Segreto, Ricardo V. Godoy, Marcelo Becker (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17468.txt.

Introduction

Pedro Saraiva and five co-authors built made-up training data for spotting pressure gauges in robot inspection work in a 2025 paper. Real photos from offshore oil platforms are costly and risky to gather, which starves training sets. Their plan blends two ways of faking data.

One route renders sharp fake images with varied settings in a 3D tool. The other uses a video AI to make clips that stay true to physics over time. A detector trained on a mix of real and fake data beat one trained on real photos alone. A half-and-half mix scored best. The authors argue that fake data is a safe, cheap path to sturdy vision for hard industrial sites.

Catalog record

CREATORPedro Antonio Rabelo Saraiva, Enzo Ferreira de Souza, João Manoel Herrera Pinheiro, Thiago H. Segreto, Ricardo V. Godoy, Marcelo Becker
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-17468

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Synthetic Dataset for Manometry Recognition in Robotic Applications Pedro Antonio Rabelo Saraiva, Enzo Ferreira de Souza, João Manoel Herrera Pinheiro, Thiago H. Segreto, Ricardo V. Godoy, Marcelo Becker Abstract This work addresses the challenges of data scarcity and high acquisition costs for training robust object detection models in complex industrial environments, such as offshore oil platforms. The practical and economic barriers to collecting real-world data in these hazardous settings often hamper the development of autonomous inspection systems. To overcome this, in this work we propose and validate a hybrid data synthesis pipeline that combines procedural rendering with AI-driven video generation. Our methodology leverages BlenderProc to create photorealistic images with precise annotations and controlled domain randomization, and integrates NVIDIA’s Cosmos-Predict2 world-foundation model to synthesize physically plausible video sequences with temporal diversity, capturing rare viewpoints and adverse conditions. We demonstrate that a YOLO-based detection network trained on a composite dataset, blending real images with our synthetic data, achieves superior performance compared to models trained exclusively on real-world data. Notably, a 1:1 mixture of real and synthetic data yielded the highest accuracy, surpassing the real-only baseline. These findings highlight the viability of a synthetic-first approach as an efficient, cost-effective, and safe alternative for developing reliable perception systems in safety-critical and resource-constrained industrial applications. I INTRODUCTION The uninterrupted functioning and security of vital infrastructure, especially within the petroleum and natural gas sectors, are of utmost importance due to the inherent dangers associated with the handled materials and the severe repercussions of system malfunctions [ 1 , 2 , 3 ] . Conventional maintenance and inspection procedures in these intricate industrial settings are largely dependent on human personnel, who are frequently exposed to substantial hazards such as contact with toxic agents, extreme temperatures, and confined spaces [ 4 , 5 ] . Accordingly, there is a strong demand for technologies that increase inspection effectiveness [ 6 , 7 ] while simultaneously reducing human exposure in dangerous scenarios [ 8 , 9 , 10 ] . The introduction of autonomous legged robots, e.g., Unitree B2 [ 11 ] and ANYmal C [ 12 ] , offers a promising alternative [ 13 , 14 ] . Unlike wheeled or tracked systems that struggle with uneven terrain, legged platforms can operate in a reliable manner even in the presence of stairs and irregular surfaces [ 15 ] , enabling routine, automated data capture that minimizes downtime and reduces human risk [ 16 ] . However, reliable perception remains a key bottleneck: robots must detect and localize facility-critical assets—valves, pipes, gauges, and safety equipment—to assess conditions and comply with procedures in visually cluttered plants [ 17 , 3 ] . Acquiring and annotating large, diverse datasets for training modern detectors (e.g., YOLO) is time-consuming, costly, and often disruptive to operations; access constraints and safety risks further limit in-plant data collection [ 18 , 19 , 20 , 21 ] . To overcome these limitations, in this work, we leverage high-quality synthetic data at two complementary levels. First, we use BlenderProc—an open-source, procedural rendering pipeline—to generate photorealistic images with controlled domain randomization over geometry, illumination, materials, and sensors [ 22 , 23 , 24 ] . Second, we integrate NVIDIA Cosmos-Predict2, NVIDIA’s latest world-foundation model (WFM) family for “physical AI” [ 25 , 26 , 27 ] , via ComfyUI [ 28 ] workflows to synthesize physically plausible imagery and video priors from rare viewpoints, adverse lighting, and hard-to-stage events, thus broadening coverage beyond what is practical to render or capture in the field. Cosmos provides model variants and deployment tooling intended for robotics and AV pipelines, enabling scalable generation and curation that complements procedural graphics and reduces the sim-to-real gap in downstream perception [ 29 ] . This work introduces a practical pipeline that blends BlenderProc rendering with Cosmos-Predict2 generation to mitigate data scarcity for vision-based inspection in oil and gas facilities. We build a large-scale, richly annotated synthetic dataset and train a YOLO-based detector, showing that synthetic data can substantially reduce reliance on costly and hazardous in-plant collection while improving recognition of safety-critical assets in complex environments. The rest of this paper is organized as follows. Section II presents the related works. Section III details the unified pipeline—procedural dataset creation with BlenderProc and AI-extended synthesis with Cosmos-Predict2 (ComfyUI)—and training/validation of the object detector. Section IV presents quantitative and qualitative results, and Section V concludes with limitations and future work. II Related Work Synthetic data has become a practical solution for the scarcity and safety constraints of in-plant data collection, with domain randomization and photorealistic rendering shown to reduce the sim-to-real gap for perception and control [ 30 ] . Early sim-to-real studies demonstrated that heavy appearance randomization can transfer object localization and even collision-avoidance policies trained purely in simulation to the real world [ 31 , 32 ] . Recent analyses formalize when and how randomization narrows the gap and how to tune distributions over simulator parameters [ 33 , 34 ] . On the procedural/graphics side, toolchains such as BlenderProc provide modular, scriptable generation of photorealistic images with rich annotations and sensor simulation—now a common backbone for dataset bootstrapping in robotics and industrial vision [ 22 ] . Parallel efforts in commercial-grade simulators (NVIDIA Omniverse/Isaac Sim Replicator) expose APIs for large-scale synthetic data generation with domain randomization, sensor models, and annotators, frequently used in AV/robotics pipelines [ 35 , 36 ] . Unity’s Perception stack similarly targets turnkey dataset creation with labelers and randomized scenes for object detection and pose estimation [ 37 ] . Complementary to procedural rendering, world foundation models (WFMs) have emerged as AI-native generators that simulate and predict physically plausible scenes directly from text/visual conditions. NVIDIA’s Cosmos platform targets “physical AI” use cases (robotics, AV, industrial vision), exposing Cosmos-Predict2 models for Video-to-World generation (2B and 14B variants) and post-training/fine-tuning workflows aimed at scalable coverage of rare viewpoints, adverse illumination, and hard-to-stage events [ 38 , 39 , 40 ] . Public releases and reports emphasize open accessibility and training on large corpora of robotics/drive videos, positioning Cosmos as a data engine to complement graphics-based pipelines rather than replace them [ 41 , 42 ] . Community workflows via ComfyUI further lower integration friction, enabling mixed procedural+generative curation where Cosmos assets are inserted into Blender/YOLO pipelines [ 43 ] . Taken together, recent work indicates that hybrid pipelines, procedural rendering for precise labels and controllable physics, plus WFM-based synthesis for broader coverage and temporal variation, can materially reduce reliance on hazardous, costly field acquisition in complex industrial environments. III Methodology Our methodology combines real data acquisition, synthetic data generation through BlenderProc, and AI-extended video synthesis using NVIDIA Cosmos Predict2 integrated via ComfyUI. The unified pipeline is illustrated in Fig. 1 . Fig. 1 : Proposed methodology pipeline for dataset creation and training. The framework integrates three sources: (i) real data acquisition and annotation (manual via CVAT and semi-automatic via SAM2), (ii) synthetic renders generated in BlenderProc with domain randomization (backgrounds, illumination, pose, post-processing), and (iii) AI-extended video frames generated through ComfyUI with NVIDIA Cosmos Predict2 (relighting, motion, occlusion). All data sources are reviewed, merged, and used for training the YOLO-based object detector. III-A Real Data Acquisition and Annotation We collected approximately 2,500 real

Read the complete text