Car-STAGE: Automated framework for large-scale high-dimensional simulated time-series data generation based on user-defined criteria
Asma A. Almutairi, David J. LeBlanc, Arpan Kusari · 2025
Read Car-STAGE: Automated framework for large-scale high-dimensional simulated time-series data generation based on user-defined criteria by Asma A. Almutairi, David J. LeBlanc, Arpan Kusari (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03100.txt.
Introduction
Asma Almutairi, David LeBlanc, and Arpan Kusari automate the harvest of synthetic driving data from a photo-realistic simulator. Robotics teams need large, synchronized, multi-sensor data sets, and manual collection sessions do not scale. Their framework, Car-STAGE, wraps the open-source CARLA simulator in a one-step pipeline. A graphical interface captures the user's configuration, then the system runs unattended.
Maps, sensor suites, weather, and lighting all come from the configuration. Nine sensor types stream together, from ordinary cameras and lidar to optical flow and semantic segmentation, with ground-truth actor labels alongside. Threads divide the labor between server, queue, and sensor processing. Memory-mapping raw binary data to disk, with format conversion deferred to the end, supplies much of the speedup. Output lands in local or cloud databases. The framework turns data generation into a form to fill, not a shift to staff.
Catalog record
| CREATOR | Asma A. Almutairi, David J. LeBlanc, Arpan Kusari |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-03100
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Car-STAGE: Automated framework for large-scale high-dimensional simulated time-series data generation based on user-defined criteria Asma A. Almutairi, David J. LeBlanc, Arpan Kusari Abstract Generating large-scale sensing datasets through photo-realistic simulation is an important aspect of many robotics applications such as autonomous driving. In this paper, we consider the problem of synchronous data collection from the open-source CARLA simulator using multiple sensors attached to vehicle based on user-defined criteria. We propose a novel, one-step framework that we refer to as Car-STAGE, based on CARLA simulator, to generate data using a graphical user interface (GUI) defining configuration parameters to data collection without any user intervention. This framework can utilize the user-defined configuration parameters such as choice of maps, number and configurations of sensors, environmental and lighting conditions etc. to run the simulation in the background, collecting high-dimensional sensor data from diverse sensors such as RGB Camera, LiDAR, Radar, Depth Camera, IMU Sensor, GNSS Sensor, Semantic Segmentation Camera, Instance Segmentation Camera, and Optical Flow Camera along with the ground-truths of the individual actors and storing the sensor data as well as ground-truth labels in a local or cloud-based database. The framework uses multiple threads where a main thread runs the server, a worker thread deals with queue and frame number and the rest of the threads processes the sensor data. The other way we derive speed up over the native implementation is by memory mapping the raw binary data into the disk and then converting the data into known formats at the end of data collection. We show that using these techniques, we gain a significant speed up over frames, under an increasing set of sensors and over the number of spawned objects. (a) (b) Fig. 1: Screenshot of Car-STAGE GUI with the key parameters on the left and senors placement feature on the right I INTRODUCTION The fields of Advanced Driver-Assistance Systems (ADAS) and Autonomous Vehicles (AV) rely heavily on extensive data-centric techniques to enable safe, efficient, and comfortable navigation through the dynamic environment. This data-driven approach is crucial for ADAS and AV systems to perceive their surroundings, anticipate potential hazards, and make informed decisions to ensure the safety and comfort of passengers and other road users. Recently, CARLA [ 1 ] has come up as an open-source simulator for AVs which allows users to develop diverse scenarios to collect data and test various aspects of autonomous driving, such as urban traffic, highways and different environmental conditions. The users have control over maps and environmental conditions along with the different kinds and positions of sensors equipped in the subject vehicle (SV). In terms of operations, the native python API created by the CARLA team runs the server and client code in the same main thread process getting the server to generate a frame and then wait till client processes and saves the outputs. However, this makes the process inefficient and particularly slow. Secondly, CARLA can operate in asynchronous or synchronous manner - in the asynchronous manner, the server operates independently of the client while the synchronous mode leads to synchronizing between sensors using queue and frame number. However, the asynchronous mode can lead to data loss or data overrun, since there is no knowledge if sensors are working with data from same point in the simulation. On the other hand, the synchronous mode turns out to be really slow due to locking of the queue during I/O operations. Thirdly, the entire setup needs to be created by the users including synchronization of sensors and concurrent data collection strategies which presents an obstacle for even seasoned programmers. Beset by these practical challenges, we present a novel, one-step framework, Car-STAGE (Fig. 1 ), based on the CARLA simulator that allows users to utilize a graphical user interface (GUI) to generate a collection of high-dimensional sensor data without any user intervention. This framework leverages the user-defined configuration parameters to autonomously run the simulation in the background, capturing sensor data from diverse modalities such as RGB Camera, LiDAR, Radar, Depth Camera, IMU Sensor, GNSS sensor, Semantic Segmentation Camera, Instance Segmentation Camera, and Optical Flow Camera, along with the ground-truth information of the individual actors within the simulated environment. We use a synchronous mode where we separate the data processing into a number of threads - a main thread which runs the server, a worker thread which deals with queue and frames and other executor threads that deal with sensors data. We also derive further speed up by saving raw data using memory mapping to disk. The collected sensor data and ground-truth labels are then stored in a local or cloud-based database, providing a comprehensive dataset for the development and evaluation of ADAS and AV algorithms. In Section II , we talk about related research utilizing CARLA simulation, while in Section III , we provide the concepts of our proposed framework, Section IV provides the comparisons in timings between our proposed framework and the native API on the basis of the number of frames, different number of sensors etc. Finally, Section V provides some discussions and final conclusions. II RELATED WORK There has been a few research works in the recent years which have utilized CARLA and are closest to our proposed framework. CarFree [ 2 ] presents an open-source automatic ground-truth generation tool based on the CARLA simulator. CarFree consists of two main components: (i) a data extraction client that automatically gathers relevant information from the Carla simulator’s server, and (ii) a post-processing software that generates accurate 2D bounding boxes for vehicles and pedestrians in the collected driving images. Another work in the same vein is CARLA-GEAR [ 3 ] which creates a tool for automatically creating photorealistic synthetic datasets for evaluation of adversarial robustness of neural models against physical adversarial patches. It also uses CARLA to create random patches in order to generate adversarial examples. [ 4 ] provides aerial traffic generation dataset using images and labels of vehicles, pedestrians, and pedestrian crossings which the researchers provide for intelligent transportation management. None of the previously mentioned research focuses on enhancing the CARLA pipeline itself, which highlights the importance of the proposed work. We would also like to note that there are other open-source simulators which have been used for AV simulation such as AirSim [ 5 ] which is also built on Unreal Engine, similar to CARLA. However, CARLA has the most complete sensor set simulation, and better fidelity for defining complicated scenarios, which makes it the best choice for AV simulation. III Proposed framework We name our proposed framework Car-STAGE, which stands for Car la-based S imulated T ime-series A utomated G eneration E ngine. The framework has been constructed upon the CARLA simulator, incorporates a GUI alongside a comprehensive suite of 12 modules. The GUI serves to facilitate user-driven configuration of simulation parameters, encompassing aspects such as duration, weather conditions, sensor specifications, synchronization modes for sensors, and labeling methodologies, while the modules are designed to facilitate environmental manipulation, object instantiation, and the extraction of metadata from the generated data, inclusive of annotations, thus guaranteeing the production of high-fidelity and precise data. The resultant data may be stored either in local storage solutions or on remote servers. The Car-STAGE framework is compatible with CARLA