Mini Autonomous Car Driving based on 3D Convolutional Neural Networks
Pablo Moraes, Monica Rodriguez, Kristofer S. Kappel, Hiago Sodre · 2025
Read Mini Autonomous Car Driving based on 3D Convolutional Neural Networks by Pablo Moraes, Monica Rodriguez, Kristofer S. Kappel, Hiago Sodre (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-21271.txt.
Introduction
Pablo Moraes and seven co-authors teach, in a 2025 preprint, a miniature self-driving car to steer with a three-dimensional convolutional network. Mini cars are a cheap, safe stand-in for full vehicles when testing control ideas. They suit methods that must learn while driving. The team's model reads color plus depth video and treats the clip as a volume, not single frames. Motion cues live in that volume. Training and tests ran on two simulated tracks with different looks.
The rival design was a recurrent network, the classic choice for sequence data. Scores covered finishing the task, lap times, and steadiness of control. Track difficulty and small design choices both moved the results. The 3D convolutional model came out ahead in the comparison, with promising control quality. The authors present the study as guidance for picking architectures when small robots learn to drive in simulation first.
Catalog record
| CREATOR | Pablo Moraes, Monica Rodriguez, Kristofer S. Kappel, Hiago Sodre |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-21271
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mini Autonomous Car Driving based on 3D Convolutional Neural Networks Pablo Moraes, Monica Rodriguez, Kristofer S. Kappel, Hiago Sodre Abstract Autonomous driving applications have become increasingly relevant in the automotive industry due to their potential to enhance vehicle safety, efficiency, and user experience, thereby meeting the increasing demand for sophisticated driving assistance features. However, the development of reliable and trustworthy autonomous systems has inherent challenges, such as high complexity, prolonged training periods, and intrinsic levels of uncertainty. Mini Autonomous Cars (MAC) are used as a practical testbed, allowing validation of autonomous control methodologies over small-scale setups. This simplified and cost-effective experimental setup facilitates rapid evaluation and comparison of machine learning models, which is particularly beneficial for algorithms requiring online training. To address these challenges and build upon this context of MACs, the present work offers a methodology based on RGB-D information and 3D Convolutional Neural Networks (3D CNNs) for MAC autonomous driving in simulated environments. We evaluate the performance of our proposed methodology with Recurrent Neural Networks (RNNs), whose architectures were trained and tested across two simulated tracks with distinct environmental features. Their performance was evaluated based on task completion success, lap-time metrics, and driving consistency. Results highlight how architectural modifications and track complexity influence the models’ generalization capability and vehicle control performance. The proposed version of 3D CNN has shown promising results when compared with RNNs. Video link: https://youtu.be/6S2mfHWn3E8 I Introduction Autonomous vehicle technology has become a prominent research area within the automotive industry, driven by increasing market demand for integrating autonomous driving features into commercial vehicles [ 1 ] . This application field inherently requires solutions characterized by high levels of trustworthiness and reliability. Typically, available AI-based solutions for autonomous driving are complex, require extensive training periods and naturally involve certain levels of randomness or imprecision. Simulation environments have emerged as central tools in the evaluation of machine learning (ML)-based models. By employing a scaled-down version of the proposed problem, methodologies can be effectively presented and validated, facilitating the identification and assessment of relevant phenomena associated with the study. [ 2 ] . Therefore, Mini Autonomous Cars (MAC) [ 3 , 4 ] may provide an experimental environment in which solutions validated in small-scale setups may be easily scaled up to meet more realistic conditions. MAC provides a flexible and cost-effective setup for easily adapting experimental scenarios. By simplifying the creation and management of diverse conditions (e.g. lighting settings and obstacle configurations), it better supports extended evaluation of proposed autonomous driving methodologies and reduces the risks of damage. At the same time, the development of autonomous driving systems has increased consistently in recent decades thanks to advances in ML and Computer Vision [ 5 , 6 ] . Artificial Neural Networks (ANNs) have proven helpful for directly mapping images captured by front-facing cameras to vehicle control commands, enabling behavior cloning in controlled environments [ 3 , 7 ] . However, these systems inherent challenges, such as high complexity, prolonged training periods, and intrinsic levels of uncertainty, which demands improved sensing for increase performance. Also, as training and validating models with minor changes in real-world settings may be complex, simulation has become a practical approach to developing and evaluating algorithms [ 8 , 1 ] . Therefore, complex sensing information, such as from RGB-D cameras, can increase the model’s robustness, demanding more complex ANNs Built upon this context, the present study provides a methodology for MAC autonomous driving based on 3D CNNs, performing a comparative assessment with RNNs within two simulated scenarios with distinct characteristics. Figure 1 presents the simplification of our proposed methodology. Figure 1 : Block Diagram of the proposed methodology Specific datasets were generated for each track, and both standard and modified versions of each architecture were trained and tested. The performance was evaluated using objective metrics focused on time and consistency within the simulator. The results provide insights into how architectural changes and environmental complexity impact the networks’ ability to generalize and control autonomous vehicles, thereby facilitating the selection of effective models suited for future implementation on embedded hardware platforms. Overall, this paper presents the following contributions: • We show that our proposed method 3D CNN provides better performance in terms of average time to complete a proposed task when comparing with other RNN models. • We provide an Ablation Study showing the impact of adding and removing layers in our proposed model, concluding that the version with the smallest amount of layers provided the best performance in terms of average time to complete a task. The remainder of this paper is organized as follows: Section II reviews related works addressing the proposed problem. Section III describes the proposed methodology. Experimental results and discussions are reported in Section IV . Finally, Section V summarizes the concluding remarks and future directions. II Related Works Recent advances in autonomous driving research have increasingly focused on leveraging deep learning techniques, such as behavior cloning and reinforcement learning, to train control models in both simulated and real-world environments. Within this domain, a range of studies has investigated different model architectures, control strategies, and evaluation setups for improving the learning and generalization capabilities of autonomous systems. Elmquist et al. (2022) [ 5 ] describes a software framework, along with a hardware platform, used to design and analyze robotics autonomy algorithms in both simulation and real-world environments. Their physical platform is a 1/6-scale vehicle with reconfigurable components, allowing for testing of algorithms and sensor setups in both domains. Yildirim et al. (2024) [ 9 ] validate perception systems for autonomous vehicles using behavior cloning for lateral control in real-world conditions, showing accurate steering angle predictions in real-time. Codevilla et al. (2019) [ 10 ] analyze the limitations of behavior cloning, especially in generalizing to dynamic objects and lacking a causal model, highlighting areas that need further research. Karnala and Campbell (2020) [ 11 ] investigate how model architecture affects vulnerability to adversarial attacks in machine learning-based autonomous driving systems. Zhang and Du (2019) [ 12 ] propose a deep reinforcement learning method to train a scaled autonomous car in simulation, with transfer to the real world. Samak et al. (2023) [ 6 ] introduce AutoDRIVE, a modular ecosystem for research and education in autonomous driving that supports simulation and deployment of solutions including behavior cloning via deep imitation learning. Jung (2018) [ 7 ] uses behavior cloning to train a supervised CNN classifier on the DonkeyCar platform, optimizing autonomous driving in a realistic environment Although previous studies have explored autonomous vehicle control using behavior cloning and deep learning models, such as RNNs and CNNs, there is a lack of detailed comparative evaluations between architectures, particularly between RNNs and 3D CNNs, in small-scale environments like Mini Autonomous Cars (MACs). Additionally, while the general performance and accuracy of models have been investigated, few studies analyze the impact of architectural adjustments (such as adding or removing layers) on model performance in visually complex environments. The present work addresses this gap by directly comparing RNN and 3D CNN models in the context of small autonomous vehicles (MACs) in a simulated environment. We also introduce an ablation study to examine how model complexity, modified by adding or removing layers, can improve performance in tracks with high