Vision-based Perception for Autonomous Vehicles in Obstacle Avoidance Scenarios

Van-Hoang-Anh Phan, Chi-Tam Nguyen, Doan-Trung Au, Thanh-Danh Phan, Minh-Thien Duong, My-Ha Le · 2025

Read Vision-based Perception for Autonomous Vehicles in Obstacle Avoidance Scenarios by Van-Hoang-Anh Phan, Chi-Tam Nguyen, Doan-Trung Au, Thanh-Danh Phan, Minh-Thien Duong, My-Ha Le (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12449.txt.

Introduction

Camera-only self-driving stacks can dodge obstacles on a budget, and a research team led by Van-Hoang-Anh Phan tested one on a campus, in work from twenty twenty-five. Their stack spots objects with a fast detector and gauges distance with a depth-guessing model. A classic path rule then steers the car.

Depth models were compared head to head for truth, speed, and toughness in real scenes. Trials ran across varied campus setups with mixed obstacles. The stack handled them well, the team reports. The work backs a low-cost path to safer campus and yard vehicles, where lidar rigs price out.

Catalog record

CREATORVan-Hoang-Anh Phan, Chi-Tam Nguyen, Doan-Trung Au, Thanh-Danh Phan, Minh-Thien Duong, My-Ha Le
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-12449

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Vision-based Perception for Autonomous Vehicles in Obstacle Avoidance Scenarios Van-Hoang-Anh Phan, Chi-Tam Nguyen, Doan-Trung Au, Thanh-Danh Phan, Minh-Thien Duong, My-Ha Le Abstract Obstacle avoidance is essential for ensuring the safety of autonomous vehicles. Accurate perception and motion planning are crucial to enabling vehicles to navigate complex environments while avoiding collisions. In this paper, we propose an efficient obstacle avoidance pipeline that leverages a camera-only perception module and a Frenet-Pure Pursuit-based planning strategy. By integrating advancements in computer vision, the system utilizes YOLOv11 for object detection and state-of-the-art monocular depth estimation models, such as Depth Anything V2, to estimate object distances. A comparative analysis of these models provides valuable insights into their accuracy, efficiency, and robustness in real-world conditions. The system is evaluated in diverse scenarios on a university campus, demonstrating its effectiveness in handling various obstacles and enhancing autonomous navigation. The video presenting the results of the obstacle avoidance experiments is available at: https://www.youtube.com/watch?v=FoXiO5S_tA8 I Introduction Autonomous vehicles have become a major topic in the research community [ 1 , 2 , 3 ] , particularly in the development of safety systems for self-driving cars [ 4 , 5 , 6 ] . Among these, obstacle avoidance is a critical area of interest. The objective of this task is to design an algorithm that enables smooth navigation while ensuring collision avoidance. Additionally, the algorithm must be efficient and compatible with real-world hardware constraints. The obstacle avoidance process relies on two key processes: perception and planning [ 6 , 7 ] . Perception is responsible for collecting and interpreting data from the surrounding environment, such as detecting obstacles and estimating distances. Some existing methods [ 6 , 8 ] utilize 3D LiDAR data to determine the position of obstacles. The authors of [ 9 ] proposed a fusion of a camera and 2D LiDAR to identify drivable areas and determine avoidance directions. In this approach, the 2D LiDAR monitors scene information on the right side, which lies outside the camera’s field of view. However, due to cost constraints and system simplicity, we use only a single camera for obstacle detection and distance estimation. The safe and reliable planning of obstacle-avoidance routes is a critical aspect of autonomous vehicle technology. Several research efforts have explored different methodologies to address this challenge [ 10 , 11 , 12 ] . Genetic algorithms have been employed as a path planning technique for autonomous vehicles. Most representatively, Weng et al. [ 10 ] particularly emphasizing the integration of the Frenet-Serret coordinate system and Sequential Quadratic Programming (SQP) to enhance adaptability and optimize trajectories. Yoon et al. [ 11 ] proposed an alternative approach that combines a neural network for path proposal with sampling-based path planning in the Frenet coordinate system. In addition, traditional methods such as the Artificial Potential Field (APF) have also been utilized for obstacle avoidance [ 12 ] . In our system, the Frenet coordinate system is employed for path planning in structured road environments, providing an efficient representation for trajectory generation. More specifically, the Pure Pursuit algorithm is utilized for accurate path tracking to ensure precise and stable vehicle control. By integrating these approaches, our system facilitates smooth and stable vehicle motion while enhancing obstacle avoidance capabilities. Fig. 1: The block diagram of the proposed method. Based on the analysis above, this paper proposes an efficient perception and planning system for autonomous obstacle avoidance, utilizing a camera-only perception module and a Frenet-Pure Pursuit-based motion planning strategy. We developed an obstacle avoidance system for autonomous vehicles that can operate in real-world environments. The perception module relies solely on a monocular camera to capture environmental information. Obstacles are detected using a You Only Look Once (YOLO) object detection model, where we evaluate and compare state-of-the-art versions, including YOLOv9 [ 13 ] , YOLOv10 [ 14 ] , and YOLOv11 [ 15 ] , to select the most suitable model for obstacle detection. Their distances are estimated using Depth Anything V2 [ 16 ] , a monocular depth estimation foundation model. Furthermore, we conduct experiments and analyze various monocular depth estimation foundation models in real-world scenarios to determine the most effective one. The planning module integrates Frenet and Pure Pursuit methods for optimal path generation and path tracking, as illustrated in Fig. 1 . In summary, this paper presents the following key contributions: - Proposes an efficient obstacle avoidance pipeline using a camera-only perception module and a Frenet-Pure Pursuit-based planning strategy. - Evaluates and compares state-of-the-art YOLO models for obstacle detection and selects the most suitable model. Additionally, analyzes monocular depth estimation models in real-world environments to identify the most accurate and reliable model for obstacle distance estimation. - Conducts extensive real-world experiments across various scenarios to analyze the effectiveness of the proposed system in obstacle avoidance and path planning. II METHODOLOGY II-A Perception Module The perception module is crucial for the navigation of autonomous vehicles as it enables the vehicle to understand its surroundings. It integrates data from an RTK GPS and a camera to detect and localize obstacles. The system comprises three major components: object detection, depth estimation, and coordinate transformation. Among them, object detection takes on identifying obstacles, depth estimation model is used to calculate their distances, and coordinate transformation algorithm aims at converting image coordinates into the global coordinate system. II-A 1 Obstacle detection In this work, we first evaluate and compare multiple state-of-the-art YOLO models to determine the most suitable one for real-world deployment. After extensive evaluation based on criteria such as accuracy, computational efficiency, and real-time performance, YOLOv11 [ 15 ] is selected for its significant detection accuracy and promising real-time performance in identifying and classifying objects in diverse environments. The detected obstacles are assigned bounding boxes, which provide the initial spatial information used for further depth estimation in the subsequent stages. II-A 2 Monocular Depth Estimation A depth map is vital for understanding the 3D structure of the environment and ensuring accurate distance estimation between the vehicle and obstacles. To this end, we employ Depth Anything V2 [ 16 ] , a high-performance monocular depth estimation model trained on extensive datasets. In our evaluation, we compare the performance of several state-of-the-art depth estimation models, considering factors such as the discrepancy between estimated and actual distances, as well as computational efficiency. By integrating the depth map from Depth Anything V2 [ 16 ] with the bounding box coordinates from YOLOv11 [ 15 ] , our system accurately determines the real-world positions of detected obstacles. This fusion significantly enhances situational awareness, enabling the vehicle to navigate complex environments more precisely while avoiding obstacles. II-A 3 Coordinate Transformation To enable local path planning and vehicle control, we establish coordinate transformations between the vehicle frame and the global Universal Transverse Mercator (UTM) coordinate system. The obstacle localization process involves three key coordinate transformations, as detailed below. - Image to Camera Coordinates. For each detected obstacle with bounding box coordinates (x_{i},y_{i}) , we first compute the median depth value d within the bounding box to mitigate depth estimation noise. The transformation from pixel coordinates (x_{i},y_{i}) to 3D camera coordinates P_{cam}=[x_{cam},y_{cam},z_{cam}]^{T} is derived using the camera intrinsic matrix K : P_{cam}=d\cdot K^{-1}\begin{bmatrix}x_{i}&y_{i}&1\end{bmatrix}^{T} (1) where K=\begin{bmatrix}f_{x}&0&c_{x}\\ 0&f_{y}&c_{y}\\ 0&0&1\end{bmatrix} contains the focal lengths (f_{x},f_{y}) and

Read the complete text