Polar R-CNN: End-to-End Lane Detection with Fewer Anchors

Shengqi Wang, Junmin Liu, Xiangyong Cao, Zengjie Song, Kai Sun · 2024

Read Polar R-CNN: End-to-End Lane Detection with Fewer Anchors by Shengqi Wang, Junmin Liu, Xiangyong Cao, Zengjie Song, Kai Sun (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-01499.txt.

Description

Abstract Lane detection is a critical and challenging task in autonomous driving, particularly in real-world scenarios where traffic lanes can be slender, lengthy, and often obscured by other vehicles, complicating detection efforts. Existing anchor-based methods typically rely on prior lane anchors to extract features and subsequently refine the location and shape of lanes.

Catalog record

CREATORShengqi Wang, Junmin Liu, Xiangyong Cao, Zengjie Song, Kai Sun
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-01499

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Polar R-CNN: End-to-End Lane Detection with Fewer Anchors Thanks: This work was supported in part by the National Nature Science Foundation of China (Grant Nos. 62276208, 12326607) and in part by the Natural Science Basic Research Program of Shaanxi Province (Grant No. 2024JC-JCQN-02). Thanks: S. Wang, J. Liu, Z. Song and K. Sun are with the School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an 710049, China. Thanks: X. Cao is with the School of Computer Science and Technology and the Ministry of Education Key Lab for Intelligent Networks and Network Security, Xi’an Jiaotong University, Xi’an 710049, China. Shengqi Wang, Junmin Liu, Xiangyong Cao, Zengjie Song, Kai Sun Abstract Lane detection is a critical and challenging task in autonomous driving, particularly in real-world scenarios where traffic lanes can be slender, lengthy, and often obscured by other vehicles, complicating detection efforts. Existing anchor-based methods typically rely on prior lane anchors to extract features and subsequently refine the location and shape of lanes. While these methods achieve high performance, manually setting prior anchors is cumbersome, and ensuring sufficient coverage across diverse datasets often requires a large amount of dense anchors. Furthermore, the use of Non-Maximum Suppression (NMS) to eliminate redundant predictions complicates real-world deployment and may underperform in complex scenarios. In this paper, we propose Polar R-CNN , an end-to-end anchor-based method for lane detection. By incorporating both local and global polar coordinate systems, Polar R-CNN facilitates flexible anchor proposals and significantly reduces the number of anchors required without compromising performance. Additionally, we introduce a triplet head with heuristic structure that supports NMS-free paradigm, enhancing deployment efficiency and performance in scenarios with dense lanes. Our method achieves competitive results on five popular lane detection benchmarks— Tusimple , CULane , LLAMAS , CurveLanes , and DL-Rail —while maintaining a lightweight design and straightforward structure. Our source code is available at https://github.com/ShqWW/PolarRCNN . I Introduction Lane detection is a critical task in computer vision and autonomous driving, aimed at identifying and tracking lane markings on the road [ 1 ] . While extensive research has been conducted in ideal environments, it is still challenging in adverse scenarios such as night driving, glare, crowd, and rainy conditions, where lanes may be occluded or damaged [ 2 ] . Moreover, the slender shapes and complex topologies of lanes further complicate detection efforts [ 3 ] . In the past few decades, a lot of methods primarily focus on handcrafted local feature extraction and lane shape modeling. Techniques such as the Canny edge detector [ 4 ] , Hough transform [ 5 ] , and deformable templates [ 6 ] have been widely employed for lane fitting. However, these approaches often face limitations in real-world scenarios, especially when low-level and local features lack clarity and distinctiveness. In recent years, advancements in deep learning and the availability of large datasets have led to significant progress in lane detection, especially deep models such as Convolutional Neural Networks (CNNs) [ 2 ] and transformer-based architectures [ 7 ] . Based on this, earlier approaches typically framed lane detection as a segmentation task [ 8 ] , which, despite its straightforward, required time-consuming computations. There are still some methods that rely on parameter-based models, which directly output lane curve parameters rather than pixel locations [ 3 ] [ 7 ] [ 9 ] . Although these segmentation-based and parameter-based methods provide end-to-end solutions, their sensitivity to lane shape compromises their robustness. (a) (b) (c) (d) Fig. 1 : Anchor ( i.e. , the yellow lines) settings of different methods and the ground truth lanes. (a) The initial anchor settings of CLRNet. (b) The learned anchor settings of CLRNet trained on CULane. (c) The flexible proposal anchors of our method. (d) The ground truth. (a) (b) (c) (d) Fig. 2 : Comparison of NMS thresholds in sparse and dense scenarios. (a) and (b) Ground truths in the dense and sparse scenarios, respectively. (c) Predictions with large NMS thresholds in a dense scenario, resulting in a lane prediction being mistakenly suppressed. (d) Predictions with small NMS thresholds in a sparse scenario, where redundant prediction results are not effectively removed. Drawing inspiration from object detection methods such as YOLO [ 10 ] and Faster R-CNN [ 11 ] , several anchor-based approaches have been introduced for lane detection, with representative works including LaneATT [ 12 ] and CLRNet [ 13 ] . These methods have shown superior performance by leveraging anchor priors (as shown in Fig. 1 ) and enabling larger receptive fields for feature extraction. However, anchor-based methods encounter similar drawbacks to those in general object detection, including the following: • As shown in Fig. 1 (a), a large amount of lane anchors are predefined in the image, even in sparse scenarios —the situations where lanes are distributed widely and located far apart from each other, as illustrated in the Fig. 1 (d). • Non-Maximum Suppression (NMS) [ 14 ] post-processing is required to eliminate redundant predictions but may struggle in dense scenarios where lanes are close to each other, such as forked lanes and double lanes, as illustrated in the Fig. 2 (a). Regrading the first issue, [ 13 ] introduced learned anchors that optimize the anchor parameters during training to better adapt to lane distributions, as shown in Fig. 1 (b). However, the number of anchors remains excessive to adequately cover the diverse potential distributions of lanes. Furthermore, [ 15 ] proposes flexible anchors for each image by generating start points with directions, rather than using a fixed set of anchors. Nevertheless, these start points of lanes are subjective and lack clear visual evidence due to the global nature of lanes. In contrast, [ 16 ] uses a local angle map to propose sketch anchors according to the direction of ground truth. While this approach considers directional alignment, it neglects precise anchor positioning, resulting in suboptimal performance. Overall, the abundance of anchors is unnecessary in sparse scenarios. Regarding the second issue, nearly all anchor-based methods [ 12 ] [ 13 ] [ 15 ] [ 16 ] rely on direct or indirect NMS post-processing to eliminate redundant predictions. Although it is necessary to eliminate redundant predictions, NMS remains a suboptimal solution. On one hand, NMS is not deployment-friendly because it requires defining and calculating distances between lane pairs using metrics such as Intersection over Union (IoU). This task is more challenging than in general object detection due to the intricate geometry of lanes. On the other hand, NMS can struggle in dense scenarios. Typically, a large distance threshold may lead to false negatives, as some true positive predictions could be mistakenly eliminated, as illustrated in Fig. 2 (a)(c). Conversely, a small distance threshold may fail to eliminate redundant predictions effectively, resulting in false positives, as shown in Fig. 2 (b)(d). Therefore, achieving an optimal trade-off across all scenarios by manually setting the distance threshold is challenging. To address the above two issues, we propose Polar R-CNN, a novel anchor-based method for lane detection. For the first issue, we introduce Local Polar Module based on the polar coordinate system to create anchors with more accurate locations, thereby reducing the number of proposed anchors in sparse scenarios, as illustrated in Fig. 1 (c).

Read the complete text