DSFEC: Efficient and Deployable Deep Radar Object Detection

Gayathri Dandugula, Santhosh Boddana, Sudesh Mirashi · 2024

Read DSFEC: Efficient and Deployable Deep Radar Object Detection by Gayathri Dandugula, Santhosh Boddana, Sudesh Mirashi (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-07411.txt.

Introduction

Gayathri Dandugula, Santhosh Boddana, and Sudesh Mirashi build radar object detection for small edge devices such as a Raspberry Pi. Their model, DSFEC, uses lean convolutions to cut the computing load. A new module sharpens and compresses features inside the encoder. On the nuScenes data set, the mid-size version beats the base model by about fifteen percent. It also cuts compute by sixty percent. The small version runs about three quarters faster on the Pi itself.

Catalog record

CREATORGayathri Dandugula, Santhosh Boddana, Sudesh Mirashi
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-07411

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DSFEC: Efficient and Deployable Deep Radar Object Detection Gayathri Dandugula, Santhosh Boddana, Sudesh Mirashi Abstract Deploying radar object detection models on resource-constrained edge devices like the Raspberry Pi poses significant challenges due to the large size of the model and the limited computational power and the memory of the Pi. In this work, we explore the efficiency of Depthwise Separable Convolutions in radar object detection networks and integrate them into our model. Additionally, we introduce a novel Feature Enhancement and Compression (FEC) module to the PointPillars feature encoder to further improve the model performance. With these innovations, we propose the DSFEC-L model and its two versions, which outperform the baseline (23.9 mAP of Car class, 20.72 GFLOPs) on nuScenes dataset: 1). An efficient DSFEC-M model with a 14.6% performance improvement and a 60% reduction in GFLOPs. 2). A deployable DSFEC-S model with a 3.76% performance improvement and a remarkable 78.5% reduction in GFLOPs. Despite marginal performance gains, our deployable model achieves an impressive 74.5% reduction in runtime on the Raspberry Pi compared to the baseline. 1 Introduction In recent years, Radar systems have become indispensable in enhancing the perception abilities of autonomous vehicles, especially in challenging weather conditions. The Radar data plays a critical role in enabling accurate object detection, collision avoidance and adaptive cruise control, thus ensuring safe navigation and consistent performance across various driving scenarios. However, current state-of-the-art radar-based algorithms require significant GPU computing power and frequently encounter challenges in achieving real-time object detection. Yet, achieving real-time processing is crucial for autonomous vehicles to enable timely decision-making and responses to dynamic changes in the environment, ensuring safe and efficient navigation by processing sensor data, detecting obstacles and executing control commands with minimal latency. State-of-the-art object detection models, designed for Image-based [ 1 ] [ 2 ] and Lidar-based [ 3 ] [ 4 ] methods have demonstrated high accuracy in various performance metrics. Initially, radar-based methods lagged behind due to the sparsity of the data compared to other sensor modalities.However, recent studies have improved our understanding of how radar can be beneficial for autonomous vehicles. [ 5 ] provides a concise overview of the radar-based object detection methods. Recent studies have primarily focused on enhancing feature extractors rather than backbone architectures, often utilizing similar backbones [ 3 ] [ 6 ] . Moreover, the emphasis has been on improving accuracy rather than deployability. In our work, we are exploring modifications to the backbone of [ 3 ] [ 7 ] along with the feature extractor to emphasize the significance of real-time processing in autonomous vehicles. Our goal is to develop deployable models suitable for edge devices while maintaining high accuracy. The significant contributions of our work are as follows: • Introduction of the FEC (Feature Enhancement and Compression) module to the feature extraction process, facilitating learning and mitigating memory bottlenecks at the initial stages of the network. • We investigated the efficacy of depthwise separable convolutions and integrated them into the backbone of the radar-based object detection model [ 7 ] . This integration is aimed to enhance the model’s efficiency, enhancing performance while minimizing latency. • Designing a deployable version of the proposed model specifically tailored for ARM-based Raspberry Pi. 2 RELATED WORK 2.1 Feature Encoder for Point Clouds Sensor data, unlike images, often arrives in irregular formats like point clouds, where each point signifies a measurement from the environment. Analyzing such data requires specialized techniques such as Point-based and Grid-based architectures to extract meaningful information effectively due to its irregular nature. Point-based architectures [ 8 ] , [ 6 ] , [ 9 ] , [ 10 ] , [ 11 ] utilize raw point cloud data to extract features directly. PointNet [ 6 ] , a foundational work in this field, processes point clouds without requiring any pre-processing and PointNet++ [ 9 ] builds upon this by hierarchically grouping points and extracting features to improve performance. In grid-based approaches, point clouds are initially transformed into either a 2D bird’s eye view (BEV) or a 3D voxel grid using hand-crafted or learned feature encoders. Hand-crafted feature extraction methods [ 12 ] , [ 13 ] , [ 14 ] , [ 15 ] rely on manual algorithm design based on domain knowledge or heuristics. However, in complex data like point clouds, these methods have limitations to capture all intricate feature relationships. Conversely, learned feature encoders, such as PointPillars [ 16 ] and VoxelNet [ 4 ] , employ CNNs or point cloud processing networks to automatically learn these relationships from 2D BEV or 3D voxel grid points, potentially uncovering nuances missed by hand-crafted approaches. VoxelNet [ 4 ] employs voxelization to transform point clouds into evenly distributed 3D voxels. It utilizes Stacked Voxel Feature Encoding (VFE) layers to extract features. On the other hand, the PointPillars [ 16 ] utilizes a CNN pillar feature net to extract features from raw point clouds and efficiently converts them into a pseudo-image format. We chose the feature encoder from the PointPillars network for its effective pseudo-image representation in terms of memory and computation. We then implemented our innovative approach within this feature encoder. 2.2 Object Detection for Radar point cloud Feature Pyramid Networks(FPNs) [ 17 ] were introduced as single-stage object detection models, utilizing a top-down architecture with lateral connections to construct a feature pyramid from a backbone network. This design addresses the challenge of object detection in images with varying scales. RetinaNet [ 18 ] , an image-based object detector, utilizes FPNs on top of ResNet [ 19 ] to generate features at different pyramid levels. Following a similar single-stage dense object detection approach, Pixor [ 3 ] extends these concepts to real-time LiDAR-based 3D object detection by adjusting input representation, network architecture and output parameterization. Several radar-based object detection methods [ 7 ] [ 20 ] [ 21 ] have adopted the Pixor [ 3 ] framework for their work with three-headed network to address the challenge of detecting objects at different scales. All of these networks employ ResNet [ 19 ] ’s residual blocks as the fundamental building blocks for their CNN backbones. While these residual blocks are renowned for their high accuracy in computer vision tasks due to the innovative skip-connection mechanism in standard convolutional networks and demand higher computational resources and memory. Consequently, this results in heightened latency on edge devices. Moreover, as more of these blocks are added in each stage, the latency increases proportionately. To tackle this issue, we conducted an analysis of various convolution types, including Dilated [ 22 ] , Quantized [ 23 ] and Depthwise Separable [ 24 ] convolutions, implemented across diverse applications. Particularly, the Depthwise Separable Convolution, introduced in XceptionNet [ 24 ] , substitutes a standard convolution with a depthwise and a pointwise convolution, rendering them nine times faster and suitable for building lightweight architectures like [ 25 ] , [ 26 ] , [ 27 ] , [ 28 ] , [ 29 ] for mobile applications. Furthermore, MobileNet [ 29 ] and its subsequent versions [ 30 ] , [ 31 ] leveraged depthwise separable convolutions, demonstrating superior performance in the ImageNet classification challenge. Additionally, Object detection methods [ 32 ] , [ 33

Read the complete text