Faster than Fast: Accelerating Oriented FAST Feature Detection on Low-end Embedded GPUs
Qiong Chang, Xinyuan Chen, Xiang Li, Weimin Wang*, Jun Miyazaki · 2025
Read Faster than Fast: Accelerating Oriented FAST Feature Detection on Low-end Embedded GPUs by Qiong Chang, Xinyuan Chen, Xiang Li, Weimin Wang*, Jun Miyazaki (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07164.txt.
Introduction
Qiong Chang and co-authors published a 2025 paper on speeding up a vision step used by robots that map their surroundings. Such systems, called visual SLAM, pick out feature points in camera images to track motion and build a map. A popular method spends about half its time on one step: finding corners with their orientations. On small mobile hardware, that cost breaks real-time work.
The authors attack the two slowest parts of that step. For finding candidate points, they encode the test in binary form so weak points are rejected fast. For scoring corners, they split the math into separable passes and use special low-level instructions of the graphics chip. Tests ran on a Jetson TX2, an embedded board. The result was an average speedup of more than seven times over the OpenCV library.
Catalog record
| CREATOR | Qiong Chang, Xinyuan Chen, Xiang Li, Weimin Wang*, Jun Miyazaki |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-07164
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Faster than Fast: Accelerating Oriented FAST Feature Detection on Low-end Embedded GPUs Qiong Chang, Xinyuan Chen, Xiang Li, Weimin Wang*, Jun Miyazaki Abstract The visual-based SLAM (Simultaneous Localization and Mapping) is a technology widely used in applications such as robotic navigation and virtual reality, which primarily focuses on detecting feature points from visual images to construct an unknown environmental map and simultaneously determines its own location. It usually imposes stringent requirements on hardware power consumption, processing speed and accuracy. Currently, the ORB (Oriented FAST and Rotated BRIEF)-based SLAM systems have exhibited superior performance in terms of processing speed and robustness. However, they still fall short of meeting the demands for real-time processing on mobile platforms. This limitation is primarily due to the time-consuming Oriented FAST calculations accounting for approximately half of the entire SLAM system. This paper presents two methods to accelerate the Oriented FAST feature detection on low-end embedded GPUs. These methods optimize the most time-consuming steps in Oriented FAST feature detection: FAST feature point detection and Harris corner detection, which is achieved by implementing a binary-level encoding strategy to determine candidate points quickly and a separable Harris detection strategy with efficient low-level GPU hardware-specific instructions. Extensive experiments on a Jetson TX2 embedded GPU demonstrate an average speedup of over 7.3 times compared to widely used OpenCV with GPU support. This significant improvement highlights its effectiveness and potential for real-time applications in mobile and resource-constrained environments. 1 Introduction SLAM (Simultaneous Localization and Mapping) [ 1 ] is an algorithm that constructs an unknown environmental map and simultaneously determines its own location, primarily used in robotics and self-driving applications [ 2 ] . Various sensor modes, such as sonar, LiDAR [ 3 ] , and cameras, are employed in different SLAM systems. Among these, Feature-Based Visual SLAM (VSLAM) [ 4 ] is particularly convenient and cost-effective, leading to extensive research in this area. As feature-based VSLAM has advanced, numerous feature point extraction methods have been proposed, including SIFT [ 5 ] , SURF [ 6 ] , FAST [ 7 ] , and even learning-based methods [ 8 ] [ 9 ] . Most current mainstream SLAM systems are deployed in mobile applications, which impose stringent requirements on real-time performance, computational resources, and power consumption. While SIFT, SURF, and learning-based descriptors account for changes in lighting, scale, and other factors during image transformations and can extract precise feature points, they are computationally expensive and often fail to meet the performance needs of SLAM systems. On the other hand, ORB (Oriented FAST and Rotated BRIEF) [ 10 ] , a lightweight feature description method, addresses these challenges by using Oriented FAST (Features from accelerated segment test) for feature point detection and rotated BRIEF (Binary Robust Independent Elementary Features) for feature description, trading off some accuracy and robustness for improved computational speed. Currently, ORB has become the predominant feature point detection method used in SLAM systems. However, with the continuous improvement in image resolution, ORB-based SLAM systems still struggle to meet real-time processing requirements on most mobile platforms. The primary reason is that to enhance accuracy, the Oriented FAST detection step of modern ORB algorithms typically requires constructing multi-level pyramids to detect features at various scales. Additionally, it also involves matching Harris corner points for each candidate feature point identified by the FAST algorithm to screen more stable and robust feature points. Although the computation of the FAST algorithm itself is straightforward, it is highly repetitive and the processing of adjacent pixels is locally independent, making it challenging to further optimize the algorithm’s complexity. Therefore, Oriented FAST feature point detection typically accounts for approximately half of the computing time in ORB, which itself constitutes over 65% of the total computation in SLAM systems [ 11 ] . To enhance the practicality of SLAM systems, numerous researchers are exploring methods to accelerate Oriented FAST processing on mobile platforms. The primary method involves leveraging high-performance acceleration hardware such as FPGAs and GPUs. Researchers, including those cited in [ 12 , 13 , 14 , 15 ] , have successfully built pipelines on FPGAs and designed reusable on-chip BRAM to store intermediate results, thereby speeding up Oriented FAST processing. Although using FPGAs for large-scale SLAM systems offers certain advantages in terms of energy efficiency, it comes with high device costs and long development cycles. More critically, customized hardware designs struggle to maintain consistent SLAM system performance under varying conditions. In contrast, embedded GPUs have become the preferred choice for high-performance mobile intelligent systems due to their superior parallel processing capabilities and more flexible software computation methods [ 16 ] . Mimura et al. [ 17 ] proposed an asynchronous processing method for object detection using an embedded GPU. Their method leverages the CPU to handle object detection tasks, thereby offsetting the GPU overhead during Oriented FAST feature point detection. This method enabled real-time detection for a single-layer ORB system, achieving a performance of nearly 81 FPS on a Jetson Nano GPU. Muzzini et al. [ 18 ] employed GPU multi-channel stream processing to decompose the ORB process and balance the load of GPU computing resources, thereby accelerating the entire system’s processing. Their methods significantly improve the execution efficiency of the Oriented FAST algorithm on a Jetson AGX Xavier GPU. Zhi et al. [ 19 ] accelerated the FAST detection by leveraging the parallel processing capabilities of the Tesla K40c GPU architecture by CUDA. They allocated GPU resources equally to each pixel, enabling the efficient processing of FAST feature detection task for each pyramid level. This method achieved a processing speed 6~10 times faster than that of a CPU. All methods aim to leverage the GPU to enhance the overall ORB processing flow; however, they do not significantly optimize the Oriented FAST algorithm itself. Recently, a fast framework of ORB system (CUDA_ORB) has been published by [ 20 ] . They addressed the limitations of library functions by implementing the ORB algorithm with pixel-level processing on GPUs. Their performed the detection over 3,000 feature points in a four-layer pyramid within a 1920 \times 1080 image, achieving a processing speed of 57fps on a Jetson TX2 GPU, which is faster than the GPU-based OpenCV library. However, there is still room for improvement in terms of feature point detection and memory usage. An analysis of their runtime distribution for each step across various image sizes is provided in Fig 1 . The results indicate that FAST and Harris detection are the most time-consuming steps in Oriented FAST algorithm. Specifically, FAST feature detection involves numerous branch instructions, which in parallel execution can be several to dozens of times less efficient than basic arithmetic operations like addition, subtraction, and multiplication. Furthermore, Harris detection requires frequent access to randomly located features, leading to significant overhead on embedded GPUs due to their high memory access latency. Therefore, to further enhance the performance of the Oriented FAST and facilitate its application in SLAM systems, this paper introduces significant optimizations, including: 720 \times 540 1080 \times 720 1440 \times 1080 1920 \times 1080 0 20 40 60 80 100 Image Size Runtime Distribution (%) Centroid NMS Harris FAST Figure 1: Runtime distribution of each step in Oriented-FAST using a Jetson TX2 GPU • An