Prepare for Warp Speed: Sub-millisecond Visual Place Recognition Using Event Cameras

Vignesh Ramanathan, Michael Milford, Tobias Fischer · 2025

Read Prepare for Warp Speed: Sub-millisecond Visual Place Recognition Using Event Cameras by Vignesh Ramanathan, Michael Milford, Tobias Fischer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-24094.txt.

Introduction

A robot that can tell where it is from what it sees can find its way back to known places. Vignesh Ramanathan and 2 co-authors built Flash, a place-recognition system for event cameras, which record brightness changes pixel by pixel with very fine timing. Past systems pooled many events into dense pictures and needed long slices of data.

Flash instead uses slices shorter than a millisecond. It codes which pixels fired into compact binary frames and compares them with fast bit operations. Scores are scaled by how active each frame was. Flash beat prior systems by a wide margin on indoor and city-scale test sets, and it cut the time a robot runs unsure of its place.

Catalog record

CREATORVignesh Ramanathan, Michael Milford, Tobias Fischer
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-24094

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Prepare for Warp Speed: Sub-millisecond Visual Place Recognition Using Event Cameras Vignesh Ramanathan, Michael Milford, Tobias Fischer Abstract Visual Place Recognition (VPR) enables systems to identify previously visited locations within a map, a fundamental task for autonomous navigation. Prior works have developed VPR solutions using event cameras, which asynchronously measure per-pixel brightness changes with microsecond temporal resolution. However, these approaches rely on dense representations of the inherently sparse camera output and require tens to hundreds of milliseconds of event data to predict a place. Here, we break this paradigm with Flash, a lightweight VPR system that predicts places using sub-millisecond slices of event data. Our method is based on the observation that active pixel locations provide strong discriminative features for VPR. Flash encodes these active pixel locations using efficient binary frames and computes similarities via fast bitwise operations, which are then normalized based on the relative event activity in the query and reference frames. Flash improves Recall@1 for sub-millisecond VPR over existing baselines by 11.33 × 11.33\times on the indoor QCR-Event-Dataset and 5.92 × 5.92\times on the 8 km Brisbane-Event-VPR dataset. Moreover, our approach reduces the duration for which the robot must operate without awareness of its position, as evidenced by a localization latency metric we term Time to Correct Match (TCM). To the best of our knowledge, this is the first work to demonstrate sub-millisecond VPR using event cameras. I Introduction Visual place recognition (VPR) is a fundamental capability for autonomous systems, allowing them to localize and navigate by recognizing previously visited locations [ 1 , 2 , 3 , 4 , 5 ] . For high-speed robots, achieving low-latency place matching is crucial to reduce the time without a position estimate and improve safety in applications such as self-driving vehicles [ 6 ] and facilitating GPS-denied navigation [ 7 ] . The latency of a VPR system arises from both sensing and processing delays. To address processing latency, traditional camera-based methods have investigated lightweight architectures, bioinspired models, and specialized visual cues to increase VPR speed while preserving accuracy [ 8 , 9 , 10 ] . However, conventional cameras remain limited by bandwidth-latency trade-offs, constraining their usability in mobile robotic applications. Event cameras are neuromorphic sensors that asynchronously detect per-pixel logarithmic changes in scene brightness. Unlike traditional cameras, event cameras sense the visual scene with microsecond resolution in a bandwidth-efficient manner [ 11 ] , enabling sub-millisecond perception and localization, which are critical for high-speed robotic applications. While some vision tasks leverage these advantages [ 12 , 6 , 13 ] , event camera-based VPR methods typically accumulate events over tens to hundreds of milliseconds to construct dense representations, thus failing to exploit the microsecond temporal resolution of event cameras [ 14 , 15 , 16 , 17 , 18 , 19 ] . In this work, we challenge this paradigm by demonstrating that the spatial distribution of events alone , even over sub-millisecond windows, contains sufficient discriminative information for place recognition. Fig. 1: Traditional cameras face a bandwidth–latency trade-off: higher frame rates demand more bandwidth, and processing dense frames is costly. Event cameras, by contrast, capture sparse scene changes at microsecond resolution. Existing methods, however, still accumulate tens to hundreds of milliseconds of events, squandering this speed. Flash exploits sub-millisecond slices of event data, using primarily bitwise operations to minimize both sensing and processing latencies. In this work, we introduce an efficient, ultra-low-latency VPR approach, termed Flash . Our approach reduces sensing latency by relying on only sub-millisecond slices of event data. In the resulting event frames, fewer than 3% of pixels are active per frame in the indoor dataset and fewer than 9% in the outdoor dataset, with the average number of events per active pixel approaching one ( Section VI-D ). This makes a binary frame representation both a natural and a highly compact choice ( Fig. 1 ). While the binary representation exploits event sparsity, it also introduces an aliasing bias: reference frames with more active pixels tend to yield higher overlap scores, regardless of true similarity. To address this, we introduce a lightweight normalization that scales the similarity score by the ratio of active pixel counts between query and reference frames, mitigating the aliasing bias using only two floating-point operations per pair. Our design enables both sensing and processing to happen in a Flash. Operating in the sub-millisecond regime poses a new challenge: the extremely short event windows produce a large number of reference frames, increasing both latency and computational cost. To address this, we propose uniformly sampling frames from the reference database to reduce its size while retaining sufficient map coverage. We further evaluate this strategy to characterize the trade-off between recognition accuracy and computational efficiency. Our contributions can be summarized as follows: 1. We introduce the first event camera-based VPR system that recognizes places using less than a millisecond of event data. 2. We show that pixel locations responding to scene changes are sufficient for sub-millisecond place recognition with event cameras. 3. We reduce the storage and search times of the large databases created by sub-millisecond accumulation windows through subsampling and analyze the resulting accuracy–compute trade-offs. 4. We benchmark Flash against existing event camera-based VPR methods and conduct ablation studies to assess the sufficiency of active-pixel location encoding, the effectiveness of normalization in mitigating aliasing bias, and the distribution of time intervals during which the robot remains not localized. Flash’s sub-millisecond recognition capability enables new possibilities for time-critical localization, where traditional VPR methods fail to meet latency requirements. The code will be released publicly to support reproducibility. II Related Works This section reviews literature relevant to low-latency visual place recognition (VPR). We first discuss key works in traditional camera-based VPR that introduce concepts related to our approach, particularly visual saliency and efficient computing ( Section II-A ). We then review existing event camera-based VPR methods, showing how none have exploited the microsecond temporal resolution despite this being a key advantage of the sensor ( Section II-B ). Finally, we examine recent successes in sub-millisecond perception using event cameras in other vision tasks, demonstrating that ultra-low-latency processing is achievable but has not yet been realized for VPR ( Section II-C ). II-A Traditional Camera-based VPR II-A 1 Visual Saliency for VPR Visual saliency, the perceptual quality that distinguishes certain scene regions, has been widely used in VPR to identify cues relevant for place recognition. Zaffar et al. [ 10 ] used entropy maps to select salient regions for Histogram-of-Gradients-based matching, while Wang et al. [ 20 ] performed saliency detection in the frequency domain for efficiency. Keetha et al. [ 21 ] reduced perceptual aliasing by using VLAD clusters to distinguish environment-specific from place-specific cues. Peng et al. [ 22 ] proposed a multi-level attention framework combining semantic guidance with attentional pyramid pooling, and Nie et al. [ 23 ] integrated saliency cues with semantic embeddings through pooling operations. While effective, these methods require explicit saliency computation. In contrast, the ego-motion of an event camera naturally captures brightness changes, and the resulting event locations serve as strong discriminative features for place recognition. II-A 2 Efficient VPR Recent works have pursued computational efficiency to minimize VPR processing latency. Ferrarini et al. [ 24

Read the complete text