Match-Any-Events: Zero-Shot Motion-Robust Feature Matching Across Wide Baselines for Event Cameras

Ruijun Zhang, Hang Su, Kostas Daniilidis, Ziyun Wang · 2026

Read Match-Any-Events: Zero-Shot Motion-Robust Feature Matching Across Wide Baselines for Event Cameras by Ruijun Zhang, Hang Su, Kostas Daniilidis, Ziyun Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18744.txt.

Introduction

Zhang and three colleagues present Match-Any-Events, the first event-camera matching model to achieve wide-baseline correspondence across data sets with no target-domain fine-tuning. A motion-robust attention backbone learns multi-timescale features from event streams, with sparsity-aware token selection keeping large-scale training feasible. A motion-synthesis framework supplies the wide-baseline supervision the model needs. Across benchmarks, the system improves on the previous best event matching methods by about 38 percent.

Catalog record

CREATORRuijun Zhang, Hang Su, Kostas Daniilidis, Ziyun Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36215
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18744

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Match-Any-Events: Zero-Shot Motion-Robust Feature Matching Across Wide Baselines for Event Cameras Ruijun Zhang, Hang Su, Kostas Daniilidis, Ziyun Wang Abstract Event cameras have recently shown promising capabilities in instantaneous motion estimation due to their robustness to low light and fast motions. However, computing wide-baseline correspondence between two arbitrary views remains a significant challenge, since event appearance changes substantially with motion, and learning-based approaches are constrained by both scalability and limited wide-baseline supervision. We therefore introduce the first event matching model that achieves cross-dataset wide-baseline correspondence in a zero-shot manner : a single model trained once is deployed on unseen datasets without any target-domain fine-tuning or adaptation. To enable this capability, we introduce a motion-robust and computationally efficient attention backbone that learns multi-timescale features from event streams, augmented with sparsity-aware event token selection, making large-scale training on diverse wide-baseline supervision computationally feasible. To provide the supervision needed for wide-baseline generalization, we develop a robust event motion synthesis framework to generate large-scale event-matching datasets with augmented viewpoints, modalities, and motions . Extensive experiments across multiple benchmarks show that our framework achieves a 37.7 % \mathbf{37.7\%} improvement over the previous best event feature matching methods. Code and data are available at: https://github.com/spikelab-jhu/Match-Any-Events . Figure 1 : Match-Any-Events can perform robust feature matching between two arbitrary views with different motion profiles and across modalities . No fine-tuning is needed for new datasets. 1 Introduction Biological vision systems exhibit remarkable abilities to establish correspondence across different spatial and temporal scales. At shorter spatiotemporal intervals, instantaneous motions of objects are captured by optical flow processed within motion-sensitive areas, such as Middle Temporal (MT) area, in the brain [ 7 , 24 ] . On the other hand, humans can easily establish correspondence between two distinct views with minimal overlaps, even in the absence of temporal continuity between two observations [ 15 , 19 , 47 , 42 ] . This intrinsic understanding of correspondence enables self-localization, loop-closure in odometry, and recognition of structural and semantic similarities between objects. Recently, frame-based computer vision algorithms have made substantial progress for both instantaneous and wide-baseline matching, driven by large-scale datasets and scalable network architectures [ 60 , 40 , 51 , 63 , 68 , 66 , 38 ] . In contrast, biologically inspired event-based cameras have demonstrated unbalanced performance between instantaneous and wide-baseline correspondence. Event algorithms excel at estimating instantaneous motions due to their high temporal resolution and dynamic range, allowing them to handle extremely dynamic and event deformable objects [ 78 , 82 , 23 , 71 , 72 , 73 , 74 ] . However, event-based methods have not shown generalizable performance in wide-baseline matching for several crucial factors. First, event data processing usually rely on a hand-crafted encoding function that depends on hyperparameters such as time interval and number of events. These parameters change the appearance of events based on motions, which prevents networks trained on certain motion speeds from generalizing to different motions. Second, we do not have sufficient scale for the current event-based matching networks and datasets. On the data side, existing event datasets provide narrow-baseline optical flow ground truth, annotated with SLAM-derived poses and point maps. In our experiments, networks trained with only such data cannot generalize to large view point changes. The need for diverse motion augmentations further amplifies the data problem. On the model side, dense spatiotemporal attentions in event transformers increase the attention cost by \mathcal{O}(T^{2}) , where T is event volume time resolution, making it computationally prohibitive to train networks on bigger datasets. Due to these issues, we have yet to have a generalizable event-based matching network with good zero-shot performance on unseen data. In this work, we seek to fill this missing link in event-based matching from two different directions: architecture design and supervision . We design an event transformer that explicitly separates spatial and temporal aggregation to make multi-timescale tokens tractable at scale. Particularly, events present unique challenges that break the assumptions underlying 2D transformers for matching. First, events form an inherently 3D spatiotemporal representation rather than a fixed 2D grid. Second, motion profiles vary drastically across pixels, from slow drift to rapid edges, producing non-uniform sampling in time. To this end, we introduce a motion-aware and separable feature encoder layer, which computes time and space feature aggregation efficiently. While naive multi-scale motion-aware layers would substantially increase the inference cost of transformers due to the large number of tokens, our proposed architecture mitigates this by decoupling spatial and temporal aggregation in a computationally efficient manner. Concretely, we use separable space and time attention to reduce the attention cost from \mathcal{O}((THW)^{2}) to \mathcal{O}(T(HW)^{2}+HW\,T^{2}) , which is the key enabling factor for training on millions of wide-baseline pairs rather than the narrow-baseline regimes used previously. In addition, we introduce an adaptive sparsity-aware event token selection module (SETS) that adaptively prunes redundant tokens for matching. By allocating computation only to informative spatiotemporal regions and time steps, SETS further reduces the effective cost of multi-timescale processing while preserving matching accuracy. On the supervision side, we contribute two new datasets that cover a much wider range of view changes for event-based matching: a synthetic E-MegaDepth dataset and a real Event Cross Matching (ECM) dataset. E-MegaDepth contains simulated events generated from the large MegaDepth [ 39 ] dataset, featuring extensive, wide-baseline view changes and motion profiles. For real-world evaluation, we carefully designed a hardware-synchronized hetero-stereo setup that captures images and events simultaneously. Our ECM dataset enables real-world evaluation by providing synchronized images and event streams with dense and precise correspondence annotations across wide baselines. Using SOTA multi-view geometric foundation models, we generate point maps of higher density and precision compared to classical structure-from-motion solutions. Finally, we trained our model using the combined large-scale dataset, achieving state-of-the-art results in semi-dense matching and camera pose estimation for both in-domain data and unseen test in-the-wild data without any fine-tuning. Our main contributions are as follows: • Zero-shot wide-baseline event matching . We formalize the setting where viewpoint and motion profile vary jointly, and propose a single matcher that generalizes to unseen datasets without test-time tuning, supporting both event-to-event and event-to-image correspondence. • Efficient multi-timescale event aggregation . We introduce a motion-robust attention backbone that learns multi-timescale features via separable spatial–temporal aggregation, and further propose sparsity-aware event token selection to adaptively prune redundant tokens, resulting in efficient spatiotemporal transformers for events. • Wide-baseline supervision for events . We release two complementary datasets, E-MegaDepth (large-scale synthetic wide-baseline pairs with diverse motions) and ECM (real hetero-stereo event–image data with dense correspondences), enabling scalable training and rigorous evaluation. 2 Related Work Image-based Matching. Traditional image matching follows a detect-describe-match pipeline, where salient keypoints are extracted and encoded by handcrafted descriptors [ 44 , 5 , 59 ] . Their invariance abilities made them the backbone of early SfM [ 61 ] and SLAM systems [ 10 ] , but they suffer from performance degrades in low-texture and fast motion scenes. Learning-based methods improved this pipeline through data-driven descriptors and joint detection-description, as shown in LIFT [ 75 ] . SuperPoint [ 14 ] popularized self-supervised keypoint learning, followed by [ 57 , 64 , 16 ] , which enhanced feature confidence and distinctiveness. Later correspondence estimation models like SuperGlue

Read the complete text