Generative Anonymization in Event Streams
Adam T. Müller, Mihai Kocsis, Nicolaj C. Stache · 2026
Read Generative Anonymization in Event Streams by Adam T. Müller, Mihai Kocsis, Nicolaj C. Stache (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12803.txt.
Introduction
Adam T. Müller and two colleagues anonymize event-camera streams without wrecking their usefulness. Video models can rebuild face images from sparse events, leaking identities in public spaces. Masking or scrambling breaks the space-time structure that later vision tasks need. Their pipeline turns events into an image, swaps in a fake identity, and re-encodes the result as events. Identity recovery is blocked while structure for later tasks survives. A new synchronized event and RGB set from robot paths gives future work a benchmark.
Catalog record
| CREATOR | Adam T. Müller, Mihai Kocsis, Nicolaj C. Stache |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36765 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.12803
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Generative Anonymization in Event Streams Adam T. Müller, Mihai Kocsis, Nicolaj C. Stache Abstract Neuromorphic vision sensors offer low latency and high dynamic range, but their deployment in public spaces raises severe data protection concerns. Recent Event-to-Video (E2V) models can reconstruct high-fidelity intensity images from sparse event streams, inadvertently exposing human identities. Current obfuscation methods, such as masking or scrambling, corrupt the spatio-temporal structure, severely degrading data utility for downstream perception tasks. In this paper, to the best of our knowledge, we present the first generative anonymization framework for event streams to resolve this utility-privacy trade-off. By bridging the modality gap between asynchronous events and standard spatial generative models, our pipeline projects events into an intermediate intensity representation, leverages pretrained models to synthesize realistic, non-existent identities, and re-encodes the features back into the neuromorphic domain. Experiments demonstrate that our method reliably prevents identity recovery from E2V reconstructions while preserving the structural data integrity required for downstream vision tasks. Finally, to facilitate rigorous evaluation, we introduce a novel, synchronized real-world event and RGB dataset captured via precise robotic trajectories, providing a robust benchmark for future research in privacy-preserving neuromorphic vision. 1 Introduction Neuromorphic vision sensors, or event cameras, represent a paradigm shift in visual perception. Unlike conventional cameras that capture dense, synchronous frames at fixed intervals, event cameras respond asynchronously to per-pixel changes in illumination 25 . This fundamental difference enables sensors with microsecond latency, high dynamic range, and minimal power consumption, making them highly attractive for highly dynamic real-world applications such as autonomous driving, robotics, and smart surveillance 13 ; 27 ; 44 . However, as the deployment of these sensors accelerates in public and human-centric spaces, the treatment of the data they capture falls under stringent data protection regulations 20 . Because event streams inherently lack absolute intensity information and only encode scene dynamics as a sparse point cloud of brightness changes, there has been a passive assumption that they do not capture sensitive biometric information 4 ; 6 . Recent advancements in deep learning have demonstrated that this assumption is flawed, as state-of-the-art event-to-video (E2V) 19 ; 31 reconstruction models are able to recover high-fidelity intensity images from raw event streams. Consequently, an unprotected event stream capturing biometric identifiers can easily be inverted to reveal the subject’s identity, introducing a severe privacy vulnerability. To mitigate this risk, early works in event privacy have proposed pertubation based approaches 3 ; 7 . While effective against reconstruction attacks, such anonymization methods inherently corrupt the underlying spatio-temporal structure of the event stream, severely limiting the utility of the anonymized data for downstream tasks. In the conventional frame-based domain, this utility-privacy trade-off is being addressed through generative anonymization , utilizing advanced machine learning based models to seamlessly replace a person’s identity with a synthetic, non-existent one while preserving semantic context, gaze, and pose 28 ; 46 . In this paper, we present the first step toward bridging this utility-privacy gap by introducing generative identity anonymization to the event domain. We propose a framework that maps the principles of generative RGB anonymization into the event space. Our approach utilizes the maturity of RGB-based pretrained face-swapping models. We detect and generatively anonymize facial identities in projected frame-space, and subsequently utilize robust video-to-event (V2E) processing to project these synthesized identities into an anonymized event stream. When subjected to E2V reconstruction attacks, our processed streams yield realistic human features belonging to a newly generated identity, effectively protecting the original subject without destroying the structural integrity of the data. Furthermore, research in event-based human perception is restricted by a lack of high-quality, real-world datasets. Existing collections, such as the FES dataset by ISSAI 9 , frequently rely on synthetic video-to-event (V2E) generation or feature uncontrolled subject movement. To facilitate rigorous evaluation and future research, we introduce a novel dataset featuring synchronized real-world event and RGB streams. To ensure precise, reproducible egomotion and a static subject setup, the sensor suite was mounted on a collaborative robot (cobot) executing programmed trajectories. In summary, our main contributions are as follows: (1) We propose a information retaining generative anonymization pipeline for event streams, utilizing frame-space diffusion models and V2E projection to synthesize realistic, alternative identities. (2) We demonstrate that the proposed anonymization reliably prevents identity recovery from high-fidelity E2V reconstructions while preserving the spatio-temporal utility necessary for downstream vision tasks. (3) We introduce a synchronized real-world event-RGB dataset 1 1 1 https://github.com/muelleradam/KinematicEvent-HumanUpperBody-2026 , captured via precise cobot trajectories, to spur further research in privacy-preserving neuromorphic vision. 2 Related Work Event-to-Video and Image Reconstruction. Neuromorphic vision sensors encode visual information asynchronously as sparse streams of brightness changes 25 . To bridge the modality gap between this non-standard data and conventional computer vision pipelines, a rich body of work has focused on E2V 19 reconstruction. Seminal learning-based approaches, such as E2VID 32 , successfully demonstrated the recovery of high frame-rate absolute intensity videos from event streams using recurrent neural networks. Subsequent advancements introduced lightweight, high-speed alternatives like FireNet 37 , as well as high-fidelity models such as ET-Net 40 . While the field continues to rapidly advance with highly complex recent architectures 31 ; 22 ; 45 , deploying and standardizing these models across different sensor setups remains challenging. Consequently, we utilize the highly robust EVREAL evaluation framework 19 for our pipeline. Crucially, the continuous refinement of these E2V methodologies has inadvertently demonstrated the reliable extraction of highly identifiable facial details from sparse event spikes. These reconstruction networks have exposed a severe privacy vulnerability, directly motivating the necessity of data anonymization frameworks. Privacy and Anonymization in Event Streams. As the capabilities of E2V reconstruction models matured, the privacy risks associated with neuromorphic sensors spurred pioneering works in the domain of event stream anonymization. To conceal identities, initial approaches employ techniques such as spatial scrambling, adversarial noise injection, or the direct encryption of event spikes 17 . Most notable are the EventAnon frameworks introduced by Ahmad et al . 4 ; 2 ; 3 , seeking to mitigate privacy vulnerabilities by proposing end-to-end architectures optimized jointly for identity obfuscation and specific macroscopic downstream tasks, such as person re-identification or pose estimation. Building upon this, Bendig et al. recently introduced AnonyNoise 7 , which applies learnable, data-dependent noise to raw event streams, preventing neural network-based re-identification while retaining coarse information for downstream tasks. While highly effective at thwarting facial reconstruction via re-identification networks, these methodologies fundamentally degrade information by design. By intentionally obfuscating or displacing precise event coordinates, such methods inherently corrupt the localized spatio-temporal structure of the raw data. Such data degradation introduces a severe utility-privacy trade-off, bottlenecking the performance of fine-grained perception tasks that rely on high-fidelity structural integrity, such as facial expression recognition 8 or dense tracking 23 . Taking a different approach, Adra and Dugelay proposed E2PRIV 1 , shifting the obfuscation step by integrating distortion based anonymization directly into the E2V reconstruction process. However, as E2PRIV avoids altering the raw event stream, it provides no privacy protection against malicious actors or perception networks operating directly in the event-space. To address privacy natively in the event-space, without incurring to the limitations of destructive obfuscation, our work proposes a paradigm shift toward generative anonymization. By seamlessly replacing sensitive features with synthesized, non-existent