Temporal Dynamics Enhancer for Directly Trained Spiking Object Detectors Fan Luo, Zeyu Gao, Xinhao Luo, Kai Zhao, Yanfeng Lu Abstract Spiking Neural Networks (SNNs), with their brain-inspired spatiotemporal dynamics and spike-driven computation, have emerged as promising energy-efficient alternatives to Artificial Neural Networks (ANNs). However, existing SNNs typically replicate inputs directly or aggregate them into frames at fixed intervals. Such strategies lead to neurons receiving nearly identical stimuli across time steps, severely limiting the model’s expressive power—particularly in complex tasks like object detection. In this work, we propose the Temporal Dynamics Enhancer (TDE) to strengthen SNNs’ capacity for temporal information modeling. TDE consists of two modules: a Spiking Encoder (SE) that generates diverse input stimuli across time steps, and an Attention Gating Module (AGM) that guides the SE generation based on inter-temporal dependencies. Moreover, to eliminate the high-energy multiplication operations introduced by the AGM, we propose a Spike-Driven Attention (SDA) to reduce attention-related energy consumption. Extensive experiments demonstrate that TDE can be seamlessly integrated into existing SNN-based detectors and consistently outperforms state-of-the-art methods, achieving mAP@50-95 scores of 57.7% on the static PASCAL VOC dataset and 47.6% on the neuromorphic EvDET200K dataset. In terms of energy consumption, the SDA consumes only 0.240× the energy of conventional attention modules. Code — https://github.com/Mortal825/TDE.git Introduction As a representative of third-generation neural networks, Spiking Neural Networks (SNNs) ( Maass 1997 ; Roy, Jaiswal, and Panda 2019 ; Zhang et al. 2021 ; Guo et al. 2023 ; Qu et al. 2024a ; Zhang et al. 2025c ; Zhang et al. 2025b ; Zhang et al. 2025a ) offer a biologically plausible and energy-efficient alternative, gradually attracting increasing attention. SNNs transmit information through discrete spikes rather than continuous values, significantly reducing data transmission and storage costs. Their inherently asynchronous and event-driven nature further eliminates redundant computation and synchronization overhead. As a result, SNNs achieve high energy efficiency on neuromorphic hardware platforms ( Poon and Zhou 2011 ; Merolla et al. 2014 ) . (a) Spike Firing Pattern Before and After the TDE (b) Membrane Potential Accumulation (c) Energy Cost of Traditional Attention Mechanisms in SNNs Figure 1: Research Motivation of the TDE Module. (a) Illustrates the spike firing pattern of the first LIF neuron layer before and after applying TDE. (b) Describes how the LIF neuron in existing SNNs receive repetitive input stimuli, resulting in the disappearance of a series of spike streams. (c) Highlights that traditional attention mechanisms in SNNs introduce a large number of energy-intensive multiplication operations. Nevertheless, SNNs exhibit limited expressiveness, particularly in complex regression tasks such as object detection. This is primarily due to their spike-based communication paradigm, which inherently restricts the precision and continuity of information representation. Although incorporating multiple time steps enhances temporal expressivity, existing SNN-based detection frameworks still fall short of matching the performance of their ANN counterparts. Recent efforts have attempted to bridge this gap by directly or indirectly incorporating integer spikes ( Qu et al. 2024b ; Luo et al. 2024 ; Yao et al. 2025 ) . However, direct usage of integer spikes ( Qu et al. 2024b ) compromises the spike-driven nature of SNNs, while indirect methods ( Luo et al. 2024 ; Yao et al. 2025 ) often overlook the hardware costs of converting integer spikes into actual spike events. Importantly, these approaches tend to focus on the representation of single spike information but overlook the temporal domain, which is another critical source of expressive power unique to SNNs. In contrast to ANNs, SNNs possess inherent temporal dynamics, which, if effectively leveraged, could offer a richer and more biologically plausible form of computation. We argue that existing SNN-based object detection frameworks fail to fully utilize the temporal domain. For static datasets, identical stimuli are repeated across time steps, while for neuromorphic datasets, the long integration window causes similar stimuli, both hindering temporal dynamics. As a result, temporal information is primarily captured through the accumulation of membrane potentials, leaving the broader temporal dimension largely underutilized. As shown in the Fig. 1(a) and Fig. 1(b) , the spike streams of the first-layer Leaky Integrate-and-Fire (LIF) neurons exhibit significant disappearance, with spike streams such as “1110”, “1101”. The spike streams tend to be all-silent or all-active, resulting in the temporal dynamics pattern scarcity problem. In addition, attention mechanisms have become a key component in SNN frameworks, providing a clear modulation strategy for sparse, temporally-distributed spike representations, allowing the limited expressive power of SNNs to dynamically focus on informative spatial and temporal regions ( Yao et al. 2021 ; Yao et al. 2023c ; Zhu et al. 2024 ) . However, the non-spiking operations introduced by conventional attention mechanisms contradict the energy-efficient nature of SNNs, severely limiting their practical deployment ( Qiu et al. 2024 ) . To address the temporal dynamics pattern scarcity problem, we propose the Temporal Dynamics Enhancer (TDE) , a framework that consists of two key components: a Spiking Encoder (SE) that generates temporally diverse input stimuli, and an Attention Gating Module (AGM) that captures inter-temporal dependencies within the network. By introducing temporal diversity and enriching multi-step spike representations, the TDE effectively unlocks the potential of the temporal dimension in SNNs. Moreover, to mitigate the increased high-energy multiplication operations introduced by the attention mechanism in the AGM, we propose a Spike-Driven Attention (SDA) to enable fully accumulation operations reduces attention-related energy consumption. As shown in Fig. 1(a) , which illustrates the spike firing pattern of the first LIF layer. After integrating the TDE module, the temporal diversity of fire pattern improves markedly, and all previously missing spike streams in the first-layer LIF neurons are fully recovered. Our main contributions are summarized as follows: • We identify that the reliance on repeated inputs across multiple time steps in SNNs restricts the diversity of spike streams, thereby underutilizing the temporal modeling capabilities of the network. • We propose the Temporal Dynamics Enhancer (TDE), a general framework that enhances spike stream diversity and significantly improves the expressiveness of directly trained spiking Object Detectors. • We introduce the Spike-Driven Attention (SDA) module, which leverages spatio-temporal spike-based attention to enhance performance while reducing energy consumption to 0.240 times that of non-spiking modules. • Through extensive experiments on both static (VOC) and neuromorphic (EvDET200K) datasets, we demonstrate that the Temporal Dynamics Enhancer (TDE) consistently improves performance across a variety of state-of-the-art methods, boosting mAP@50-95 by 1.2% on the VOC dataset and 2.2% on the EvDET200K dataset. Our method refreshes the state-of-the-art on both datasets, with the latest mAP@50-95 scores reaching 57.7% and 47.6%, respectively. Related Works Direct training of SNN-based object detectors Direct training of spiking neural network (SNN)-based target detectors has attracted increasing attention, aiming to optimize network architecture and neuronal properties for enhanced performance in object detection tasks. SNNs are typically categorized into CNN-based and Transformer-based models. Owing to their strong inductive bias, CNNs have long dominated the field ( d’Ascoli et al. 2021 ) , with representative models such as Spiking ResNet ( Zheng et al. 2021 ) , SEW-ResNet ( Fang et al. 2021a ) , and MSResNet ( Hu et al. 2024 ) , differing mainly in LIF neuron placement and identity mapping ( He et al. 2016 ) . Recently, Transformer-based SNNs ( Dosovitskiy et al. 2020 ; Vaswani et al. 2017 ) have emerged, achieving state-of-the-art results in classification tasks ( Yao et al. 2023a ; Zhang et al. 2022 ) and enabling the development of directly trained target detectors. Notably, the first such detector was proposed using spike-residue blocks ( Su et al. 2023 ) , and SpikeYOLO ( Luo et al. 2024 ) further enhanced detection performance by incorporating the Meta-SpikeFormer design ( Yao et al. 2024 ) . However, these frameworks still underexplore the inherent temporal dynamics of SNNs and lack explicit temporal modeling. Many studies ( Fang et al. 2021b ; Yao et al. 2022 ; Guo et al. 2024 ) show that binary activation of LIF neurons often results in insufficient precision in complex tasks. Current methods, such as I-LIF neurons ( Luo et al. 2024 ) , address this by using integer values during training and expanding virtual time steps to maintain spike-driven behavior. Similarly, the SFA method ( Yao et al. 2025 ) uses integer training and spike-driven inference. Ternary spiking neurons ( Yuan et al. 2024 ; Miao et al. 2025 ) improve deep-layer features, enhancing target detection. However, these methods require additional hardware overhead or disrupt the spike-driven nature of SNNs due to their use of non-traditional LIF neurons. We believe the temporal dimension of SNNs holds significant potential, and this paper focuses on exploring this using the binary activation of original LIF neurons. Enhancing Temporal Dynamics in SNNs To enhance the temporal dynamics of SNNs, researchers have improved spike representation encoding schemes. For example, Gated Attention Coding (GAC) ( Qiu et al. 2024 ) transforms static images into robust representations with temporal dynamics. Additionally, Frequency Encoding (FE) ( Xu et al. 2024 ) simulates selective visual attention in the biological brain, removing noise at different frequencies. However, these methods have not clearly elucidated the relationship between temporal dynamics and spike firing pattern, and have only been tested on classification tasks with relatively low precision demands. Many studies ( Shen et al. 2024 ; Zhang et al. 2025d ; Lee et al. 2025 ) have explored the advantages of the temporal dimension when using attention mechanisms in SNNs. Inspired by SE-Net ( Hu, Shen, and Sun 2018 ) , researchers extended the attention mechanism to the temporal dimension, evaluating the importance of each frame in the final decision during training ( Yao et al. 2021 ) , thereby improving the temporal dynamics of SNNs. Modules like TCSA-SNN ( Yao et al. 2023c ) and TCJA-SNN ( Zhu et al. 2024 ) assess the significance of spike streams across multiple dimensions, further enhancing the temporal dynamics. However, the current temporal-based attention mechanism requires a separate multiplication module to compute attention weights, disrupting the spike-driven nature of SNNs. Figure 2: The Temporal Dynamics Enhancer (TDE) consists of two main components: (1) The spiking encoder (SE), using the CB component (Conv-BN), triggers the generation of diverse spikes. Its connection mechanism is based on the charging equation of the LIF neuron and the firing equation. (2) The Attention Gating Module (AGM) enhances the temporal dynamics of neurons within the layer by utilizing a general multi-dimensional attention mechanism. At the same time, it obtains temporal attention weights to regulate the spike stream generation of the SE, suppressing unreasonable exploration. Preliminary Knowledge Leaky Integrate-and-Fire neuron (LIF) : In Spiking Neural Networks, one of the most commonly used neuron models is the Leaky Integrate-and-Fire (LIF) model ( Tal and Schwartz 1997 ) , as it offers a good balance between biological plausibility and computational efficiency. Formally, the neuron dynamics at time step t are given by: \displaystyle H_{t} \displaystyle=V_{t-1}+X_{t}, (1) \displaystyle S_{t} \displaystyle=\Theta(H_{t}-V_{th}), (2) \displaystyle V_{t} \displaystyle=\beta(H_{t}-V_{th}S_{t}), (3) where X_{t}\in\mathbb{R} is the input current at time t , V_{t-1} is the membrane potential carried over from the previous step, and H_{t} is the pre-firing potential after integrating input. The neuron fires a spike S_{t}\in\{0,1\} when H_{t} exceeds the firing threshold V_{th} , determined by the Heaviside step function \Theta(\cdot) . After firing, the membrane potential is updated using a soft-reset mechanism, where \beta\in[0,1] is the leak factor that governs the decay of membrane potential over time. Neuromorphic data : Neuromorphic data are generated by a Dynamic Vision Sensor (DVS), which triggers events when the logarithmic change in pixel intensity exceeds a threshold. Each event is represented as (x_{n},y_{n},t_{n},p_{n}) , where (x_{n},y_{n}) are spatial coordinates, t_{n} is the timestamp, and p_{n}\in\{-1,1\} indicates polarity (increase or decrease in brightness). A common preprocessing strategy is to accumulate the event streams within a fixed time window into a frame format ( Yao et al. 2023b ) . The resulting event data can be represented as a tensor of shape \mathbb{R}^{1\times H\times W} , where the single channel encodes the accumulated event polarity information. Direct encoding schemes : Current SNN-based object detectors often adopt direct encoding ( Wu et al. 2019 ) , where the raw image is injected at each time step and spike streams are implicitly generated by the initial Conv-BN layer. Method In this section, we introduce the Temporal Dynamics Enhancer (TDE) to tackle spike firing pattern scarcity in SNNs for object detection. The TDE comprises two modules: a Spiking Encoder (SE) to generate varied temporal stimuli and an Attention Gating Module (AGM) to mitigate irrational exploration within the SE. By adding additional neuron groups, we achieve a fully Spike-Driven Attention (SDA) without multiplication operations. TDE is a general-purpose module. In this section, we integrate it into the SpikeYOLO framework to illustrate its design and implementation. Spiking Encoder (SE) Current SNN-based object detection frameworks predominantly employ direct encoding schemes, where the image input is repeatedly fed into LIF neurons. This repetitive operation fails to generate dynamic output, leading to a lack of temporal dynamics in subsequent SNN architectures. The spiking encoder of an SNN is designed to convert an image input I\in R^{C_{in}\times H\times W} into the spike streams S\in\{0,1\}^{T\times C_{out}\times H\times W} . For neuromorphic datasets, we use event-accumulated frames over the entire time window as input. We first use a convolutional layer to extract initial feature. Considering the membrane potential accumulation property of the LIF neuron model, the feature block at each time step in every T timestep simulations should satisfy: A_{t}=\begin{cases}f_{0}(I),&t=0\\ f_{t}(A_{t-1},I),&0