Error Amplification Limits ANN-to-SNN Conversion in Continuous Control

Zijie Xu, Zihan Huang, Yiting Dong, Kang Chen, Wenxuan Liu, Zhaofei Yu · 2026

Read Error Amplification Limits ANN-to-SNN Conversion in Continuous Control by Zijie Xu, Zihan Huang, Yiting Dong, Kang Chen, Wenxuan Liu, Zhaofei Yu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21778.txt.

Introduction

Zijie Xu and co-authors examine a shortcut that often fails. Spiking neural networks can be made by converting an already trained ordinary network, which avoids costly retraining. That is attractive for reinforcement learning, where training through live interaction is expensive and can be unsafe.

In practice, though, converted networks perform poorly on continuous control, tasks where actions vary smoothly, like steering or balancing. The 2026 preprint studies how errors grow during conversion and what limits the method in these settings. Knowing where the shortcut breaks helps engineers decide when conversion is safe to use. And it points to what a better conversion method would need to fix first.

Catalog record

CREATORZijie Xu, Zihan Huang, Yiting Dong, Kang Chen, Wenxuan Liu, Zhaofei Yu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-21778

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Error Amplification Limits ANN-to-SNN Conversion in Continuous Control Zijie Xu, Zihan Huang, Yiting Dong, Kang Chen, Wenxuan Liu, Zhaofei Yu Abstract Spiking Neural Networks (SNNs) can achieve competitive performance by converting already existing well-trained Artificial Neural Networks (ANNs), avoiding further costly training. This property is particularly attractive in Reinforcement Learning (RL), where training through environment interaction is expensive and potentially unsafe. However, existing conversion methods perform poorly in continuous control, where suitable baselines are largely absent. We identify error amplification as the key cause: small action approximation errors become temporally correlated across decision steps, inducing cumulative state distribution shift and severe performance degradation. To address this issue, we propose Cross-Step Residual Potential Initialization (CRPI), a lightweight training-free mechanism that carries over residual membrane potentials across decision steps to suppress temporally correlated errors. Experiments on continuous control benchmarks with both vector and visual observations demonstrate that CRPI can be integrated into existing conversion pipelines and substantially recovers lost performance. Our results highlight continuous control as a critical and challenging benchmark for ANN-to-SNN conversion, where small errors can be strongly amplified and impact performance. 1 Introduction Spiking Neural Networks (SNNs) ( 46 ; 22 ) communicate through discrete spikes rather than continuous activations, enabling event-driven computation and substantially reducing energy consumption when deployed on neuromorphic hardware ( 47 ; 11 ; 12 ) . These properties make SNNs particularly attractive for Reinforcement Learning (RL) on resource-constrained edge devices such as drones, wearables, and Internet-of-Things (IoT) sensors, where power efficiency is a critical concern. ANN-to-SNN conversion constructs SNNs by transferring pretrained ANN weights and replacing nonlinear activations with spiking neurons, allowing SNNs to inherit strong ANN performance without additional training ( 8 ; 28 ; 43 ; 13 ; 4 ; 7 ) . This training-free paradigm is especially valuable in RL, where learning an agent typically requires extensive environment interaction that is costly, time-consuming, and potentially unsafe ( 36 ; 51 ; 63 ; 35 ) . By reusing pretrained ANN policies, ANN-to-SNN conversion allows energy-efficient SNN agents to be deployed without further environment interaction. Figure 1 : Challenges of ANN-to-SNN conversion across different task categories. (a) Classification accuracy on ImageNet ( 33 ) . (b) Average returns in discrete control tasks on Atari ( 53 ) . (c) Relative returns in continuous control tasks, averaged over six environments from the DeepMind Control Suite. Additional results in the experimental section confirm that the performance degradation is consistent across tasks. (d) Illustration of error accumulation and amplification, where trajectories generated by converted SNNs progressively diverge from those of the original ANN policies. Despite these advantages, the study of ANN-to-SNN conversion in RL remains limited in scope. Existing work has primarily focused on discrete control settings ( 53 ; 62 ; 40 ; 17 ) , while ANN-to-SNN conversion in continuous action spaces remains largely unexplored, despite its central role in real-world robotics and embodied AI systems ( 39 ; 24 ; 3 ) . Figure 1 (a)–(c) compares the performance of ANN-to-SNN conversion across classification, discrete control, and continuous control tasks. While existing conversion methods achieve competitive performance in classification and discrete control, they suffer substantially larger performance degradation in continuous control. This gap arises from the requirement for precise, high-dimensional vector-valued actions in continuous control, in contrast to the categorical outputs in classification and discrete control tasks, making continuous control considerably more sensitive to conversion errors. To understand this phenomenon, we conduct a detailed analysis of conversion errors in continuous control. We find that: (i) performance degradation in converted SNNs is primarily driven by deviations in induced state trajectories rather than instantaneous action errors; (ii) these state deviations grow progressively over decision steps along a trajectory; and (iii) action approximation errors exhibit positive temporal correlation across consecutive decision steps, amplifying even small conversion errors. As illustrated in Figure 1 (d), trajectories generated by converted SNNs gradually diverge from those of the optimal ANN policies, whereas ANN policies themselves do not exhibit such progressive drift. Motivated by this analysis, we propose Cross-Step Residual Potential Initialization (CRPI), a simple yet effective mechanism to mitigate error amplification in ANN-to-SNN conversion for RL. CRPI carries over residual membrane potentials across consecutive decision steps to initialize neuron states, suppressing temporally correlated action errors and stabilizing the resulting state trajectories, as illustrated in Figure 1 (d). Notably, CRPI requires no additional training and can be seamlessly integrated into existing training-free ANN-to-SNN conversion pipelines. We evaluate CRPI on a range of continuous control benchmarks, including vector-based tasks from MuJoCo ( 66 ) and vision-based environments from the DeepMind Control (DMC) Suite ( 69 ) . CRPI consistently improves the performance of multiple state-of-the-art ANN-to-SNN conversion methods and outperforms directly trained SNNs in challenging vision-based continuous control tasks. Our results highlight continuous control as a challenging benchmark for ANN-to-SNN conversion, where conversion errors can be strongly amplified and significantly impact long-horizon performance. 2 Related Works 2.1 ANN–SNN Conversion ANN-to-SNN conversion typically maps ReLU activations in ANNs to the firing rates of Integrate-and-Fire neurons by accumulating spikes over time ( 8 ) . However, the bounded firing rates in SNNs introduce significant errors, which is often mitigated through techniques such as weight normalization ( 57 ) and threshold balancing ( 28 ) . Temporal discretization introduces additional quantization errors, which have been addressed by methods like quantizing the source ANN activations ( 6 ; 32 ) , using two-stage inference ( 29 ) , improving membrane potential initialization ( 30 ) , and extending neuron models with signed spikes ( 70 ; 41 ) or multiple thresholds ( 34 ) . Other encoding schemes such as time-to-first-spike coding ( 56 ; 83 ; 59 ) , phase coding ( 38 ; 71 ) , burst coding ( 52 ; 42 ; 72 ) , and differential coding ( 33 ) , have also been explored to enhance both efficiency and expressiveness. Recent works have further extended conversion methods by allowing for approximations of general nonlinear layers ( 50 ; 37 ; 34 ) and enabling conversion of Transformer architectures to SNNs ( 73 ; 81 ) . 2.2 SNNs for Reinforcement Learning Early works on SNNs for RL primarily relied on biologically inspired local learning rules, particularly reward-modulated spike-timing-dependent plasticity (R-STDP) and its variants ( 18 ; 19 ; 23 ; 20 ; 78 ) . Later research introduced gradient-based optimization methods, such as spatio-temporal backpropagation (STBP) for deep spiking Q-networks ( 75 ; 45 ; 9 ; 55 ; 60 ) and e-prop for policy gradient methods ( 1 ) . In continuous control, the hybrid actor-critic framework has been widely adopted, where a spiking actor network is co-trained with an ANN-based critic network ( 77 ; 64 ; 65 ; 82 ; 10 ; 14 ) . This approach has been further advanced with proxy-target mechanisms, allowing spiking actors to match or even surpass ANN policies ( 76 ) . 2.3 ANN–SNN Conversion in Reinforcement Learning ANN-to-SNN conversion in RL has also been explored in several studies. These works mainly focus on converting Deep Q-Networks (DQNs) ( 49 ; 48 ) into spiking policies for Atari games ( 53 ; 62 ) , as well as deploying converted agents

Read the complete text