Benchmarking Fairness in Spiking Neural Networks: Data Bias, Spurious Features, and Hardware Effects
Hudi He, Fukun Wang, Zhe Wang, Xinyi Wang, Shuhan Ye, Jiarui Liu, Qing Qing, Ziqi Xu, Xikun Zhang, Renqiang Luo · 2026
Read Benchmarking Fairness in Spiking Neural Networks: Data Bias, Spurious Features, and Hardware Effects by Hudi He, Fukun Wang, Zhe Wang, Xinyi Wang, Shuhan Ye, Jiarui Liu, Qing Qing, Ziqi Xu, Xikun Zhang, Renqiang Luo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27407.txt.
Introduction
Hudi He and colleagues benchmark fairness in spiking neural networks across demographic coverage, spurious features, and hardware effects. Models trained on biased data show 23 percent higher false positive rates for underrepresented groups, with edge hardware widening gaps by up to 41 percent. Cloud-built bias fixes often degrade under tight resources, so fairness and hardware efficiency need joint design.
Catalog record
| CREATOR | Hudi He, Fukun Wang, Zhe Wang, Xinyi Wang, Shuhan Ye, Jiarui Liu, Qing Qing, Ziqi Xu, Xikun Zhang, Renqiang Luo |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51473 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27407
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Benchmarking Fairness in Spiking Neural Networks: Data Bias, Spurious Features, and Hardware Effects Hudi He, Fukun Wang, Zhe Wang, Xinyi Wang, Shuhan Ye, Jiarui Liu, Qing Qing, Ziqi Xu, Xikun Zhang, Renqiang Luo Abstract Evaluating fairness in Spiking Neural Networks (SNNs) demands rigorous benchmarks that reflect real-world complexities, yet existing assessments remain limited by superficial dataset diversity and idealized hardware assumptions. This work introduces the first systematic fairness benchmark for SNNs, addressing three critical dimensions of realism: ( 1 1 ) demographic coverage gaps in training data, ( 2 2 ) spurious feature leakage (e.g., skin tone as a proxy for class labels), and ( 3 3 ) deployment-environment mismatches (e.g., edge devices with constrained spike encoding). Our framework integrates four cross-demographic datasets with controlled bias injections and three neuromorphic hardware simulators (Loihi 2 2 , SpiNNaker), enabling isolated analysis of fairness-performance trade-offs under resource constraints. Standardized evaluations of 12 12 state-of-the-art SNNs reveal stark disparities: models trained on biased data exhibit 23 23 % higher false positive rates for underrepresented groups, while hardware limitations (e.g., reduced spike precision) further amplify accuracy gaps by up to 41 41 % in edge deployments. Critically, bias mitigation strategies developed for cloud-based SNNs often degrade under resource constraints, highlighting the need for co-design principles that jointly optimize fairness and hardware efficiency. By bridging algorithmic fairness research with neuromorphic engineering, our benchmark provides a foundation for trustworthy SNNs in socially critical applications such as healthcare and autonomous systems. Our code is available at: https://anonymous.4open.science/r/SNN-Benchmarks-8017 . 1 Introduction By mimicking the event-driven mechanism and binary spatiotemporal dynamics of biological neurons, Spiking Neural Networks (SNNs) show strong potential for low-power computing in edge devices and Internet of Things (IoT) applications 39 . Their hardware–algorithm co-design makes them efficient in resource-limited settings 20 . Recent advances, such as spike-driven Transformers, further improve performance and versatility across various visual tasks by leveraging sparse addition paradigms 35 . As a result, SNNs are increasingly used in applications like biomedical monitoring, autonomous perception, and facial analysis, where fairness concerns are becoming important 28 . However, the rapid progress of SNNs has hidden an important socio-technical risk: algorithmic fairness. While fairness has been widely studied in many machine learning systems, it is still largely overlooked in SNNs 1 . Consequently, when applied in human-centered vision tasks, these models may produce biased outcomes across demographic groups 18 . For example, in facial recognition or identity classification, individuals from underrepresented racial groups may experience lower accuracy or higher misclassification rates 26 . In Artificial Neural Networks (ANNs), such bias is often caused by imbalanced datasets 28 , and mitigation typically relies on continuous representation disentanglement or selective fine-tuning 41 . However, these conventional debiasing paradigms cannot be trivially transferred to SNNs, because the root causes of bias in neuromorphic models extend fundamentally beyond mere data distribution 30 . While current neuromorphic research heavily prioritizes performance and hardware efficiency (such as through activity pruning 2 ), it overlooks how the unique algorithmic and physical mechanisms of SNNs intrinsically alter the fairness landscape. The fairness issues in SNNs are not simply a replication of ANN biases; they are distinct phenomena shaped by spike-based processing. Since existing fairness toolkits, such as OxonFair 4 , are entirely designed for continuous ANNs and are blind to both spike-driven dynamics and hardware limitations, existing evaluations often rely on static and idealized datasets that fail to reflect these neuromorphic-specific complexities. Consequently, there is an urgent need for a specialized fairness benchmark tailored for neuromorphic systems. To address this gap, we propose a fairness benchmark for SNNs. Our framework maps the aforementioned neuromorphic challenges to three dimensions of realism: ( 1 ) demographic coverage gaps to evaluate fundamental data-level bias; ( 2 ) spurious feature leakage to assess how asymmetric information filtering in SNNs triggers texture-based shortcut learning; and ( 3 ) deployment-environment mismatches to quantify the impact of hardware-specific constraints on algorithmic equity. Additionally, we design fine-grained evaluation protocols to better understand fairness in SNNs. Specifically, we evaluate datasets with multiple sensitive attributes and report results for each attribute separately, which reveals detailed fairness differences. We also conduct controlled experiments on image grayscale, since grayscale is critical in spike-based processing, to study its impact on fairness. Furthermore, we track training dynamics under different sensitive attributes and analyze model behavior during fitting, which provides initial insights into the causes of fairness issues. Through comprehensive experiments across multiple datasets, our benchmark enables a systematic study of fairness–performance trade-offs under realistic resource constraints. Our main contributions are summarized as follows: • We design a standardized fairness benchmark using metrics such as Statistical Parity and Equal Opportunity. We evaluate models on three diverse datasets (UTKFace, FairFace, and DemogPairs). We also perform race-specific accuracy analysis on the RFW dataset to measure performance gaps across 12 state-of-the-art SNN models. • We study the source of bias through a controlled data cleaning process. We construct a refined subset, rfw-dataclean , by removing black-and-white and abnormal-color images. Results show that SNNs rely heavily on color and texture cues, rather than robust geometric features. • We track training dynamics over 150 epochs on the RFW dataset. We observe clear differences in convergence behavior across demographic groups. Models learn uneven feature representations, especially in early training stages, which leads to fairness issues. • We extend fairness evaluation to include system-level constraints. Experiments show that deployment factors, such as reduced spike precision, not only reduce accuracy but also enlarge performance gaps across demographic groups. 2 Methodology 2.1 Fairness Metrics We evaluate the fairness of SNNs using two primary metrics: Statistical Parity (SP) 8 and Equal Opportunity (EO) 11 . For both metrics, a value closer to 0 indicates a fairer SNN model. Let \mathbf{A}\in\{0,1\} represent a protected sensitive attribute. Let \hat{\mathbf{Y}}\in\{0,1\} denote the model’s predicted outcome. Statistical parity difference ( \Delta_{\text{SP}} ) measures whether the model provides equal positive outcomes to all groups. It requires the prediction \hat{\mathbf{Y}} to be independent of the sensitive attribute \mathbf{A} . We calculate the absolute difference in acceptance rates between groups: \Delta_{\text{SP}}=|\mathbb{P}(\hat{\mathbf{Y}}=1|\mathbf{A}=1)-\mathbb{P}(\hat{\mathbf{Y}}=1|\mathbf{A}=0)|. (1) Equal opportunity difference ( \Delta_{\text{EO}} ) focuses on the fairness of outcomes for qualified individuals. It requires the true positive rate to be equal across groups. We define the disparity as: \Delta_{\text{EO}}=|\mathbb{P}(\hat{\mathbf{Y}}=1|\mathbf{A}=1,\mathbf{Y}=1)-\mathbb{P}(\hat{\mathbf{Y}}=1|\mathbf{A}=0,\mathbf{Y}=1)|. (2) Figure 1: Framework for quantifying algorithmic fairness based on SP/EO and Accuracy Difference. 2.2 Problem Formulation: The Fairness Gap as Optimization Constraints Deep SNNs, including Spike-ResNet and QKFormer, achieve high performance using Surrogate Gradient (SG) 42 methods. Their event-driven nature ensures energy efficiency for edge deployment in visual tasks 39 . Standard SNN training focuses solely on minimizing task-specific loss \mathcal{L}_{\text{task}} , where \theta represents the trainable parameters: \min_{\theta}\mathcal{L}_{\text{task}}(f_{\theta}(X),Y). (3) However, this aggressive pursuit of state-of-the-art accuracy and hardware efficiency often comes at the cost of algorithmic fairness. Since standard SNN training focuses solely on minimizing the global task loss, the optimization process may inadvertently sacrifice the representation quality of minority groups to achieve a lower overall error 35 . This objective rewards error minimization but ignores fairness constraints 3 , causing networks to capture easily accessible discriminatory signals instead of equitable representations 24 . To transition SP and EO from mere post-hoc evaluation metrics to actionable optimization targets,