Federated Few-Shot Learning on Neuromorphic Hardware: An Empirical Study Across Physical Edge Nodes

Steven Motta, Gioele Nanni · 2026

Read Federated Few-Shot Learning on Neuromorphic Hardware: An Empirical Study Across Physical Edge Nodes by Steven Motta, Gioele Nanni (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13037.txt.

Introduction

Steven Motta and Gioele Nanni run federated few-shot learning on real neuromorphic edge hardware, a setting not tried before. On-chip plasticity gives binary weight updates, not the float gradients standard methods assume. Their two-node system uses BrainChip Akida processors across about 1,580 trials. Neuron-level joining of weights kept accuracy, while plain averaging destroyed it. Tuning the feature extractor drove most gains. Wider features helped federation more than solo learning, which points to shared prototype effects.

Catalog record

CREATORSteven Motta, Gioele Nanni
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48449
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.13037

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Federated Few-Shot Learning on Neuromorphic Hardware: An Empirical Study Across Physical Edge Nodes Steven Motta, Gioele Nanni Abstract Federated learning on neuromorphic hardware remains unexplored because on-chip spike-timing-dependent plasticity (STDP) produces binary weight updates rather than the floating-point gradients assumed by standard algorithms. We build a two-node federated system with BrainChip Akida AKD1000 processors and run approximately 1,580 experimental trials across seven analysis phases. Of four weight-exchange strategies tested, neuron-level concatenation (FedUnion) consistently preserves accuracy while element-wise weight averaging (FedAvg) destroys it ( p = 0.002 p=0.002 ). Domain-adaptive fine-tuning of the upstream feature extractor accounts for most of the accuracy gains, confirming feature quality as the dominant factor. Scaling feature dimensionality from 64 to 256 yields 77.0 % 77.0\% best-strategy federated accuracy ( n = 30 n=30 , p < 0.001 p<0.001 ). Two independent asymmetries (wider features help federation more than individual learning, while binarization hurts federation more) point to a shared prototype complementarity mechanism: cross-node transfer scales with the distinctiveness of neuron prototypes. 1 Introduction Neuromorphic processors such as the BrainChip Akida AKD1000 [ BrainChip 2023a ] execute spiking neural network (SNN) [ Maass 1997 , Roy et al. 2019 ] inference and on-chip learning at milliwatt power budgets, making them attractive for edge deployment [ Shi et al. 2016 ] . Their native learning mechanism, spike-timing-dependent plasticity (STDP) [ Bi and Poo 1998 ] , produces sparse binary weight updates rather than the floating-point gradients that federated learning algorithms [ McMahan et al. 2017 , Kairouz et al. 2021 ] expect. No prior work has attempted to federate STDP-learned models across physical neuromorphic devices: existing studies operate entirely in simulation and rely on surrogate-gradient training instead of on-chip plasticity. We build a two-node federated system with Akida AKD1000 coprocessors on Raspberry Pi 5 boards and run approximately 1,580 experimental trials across seven analysis phases. Our contributions are: 1. A two-stage architecture that works around the Akida IP version mismatch (v2 feature extractor, v1 STDP edge learner) together with an on-device fine-tuning pipeline using quantization-aware training [ Jacob et al. 2018 ] on commodity Raspberry Pi hardware. 2. Four federation strategies for STDP weight matrices. Neuron-level concatenation (FedUnion) preserves accuracy across all tested conditions; element-wise averaging (FedAvg) consistently destroys the sparse selectivity patterns that STDP produces. 3. An experimental framework covering 42 STDP configurations \times up to 30 trials \times seven analysis phases ( {\sim}1{,}580 runs total), with seeded splits, software baselines, bootstrap CIs, and Cohen’s d effect sizes. 4. Feature dimensionality scaling from 64 to 256 dimensions, and a prototype complementarity mechanism that explains two observed asymmetries: wider features amplify the federation gain while binarization amplifies the federation penalty. 2 Related Work Neuromorphic Computing and SNNs. Spiking neural networks (SNNs) [ Maass 1997 ] communicate via discrete spikes rather than continuous activations, enabling event-driven computation at milliwatt-scale power [ Roy et al. 2019 , Pfeiffer and Pfeil 2018 ] . Hardware platforms include Intel Loihi [ Davies et al. 2018 ] , a research manycore chip with programmable learning rules, and IBM TrueNorth [ Merolla et al. 2014 ] , which integrated one million neurons on a single die. The BrainChip Akida AKD1000 [ BrainChip 2023a ] differs from these research platforms in that it ships as a standard PCIe peripheral and supports on-chip STDP-based learning [ Bi and Poo 1998 ] alongside inference. Akida has been applied to single-device keyword spotting [ BrainChip 2023a , BrainChip 2023b ] and visual classification [ BrainChip 2023c ] ; no multi-device or federated deployments have been reported. Federated Learning. Federated Averaging (FedAvg) [ McMahan et al. 2017 ] trains models across decentralized nodes without sharing raw data. Subsequent work has tackled non-IID distributions [ Li et al. 2020 , Zhao et al. 2018 ] , communication cost [ Konecny et al. 2016 ] , device heterogeneity [ Li et al. 2023 ] , and numerous open problems surveyed by Kairouz et al. 2021 . All of these algorithms aggregate floating-point gradient updates, a primitive that has no direct analogue in STDP-based on-chip learning. Federated Learning on Neuromorphic Hardware. Table 1 summarises the small body of work in this area; all of it is simulation-only. Skatchkovsky et al. 2020 trained SNNs on MNIST-DVS across two simulated nodes, transmitting only weights above a threshold and showing convergence on par with centralized training at lower communication cost. Yang et al. 2022 proposed LEAD, a leader-election protocol in which the best-performing node’s weights guide aggregation; on SHD and DVS-Gesture with 3+ simulated nodes they reported 94 – 96\% accuracy. Venkatesha et al. 2021 federated SNNs on CIFAR-10 with 5+ simulated clients using surrogate-gradient backpropagation. A common thread is that all three rely on surrogate gradients rather than on-chip STDP, and none deploy on physical hardware. Our experiments are, to our knowledge, the first to exchange STDP-learned weights between physical neuromorphic processors. Table 1: Comparison with prior federated neuromorphic learning. P = physical hardware; S = simulated. Study Hw. N Task Acc. (%) Skatchkovsky+ [ Skatchkovsky et al. 2020 ] S 2 MNIST-DVS {\sim}90^{*} Yang+ [ Yang et al. 2022 ] S 3+ SHD/DVS 94–96 Venkatesha+ [ Venkatesha et al. 2021 ] S 5+ CIFAR-10 {\sim}90^{*} This work P 2–4 Speech Cmd. 77.0 ∗ Estimated from figures. Few-Shot Learning and Transfer Learning. Few-shot learning aims to classify new categories from minimal examples [ Wang et al. 2020 ] . Prototypical networks [ Snell et al. 2017 ] learn embedding spaces in which class prototypes are compared via distance functions; STDP’s per-neuron weight vectors play an analogous role, as we discuss in § 6.1 . Fine-tuning pretrained feature extractors for new domains [ Pan and Yang 2010 ] is well established for CNNs but unexplored in combination with neuromorphic STDP learners that require binary inputs. Feature binarization has been studied in binary neural networks [ Courbariaux et al. 2016 ] , yet how binarization interacts with federated aggregation of STDP weights is an open question that our experiments address directly. 3 Proposed Method 3.1 Two-Stage Pipeline: Bridging IP Versions A critical engineering constraint is the Akida SDK’s IP version architecture. The pretrained DS-CNN keyword spotting model [ Zhang et al. 2017 ] converts to Akida v2, but the FullyConnected layer required for STDP edge learning is only available in v1. These versions cannot be mixed within a single model. Our solution is a two-stage pipeline : 1. Stage 1, Feature Extractor (v2, software): The DS-CNN [ Zhang et al. 2017 , BrainChip 2023b ] is converted from Keras to Akida v2, with the classification head removed. In the base configuration, this maps MFCC spectrograms [ Davis and Mermelstein 1980 ] of shape (49,10,1) to 64-dimensional int8 feature vectors. In Phase 2+, the DS-CNN is fine-tuned on target classes before head removal (§ 4.2 ). 2. Stage 2, Edge Learner (v1, hardware): A standalone v1 model with a single FullyConnected layer compiled with the AkidaUnsupervised STDP optimizer. It accepts 1-bit binary inputs and maps to the AKD1000 for on-chip learning. Wide feature variants. For feature dimensionality scaling experiments (§ 5.5 ), the DS-CNN classification head is replaced with a wider projection: a QuantizedDense layer with 128 or 256 output units, followed by a Dequantizer .

Read the complete text