CMOS Implementation of Field Programmable Spiking Neural Network for Hardware Reservoir Computing

Ckristian Duran, Nanako Kimura, Zolboo Byambadorj, Tetsuya Iizuka · 2025

Read CMOS Implementation of Field Programmable Spiking Neural Network for Hardware Reservoir Computing by Ckristian Duran, Nanako Kimura, Zolboo Byambadorj, Tetsuya Iizuka (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17355.txt.

Introduction

Ckristian Duran, Nanako Kimura, Zolboo Byambadorj, and Tetsuya Iizuka built a spiking neural chip in a 2025 arXiv paper. Large neural networks cost too much power for small edge devices. Spiking networks promise low power, above all in analog form, but they suffer from noise and weak wiring options.

The team's design is a field-programmable spiking network in CMOS, built for reservoir computing. Each neuron is a leaky integrate-and-fire circuit with its own voltage-controlled oscillator. Weighted links between neurons can be rewired through an on-chip FPGA frame, so the reservoir can take many shapes. The chip ran the FORCE learning rule, memory tests, and a standard time-series task in both simulation and real measurements. It stays compact and uses very little energy per spike, with no analog-to-digital converters needed for readout.

Catalog record

CREATORCkristian Duran, Nanako Kimura, Zolboo Byambadorj, Tetsuya Iizuka
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-17355

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CMOS Implementation of Field Programmable Spiking Neural Network for Hardware Reservoir Computing Ckristian Duran, Nanako Kimura, Zolboo Byambadorj, Tetsuya Iizuka Abstract The increasing complexity and energy demands of large-scale neural networks, such as Deep Neural Networks (DNNs) and Large Language Models (LLMs), challenge their practical deployment in edge applications due to high power consumption, area requirements, and privacy concerns. Spiking Neural Networks (SNNs), particularly in analog implementations, offer a promising low-power alternative but suffer from noise sensitivity and connectivity limitations. This work presents a novel CMOS-implemented field-programmable neural network architecture for hardware reservoir computing. We propose a Leaky Integrate-and-Fire (LIF) neuron circuit with integrated voltage-controlled oscillators (VCOs) and programmable weighted interconnections via an on-chip FPGA framework, enabling arbitrary reservoir configurations. The system demonstrates effective implementation of the FORCE algorithm learning, linear and non-linear memory capacity benchmarks, and NARMA10 tasks, both in simulation and actual chip measurements. The neuron design achieves compact area utilization (around 540 NAND2-equivalent units) and low energy consumption (21.7 pJ/pulse) without requiring ADCs for information readout, making it ideal for system-on-chip integration of reservoir computing. This architecture paves the way for scalable, energy-efficient neuromorphic systems capable of performing real-time learning and inference with high configurability and digital interfacing. November 2024 (minor update January 2025) Keywords : neural network, spiking neurons, leaky integrate-and-fire model, complementary metal-oxide-semiconductor (CMOS), reservoir computing, hardware 1 Introduction Advancements in Artificial Intelligence (AI) have offered a powerful tool to humanity. Large Language Models (LLMs) such as ChatGPT have demonstrated the power of AI for lifestyle and advanced applications. Day by day, such models are more intricately implemented into the daily lives of people and are being broadened in interdisciplinary fields. However, with the advances of AI over the world, several issues arise in particular with the escalation of complex construction of models. Multiple implementations of large models in recent years reflect in global energy consumption [ 1 ] . Moreover, the latest advancements of AI technology reaches the edge and the final user with a really high energy and implementation cost. Deep Neural Networks (DNNs) and LLMs require a substantial quantity of memory and calculation, which translates to very high area (server clusters) and high power consumption (in the order of giga watts). LLMs also occupies entire server rooms and cluster-based accelerated systems to work, making it impractical to implement and make it usable without access to an internet connection. These problems arise due to the size of the model, causing the calculation power and memory access of such networks increase to unprecedented limits. Up to today, there is no viable solution to realize large implementations of neural networks unless pushing the size of the cluster and rising the consumption of energy, making it unsustainable. This situation also creates concerns with privacy and security. As the construction of these models can only exist outside the personal devices of the user, sensitive data need to travel through public domains to make use of the latest advancements of neural networks. Although nowadays such domains implement security by themselves, the data still need to be trusted to the company or entity that houses the implementation of the neural network. Such escalating problems beg the creation of alternatives that offer smaller implementation sizes, low energy consumption, and integration with the end user to keep the data private. One potential alternative to combat the scaling issue is Spiking Neural Networks (SNNs). SNNs can be adopted into different research areas, offering good learning capabilities at low cost [ 2 , 3 ] . The advantage of using SNNs over other systems is due different factors, but is mainly non-computing intensive (only accumulation computations needed) and relatively simple to implement in real hardware. The SNNs can also be arranged in different configurations including in neuromorphic manners, allowing more natural implementations of intelligence. Several circuit implementations of SNNs exist [ 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 ] , which can be classified into digital and analog circuits. The digital SNNs perform the computation of the neural network discretely, usually by accelerating the computation using per-step spike calculations. The digital implementations are immune to environmental noise and can easily be scaled with the technology node. Although comparatively the digital SNNs offer substantial benefits over area and energy consumption compared to previously discussed DNNs or LLMs [ 15 , 16 ] , analog SNNs offer even better efficiency compared to the digital counterpart [ 17 ] . Several studies have demonstrated such benefits, especially with CMOS technology [ 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 ] . Despite this, one main disadvantage is the sensitiveness to the noise, which makes analog implementations difficult to realize [ 27 ] . We implement an attractive and fairly-known framework named reservoir computing (RC) to compensate the sensitiveness to noise in analog SNNs and maintain the area and energy consumption. This computing is a special type of Recurrent Neural Network (RNN), which is used as a reservoir to perform non-linear transformations of data. In a reservoir, the connections between neuron nodes are randomized both in weights and destination nodes. This connectivity allows fading memory to exist in the reservoir, which allows calculations over the input data with previous states of the input and output of the system. By using dynamic or static filters over the outputs of a reservoir, a system can optimize a learning curve over the input and desired output data, effectively converting it to a learning system. The filter is composed of a combination of linear weights over the states of the nodes from the reservoir, typically optimized by using a linear regression algorithm that reduces the error between learning and the output [ 28 , 29 ] . These weights exist outside of the reservoir, allowing to reduce the number of rewritable memory for learning. Compared to typical neural networks, RC is faster, highly-adaptive, real-time, and energy-efficient at the learning stage. These advantages are demonstrated in software by using Echo State Networks (ESN) [ 30 ] . This paradigm allows the reservoir to be implemented using physics dynamics. Several examples of physical implementations demonstrate the feasibility of neural network systems using RC, e.g., analog circuits [ 31 , 32 ] , optics devices [ 33 , 34 ] , optoelectronic devices [ 35 , 36 ] , spin-tronic devices [ 37 , 38 ] , FeFET devices [ 39 ] , memristors [ 40 , 41 , 42 ] , water [ 43 ] , and soft materials [ 44 ] . These physical implementations allow fully-analog spiking reservoirs to be realized for energy-efficient, low-area, and non-heavy computation of neural networks. The implementation of analog spiking reservoirs, analog SNNs, or analog computation in general, have several issues. One of the most prominent issues is the extraction of the state of the nodes inside of the network. The deployment of data inside of an analog network usually does not require additional circuitry, but the sampling of data normally requires Analog-to-Digital Converters (ADCs). Physical RC systems have been implemented using fully analog circuits with ADCs [ 31 , 45 ] .

Read the complete text