Energy-Aware FPGA Implementation of Spiking Neural Network with LIF Neurons
Asmer Hamid Ali, Mozhgan Navardi, Tinoosh Mohsenin · 2024
Read Energy-Aware FPGA Implementation of Spiking Neural Network with LIF Neurons by Asmer Hamid Ali, Mozhgan Navardi, Tinoosh Mohsenin (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-01628.txt.
Description
Abstract . Tiny Machine Learning (TinyML) has become a growing field in on-device processing for Internet of Things (IoT) applications, capitalizing on AI algorithms that are optimized for their low complexity and energy efficiency. These algorithms are designed to minimize power and memory footprints, making them ideal for the constraints of IoT devices.
Catalog record
| CREATOR | Asmer Hamid Ali, Mozhgan Navardi, Tinoosh Mohsenin |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-01628
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Energy-Aware FPGA Implementation of Spiking Neural Network with LIF Neurons Asmer Hamid Ali, Mozhgan Navardi, Tinoosh Mohsenin Abstract . Tiny Machine Learning (TinyML) has become a growing field in on-device processing for Internet of Things (IoT) applications, capitalizing on AI algorithms that are optimized for their low complexity and energy efficiency. These algorithms are designed to minimize power and memory footprints, making them ideal for the constraints of IoT devices. Within this domain, Spiking Neural Networks (SNNs) stand out as a cutting-edge solution for TinyML, owning to their event-driven processing paradigm which offers an efficient method of handling dataflow. This paper presents a novel SNN architecture based on the 1 s t 1^{st} Order Leaky Integrate-and-Fire (LIF) neuron model to efficiently deploy vision-based ML algorithms on TinyML systems. A hardware-friendly LIF design is also proposed, and implemented on a Xilinx Artix-7 FPGA. To evaluate the proposed model, a collision avoidance dataset is considered as a case study. The proposed SNN model is compared to the state-of-the-art works and Binarized Convolutional Neural Network (BCNN) as a baseline. The results show the proposed approach is 86% more energy efficient than the baseline. 1. Introduction Deep learning algorithms based on Artificial Neural Networks (ANN) are popular in Internet of Things (IoT) applications due to their AI capabilities. However, the size and complexity of these models require high-performance computing (HPC) clusters in data centers, which poses challenges for IoT devices that gather data on the edge ( Navardi and Mohsenin, 2023 ; Humes et al., 2023 ) . Edge computing, where data is processed on the device itself, can address these challenges but is limited by memory and energy constraints ( Navardi and Mohsenin, 2023 ; Rashid et al., 2024 ; Mazumder and Mohsenin, 2023 ; Navardi et al., 2023 ) . It led Tiny Machine Learning (TinyML) to emerge which considers efficient deployment of ANN models on tiny robots such as Unmanned Aerial Vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) ( Manjunath et al., 2023 ) . However, deploying ANN models on the edge is still limited by power and hardware constraints due to the highly intensive computational of such models. To overcome this, there is interest in bio-inspired approaches like Spiking Neural Networks (SNNs), which have lower energy consumption ( Nguyen et al., 2022 ; Davidson and Furber, 2021 ; Véstias, 2019 ; Roy et al., 2017 ) . Recent advancements in the field of neural networks have led to an era where the computational efficiency of SNNs is being harnessed in more innovative and practical ways ( Pietrzak et al., 2023 ; Agatonovic-Kustrin and Beresford, 2000 ; Pfeiffer and Pfeil, 2018 ) . SNNs, with their ability to mimic the intricacies of biological neural networks, represent a significant leap from traditional artificial neural networks. They offer a more nuanced approach to information processing, mimicking the dynamic, temporal characteristics of biological neuron activity. The integration of SNNs with Field-Programmable Gate Arrays (FPGAs) has opened new avenues in computing, merging the adaptability of neural networks with the energy efficiency and customization offered by FPGAs ( Li et al., 2024 ; Omondi and Rajapakse, 2006 ; Panchapakesan et al., 2022 ; Kakani et al., 2023 ; Heidarpur et al., 2019 ; Pham et al., 2021 ; Mazumder et al., 2021 ) . This synergy is crucial, especially in applications where power efficiency is important, such as in embedded systems or portable devices. While recent research has made strides in developing effective FPGA architectures for SNNs and creating more biologically plausible models ( Farsa et al., 2019a ; Farsa et al., 2015 ; Lammie et al., 2018 ; Ali et al., 2022 ) , there remains a gap in applying these advancements to complex, real-world scenarios. Much of the existing work ( Iyer et al., 2021 ; Diehl and eCook, 2015 ; Zhou, 2023 ) focuses on pattern recognition tasks using simplified datasets like MNIST ( Lecun et al., 1998 ) , has not fully explored the potential of SNNs in more challenging and realistic environments. This research aims to bridge this gap by shifting the focus to a more demanding and realistic dataset: collision avoidance. The study explores the training of SNNs for collision avoidance and their implementation on FPGA platforms. By moving beyond the conventional realm of simple image classification tasks, this work aims to validate the practicality and robustness of SNNs in high-stakes scenarios, marking a significant stride toward their real-life applicability. This paper presents a novel approach to SNN implementation, leveraging the strengths of FPGAs to address the challenges of image recognition in dynamic environments. The choice to focus on FPGA implementations for SNNs was driven by several considerations such as FPGAs offer a unique blend of flexibility and performance, allowing for rapid prototyping and iterative design that is crucial for the evolving field of SNNs. This work contributes to the field by not only validating the FPGA-based hardware design using a complex dataset but also by offering a comprehensive comparison with prior standard works. This research underscores the progression of neuromorphic computing ( Mead, 1990 ) towards practical, everyday applications, setting a new benchmark for future endeavors in the domain. In summary, the main contributions of this paper are: • Developing a vision-based TinyML framework optimized for tiny UAVs and UGVs. • Adapting a widely-recognized 1^{st} Order LIF model for on-device processing in TinyML applications, tested with a challenging dataset. • Architecting a robust hardware solution tailored for the efficient deployment of this SNN model on an FPGA platform. 2. Related Works Recent studies have focused on the integration of SNNs with FPGAs ( Pani et al., 2017a ; Khodamoradi et al., 2021 ) . Inspired by biological neural networks, SNNs seek to mimic the information transmission and signal processing inspired by biological neurons ( Isik, 2023a ; Yamazaki et al., 2022 ) . Neural dynamics play a major role in the physiologically realistic SNN’s performance ( Guo et al., 2021 ) . FPGA implementations are becoming more popular because they can be used to create neural network systems with minimal power consumption, making use of FPGA’s ability to create customized topologies for embedded and high-performance applications. The development of an effective and adaptable FPGA architecture for the Izhikevich model-based real-time simulation of SNNs is a noteworthy achievement ( Pani et al., 2017a ) . With a 10 kHz sampling rate, this device can simulate up to 1,440 neurons in real-time, making it appropriate for small-to-medium-sized extracellular closed-loop research. Another aspect is the realization of more biologically plausible artificial neurons as proposed in ( Qiao et al., 2019 ) . The implementation of online learning in neuromorphic chips is a challenging task that has been addressed to improve the functionality and flexibility of these systems. A bio-plausible online learning SNN designed for effective hardware implementation is shown in the suggested model. This advancement might completely change the way SNNs are utilized in various applications, including artificial intelligence and neuroprosthetics. It also represents a significant step towards building more robust and adaptable neuromorphic computing systems. In recent research ( Farsa et al., 2019b ; Han et al., 2020 ; Zhang et al., 2020 ; Lu and Xu, 2022 ; Ali