M2RU: M emristive M inion R ecurrent U nit for On-Chip Continual Learning at the Edge
Abdullah M. Zyarah, Dhireesha Kudithipudi · 2025
Read M2RU: M emristive M inion R ecurrent U nit for On-Chip Continual Learning at the Edge by Abdullah M. Zyarah, Dhireesha Kudithipudi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-17299.txt.
Introduction
Abdullah M Zyarah and Dhireesha Kudithipudi design a chip that lets small edge devices keep learning over time without draining power. Recurrent networks, which handle sequences, normally need costly training and constant data shuttling. That load is too heavy for tiny embedded hardware that must adapt on the spot.
Their design, M2RU, mixes analog memristor circuits with digital control and runs a compact recurrent unit on the chip itself. Two tricks help: inputs stream in bit by bit without pricey converters, and a replay store steadies learning when the data shifts. The chip hits 312 billion operations per watt, uses 29 times less energy than a standard digital design, and should last about 12.2 years.
Catalog record
| CREATOR | Abdullah M. Zyarah, Dhireesha Kudithipudi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-17299
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
M2RU: M emristive M inion R ecurrent U nit for On-Chip Continual Learning at the Edge Abdullah M. Zyarah, Dhireesha Kudithipudi Abstract Continual learning on edge platforms remains challenging because recurrent networks depend on energy-intensive training procedures and frequent data movement that are impractical for embedded deployments. This work introduces M2RU, a mixed-signal architecture that implements the minion recurrent unit for efficient temporal processing with on-chip continual learning. The architecture integrates weighted-bit streaming, which enables multi-bit digital inputs to be processed in crossbars without high-resolution conversion, and an experience replay mechanism that stabilizes learning under domain shifts. M2RU achieves 15 GOPS at 48.62 mW, corresponding to 312 GOPS per watt, and maintains accuracy within 5 percent of software baselines on sequential MNIST and CIFAR-10 tasks. Compared with a CMOS digital design, the accelerator provides 29 × \times improvement in energy efficiency. Device-aware analysis shows an expected operational lifetime of 12.2 years under continual learning workloads. These results establish M2RU as a scalable and energy-efficient platform for real-time adaptation in edge-level temporal intelligence. I Introduction Continual learning is a fundamental requirement for systems that operate in dynamic and real-world environments. Unlike ML training paradigms that assume static data distributions and repeated offline retraining, continual learning models should adapt as new information becomes available while preserving prior knowledge [ 1 ] . This ability seems to be essential for several edge applications, such as sensing, autonomous driving, that handle streaming data under tight energy and latency constraints [ 2 ] . However, several of the existing models still rely on centralized training pipelines that require substantial computation and data movement, which limits their application to edge deployments. On the other hand, recurrent neural networks (RNNs) naturally model temporal and sequential structure, yet their integration into continual learning frameworks remains limited. Previous studies have explored only a narrow set of hardware architectures, including continual variants of echo state networks [ 3 , 4 ] , LSTMs [ 5 ] , and GRUs [ 6 ] . However, these efforts focus almost exclusively on algorithmic techniques and provide little support for continual adaptation at the hardware level. In practice, most systems still follow a train-then-deploy paradigm in which training is performed on centralized servers, while inference is executed on edge devices with severe constraints on compute, memory, and energy. This rigid separation prevents models from adapting to evolving data distributions and leads to deterioration of performance over time, raising reliability concerns in dynamic real world settings [ 7 ] . Recent efforts have introduced memristor-based neuromorphic implementations to alleviate these issues by integrating non-volatile memory and computation. Early research focused primarily on memristive LSTM architectures. For example, Dou et al. proposed a memristor-based LSTM network for text classification from the IMDB dataset. The network used a 1T1R crossbar architecture to reduce slip path currents and was trained ex-situ [ 8 ] . Building on this direction, subsequent work explored modifications to gate structures to reduce complexity. Xiangrong et al. proposed a hybrid memristor-based GRU, which fuses the update and reset gates as originally suggested by [ 9 ] to enhance computational speed and reduce storage requirements [ 10 ] . The design is validated with the MNIST and IMDB datasets. While these approaches demonstrate the feasibility of mapping gated RNNs to memristive architectures, they remain dependent on ex-situ training and are limited to static tasks. To overcome this limitation, Liu et al. introduced a memristor-based implementation of LSTM capable of performing in-situ using backpropagation, validated in sentiment and digit classification using MNIST and IMDB datasets [ 11 ] . Zhang et al. introduced a memristor-based GRU network to recognize hand-written characters from the CASIA dataset. The authors used separated memristors within each GRU cell to emulate synaptic weights rather than integrating them into a crossbar structure, leading to an inevitable increase in the utilized resources. More recently, Zyarah et al. introduced a memristive reservoir system for time-series forecasting and sequence learning, which offers in-situ training and robustness to device failure when evaluated against univariate benchmarks [ 12 ] . Despite these advances, there are no existing memristor-based gated RNN that supports on-chip continual learning, with mechanisms that safeguard previously acquired knowledge while processing new temporal data. To address this gap, this work presents M2RU, a memristor-based mixed-signal implementation of the Minion Recurrent Unit (MiRU), designed for efficient and adaptive temporal learning directly on-chip. The contributions of this work are as follows: • A mixed signal architecture of the Minion Recurrent Unit, providing a compact alternative to GRU based temporal processing with reduced gate complexity and lower storage requirements, with \approx 5 percent accuracy degradation, and an estimated operational lifetime of 12.2 years. • A weighted bit streaming method for crossbar computation, which assigns bit significance using memristor based ratio scaling and eliminates the need for high resolution ADCs/DACs during multi-bit input presentation. • An on-chip continual learning framework based on direct feedback alignment, enabling efficient weight updates without backward locking or storage of intermediate states, and supporting temporal adaptation under domain incremental scenarios. • A hardware integrated experience replay mechanism , including a reservoir sampler and stochastic quantizer optimized for nonstationary data streams with minimal memory footprint. The rest of the paper is organized as follows: Section II discusses the basics of continual learning, MiRU network architecture, and training. Section III presents the system design and implementation of the MiRU RNN. The design methodology is introduced in Section IV. Sections V and VI, respectively, discuss the results and conclude the paper. II Background II-A Continual Learning Continual learning refers to the ability of the system to continuously acquire new knowledge from non-stationary data without experiencing catastrophic forgetting. Catastrophic forgetting usually occurs due to the lack of balance between the stability and plasticity aspects, where plasticity indicates the network’s ability to learn novel information, and stability reflects its ability to retain previously learned knowledge [ 13 ] . Broadly, continual learning can be evaluated in task-incremental, domain-incremental, and class-incremental learning scenarios. In this work, we emphasize the domain-incremental learning scenario, in which the system is expected to learn multiple tasks without providing their identity and incorporating explicit boundaries [ 14 ] . There are various approaches that have been proposed in the literature to enable continual learning without experiencing catastrophic forgetting. These approaches can be classified into: regularization-based method, dynamic architecture, and complementary memory system (also known as replay or rehearsal) [ 15 ] . The regularization-based methods alleviate catastrophic forgetting through imposing constraints on the synaptic weight updates according to the task being learned, specifically identifying the critical synapses to the learned tasks and making it more rigid to future updates. This method is known to be computationally and memory efficient, but it is less effective compared to other methods [ 16 ] . Examples include Elastic Weight Consolidation (EWC) [ 17 ] , Synaptic Intelligence (SI) [ 18 ] , and Learning without Forgetting (LwF) [ 19 ] . In dynamic architecture, the network dynamically changes its architecture via adding or removing neurons and synaptic pathways to accommodate new knowledge [ 20 ] . Despite its promising performance, the dynamic architectures demand a reconfigurability feature and high computational cost. The complementary memory-based method