RECAP: Local Hebbian Prototype Learning as a Self-Organizing Readout for Reservoir Dynamics

Heng Zhang · 2026

Read RECAP: Local Hebbian Prototype Learning as a Self-Organizing Readout for Reservoir Dynamics by Heng Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-06639.txt.

Introduction

Zhang brings RECAP, a strategy for robust image classification coupling raw reservoir dynamics to a self-ordering Hebbian prototype readout; the name expands to Reservoir Computing with Hebbian Co-Firing Prototypes. The method bins tank responses into activation levels, builds a mask over tank unit pairs catching co-firing, and updates class-wise template matrices through a Hebbian-like growth-decay rule. Inference proceeds by overlap-based template matching, skipping error backpropagation and suiting template updates. On MNIST-C, RECAP remains robust under damage without exposure to training samples.

Catalog record

CREATORHeng Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32465
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.06639

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RECAP: Local Hebbian Prototype Learning as a Self-Organizing Readout for Reservoir Dynamics Heng Zhang Abstract Robust perception in brains is often attributed to high-dimensional population activity together with local plasticity mechanisms that reinforce recurring structure. In contrast, most modern image recognition systems are trained by error backpropagation and end-to-end gradient optimization, which are not naturally aligned with local computation and local plasticity. We introduce RECAP ( R eservoir Computing with H E bbian C o- A ctivation P roto-types), a bio-inspired learning strategy for robust image classification that couples untrained reservoir dynamics with a self-organizing Hebbian prototype readout. RECAP discretizes time-averaged reservoir responses into activation levels, constructs a co-activation mask over reservoir unit pairs, and incrementally updates class-wise prototype matrices via a Hebbian-like potentiation–decay rule. Inference is performed by overlap-based prototype matching. The method avoids error backpropagation and is naturally compatible with online prototype updates. We illustrate the resulting robustness behavior on MNIST-C, where RECAP remains resilience under diverse corruptions without exposure to corrupted training samples. Highlights • Backpropagation-free readout learning: RECAP updates class-wise prototypes via local Hebbian potentiation–decay (no gradient descent). • Robustness under common corruptions: clean-only training substantially reduced relative mean corruption errors on MNIST-C. • Self-organizing and online-updatable: discretized co-activation structure produces compact binary templates that can be updated incrementally. Keywords Bio-inspired learning; self-organization; Hebbian plasticity; robustness; reservoir computing 1 Introduction Biological perception is remarkably robust: humans recognize objects under diverse degradations without explicit training on every possible distortion. This reliability is often attributed to population-level neural representations and local plasticity mechanisms that consolidate stable structure from repeated experience [ 8 , 4 ] . These observations motivate a long-standing goal in neuro-inspired computation: build learning systems whose robustness emerges from dynamics and self-organization , rather than from exhaustive optimization or exposure to every possible perturbation. Modern machine vision frequently exhibits the opposite behavior. Deep networks excelling on clean benchmarks can be fragile under realistic distribution shifts, including non-adversarial corruptions produced by sensors or environments [ 9 ] . While adversarial perturbations have been studied extensively [ 6 ] , a practically important failure mode is degradation under common corruptions such as noise, blur, weather artifacts, and digital distortions. Moreover, standard remedies typically involve augmentation or specialized training objectives, increasing computational cost and tying robustness to assumed perturbation models. In addition, the dominant training mechanism in modern deep learning, error backpropagation, relies on non-local credit assignment and assumptions (e.g., precise feedback/weight transport) that are difficult to reconcile with known biological circuitry. This has motivated learning frameworks that emphasize local computation and local plasticity as minimal plausibility criteria [ 18 , 3 ] . Reservoir computing (RC) offers a neuro-inspired alternative [ 13 , 21 , 37 ] . In RC, an untrained recurrent network generates rich high-dimensional dynamics, confining learning to the readout layer. This framework has shown promise in settings where robustness to noise is desirable [ 14 , 16 ] . However, standard linear readouts (e.g., ridge regression) can still be brittle when the representation is not linearly separable or when corruptions distort the feature geometry. We propose RECAP ( R eservoir Computing with H E bbian C o- A ctivation P rototypes) 1 1 1 Pronounced “re-cap.” , a self-organizing readout designed for robustness to common corruptions without training on corrupted samples. Given an input image, the reservoir produces a temporal response that we time-average into a stable activity vector. This vector is discretized into a small number of activation levels, yielding a co-activation mask encoding which reservoir units share the same discrete state. For each class, RECAP learns a sparse binary prototype updated by a simple potentiation-and-decay rule inspired by Hebbian plasticity [ 8 ] , where backpropagation and end-to-end gradient-based optimization are not required. At inference, classification reduces to template matching: the predicted label corresponds to the prototype with highest overlap. Because the prototype updates are incremental, the readout can in principle be updated online as new data arrive, suggesting a potential bridge to adaptive and continual learning settings. Figure 1 provides a graphical overview of RECAP, showing how untrained reservoir dynamics are converted into co-activation masks and then matched against class-wise prototypes for inference. We evaluate RECAP on MNIST-C , adapting ImageNet-C corruption types to MNIST [ 9 ] . Across 15 corruption types at five severity levels, RECAP achieves relative mCE of 34.1% , compared with 52.1% for MLP, 55.0% for ESN-Ridge (ablation), and near-baseline performance for ResNet-18 and AlexNet—despite never observing corrupted images during training. This gain involves a tradeoff in clean accuracy, which we discuss explicitly: our goal is not to outperform optimized deep architectures on clean data, but to demonstrate that a biologically inspired, self-organizing readout can provide strong corruption robustness under constrained training. 1.1 Contributions • We introduce RECAP , a bio-inspired learning strategy that combines untrained reservoir dynamics with a Hebbian co-activation prototype readout trained without error backpropagation or gradient descent. • We show that RECAP yields strong robustness to common corruptions on MNIST-C without training on corrupted data , highlighting the importance of the readout learning rule for generalization. • We discuss how the local, incremental prototype updates make RECAP naturally compatible with online adaptation. Figure 1: RECAP for robust image classification. An input image drives an untrained echo-state reservoir, producing temporal population activity that is time-averaged and discretized into activation levels. The discretized population code is converted into a binary co-activation mask, which updates a class-wise continuous prototype state via a Hebbian-like potentiation–decay rule. After thresholding, inference is performed by matching the test mask against all class prototypes and selecting the highest-overlap class. 2 Related Work 2.1 Robustness Under Common Corruptions Strong clean-data performance does not guarantee reliable behavior under realistic perturbations. Beyond adversarial examples crafted to induce errors [ 6 , 22 ] , vision systems must handle natural corruptions . Recently, Hendrycks and Dietterich introduced standardized benchmarks (e.g., ImageNet-C) with metrics including mean Corruption Error (mCE) to quantify how performance degrades with corruption severity [ 9 ] . In this work, we adapt this benchmark to the MNIST test set, producing MNIST-C (see Figure 2 ). The gap between benchmark accuracy and real-world reliability extends beyond explicit corruptions. Subtle image transformations substantially impact convolutional networks [ 2 ] , and evaluation on newly collected test sets reveals non-trivial generalization gaps [ 26 ] . Moreover, robustness and accuracy objectives often exhibit tension [ 34 ] , suggesting that robustness may require different training signals, model biases, or representational strategies. Finally, robustness claims benefit from careful evaluation protocols, as defenses can exploit weaknesses in testing procedures [ 1 , 35 ] . Figure 2: Corrupted examples of the MNIST-C dataset used in the experiments. The method consists of 15 types of algorithmically generated corruptions from noise ( top-left ), blur ( bottom-left ), weather ( top-right ), and digital categories ( bottom-right ). Each type has 5 levels of severity (i.e., 75 distinct corruptions). 2.2 Reservoir Computing Reservoir computing (RC) offers a neuro-inspired framework in which a fixed, randomly connected recurrent network transforms inputs into high-dimensional dynamical states, with learning restricted to a simple readout. Echo State Networks (ESNs) [ 13 ] and Liquid State Machines (LSMs) [ 21 ] are foundational

Read the complete text