Efficient Online Learning with Predictive Coding Networks: Exploiting Temporal Correlations
Darius Masoum Zadeh-Jousdani, Elvin Hajizada, Eyke Hüllermeier[0.8em] Institute for Informatics, University of Munich (LMU), Munich, Germany, [0.5em] These authors contributed equally to this work. · 2025
Read Efficient Online Learning with Predictive Coding Networks: Exploiting Temporal Correlations by Darius Masoum Zadeh-Jousdani, Elvin Hajizada, Eyke Hüllermeier[0.8em] Institute for Informatics, University of Munich (LMU), Munich, Germany, [0.5em] These authors contributed equally to this work. (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-25993.txt.
Introduction
Darius Masoum Zadeh-Jousdani, Elvin Hajizada, and Eyke Hullermeier make predictive coding networks train faster by reusing state across time steps. Predictive coding is a biologically inspired learning framework where each layer predicts the next and learns from local errors, without global backpropagation. It suits low power edge robots, but its repeated inference steps during training are costly.
Their network, PCN-TA, keeps latent states from one frame to the next and exploits the fact that streaming sensor data change slowly. On a robotic perception data set, the method used ten percent fewer weight updates than backpropagation and half the inference steps of a baseline predictive coding network. The savings cut compute cost while keeping learning performance in their tests.
Catalog record
| CREATOR | Darius Masoum Zadeh-Jousdani, Elvin Hajizada, Eyke Hüllermeier[0.8em] Institute for Informatics, University of Munich (LMU), Munich, Germany, [0.5em] These authors contributed equally to this work. |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-25993
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Efficient Online Learning with Predictive Coding Networks: Exploiting Temporal Correlations Thanks: Accepted at EdgeAI4R Workshop, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2025 Darius Masoum Zadeh-Jousdani, Elvin Hajizada, Eyke Hüllermeier[0.8em] Institute for Informatics, University of Munich (LMU), Munich, Germany, [0.5em] These authors contributed equally to this work. Abstract Robotic systems operating at the edge require efficient online learning algorithms that can continuously adapt to changing environments while processing streaming sensory data. Traditional backpropagation, while effective, conflicts with biological plausibility principles and may be suboptimal for continuous adaptation scenarios. The Predictive Coding (PC) framework offers a biologically plausible alternative with local, Hebbian-like update rules, making it suitable for neuromorphic hardware implementation. However, PC’s main limitation is its computational overhead due to multiple inference iterations during training. We present Predictive Coding Network with Temporal Amortization (PCN-TA), which preserves latent states across temporal frames. By leveraging temporal correlations, PCN-TA significantly reduces computational demands while maintaining learning performance. Our experiments on the COIL-20 robotic perception dataset demonstrate that PCN-TA achieves 10% fewer weight updates compared to backpropagation and requires 50% fewer inference steps than baseline PC networks. These efficiency gains directly translate to reduced computational overhead for moving another step toward edge deployment and real-time adaptation support in resource-constrained robotic systems. The biologically-inspired nature of our approach also makes it a promising candidate for future neuromorphic hardware implementations, enabling efficient online learning at the edge. I INTRODUCTION Backpropagation is a widely used and highly efficient learning algorithm. However, the prevailing consensus today is that the brain is unlikely to implement backpropagation in its exact form [ 3 ] . Most theories of learning in the brain postulate that learning occurs purely locally between neurons, without requiring distant error signals. This type of learning algorithm is also known as Hebbian plasticity, often summarized by the famous phrase: "Cells that fire together wire together" [ 2 ] . Hence, reliance on global error information makes backpropagation biologically implausible. To achieve a biologically plausible learning algorithm, we must seek alternatives that adhere to local learning rules. Predictive Coding is a theory of how the brain learns. The fundamental difference between Predictive Coding and backpropagation lies in how they propagate and use error signals in a neural network. Predictive coding theory emphasizes that each neuron interacts only with nearby neurons, typically those in adjacent layers, such as its inputs and outputs [ 7 ] . This stands in contrast to backpropagation, which requires each unit to access information that depends on the entire network structure, as it computes gradients using the chain rule, which requires knowledge of the entire pathway from output to input. A core principle of Predictive Coding is that each layer in a hierarchical neural network generates predictions about the activity of the layer below. learning is guided by the minimization of local prediction errors, calculated as the difference between the actual activity of lower-layer neurons and the top-down predictions. This process follows the principle of learning through error minimization, whereby the network continuously updates its internal representations and synaptic weights to reduce these discrepancies over time. A distinctive feature of Predictive Coding is that, rather than immediately updating weights for each new input, the network first undergoes an inference phase. During this phase, it iteratively adjusts its internal or hidden states in order to minimize prediction error. In essence, the network attempts to ”explain” the current input by refining its internal model, aligning top-down predictions as closely as possible with the actual neuronal activity. This iterative process continues until the prediction errors converge to a minimum, allowing the network to make more informed and plausible updates. Millidge et al. [ 4 ] introduced a practical implementation of the predictive coding theory, which we will hereafter refer to simply as PCN. This framework differs from classical predictive coding theory, as it operates under the fixed-prediction assumption: during the initial feedforward phase, the input propagates through each layer of the network until it reaches the output layer. The activations of neurons are used as a prediction, which remains the same throughout the entire inference phase of the given sample. In the inference phase, based on label, input, and the predictions, each neuron’s internal state is iteratively updated to minimize the local prediction error. Once the number of predefined inference steps are finished, the leftover error are further minimized by a single weight update. Thanks to the fixed-prediction assumption, this PCN approximates backpropagation. However, Millidge et al. argued in [ 6 ] that the main drawback of his PC version lies in its computational cost: unlike Backpropagation, which computes gradients in a single pass, this PC variant requires iterative inference with repeated updates until prediction errors converge, performed independently for each input sample. Nevertheless, in online learning scenarios such as video streams, latent states do not need to be reinitialized from scratch for every frame, since consecutive inputs are temporally correlated. To exploit this property we introduce a Predictive Coding Network with Temporal Amortization (PCN-TA) , a variant of the baseline PCN that maintains latent states across frames, effectively leveraging temporal continuity in sequential data. This design should reduce the number of required inference iterations and the number of weight updates. Before presenting the methodology of our experiments, we first describe the PCN-TA in greater detail, followed by a discussion of our experimental methods and results and concluding with a brief discussion and summary. II Mathematical Formulations of PCN-TA For both the PCN-TA and the PCN, we have an arbitrary computation graph, where we consider \mathcal{G}=\{\mathbb{Y},\mathbb{V},\mathbb{E}\} . Each edge y_{i}\in\mathbb{Y} corresponds to the application of an activation function that computes a vertex v_{i}\in\mathbb{V} . Additionally, we define error units \epsilon_{i}\in\mathbb{E} as the difference between the actual state value v_{i} and the top-down prediction \hat{v}_{i} : \epsilon_{i}=v_{i}-\hat{v}_{i} . In a Predictive Coding network, each hierarchical layer is composed of functional units that include a prediction error neuron \epsilon_{i} and its associated state neuron v_{i} , representing the actual state of the corresponding vertex. In contrast to Backpropagation, which computes the gradient of the global loss, Predictive Coding computes and minimizes the gradient of the variational free energy (VFE) \mathcal{F} . The VFE, an objective from variational inference that renders Bayesian learning tractable, serves as the function that guides updates of the state neurons v_{i} . For a more detailed explanation of the VFE we refer the reader to [ 1 ] and [ 5 ] . In PCN-TA, the initialization for the first frame follows the standard Predictive Coding procedure. Specifically, during the initial feedforward phase, the input is propagated through the network as in ANNs, where the activations are used as predictions \hat{v}_{i} . These predictions are kept same throughout the inference phase for the given sample. This is the fixed-prediction assumption and needed to approximate backpropagation. Additionally initial states ( v_{i} s) of the neurons are also set to the predicted values ( \hat{v}_{i} ). The next steps of the inference phase consists of iterative update of these state values, according to v_{i}^{t+1}=v_{i}^{t}+\eta_{v}\tfrac{\partial\mathcal{F}}{\partial v_{i}^{t}} , with \eta_{v} denoting the inference learning rate, which serves as the step size in the optimization process, and \tfrac{\partial\mathcal{F}}{\partial v_{i}^{t}} representing the gradient of the VFE \mathcal{F} . The