DMPCN: Dynamic Modulated Predictive Coding Network with Hybrid Feedback Representations
A S M Sharifuzzaman Sagar, Yu Chen, Jun Hoong Chan · 2025
Read DMPCN: Dynamic Modulated Predictive Coding Network with Hybrid Feedback Representations by A S M Sharifuzzaman Sagar, Yu Chen, Jun Hoong Chan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-14665.txt.
Introduction
Predictive coding networks mimic how the brain is thought to learn from errors. A model predicts its input, compares, and updates. Sharifuzzaman Sagar, Yu Chen, and Jun Hoong Chan find the usual error feedback too rigid. Local updates miss the big picture, while global ones blur detail. Their network, DMPCN, mixes both kinds of feedback. A dynamic modulation adjusts the mix to the input's complexity. A tailored loss function sharpens the training signal.
On four image benchmarks, including CIFAR-10 and MNIST, the model converged faster than rivals. It also reached higher accuracy. The authors present hybrid feedback as a general fix for predictive coding designs.
Catalog record
| CREATOR | A S M Sharifuzzaman Sagar, Yu Chen, Jun Hoong Chan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-14665
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DMPCN: Dynamic Modulated Predictive Coding Network with Hybrid Feedback Representations A S M Sharifuzzaman Sagar, Yu Chen, Jun Hoong Chan Abstract Traditional predictive coding networks, inspired by theories of brain function, consistently achieve promising results across various domains, extending their influence into the field of computer vision. However, the performance of the predictive coding networks is limited by their error feedback mechanism, which traditionally employs either local or global recurrent updates, leading to suboptimal performance in processing both local and broader details simultaneously. In addition, traditional predictive coding networks face difficulties in dynamically adjusting to the complexity and context of varying input data, which is crucial for achieving high levels of performance in diverse scenarios. Furthermore, there is a gap in the development and application of specific loss functions that could more effectively guide the model towards optimal performance. To deal with these issues, this paper introduces a hybrid prediction error feedback mechanism with dynamic modulation for deep predictive coding networks by effectively combining global contexts and local details while adjusting feedback based on input complexity. Additionally, we present a loss function tailored to this framework to improve accuracy by focusing on precise prediction error minimization. Experimental results demonstrate the superiority of our model over other approaches, showcasing faster convergence and higher predictive accuracy in CIFAR-10, CIFAR-100, MNIST, and FashionMNIST datasets. I Introduction Predictive coding network [ 16 ] is a computational model utilizing feedback mechanisms to generate predictions about sensory input, facilitating efficient processing of information in the brain. It is inspired by the predictive coding theory [ 16 ] , which suggests that the brain predicts sensory inputs through hierarchical generative models and emerges as an alternative approach that aligns closely with biological mechanisms of human learning and perception. Unlike traditional convolutional networks [ 2 ] that rely on backpropagation, predictive coding networks employ a biologically plausible mechanism that iteratively adjusts based on prediction errors at each layer, potentially offering more efficient computation and a closer alignment with natural neural processes. This achieves a very useful potential computational efficiency, reducing reliance on extensive data and computations as compared to typical convolutional networks. The prediction error feedback mechanism in conventional predictive coding networks either focus on local feature [ 6 ] or global feature information processing [ 23 ] , which limits the performance of the predictive coding networks. Moreover, they often exhibit limited contextual adaptability, failing to dynamically tailor processing strategies to the variations of inputs, which can hinder performance in diverse and dynamic visual environments. These limitations highlight the need for variants of predictive coding network models that can effectively navigate the complexities of image recognition by enhancing detail discernment and contextual responsiveness. Recent advancements in PCNs for image recognition have predominantly focused on leveraging global recurrent update mechanisms to improve model performance, even with a reduced layer count [ 23 ] . Concurrently, alternative strategies emphasize the utilization of local recurrent updates as a means to refine model efficacy. There is a notable gap in the existing literature in introducing a unified framework that integrates both global and local recurrent mechanisms for image recognition. Moreover, there is a noticeable oversight in the adaptability of these models, with a lack of context-aware dynamic modulation to tailor the network processing in response to specific input characteristics. Additionally, conventional approaches by applying standard loss functions neglect the potential benefits of employing loss functions specifically designed for predictive coding networks, which could further optimize image recognition performance. This highlights the need for a more integrated and contextually adaptive model guided by specifically tailored loss functions. In this paper, we propose DMPCN, a D ynamic M odulated P redictive C oding N etwork with hybrid feedback representation by combining both global and local recurrent update to capture broad contextual information with fine-grained pixel details of the input images. DMPCN enables the network to adapt its processing based on the contextual information present within the input images, thereby enhancing the flexibility of the model and responsiveness to varied input images. Furthermore, we propose a loss function explicitly for predictive coding networks to optimize the performance of the network by more effectively leveraging the unique characteristics of predictive coding, focusing on minimizing prediction errors in a manner that directly correlates with improved image recognition accuracy. In summary, DMPCN not only addresses the limitations of traditional predictive coding network architectures but also shows the capability of the model in image recognition with smaller layers via the following contribution: • we propose a hybrid prediction error mechanism that combines local and global feedback within the network architecture; • we introduce a dynamic modulation mechanism with easy adaptation of the input data; • we design a predictive consistency loss function tailored for the hybrid predictive coding network. The experimental results indicate that our proposed DMPCN achieves superior performance compared to other object recognition approaches. II Related Work This section mainly discusses predictive coding and recurrent processing approaches in predictive coding networks, such as local and global updates. II-A Predictive Coding Predictive Coding is an important concept in understanding the information-processing mechanisms of the human brain [ 14 ] . The fundamental of predictive coding lies in the ability of the brain to learn how to reduce the prediction errors across neurons by utilizing an internal generative model to anticipate incoming stimuli [ 5 ] . This framework not only approximates but, under certain conditions, can also mirror the weight update dynamics of backpropagation in layered networks [ 24 ] , and is further generalized across different models [ 13 ] . Notably, the weight update of backpropagation can be replicated by predictive coding precisely with the integration of external controls [ 20 ] , encompassing the flexibility of predictive coding in modalities during training and testing phases, its intricate mathematical underpinnings, and its formulation as an energy-based model [ 19 , 12 , 1 ] . The research scope of predictive coding extends to potentially unifying brain function theory, providing a comprehensive framework for understanding perception, learning, and cognitive neural substrates. II-B Local Recurrent Processing Local Recurrent Processing is pivotal in the object recognition capabilities of the brain, with studies emphasizing both feedforward mechanisms for rapid recognition [ 3 ] and feedback connections for top-down predictions [ 17 ] . The feedback signals operate between hierarchically adjacent areas and are essential for disambiguating visual inputs, especially under ambiguous conditions, enhancing object recognition through local recurrent processing [ 15 ] . Furthermore, the integration of top-down attention and bottom-up sensory information through global and local processing is crucial for efficient recognition, facilitated by feedback processes that coordinate information across the brain [ 22 , 8 ] . Advanced neuroimaging techniques have shed light on these dynamic interactions and the critical role of feedback in modulating neural activity for recognition [ 21 ] . These findings highlight the need for ongoing research to understand the intricate neural mechanisms behind object recognition with local recurrent processing. II-C Global Recurrent Processing. The introduction of a predictive coding network incorporating global recurrent processing, as outlined in [ 23 ] , signifies a significant advancement. This model seamlessly integrates feedforward and feedback computations throughout its architecture, facilitating comprehensive information integration via recurrent