Towards Scaling Deep Neural Networks with Predictive Coding: Theory and Practice
Francesco Innocenti · 2025
Read Towards Scaling Deep Neural Networks with Predictive Coding: Theory and Practice by Francesco Innocenti (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-23323.txt.
Introduction
Francesco Innocenti wrote a thesis on scaling deep neural networks with predictive coding, a brain-inspired alternative to backpropagation. That standard method trains modern AI but is energy hungry and unlikely to be how brains learn. Predictive coding networks instead settle neuron activity by repeated balancing before any weight update.
The thesis develops theory and practice for that repeated inference, which recent work suggests brings gains over the standard method. Scaling predictive coding could yield efficient learning machines closer to biology. He examines where the method stands and what it needs to reach large networks.
Catalog record
| CREATOR | Francesco Innocenti |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 265 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-23323