Towards Scaling Deep Neural Networks with Predictive Coding: Theory and Practice

Francesco Innocenti · 2025

Read Towards Scaling Deep Neural Networks with Predictive Coding: Theory and Practice by Francesco Innocenti (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-23323.txt.

Introduction

Francesco Innocenti wrote a thesis on scaling deep neural networks with predictive coding, a brain-inspired alternative to backpropagation. That standard method trains modern AI but is energy hungry and unlikely to be how brains learn. Predictive coding networks instead settle neuron activity by repeated balancing before any weight update.

The thesis develops theory and practice for that repeated inference, which recent work suggests brings gains over the standard method. Scaling predictive coding could yield efficient learning machines closer to biology. He examines where the method stands and what it needs to reach large networks.

Catalog record

CREATORFrancesco Innocenti
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE265 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-23323

Browse the full library · About the Tower of Babel