Covariance-Aware Goodness for Scalable Forward-Forward Learning

Xiaoyi Jiang, Bashir M. Al-Hashimi, Kai Xu · 2026

Read Covariance-Aware Goodness for Scalable Forward-Forward Learning by Xiaoyi Jiang, Bashir M. Al-Hashimi, Kai Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04346.txt.

Description

Xiaoyi Jiang, Bashir M. Al-Hashimi, and Kai Xu improve the Forward-Forward method, a way to train neural networks layer by layer without sending gradients through the whole network. In image tasks the method lags far behind standard training, especially on harder benchmarks.

They trace the gap to how each layer scores its own activity: a simple sum of squares throws away links between features. Their fix adds structured second-order information across channels and across scales, plus a light module that combines predictions from all layers with weight on deeper ones. The approach aims to close much of the accuracy gap while keeping training cheap.

Catalog record

CREATORXiaoyi Jiang, Bashir M. Al-Hashimi, Kai Xu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.04346

Browse the full library · About the Tower of Babel