Covariance-Aware Goodness for Scalable Forward-Forward Learning
Xiaoyi Jiang, Bashir M. Al-Hashimi, Kai Xu · 2026
Read Covariance-Aware Goodness for Scalable Forward-Forward Learning by Xiaoyi Jiang, Bashir M. Al-Hashimi, Kai Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04346.txt.
Description
Xiaoyi Jiang, Bashir M. Al-Hashimi, and Kai Xu improve the Forward-Forward method, a way to train neural networks layer by layer without sending gradients through the whole network. In image tasks the method lags far behind standard training, especially on harder benchmarks.
They trace the gap to how each layer scores its own activity: a simple sum of squares throws away links between features. Their fix adds structured second-order information across channels and across scales, plus a light module that combines predictions from all layers with weight on deeper ones. The approach aims to close much of the accuracy gap while keeping training cheap.
Catalog record
| CREATOR | Xiaoyi Jiang, Bashir M. Al-Hashimi, Kai Xu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.04346