Expressivity of congruence-based architectures for DNNs on positive-definite matrices
Antonin Oswald, Estelle Massart · 2026
Read Expressivity of congruence-based architectures for DNNs on positive-definite matrices by Antonin Oswald, Estelle Massart (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02490.txt.
Description
Oswald and Massart study neural networks that classify positive-definite matrices. Such matrices appear in imaging and signal data. A key layer type multiplies the input on both sides. The matrix is hit by a weight matrix and its transpose. This congruence-like layer sits at the core of SPDNet. A common rule forces the weight matrix to be semi-orthogonal.
The authors show that this rule limits what the network can express. For some activation functions, the whole design collapses. It equals a network with one hidden layer. The cause is a loss of spectral diversity in the layers. That loss follows from Poincaré's separation theorem. The team also compares final classifiers. Several Riemannian classifiers are weighed against the feature maps. Their fit with congruence layers is discussed in depth.
Catalog record
| CREATOR | Antonin Oswald, Estelle Massart |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.02490