The Geometry of Polynomial Group Convolutional Neural Networks

Yacoub Hendi, Daniel Persson, Magdalena Larfors · 2026

Read The Geometry of Polynomial Group Convolutional Neural Networks by Yacoub Hendi, Daniel Persson, Magdalena Larfors (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29566.txt.

Introduction

Hendi and co-authors study the geometry of polynomial group convolutional neural networks. These networks work for any finite group. Their framework uses graded group algebras to describe the design. Two natural parameter forms appear, based on Hadamard and Kronecker products. A linear map ties the two forms together. They compute the size of the neuromanifold for the network. It depends only on layer count and group size. Both parameter maps turn out to be identifiable, up to symmetry and scaling.

Catalog record

CREATORYacoub Hendi, Daniel Persson, Magdalena Larfors
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79300
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.29566

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Geometry of Polynomial Group Convolutional Neural Networks Yacoub Hendi, Daniel Persson, Magdalena Larfors Abstract We study polynomial group convolutional neural networks (PGCNNs) for an arbitrary finite group G G . In particular, we introduce a new mathematical framework for PGCNNs using the language of graded group algebras. This framework yields two natural parametrizations of the architecture, based on Hadamard and Kronecker products, related by a linear map. We compute the dimension of the associated neuromanifold, verifying that it depends only on the number of layers and the size of the group. We also describe the general fiber of the Kronecker parametrization up to the regular group action and rescaling, and conjecture the analogous description for the Hadamard parametrization. Our conjecture is supported by explicit computations for small groups and shallow networks. 1 Introduction Geometric deep learning [ BBL+17 , BBCV21 , GAC+23 ] is the subfield in deep learning that studies equivariant architectures with respect to a given group G . The main principle of geometric deep learning is that when training over a dataset that has a set of symmetries, we can introduce an informed bias towards equivariant and invariant models by using equivariant architectures such as convolutional layers or graph layers. The benefit of doing this is a reduction of sample complexity; this can be seen since an equivariant architecture has fewer parameters due to weight-sharing, and fewer parameters need fewer training data points to determine their values and, henceforth, smaller sample complexity [ DWZ+18 ] . A classical example of equivariant architectures is convolutional neural networks (CNN), which are equivariant under discrete translations, corresponding to the group G=\mathbb{Z} . A general theory for linear equivariant layers for finite groups and compact groups is presented in [ CW16 , CGW19 ] . The core idea is that enforcing equivariance on linear maps, under given representation, results in weight-sharing constraints which G -convolutional layers have. Hence all linear equivariant layers are convolutional and vice-versa. In [ NCWP25 ] , this approach is extended to non-linear equivariant layers. Apart from designing equivariant models, another direction of geometric deep learning is concerned with understanding the expressivity and training dynamics of such models. In this article we are interested in the latter direction, and to investigate this, we apply tools from the recently emergent field of neuroalgebraic geometry [ MSM+25 ] . The main idea of neuroalgebraic geometry can be briefly understood as follows. Given a fixed neural network architecture \Phi , one obtains a parametric family of functions \Phi_{\theta} indexed by the network parameters \theta . We call the space of all realizable functions the neuromanifold \mathcal{M}_{\Phi} associated with the architecture \Phi . The term “manifold” is a slight misnomer, as these functional spaces usually exhibit singularities. Given a loss function \mathcal{L} and a dataset \mathcal{D} , then learning via stochastic gradient descent can be interpreted as a distance minimization problem over the neuromanifold to an objective function f_{\mathcal{L},\mathcal{D}} in the ambient space, that depends on both the loss function \mathcal{L} and the dataset \mathcal{D} . From this perspective, the geometric properties of the neuromanifold translate into statistical counterparts. For example, dimension and curvature translate into sample complexity and expressivity, fiber classification translates into identifiability, and so on. However, the analysis of these neuromanifolds is often intractable due to their compositional complexity and the use of nonlinear activation functions, which in some cases even fail to be analytic (e.g. the RELU function). One useful simplification is to restrict to polynomial activation functions, which can be justified for three reasons. Firstly, polynomials are universal approximators by Weierstrass Approximation Theorem, which implies that neural networks with non-polynomial activation functions can be approximated by networks with polynomial activation functions. Secondly, the neuromanifold becomes a subspace of the space of homogeneous polynomials of fixed degree and in a fixed number of variables. More precisely, the neuromanifold becomes a semi-algebraic set (i.e. it can be described as a solution set of polynomial equations and inequalities in its finite dimensional ambient space), which can be analyzed using tools from algebraic geometry. Thirdly, even though non-polynomial activations are more used in mainstream uses, neural networks with polynomial activation have performed well in many different applications (e.g healthcare, finance, computer vision, cryptography, theoretical physics) [ DNM+16 , FML+22 , GHL11 , NM18 , YHN+21 , CMB+21 , HTG17 , DLQ22 ] . In this paper, we focus on the study of polynomial group convolutional neural networks (PGCNN) i.e. neural networks with G -convolutional layers and polynomial activation functions. We formalize the construction of PGCNNs using the language of group algebras and describe the neuromanifolds as subspaces of these algebras. The aim of this paper is to generalize the results in [ SMK25 ] which hold for polynomial CNNs to PGCNN for an arbitrary finite group G . Figure 1: PGCNN parametrization maps \varphi and \Phi . Our contribution. 1. We propose a mathematical framework for polynomial group convolutional networks in the language of graded group algebras. See § 2 and § 3 . 2. More importantly, we provide two ways to describe a polynomial activation function of degree r in this language. It can either be described by the Kronecker product or the Hadamard product. Depending on which we choose, we get two different parametrization maps denoted by \varphi and \Phi , respectively. These two maps are related by \Phi=\Lambda\circ\varphi where \Lambda is a linear map; see Figure 1 1 1 The figure is generated by Gemini Pro. 1 . 3. For the polynomial group convolutional architecture of depth L\geq 1 and a polynomial activation function of degree r\geq 2 associated with a finite group G , the neuromanifold \mathcal{M}_{\Phi} and the image \mathcal{M}_{\varphi} of \varphi have the same dimension L(|G|-1)+1 ; see Theorem 4.3 and Theorem 4.1 . Note that the dimension does not depend on the degree r or the particular group structure of G but only on the size of G and the number of layers L . 4. From the previous point, it follows directly that the general fibers of the parametrization maps \Phi and \varphi are finite, up to scaling. Moreover, we give a precise description of the general fiber of \varphi , see Theorem 4.7 , and conjecture that the same description holds for the general fiber of \Phi . 5. Finally, we provide a package PGCNNGeometry 2 2 2 https://github.com/jake997/PGCNNGeometry that uses Sage and Macaulay2 to compute the dimension and the size of the general fiber of \varphi and \Phi for an arbitrary finite group. It is worth highlighting here that the results from [ MM25 , UBDC25 , FRWY25 , Cra25 ] show that the neuromanifolds of polynomial neural networks (PNN) with fixed width have the expected (maximum) dimension. More precisely, for a general element of such a neuromanifold, the tangent space has the expected dimension. Since a PGCNN can be represented as a PNN with fixed width, then one might expect that the dimension of the neuromanifold of PGCNN can be inferred immediately from these results. This is not true because a PGCNN enforces weight-sharing constraints that violate the required generality assumption. In terms of algebraic geometry, the neuromanifold of PGCNN is a specialization of the neuromanifold of PNN

Read the complete text