bispectrum : Selective G G -Bispectra Made Practical

Johan Mathe Atmo, Inc. San Francisco, CA [email protected] · 2026

Read bispectrum : Selective G G -Bispectra Made Practical by Johan Mathe Atmo, Inc. San Francisco, CA [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-07270.txt.

Introduction

Johan Mathe and three co-authors release a software library that makes a powerful symmetry tool practical for machine learning. Many tasks are unchanged by transformations like rotation or translation, and the bispectrum captures all information about a signal up to those transformations. Its cost and scattered implementations had blocked wider use.

Their PyTorch library implements selective bispectra for seven group actions as differentiable modules that drop into learning pipelines. Selective computation cuts costs sharply for finite groups and for rotations on disks and spheres. Profiling shows near-exact invariance in under a millisecond on graphics hardware, and pooling tests beat alternatives when data are scarce.

Catalog record

CREATORJohan Mathe Atmo, Inc. San Francisco, CA [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.07270

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

bispectrum : Selective G G -Bispectra Made Practical Johan Mathe Atmo, Inc. San Francisco, CA [email protected] Abstract Many machine learning tasks are invariant under the action of a group G G of transformations: signal classification can be invariant under translations, image classification under 2D rotations, and spherical-image classification under 3D rotations. The G G -bispectrum is a principled complete invariant of a signal (retaining all all signal’s information up to the group action) with proven benefits in machine learning and as a pooling layer in deep networks. However, its deployment has been hampered by high computational cost and a patchwork of group-specific implementations. We present bispectrum , an open-source, fully unit-tested PyTorch library that implements selective G G -bispectra for seven different group actions, as differentiable modules that can be directly incorporated into machine learning pipelines and deep learning architectures. For finite groups G G , selectivity reduces the computational cost from O ⁡ ( | G | 2 ) O(|G|^{2}) to O ⁡ ( | G | ) O(|G|) . For planar rotations, we leverage the disk bispectrum. For spherical 3D rotations, we introduce an augmented selective bispectrum at band-limit L L which reduces the cost from O ⁡ ( L 3 ) O(L^{3}) to Θ ⁡ ( L 2 ) \Theta(L^{2}) coefficients. We profile the entire library (for which we implemented various compute optimizations), showing that it delivers near-exact G G -invariance with its selective G G -bispectra computed in sub-millisecond time on GPU (up to commonly used bandlimits). We evaluate the benefits of incorporating G G -bispectra as pooling layers into deep learning architectures on three classical benchmark datasets –comparing against norm pooling, gated pooling, Fourier-ELU pooling, max pooling, and (non-equivariant) data-augmented convolutional baselines. Results show that G G -bispectra consistently outperform alternatives in the low-data, moderate-capacity regime. Code is available at https://github.com/geometric-intelligence/bispectrum/ . 1 Introduction Many machine learning tasks are invariant under the action of a group G of transformations: signal classification can be invariant under translations, image classification under 2D rotations, and spherical-image classification under 3D rotations. Equivariant neural networks ( 9 ; 31 ) enforce invariance by adding an invariant pooling layer to their equivariant feature maps. Existing choices (norm pooling, gate-based pooling, max/sum aggregation ( 31 ) ) are simple but incomplete : they discard information that a complete group-invariant representation would preserve. For instance, norm pooling retains only the power spectrum of the feature map, so two signals that share the same per-frequency magnitudes but differ in their relative phases (and are therefore not related by any group element) are mapped to the same invariant descriptor. The G -bispectrum is a principled alternative ( 15 ; 19 ; 28 ; 24 ; 25 ) . The G -bispectrum is a complex-valued descriptor of a signal that is invariant under the action of a group G . It has three properties that make it particularly suited to learning on structured data: (i) completeness — it preserves all signal information up to the group action; (ii) inversion — the signal can be recovered from the invariant up to a group action; and (iii) selectivity — a small subset of the G -bispectrum’s entries suffices for completeness on generic signals, a fact first observed for translations by 15 and recently extended to finite groups and the disk ( 24 ; 25 ) . Existing constructions of G -bispectra are scattered across theoretical papers and group-specific implementations. The selective G -bispectrum of 24 covers signals defined over finite groups. The selective disk bispectrum from 25 proposes a bispectrum for 2D images defined over the disk, with invariance with respect to planar rotations. The spherical bispectrum of 19 provides a representation of spherical images that is invariant to 3D rotations; however, neither an implementation nor an empirical evaluation within machine learning pipelines has been reported to date. The classical translation bispectrum ( 15 ) is well-known in signal processing but likewise lacks an open, GPU-ready implementation. 28 provides a bispectral neural network implementation for cyclic groups, but it does not extend to continuous groups or general finite groups. The absence of a unified, efficient, and differentiable implementation across group actions has limited the bispectrum’s adoption as a practical building block in modern deep learning pipelines. Contributions. We present, profile, and evaluate bispectrum , an open-source, fully unit-tested PyTorch library that implements selective G -bispectra as differentiable modules that can be directly incorporated into machine learning pipelines and deep learning architectures. Our contributions are: 1. Software: Pytorch Library. We implement selective G -bispectra for seven group actions as drop-in differentiable modules with a uniform API unlocking practical deployment across machine learning and deep learning pipelines. We provide an efficient implementation with sub-millisecond GPU forward passes and a fully unit-tested codebase (96 % line coverage). 2. Theory: Selective Bispectrum for Spherical Rotations We introduce the first selective bispectrum for 3D rotations acting on spherical images, at bandlimit L , reducing the cost from O(L^{3}) to O(L^{2}) and empirically demonstrate its completeness when augmented with a few power coefficients. 3. Experiments: Unified Evaluation. We evaluate bispectral pooling on three classification tasks spanning planar, volumetric, and spherical domains, each equipped with a different symmetry group. We compare against norm pooling, gated pooling, Fourier-ELU pooling, max pooling, and data-augmented convolutional baselines. Bispectral pooling delivers near-exact G -invariance and a consistent data-efficiency advantage over incomplete alternatives in the low-data, moderate-capacity regime, converging to them at high capacity. Together, these contributions close the gap between the theoretical appeal of G -bispectra and their practical use in modern machine learning and deep learning pipelines. 2 Mathematical Background We introduce the main mathematical concepts used to define G -bispectra. Given a group G , a representation \rho assigns each g\in G a unitary matrix \rho(g) with \rho(gh)=\rho(g)\rho(h) ; an irreducible representation ( irrep ) has no nontrivial invariant subspace, and the dual \hat{G} is the set of equivalence classes of irreps. A G -action on a domain X , (g,x)\mapsto g\cdot x , induces an action on signals (f\circ g)(x):=f(g\cdot x) ; two signals are in the same orbit if and only if they are related by some g\in G , and an invariant is a function constant on each orbit. A neural network layer \Phi is G -equivariant if \Phi(\pi_{\mathrm{in}}(g)\,f)=\pi_{\mathrm{out}}(g)\,\Phi(f) for all g\in G ( 9 ; 31 ) . Stacking equivariant layers preserves equivariance, but any task requiring a prediction independent of the group action must eventually map equivariant features to invariant ones. Bispectrum on finite groups. The G -bispectrum ( 18 ; 24 ) provides a complete invariant pooling mechanism for signals on finite groups. Given a signal \Theta:G\to\mathbb{R} on a finite group G with unitary irreps \{\rho_{i}\}_{i\in\hat{G}} , the G -Fourier transform ( 10 ) is \mathcal{F}(\Theta)_{\rho_{i}}:=\sum_{g\in G}\Theta(g)\,\rho_{i}(g)^{\dagger}\;\in\;\mathbb{C}^{d_{i}\times d_{i}}, (1) where d_{i}=\dim(\rho_{i}) . The full G -bispectrum is \beta(\Theta)_{\rho_{1},\rho_{2}}=\bigl[\mathcal{F}(\Theta)_{\rho_{1}}\otimes\mathcal{F}(\Theta)_{\rho_{2}}\bigr]\,C_{\rho_{1},\rho_{2}}\,\Bigl[\bigoplus_{\rho\in\rho_{1}\otimes\rho_{2}}\mathcal{F}(\Theta)_{\rho}^{\dagger}\Bigr]\,C_{\rho_{1},\rho_{2}}^{\dagger}, (2) where C_{\rho_{1},\rho_{2}} is the unitary Clebsch–Gordan matrix that block-diagonalizes the tensor product \rho_{1}\otimes\rho_{2} into irreducible summands. Each matrix \beta(\Theta)_{\rho_{1},\rho_{2}} is G -invariant, and the full collection \{\beta(\Theta)_{\rho_{1},\rho_{2}}\}_{(\rho_{1},\rho_{2})\in\hat{G}^{2}} is a complete G -invariant for generic signals (i.e. those with nonsingular Fourier coefficients) ( 18 ) . The full bispectrum has O(|G|^{2}) scalar entries. 24 shows that a breadth-first search over the Kronecker product

Read the complete text