Group Downsampling with Equivariant Anti-aliasing
Md Ashiqur Rahman, Raymond A. Yeh · 2025
Read Group Downsampling with Equivariant Anti-aliasing by Md Ashiqur Rahman, Raymond A. Yeh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17258.txt.
Introduction
Md Ashiqur Rahman and Raymond Yeh generalize a core image-network step in a 2025 paper. Downsampling shrinks feature maps to widen a network's view and cut computing cost. Networks that respect symmetry, such as rotation, need a version of this step that works on general groups, not just grids, and that blurs before shrinking to avoid artifacts.
They give a method to choose a fitting subgroup for any group and shrink rate, plus a band-limit rule for the anti-aliasing blur. On plain cycles their method matches the classic filter-then-shrink recipe. Tests on image tasks show better accuracy, better kept symmetry, and smaller models when the new step is built in.
Catalog record
| CREATOR | Md Ashiqur Rahman, Raymond A. Yeh |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 84 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-17258
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Group Downsampling with Equivariant Anti-aliasing Md Ashiqur Rahman, Raymond A. Yeh Abstract Downsampling layers are crucial building blocks in CNN architectures, which help to increase the receptive field for learning high-level features and reduce the amount of memory/computation in the model. In this work, we study the generalization of the uniform downsampling layer for group equivariant architectures, e.g., G G -CNNs. That is, we aim to downsample signals (feature maps) on general finite groups with anti-aliasing. This involves the following: (a) Given a finite group and a downsampling rate, we present an algorithm to form a suitable choice of subgroup. (b) Given a group and a subgroup, we study the notion of bandlimited-ness and propose how to perform anti-aliasing. Notably, our method generalizes the notion of downsampling based on classical sampling theory. When the signal is on a cyclic group, i.e . , periodic, our method recovers the standard downsampling of an ideal low-pass filter followed by a subsampling operation. Finally, we conducted experiments on image classification tasks demonstrating that the proposed downsampling operation improves accuracy, better preserves equivariance, and reduces model size when incorporated into G G -equivariant networks. 1 Introduction Computer vision models, e.g . , ConvNets or ViTs, consist of striding and pooling layers used for downsampling a feature map ( He et al., 2016 ; Liu et al., 2022 ; Dosovitskiy et al., 2021 ; Liu et al., 2021b ; Wu et al., 2021 ; Yang et al., 2024 ) . These subsampling layers play a crucial role in learning the spatial hierarchy of features, building in translation invariance, and reduction in computation ( Zhang et al., 2023 ) . Concepts from signal processing ( Vetterli et al., 2014 ) , e.g . , bandlimited-ness and anti-aliasing, have also been introduced to design better downsampling (anti-aliasing followed by subsampling) operations ( Zhang, 2019 ; Zou et al., 2020 ; Vasconcelos et al., 2021 ) . Given additional prior knowledge, group equivariant ConvNets and Transformers have been proposed to incorporate additional structure into the models ( Cohen & Welling, 2016 ; Tai et al., 2019 ; Romero & Cordonnier, 2021 ; Rojas-Gomez et al., 2022 ; Rojas-Gomez et al., 2024 ; Xu et al., 2023 ) . These models have guarantees that the output is transformed predictably when the input is transformed. A canonical example is shift-equivariance in image segmentation, where the output mask is shifted accordingly when the input image is shifted. Interestingly, subsampling layers are not as common in group equivariant architectures. Most models only subsample over the translation group. One limitation is that existing subsampling layers ( Cohen & Welling, 2016 ; Xu et al., 2021 ) over groups require knowing the subgroup to downsample to. That is, there is no notion of “subsampled by a factor of two”. From a practitioner’s point of view, it is often unclear how to choose such a subgroup (see Appendix § A1.4 for an example). Furthermore, these subsampling layers are not designed with proper anti-aliasing, which hurts the equivariance guarantees ( Gruver et al., 2023 ) . In this work, we propose a generalization of uniform downsampling of signals (features maps) on general finite groups with anti-aliasing. We present an algorithm to form a suitable choice of subgroup given a finite group and an integer downsampling factor. Next, we define the sampling theorem and bandlimited-ness for subgroup subsampling of signals on groups. To ensure the signal is bandlimited, we propose an anti-aliasing operation following the introduced bandlimited definition while maintaining equivariance. We point out that our proposed algorithm and definitions intuitively generalize the notion of downsampling based on classical sampling theory. Beyond the theoretical aspects, we conduct experiments to test the proposed downsampling operation. First, we numerically validate the proposed claims. Second, we conduct experiments on the MNIST and CIFAR-10 datasets to evaluate the performance of the proposed downsampling layer on image classification tasks over different symmetries. We show that our proposed subsampling layer selects suitable subgroups for the task of image classification, and the proposed anti-aliasing operation further improves the models’ performance both in task performance and equivariance. Our contributions: • We generalize the uniform subsampling operation to signals on finite groups, allowing subsampling at a desired rate, yielding signals on subgroups. • We introduce the Subgroup Sampling Theorem and the concept of bandlimited-ness for subgroup subsampling. It guarantees the perfect reconstruction of the signal on the whole group from the subsampled signal on the subgroup. • We propose an equivariant anti-aliasing operation to ensure the signals are bandlimited before subgroup subsampling. Empirically, we demonstrate the efficacy of the downsampling operation. 2 Related Works Downsampling layers (subsampling & anti-aliasing). The idea of subsampling has rooted in striding and pooling as early as the seminal works of CNNs ( Fukushima, 1980 ; LeCun et al., 1999 ) . To downsample a high-resolution feature map to a low-resolution one, e.g . , by a factor of two, one can simply discard every other element in a feature map. More recently, anti-aliasing has been incorporated into deep nets, inspired by signal processing, where they propose to blur the feature map before subsampling using a low-pass filter ( Zhang, 2021 ; Karras et al., 2021 ; Rahman & Yeh, 2024 ) . Later, subsampling has also been extended to groups ( Cohen & Welling, 2016 ; Xu et al., 2021 ) . However, the term “every other” is ambiguous here, resulting in a definition that assigns groups to specific subgroups without adequately addressing the subsampling rate. Additionally, the anti-aliasing operation is not tailored for groups. In contrast, this work addresses these limitations by creating a theoretical foundation for subsampling by a specified factor within groups and proposing an effective anti-aliasing method that extends the sampling theorem, which we discuss next. The sampling theorem is the basis of digital signal processing, which studies how to sample, interpolate, and manipulate signals sampled at different rates ( Vetterli et al., 2014 ) . The sampling theorem guarantees that bandlimited signals can be perfectly reconstructed given a high enough sampling rate. This idea has been extended to graph signals and the field of graph signal processing ( Chen et al., 2015b ; Chen et al., 2015a ) . The sampling theorems for the cyclic and abelian groups have also been studied ( Dodson, 2007 ; Faridani, 1994 ; McEwen et al., 2015 ; Napolitano & Spooner, 2001 ; Vaidyanathan & Kirac, 1999 ) . These works generalize the discrete Fourier transform to discrete groups but do not consider a generalization for all finite discrete groups. Different from these works, we present a generalization of the sampling theorem for any finite groups, propose a downsampling layer, and show how the layer can be incorporated into group equivariant deep-nets. Equivariant deep-nets. Incorporating equivariance into deep-nets has been found to be an effective approach to designing deep nets ( Cohen & Welling, 2017 ; Bekkers et al., 2018 ; Worrall & Welling, 2019 ; Yeh et al., 2022 ) across many applications in multiple domains, e.g . , sets ( Ravanbakhsh et al., 2017 ; Zaheer et al., 2017 ; Hartford et al., 2018 ; Yeh et al., 2019a ; Liu et al., 2021a ; Rahman et