RotaTouille: Rotation Equivariant Deep Learning for Contours

Odin Hoff Gardaa, Nello Blaser · 2025

Read RotaTouille: Rotation Equivariant Deep Learning for Contours by Odin Hoff Gardaa, Nello Blaser (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-16359.txt.

Introduction

A closed curve is a shape with a memory problem: rotate it, or start tracing it at a different point, and a naive neural network sees a new object. Odin Hoff Gardaa and Nello Blaser build a network that sees the same object, in a 2025 paper named RotaTouille.

Complex-valued circular convolution gives the model both rotation equivariance and shift equivariance along the contour, the two symmetries the data demands. The authors add matching nonlinearities, coarsening layers, and a global pooling step that distills invariant features for final decisions. Contours are everywhere, object outlines in vision, weather isolines, machine orbits, and the framework is tested on shape classification, reconstruction, and contour regression. The lesson is geometric honesty: build the symmetry into the machine instead of teaching it with endless rotated copies.

Catalog record

CREATOROdin Hoff Gardaa, Nello Blaser
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-16359

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RotaTouille: Rotation Equivariant Deep Learning for Contours Odin Hoff Gardaa, Nello Blaser Abstract Contours or closed planar curves are common in many domains. For example, they appear as object boundaries in computer vision, isolines in meteorology, and the orbits of rotating machinery. In many cases when learning from contour data, planar rotations of the input will result in correspondingly rotated outputs. It is therefore desirable that deep learning models be rotationally equivariant. In addition, contours are typically represented as an ordered sequence of edge points, where the choice of starting point is arbitrary. It is therefore also desirable for deep learning methods to be equivariant under cyclic shifts. We present RotaTouille, a deep learning framework for learning from contour data that achieves both rotation and cyclic shift equivariance through complex-valued circular convolution. We further introduce and characterize equivariant non-linearities, coarsening layers, and global pooling layers to obtain invariant representations for downstream tasks. Finally, we demonstrate the effectiveness of RotaTouille through experiments in shape classification, reconstruction, and contour regression. 1 Introduction Equivariance and invariance are the central concepts in geometric deep learning. Designing architectures that respect certain symmetries, often defined in terms of group actions, allows us to incorporate prior geometric knowledge about the data into the learning process. This can lead to models that generalize better, require less data, and are more efficient by reducing the effective hypothesis space. Equivariance is especially useful when the task requires the model to be sensitive to transformations of the input, such as translation, rotation, or permutation, while still producing consistent and meaningful output. Invariance, on the other hand, is desirable when the output should remain unchanged under transformations. Convolutional neural networks (CNNs) illustrate both concepts in image analysis. Convolutions are translation-equivariant, so shifting an input image shifts the feature maps accordingly, which is useful for segmentation, while applying global pooling after the convolutional layers achieves invariance, allowing classification to be insensitive to the object’s position. Graph neural networks (GNNs) offer another example: they are often designed to be invariant or equivariant under permutations of node orderings (graph isomorphisms). A comprehensive overview of methods and concepts in geometric deep learning can be found in [ 9 ] and [ 17 ] . In this paper, we focus on what we will refer to as contours . Contours are complex-valued signals on finite cyclic groups, i.e., functions \Z_{n}\to\C^{k} , where \Z_{n} denotes the cyclic group of order n , and \C^{k} is the k -dimensional complex vector space consisting of k -tuples of complex numbers. Contours can serve as sparse representations of object boundaries, but they are not limited to simple closed shapes. Contours can also accommodate more general signals, including self-crossing curves and multichannel contours. For example, contours occur naturally as cell shapes in cell morphology [ 10 , 7 , 29 ] , and as orbit plots in the vibrational analysis of rotating machinery [ 21 , 22 , 11 ] . Our method is based on complex-valued neural networks, which are neural networks using complex-valued weights that are often employed in applications such as radar imaging [ 16 , 33 ] , MRI fingerprinting and reconstruction [ 40 , 14 ] , and other areas where data are naturally represented in the complex domain. See [ 27 ] and [ 4 ] for a detailed overview of complex-valued neural networks and their applications. Complex-valued CNNs have also been applied to images and shown to demonstrate self-regularizing effects [ 18 ] . 1.1 Contributions The group G_{n}=\Z_{n}\times S^{1} acts on a contour x\colon\Z_{n}\to\C^{k} by combining two operations: the cyclic group \Z_{n} acts by cyclically shifting the starting point of the contour, and S^{1} acts by rotating the image of x about the origin in each copy of the complex plane. We propose rotation- and cyclic shift-equivariant (as well as invariant) layers for deep learning on contours, leveraging complex-valued convolutions over the cyclic group (circular convolution). Convolution is well known for its cyclic shift-equivariant property, and by working in the complex domain, we automatically get equivariance to planar rotations as well. Our framework RotaTouille consists of the following main types of layers: • Convolution layers. Linear equivariant layers based on complex circular convolutions. • Activation functions. Equivariant non-linear functions applied element-wise allowing the network to learn more complex functions. • Coarsening layers. Equivariant local pooling layers downsampling the signal by coarsening the domain. • Invariant layers. Invariant global pooling layers producing real-valued embeddings for downstream tasks. This layer taxonomy aligns well with the Geometric Deep Learning Blueprint proposed in [ 9 , p. 29] . Throughout the paper, we show that the proposed layers are indeed equivariant and provide a classification of all possible equivariant non-linear activation functions in Section 2.4 . We evaluate RotaTouille in different tasks, including shape classification, shape reconstruction, and node-level curvature regression. Our implementation, including all code required to reproduce the experiments, is publicly available. 1 1 1 https://github.com/odinhg/rotation-equivariant-contour-learning 1.2 Related Work Shape analysis is a central topic in computer vision and machine learning, with early approaches often based on hand-crafted descriptors computed from contours. Examples include Curvature Scale Space (CSS) representations [ 30 , 1 ] and generalized CSS (GCSS) [ 6 ] , which were later used in the DeepGCSS neural network classifier [ 31 ] . The use of neural networks for contour data appeared already in [ 19 ] , where the authors used fully connected neural networks to classify contours. Other classical works combined contour fragments with skeleton-based features to improve shape recognition [ 37 , 36 , 35 ] . The shape context (SC) descriptors [ 5 ] , based on log-polar histograms, have also been shown to be effective in capturing the local geometric structure in a rotation-invariant way. More recently, deep learning methods have become more popular for contour analysis. ContourCNN [ 15 ] models planar contours using real-valued circular convolutions on point sequences, with a custom pooling strategy to discard shape-redundant points. A similar convolutional approach was proposed in [ 28 ] . Two-dimensional CNNs have also been applied to contour images [ 22 , 3 , 11 ] and transformer-based architectures have been adapted for shape data using SC descriptors in [ 23 ] . None of these deep learning-based methods is intrinsically equivariant or invariant to rotations and they instead rely on data augmentation or manual feature extraction of invariant features. Several works have explored learning rotation equivariant or invariant representations more directly, especially in settings of images or point clouds. The O2-VAE model [ 10 ] , for instance, applies steerable CNNs [ 13 ] to cell images, encoding them into a latent space that is invariant to planar rotations. Although effective in capturing texture- and intensity-based features, such approaches operate on pixel grids rather than directly on contour data. Group-equivariant convolutional neural networks (G-CNNs) [ 12 ] likewise provide a general framework for building equivariant networks with respect to discrete symmetry groups, although these have been applied mostly in image-based contexts. Closer in spirit to our approach are quaternion neural networks for 3D point clouds [ 38 ] , where rotation-equivariant layers are constructed using the action of unit quaternions on \R^{3} . Topological methods have

Read the complete text