Learning convolution operators on compact abelian groups

Emilia Magnani, Ernesto De Vito, Philipp Hennig, Lorenzo Rosasco · 2025

Read Learning convolution operators on compact abelian groups by Emilia Magnani, Ernesto De Vito, Philipp Hennig, Lorenzo Rosasco (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-05279.txt.

Introduction

Emilia Magnani, Ernesto De Vito, Philipp Hennig, and Lorenzo Rosasco study learning convolution operators on compact groups in a math paper from 2025. Convolutions smear a signal by a kernel, the same operation behind image filters. Here the signals live on compact abelian groups, spaces like circles and tori.

The team analyzes a ridge regression estimator for the unknown kernel. The kernel is assumed to sit in a translation-invariant Hilbert space. Error bounds show how accuracy grows with sample size. Classic smoothness assumptions gain a fresh reading as limits on space and frequency spread. Computer simulations back the theory. The work serves signal processing on periodic and directional data.

Catalog record

CREATOREmilia Magnani, Ernesto De Vito, Philipp Hennig, Lorenzo Rosasco
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE84 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-05279

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning convolution operators on compact abelian groups Emilia Magnani, Ernesto De Vito, Philipp Hennig, Lorenzo Rosasco Abstract . We consider the problem of learning convolution operators associated to compact Abelian groups. We study a regularization-based approach and provide corresponding learning guarantees under natural regularity conditions on the convolution kernel. More precisely, we assume the convolution kernel is a function in a translation invariant Hilbert space and analyze a natural ridge regression (RR) estimator. Building on existing results for RR, we characterize the accuracy of the estimator in terms of finite sample bounds. Interestingly, regularity assumptions which are classical in the analysis of RR, have a novel and natural interpretation in terms of space/frequency localization. Theoretical results are illustrated by numerical simulations. 2010 Mathematics Subject Classification 68T05, 47A52, 42B10, 62J07 1. Introduction The key problem in machine learning is estimating an input/output function f of interest from random input/output pairs (x_{i},y_{i})_{i=1}^{n} . Classically, inputs are vectors in \mathbb{R}^{d} , and outputs are binary or scalar values. However, as the scope and number of machine learning applications expand frantically, it is interesting to consider functional relationships between more general inputs and outputs. Relevant to this study is the case where both inputs and outputs are elements of infinite-dimensional spaces, such as Hilbert or Banach spaces, so that f can be viewed as an operator. This setting has recently received considerable attention, driven by applications in image and signal processing, and more generally in scientific and engineering contexts where data are described by integral and partial differential equations (PDEs), see [ 23 ] and references therein. In this paper, we focus on a special class of linear operators, namely convolution operators on an Abelian group G , x\convolution w_{*}(t)=\int_{G}x(\tau)w_{*}(t-\tau)\,d\tau. We consider a statistical framework where the inputs are random signals, and the outputs are noisy images of the convolution operator applied to the inputs, expressed as (1) y_{i}=x_{i}\convolution w_{*}+\epsilon_{i}. We address the case where translations, and hence convolutions, are defined by a compact Abelian group. Convolution operators form a special class of linear operators that can be characterized by the convolution kernel w_{*} , together with the properties of the underlying group. As we show, tools from harmonic and Fourier analysis can be employed to gain insights into the structure of the problem and develop a tailored analysis. Before describing our main contributions, we provide some context for our study, discussing a number of related works and results. 1.1. Related work While we are not aware of studies focusing specifically on learning guarantees for convolution operators, this problem is related to different yet related questions. We will briefly review these connections next. Operator learning. As already mentioned, operator learning has received significant attention lately. On the one hand, there has been a growing literature on neural network approaches, such as the so-called neural operators [ 22 ] ; see also [ 16 ] and the references therein for an overview. On the other hand, learning-theoretic studies have largely focused on learning linear operators with kernel methods, since they are amenable to a more complete analysis. A recent survey can be found in [ 23 ] , whereas a partial list of references includes [ 11 , 13 , 44 , 30 , 21 , 1 , 3 , 43 ] . These latter studies consider estimators and technical tools analogous to those in this paper. Indeed, the convolution operators we consider are an example of linear operators. However, their special structure allows for a tailored analysis that highlights the specific structure of the problem. In particular, it is possible to focus on the convolution kernel as the primary object of interest, using functional analytic tools rather than operator analytic tools, and learning bounds in different norms can be derived, leveraging the regularity properties of the convolution kernel. A recent contribution in this direction is [ 48 ] , which considers a more general class of integral operators and derives minimax rates in certain spectral Sobolev spaces. While their approach covers many integral kernels, our setting leverages the commutative group structure and frequency-domain localization, leading to interpretations that are not considered in their framework. In particular, regularity assumptions needed to derive learning bounds in our setting can be related to localization properties. Learning Green functions. Motivated by applications in PDEs, another class of linear operators that has been considered are integral kernel operators, where the kernel can be related to Green functions; see [ 4 ] and references therein. In our setting, the hypothesis space has a special structure, since it is defined by a translational invariant kernel and reflects the group structure. The analysis in this case cannot be recovered from the case of general integral kernel operators. Functional regression. The problem we study is related to functional data analysis, where input/output data are represented as functions in a continuous domain; see, e.g., [ 33 , 28 ] and [ 10 , 19 , 34 ] . For example, the studies in [ 26 , 25 , 47 ] address the analysis within Reproducing Kernel Hilbert spaces. Our framework is more general because we consider the general Abelian group setting. At the same time, it is more specific since we focus on convolution kernels, and we can derive and interpret results in different norms. Linear time-invariant system estimation. Learning convolution kernels and convolution operators is close to identification of linear time-invariants in control theory and signal processing. We refer to [ 27 ] for a classic reference and to [ 5 ] for modern data-driven approaches that use optimization and machine learning. Estimating linear time-invariant systems involves learning the so-called impulse response or transfer function, which can often be represented as a convolution operator. Indeed, the tools we employ, such as commutative Harmonic Analysis, parallel the techniques used in identification of linear time-invariant systems. Our contributions extend these ideas by focusing on a more general framework where the underlying structure is defined by a compact Abelian group. Moreover, we consider random inputs and additive noise in the observations, making the problem inherently statistical. Blind deconvolution. The problem of learning a convolution kernel is related to the so-called blind deconvolution problem; see, e.g., [ 20 ] . A number of machine learning approaches primarily based on neural networks have been considered for this problem [ 41 , 40 , 14 , 12 , 6 , 24 ] , particularly with respect to the problem of image recovery from blurred photographs [ 9 , 46 ] . Typically, only a discrete setting is considered, and no theoretical results are developed. Closely related to our study is the approach in [ 41 ] , which focused on algorithmic aspects. Here, we complement these latter results by considering a continuous setting and deriving learning theoretic guarantees. 1.2. Contribution In the context of the learning model in eq. 1 , our main contribution is the analysis of the learning properties of a ridge regression estimator in terms of non-asymptotic learning bounds. More precisely, we consider convolution operators defined by a compact Abelian group G . With this choice, we identify the input and output spaces with L^{1}(G) and L^{2}(G) , respectively, which are the Lebesgue spaces defined by

Read the complete text