Solving Convolution-type Integral Equations using Preconditioned Neural Operators

Raymond Hon-Fu Chan, Lingfeng Li · 2026

Read Solving Convolution-type Integral Equations using Preconditioned Neural Operators by Raymond Hon-Fu Chan, Lingfeng Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-07365.txt.

Introduction

Raymond Chan and Lingfeng Li solve convolution-type integral equations by pairing neural operators with classic solvers. Such equations appear in signal work and image deblurring. Older multigrid methods clear low-frequency error fast but stall on high-frequency parts, exactly where the authors aim their learned component.

Trained with a preconditioning trick, the neural operator handles the high-frequency parts, while a weighted Jacobi method handles the rest, forming a hybrid loop. The authors analyze both the training's generalization error and how the hybrid settles. On large, badly scaled systems from one- and two-axis problems, the hybrid beats multigrid and conjugate gradient methods.

Catalog record

CREATORRaymond Hon-Fu Chan, Lingfeng Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.07365

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Solving Convolution-type Integral Equations using Preconditioned Neural Operators Thanks: Submitted to the editors DATE. Raymond Hon-Fu Chan, Lingfeng Li Abstract Convolution-type integral equations arise from various fields, e.g. , finite impulse response filters in signal processing and deblurring problems in image processing. When solving these equations, conventional numerical methods, like the multigrid method, can only efficiently solve the low-frequency components in the error, but not the high-frequency components. In this paper, we apply neural operators to address this issue. By adopting a preconditioning approach, we propose a novel training strategy that trains neural operators to solve the high-frequency components efficiently. Then, we combine the neural operators with some classical iterative solvers, like the weighted Jacobi method, to obtain an efficient hybrid iterative algorithm for the integral equations. We analyze the generalization error of our training strategy and the convergence of the hybrid iterative algorithm. We test our algorithms on large-scale and ill-conditioned linear systems discretized from one- and two-dimensional convolution-type integral equations. Our proposed algorithm significantly outperforms the multigrid method and the preconditioned conjugate gradient method in both iteration numbers and computational time. keywords Integral equation; Neural operator; Multigrid method; hybrid iterative solver Funding. This work of R. Chan is partially supported by HKRGC Grants No. CityU11309922, LU13300125, ITF Grant No. MHP/054/22, and LU BGR 105824. The work of Lingfeng Li is supported by the InnoHK project at the Hong Kong Centre for Cerebro-cardiovascular Health Engineering (COCHE) and HKRGC Grants No.LU13300125. † † runningheads: R. Chan and L. Li / AMS 68T07, 45E10 1 Introduction Solving linear systems is one of the most fundamental tasks in scientific computing. In general, there are two types of algorithms for solving linear systems: direct methods and iterative methods. Direct methods can find the exact solutions to linear systems using some factorization techniques, e.g. , the LU decomposition method. Although direct methods can find the exact solutions in a finite number of operations, their computational costs increase very fast with the problem size, which makes it impractical to solve large-scale linear systems. Iterative methods, in contrast, solve linear systems by iteratively refining their solutions. They are particularly useful for large-scale problems because of their low computational costs compared to direct methods. The solution of typical iterative methods, such as the Jacobi method, the Gauss-Seidel method, and the Krylov subspace methods, would approach the exact solution as the iteration number increases. The convergence rate usually depends on the condition number of the coefficient matrix. For very ill-conditioned matrices, preconditioning techniques can help accelerate the convergence. One important class of linear systems is the Toeplitz systems, which arise from many applications, especially in the solution of convolution-type integral equations, in signal processing, and in image processing [ 16 , 19 , 25 ] . Toeplitz matrices are matrices with constant diagonals. By exploring this special structure, many efficient preconditioners have been proposed [ 14 , 13 , 43 ] . In the following, we use the terminology in [ 46 ] to call the eigenvectors corresponding to large (respectively, small) eigenvalues of a matrix the algebraic high-frequency (respectively, low-frequency) eigenvectors. If the eigenvector is itself highly-oscillating (respectively, slowly-oscillating), we call the vector a geometric high-frequency (respectively, low-frequency) eigenvector. Iterative methods, such as the Jacobi and Gauss-Seidel methods, are called smoothers in that they tend to reduce the algebraic high-frequency components (eigenvectors corresponding to large eigenvalues) in the error much faster than the algebraic low-frequency components (eigenvectors corresponding to small eigenvalues). [ 46 ] . For PDE problems, the algebraic high-frequency and low-frequency components of the discretized systems coincide with the geometric high-frequency and low-frequency components, respectively, i.e. , they are highly oscillatory and slowly oscillatory, respectively. In such cases, we can apply the multigrid method to solve the linear systems efficiently [ 22 ] . The idea of multigrid methods is to reduce the geometric high-frequency error using smoothers such as the Jacobi method, and remove the geometric low-frequency error using coarse-grid corrections. The multigrid method is often considered the optimal method for PDE problems, particularly in terms of computational efficiency [ 5 ] . Some recent studies borrow the idea from multigrid methods and replace the coarse-grid correction step with neural operator solvers [ 23 , 48 , 49 ] . For example, the DeepONet-based neural operators [ 33 ] , which are designed for operator learning in continuous spaces, can reduce the geometric low-frequency error [ 48 , 49 ] . This type of structure is known to be frequency-biased [ 47 ] , i.e. , it tends to learn the geometric low-frequency components in the solution rather than the high-frequency components during training. Therefore, it can be combined with smoothers to solve PDE problems. There also exist other types of neural operators that learn operators in discrete spaces, like convolutional neural networks (CNN) and Fourier neural operators (FNO) [ 29 ] . In [ 24 , 41 ] , the authors use CNNs as multigrid smoothers and apply them with coarse-grid corrections to solve PDE problems. Typically, neural operators require a long time of training before they can be used in applications, so these types of methods are useful when a linear system needs to be solved multiple times for different right-hand-side vectors, e.g. , when simulating the evolution of fluid dynamics or heat transfer [ 3 ] . Besides, there are also some neural operators that integrate the multigrid framework into the structure directly for solving linear systems [ 15 , 20 ] . This paper concerns problems where the algebraic high-frequency (respectively, low-frequency) components do not correspond to geometric high-frequency (respectively, low-frequency) components. This occurs in some convolution-type integral equations with smooth kernels [ 7 ] , where the corresponding linear systems are typically ill-conditioned Toeplitz or block-Toeplitz. For these systems, the multigrid method may fail since both smoothers and coarse-grid corrections tend to reduce the same algebraic high-frequency (geometric low-frequency) components in the error. Finding a good smoother to solve the algebraic low-frequency (geometric high-frequency) components is a challenging task for this type of problem [ 7 ] . In this work, we aim to solve the algebraic low-frequency components using neural operators and then combine the operators with smoothers to form a new hybrid iterative algorithm for the integral equations. The main contributions and findings are summarized as follows: 1. We developed a new algorithm that solves algebraic low-frequency components using neural operators. The main difference between our method and previous work [ 23 , 48 , 49 , 24 , 41 ] is that our method is designed to address algebraic frequency components, whereas most previous work focuses on specific geometric frequency components. 2. Inspired by the framework in [ 48 , 49 ] , we apply a hybrid iterative algorithm combining neural operators and classical smoothers to solve convolution-type integral equations. 3. We conduct some theoretical analysis of the proposed algorithm. We first estimate the generalization error when the neural operator is a two-layer ReLU network and derive an upper bound in terms of the number of training samples, problem size, and the optimization error. We then prove the convergence of the hybrid iterative algorithm when the neural operator satisfies some reasonable conditions. Lastly, we analyze how

Read the complete text