Neural Integral Operators for Inverse Problems: An Operator-Learning Framework for Small-Sample Spectroscopic Classification
Emanuele Zappala ∗, Alice Giola, Andreas Kramer, Saugat Acharya, Enrico Greco ∗ · 2025
Read Neural Integral Operators for Inverse Problems: An Operator-Learning Framework for Small-Sample Spectroscopic Classification by Emanuele Zappala ∗, Alice Giola, Andreas Kramer, Saugat Acharya, Enrico Greco ∗ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-03677.txt.
Introduction
Emanuele Zappala and co-authors build a neural operator that learns from scarce spectrum data without overfitting. Their 2025 paper targets classification from spectroscopic scans, where samples are few and standard deep models memorize noise. The task is an inverse problem: infer the class from a measured curve.
Their framework rests on integral equations, with a small network shaping the kernel and a coder producing the hidden curve. Random sampling to compute the integral acts as a built-in regularizer during training. Tests cover three real tasks: fruit purees, meat, and textiles, by two scan types. The model lands in the top two on every set and metric. It wins outright on the small, hard textile set, with steadier scores than rival deep models.
Catalog record
| CREATOR | Emanuele Zappala ∗, Alice Giola, Andreas Kramer, Saugat Acharya, Enrico Greco ∗ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-03677
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Neural Integral Operators for Inverse Problems: An Operator-Learning Framework for Small-Sample Spectroscopic Classification Thanks: ∗ Corresponding Author Emanuele Zappala ∗, Alice Giola, Andreas Kramer, Saugat Acharya, Enrico Greco ∗ Abstract . Learning maps between function spaces with a strong inductive bias is a central challenge in soft computing, especially when training data are scarce and standard deep architectures overfit. We introduce a neural integral operator (NIO) framework based on integral equations of the first kind, in which the Urysohn kernel of the operator is parameterized by a feed-forward network G θ G G_{\theta_{G}} and the latent function is produced by a convolutional encoder E ϕ E E_{\phi_{E}} , both trained jointly end-to-end via cross-entropy loss. The integral defining the learned operator is approximated by Monte Carlo sampling, which we argue acts as an implicit stochastic regularizer operating at the level of the integrand and complementing parameter-level regularizers such as weight decay and dropout. We benchmark the framework on three real-world spectroscopic classification tasks (FT-IR fruit purees, NIR meat, NIR textiles) of varying size and complexity, against traditional machine learning (decision tree, support vector machine, with and without UMAP) and modern deep learning baselines (FFNN, CNN+FFNN, shallow CNN, transformer). The proposed NIO is consistently among the top two performing models across all datasets and metrics, achieves the best results on the most challenging small-and-complex dataset (Textile), and yields lower performance variance than competing deep models in the small-data regime. The results suggest that operator-learning architectures with stochastic numerical integration are a viable soft-computing strategy for inverse problems in spectroscopy when conventional deep learning approaches are limited by data scarcity. 1. Introduction A recurring difficulty in soft computing is the design of learning architectures that admit a strong inductive bias on the structure of the mapping to be learned, while remaining flexible enough to fit data drawn from complex generative processes. When the input to the system is naturally a function of a continuous variable, rather than a fixed-dimensional vector, the learning target itself is best modelled as an operator between infinite-dimensional spaces. Neural operators [ 14 , 13 , 12 ] have recently emerged as a family of architectures designed for this setting, combining tools from functional analysis with deep learning. Within this family, the operator is parameterized by neural networks and learned from finite samples of input/output function pairs, with universal-approximation guarantees of varying strength depending on the architecture and functional spaces considered. While the bulk of the neural operator literature has focused on forward problems governed by partial differential equations, comparatively little attention has been devoted to the use of operator learning for inverse problems , where the unknown is the input function (or a property thereof) and the observation is its image under a forward operator. A natural mathematical formulation for such inverse problems is given by integral equations of the first kind [ 7 ] , in which an unknown function u is related to an observed signal f via integration against a kernel. Equations of this type have been used for decades in inverse problems arising in geophysics, climatology, immunology and analytical chemistry, but their integration into the neural operator framework remains essentially unexplored. The most directly related prior work is the Neural Integral Equation (NIE) framework [ 25 ] and its integro-differential counterpart [ 24 ] , which address second-kind equations for dynamical systems. To the best of our knowledge, no existing neural operator method explicitly targets first-kind integral equations as a vehicle for inverse classification or regression. In this paper, we propose a Neural Integral Operator (NIO) for inverse problems formulated as integral equations of the first kind. The three main contributions of the work are the following: (C1) We introduce an end-to-end trainable architecture in which a learned Urysohn kernel G_{\theta_{G}} and a convolutional encoder E_{\phi_{E}} jointly parameterize the unknown integral operator T , with classification labels recovered by evaluating Tu_{\phi_{E}} at a learned readout point \sigma_{E} produced by the encoder. (C2) We approximate the integral defining T via Monte Carlo sampling and argue that the resulting stochastic numerical scheme acts as an implicit regularizer on the operator, analogous in spirit to dropout and stochastic noise injection but operating at the level of the integrand. Empirically, the NIO is markedly more robust to overfitting than feed-forward, convolutional and transformer baselines of comparable parameter count, especially on small datasets. (C3) We provide an extensive empirical study on three real-world spectroscopic classification datasets of varying size and complexity, against classical chemometric, machine learning and modern deep learning baselines, supported by tests over 10 Monte Carlo cross-validation splits. Application domain as testbed We use spectroscopic classification as a testbed for the proposed framework for two reasons. First, spectroscopy is a paradigmatic instance of an inverse problem with a strong functional structure: spectra are naturally modelled as sampled functions over a continuous spectral domain, and the assignment of a class label corresponds to recovering structural or compositional information from an indirect observation [ 16 , 9 ] . Second, spectroscopic datasets are typically of modest size, providing a stress test for the small-data behaviour of operator-learning architectures. For comprehensive reviews of machine learning and deep learning approaches to NIR, FT-IR and Raman spectroscopy, the reader is referred to [ 27 , 19 , 15 , 3 ] ; quantitative interpretation of spectra has historically relied on chemometric calibration models such as PLS regression [ 23 ] . Several strategies have been developed to alleviate the small-sample bottleneck, including transfer learning [ 18 , 11 , 20 ] , self-supervised pre-training [ 28 , 5 ] , and specialized 1D-CNN or hybrid CNN–Transformer architectures [ 10 , 26 ] . Our work is complementary to these efforts: rather than augment the data or transfer knowledge from a source domain, we introduce an inductive bias at the level of the architecture (the operator structure) and at the level of the numerical integration scheme. While we adopt spectroscopic language in the experimental sections, the proposed framework is domain-agnostic and applies wherever an inverse problem can be cast as an integral equation of the first-kind. A schematic overview of the full pipeline is shown in Figure 1 . Figure 1. Neural integral operator pipeline. Given a one-dimensional spectrum s(\omega) , a convolutional encoder E_{\phi_{E}} extracts local features and maps the input into a latent function u_{\phi_{E}}(\omega) , together with a learned evaluation coordinate \sigma_{E} . This representation is passed to a neural integral operator T_{\theta_{G}} , defined via a learned Urysohn kernel G_{\theta_{G}}\bigl(u_{\phi_{E}}(\omega),\sigma,\omega\bigr) , which captures nonlocal relationships by integrating over the spectral domain. In practice, the integral is approximated via Monte Carlo sampling over points \{\omega^{(m)}\}_{m=1}^{M} , whose contributions are aggregated at the evaluation point \sigma_{E} . The operator output produces class logits z=(T_{\theta_{G}}u_{\phi_{E}})(\sigma_{E}) , which are transformed into class probabilities via softmax. The model is trained end-to-end using cross-entropy loss. The symbols \phi and \theta appearing inside the figure correspond, respectively, to the encoder parameters \phi_{E} and the kernel parameters \theta_{G} used in the main text. Organization of the paper The remainder of the paper is organized as follows. Section 2 reviews related work on neural operators and inverse problems and positions our contribution with respect to the existing