Generalized Reproducing Kernel Banach Spaces: A Functional Analytic Framework for Abstract Neural Networks
Raul Felipe-Sosa · 2026
Read Generalized Reproducing Kernel Banach Spaces: A Functional Analytic Framework for Abstract Neural Networks by Raul Felipe-Sosa (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-13062.txt.
Introduction
Raul Felipe-Sosa sets up a broad new frame for a class of Banach spaces with kernels. The base class, called reproducing kernel Banach spaces, is known in maths and in the study of nets. In that class, the value of a map at a point can be read off by a fixed rule.
Recent work showed that plain fully linked neural nets can be seen as small finite parts of such spaces. Felipe-Sosa uses that link as his spur. His broad form aims to hold more kinds of maps in one frame. By doing so, it may give abstract neural nets a cleaner maths home. Readers in pure maths and in learning theory both get a bridge here.
Catalog record
| CREATOR | Raul Felipe-Sosa |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-13062
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Generalized Reproducing Kernel Banach Spaces: A Functional Analytic Framework for Abstract Neural Networks Raul Felipe-Sosa Abstract In this paper, we introduce a generalization of Reproducing Kernel Banach Spaces (RKBS), which we term Generalized Reproducing Kernel Banach Spaces (GRKBS). The motivation stems from recent results showing that classical fully connected neural networks can be understood as finite-dimensional subspaces of RKBS. Our generalization extends this perspective to settings with Banach-valued codomains, allowing the construction of abstract neural networks (AbsNN) as compositions of GRKBS. This framework provides a natural pathway to model neural architectures that go beyond classical machine learning paradigms, including physically-informed structures governed by differential equations. We establish a unified definition of GRKBS, prove structural uniqueness results, and analyze the existence of sparse minimizers for the corresponding abstract training problem. This contributes to bridging functional analytic theory and the design of new neural architectures with applications in both approximation theory and mathematical modeling. Keywords: generalized RKBS; abstract training problem; abstract neural structures 1 Introduction The interplay between functional analysis and machine learning has gained increasing attention in recent years. In particular, Reproducing Kernel Hilbert Spaces (RKHS) have long provided a solid theoretical foundation for kernel methods and statistical learning theory, see 4 ; 5 . More recently, the concept of Reproducing Kernel Banach Spaces (RKBS) has been developed 7 ; 1 , extending the RKHS framework to Banach space settings. A key insight from this line of research is that fully connected neural networks can be interpreted as finite-dimensional Banach subspaces of suitable RKBS, thereby endowing neural architectures with a rigorous functional-analytic interpretation. Despite these advances, the classical theory of RKBS remains limited in scope. In particular, most formulations restrict to scalar-valued function spaces, which constrains their applicability to modern architectures that operate in structured, often infinite-dimensional, codomains. Moreover, existing definitions of RKBS coexist without a fully unified framework, which complicates both theoretical analysis and practical implementation. The aim of this paper is to address these limitations by introducing the notion of Generalized Reproducing Kernel Banach Spaces (GRKBS). Within this setting, we define abstract neural networks (AbsNN) as suitable compositions of GRKBS, generalizing the construction of deep architectures beyond classical feedforward models. This approach makes it possible to embed physical models—such as those governed by differential equations—into the neural structure, yielding architectures that are qualitatively different from standard ones. Our contributions can be summarized as follows: • We introduce a generalized and unified definition of RKBS, extending it to Banach-valued codomains. • We establish what we regard as the configuration of a GRKBS, showing that a GRKBS may admit infinitely many configurations grouped into equivalence classes, based on an equivalence relation defined on the set of configurations. • In the generalized framework we propose, we unify the existing definitions of RKBS. In this sense, we prove that a reproducing kernel for a GRKBS corresponds to a particular configuration of the space. • We present uniqueness results for the reproducing kernel of a GRKBS. • We define abstract neural networks as compositions of GRKBS and provide a functional-analytic description of multi-layer structures. • We analyze the abstract training problem (ATP) in this setting and prove the existence of sparse minimizers, following ideas from variational analysis 2 . This work contributes to the ongoing effort of building a rigorous mathematical foundation for neural networks and opens the door to new architectures where learning is intertwined with physical and functional-analytic models. The structure of the paper is as follows. In Section 2 we present the main definitions and preliminary results, highlighting the connection between classical RKBS and neural networks. Section 3 introduces the concept of Generalized Reproducing Kernel Banach Spaces (GRKBS) and establishes their basic properties, including uniqueness results and the construction of reproducing kernels. In Section 3.2 , we define abstract neural networks (AbsNN) as compositions of GRKBS and analyze how this framework naturally leads to multi-layer architectures. Finally, in Section 4 is devoted to the study of the abstract training problem in GRKBS and AbsNN, where we prove the existence of sparse minimizers by leveraging tools from variational analysis. 2 Some Definitions and Preliminary Results This section aims to present essential definitions and results that are crucial for the development of this paper. In particular, we focus on presenting a theoretical framework in which the training process of a deep abstract neural structure can be explicitly formulated using given training data. Additionally, we briefly discuss the connection between reproducing kernel Banach spaces and fully connected neural networks, a relationship that has been previously explored in the literature; see 1 and 6 . In the context of this work, \mathcal{X} will be treated as an arbitrary set, with the subsets \left\{x_{i}\right\}^{N}_{i=1}\subset\mathcal{X} and \left\{y_{i}\right\}^{N}_{i=1}\subset\mathbb{R} referred to as training data. It is important to note that \mathcal{X} is not assumed to have a geometric or topological structure. For instance, it could be a topological space, a metric space, or similar, which would provide a different approach to studying the spaces we will later define, although this is not the focus of our investigation. Additionally, we will consider a function \mathcal{L}:\mathbb{R}^{2}\rightarrow\mathbb{R} , which adheres to specific properties that will be defined subsequently. Within the realm of machine learning, \mathcal{L} is referred to as a cost function. Let’s give the following definition. Definition 1 Let \mathcal{B} be a Banach space consisting of functions f:\mathcal{X}\rightarrow\mathbb{R} . We refer to the abstract training problem (ATP) associated with \mathcal{B} and the training dataset \left\{x_{i}\right\}_{i=1}^{N}\subset\mathcal{X} and \left\{y_{i}\right\}_{i=1}^{N}\subset\mathbb{R} as: \displaystyle\inf_{f\in\mathcal{B}}\left(\frac{1}{N}\sum_{i=1}^{N}\mathcal{L}(y_{i},f(x_{i}))+\|f\|_{\mathcal{B}}\right). (2.1) Definition 1 provides a formal structure for the concept of model training in machine learning. In particular, if we take \mathcal{X}=\mathbb{R}^{n} and consider the class of functions f_{\mathcal{N}}:\mathbb{R}^{n}\rightarrow\mathbb{R} given by \displaystyle f_{\mathcal{N}}(x)=\sum_{k=1}^{K}\alpha_{k}\sigma(w_{k}\cdot x+b_{k}), where \alpha_{k},b_{k}\in\mathbb{R} , w_{k}\in\mathbb{R}^{n} , and \cdot denotes the standard inner product in \mathbb{R}^{n} , and endow this function class with a norm that turns it into a Banach space, then solving the abstract training problem corresponds to training a neural network with a single hidden layer of up to N neurons and an input layer of n neurons. Thus, a neural network model can be viewed as a Banach space in which an abstract training problem of the form ( 2.1 ) is posed and solved. The final point discussed in the preceding paragraph arises due to the connection between what are known as reproducing kernel Banach spaces (RKBS) and neural networks. RKBS extend the concept of reproducing kernel spaces. In general, these spaces are Hilbert spaces characterized by the presence of a reproducing kernel that can, in some manner, reproduce every function within the space. The following definition introduces what is known as a reproducing kernel Banach space (refer to Definition 3.2 of 1 ). Definition 2 Consider \mathcal{B} as a Banach space of functions f:\mathcal{X}\rightarrow\mathbb{R} , where the operations of addition and scalar multiplication are conducted pointwise. The space \mathcal{B} is classified as a reproducing kernel Banach space (RKBS) if, for each x\in\mathcal{X} , the evaluation linear functional that assigns to every f\in\mathcal{B} the specific value f(x) , denoted by ev_{x} , is both linear and continuous, that is, by ev_{x}\in\mathcal{B}^{\prime} . Note that Definition 2 does not explicitly reference any component of a reproducing kernel. However, as shown in the following proposition, the reproducing