Max-Min Neural Network Operators For Approximation of Multivariate Functions

Abhishek Yadav a , Uaday Singh a , Feng Dai b · 2026

Read Max-Min Neural Network Operators For Approximation of Multivariate Functions by Abhishek Yadav a , Uaday Singh a , Feng Dai b (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-07886.txt.

Introduction

Abhishek Yadav, Uaday Singh, and Feng Dai extend a neural network approximation method to several variables. Max-min neural network operators approximate functions using maximum and minimum operations inside the network. Recent advances built such operators for one variable. Their 2026 preprint proposes and analyzes multivariate versions. The operators are activated by sigmoidal functions, the smooth S-shaped curves common in neural networks.

Multivariate approximation is the real-world case: most functions depend on many inputs. A method proven only for one variable has limited use. The authors develop the framework and its analysis together. Approximation theory supplies guarantees about how fast these operators converge. Such guarantees help engineers choose methods with known error behavior. The paper serves scholars in approximation theory and neural network mathematics. It carries a newer operator family into higher dimensions.

Catalog record

CREATORAbhishek Yadav a , Uaday Singh a , Feng Dai b
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-07886

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Max-Min Neural Network Operators For Approximation of Multivariate Functions Abhishek Yadav a , Uaday Singh a , Feng Dai b Abstract . In this paper, we develop a multivariate framework for approximation by max-min neural network operators. Building on the recent advances in approximation theory by neural network operators, particularly, the univariate max-min operators, we propose and analyze new multivariate operators activated by sigmoidal functions. We establish pointwise and uniform convergence theorems and derive quantitative estimates for the order of approximation via modulus of continuity and multivariate generalized absolute moment. Our results demonstrate that multivariate max-min structure of operators, besides their algebraic elegance, provide efficient and stable approximation tools in both theoretical and applied settings. † † footnotetext: MSC2020: Primary 00A05, Secondary 00A66. Keywords: Sigmoidal functions, Modulus of continuity, Multivariate neural network operators, Order of approximation, Max-min operators. 1. Introduction and Preliminary A neural network consists of simple and highly interconnected processors called neurons. Each neuron stores a weight \bar{a}\in\mathbb{R}^{r} and a threshold b\in\mathbb{R} in the memory and evaluates certain activation function \mu(\bar{a}\cdot\bar{y}+b) on receiving an input \bar{y}\in\mathbb{R}^{r} where \bar{a}\cdot\bar{y} denotes the inner product of \bar{a} and \bar{y} in \mathbb{R}^{r} . These neurons are arranged in layers. A feed forward neural network with multi input, single output and a single hidden layer, whose general scheme is reported in Figure 1, is mathematically represented by F_{n}(\bar{y})=\sum_{i=0}^{n}c_{i}\,\mu(\bar{a}_{i}\cdot\bar{y}+b_{i}), where n\in\mathbb{N} denotes the number of neurons in the hidden layer and c_{i} are constants to be adjusted in the learning stage, and \mu is a non-linear function called the activation function. Mostly activation functions are sigmoidal functions. Sigmoidal function: A function \mu:\mathbb{R}\to\mathbb{R} is called sigmoidal iff \mu(y)=\begin{cases}1,&y\to+\infty,\\[3.00003pt] 0,&y\to-\infty.\end{cases} Figure 1 . Architecture of a single hidden layer feed forward neural network with n hidden neurons. In the literature, various other types of activation functions exist, including ramp functions, binary step functions, and the Rectified Linear Unit (ReLU) function etc. For more details one can see [ 1 ] . It should be noted that sigmoidal functions are widely studied in neural network and approximation theory (see [ 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 16 ] ). Anastassiou [ 14 ] conducted a study on neural network operators defined by Cardaliaguet-Euvrard type [ 15 ] and derived a rate for the approximation of the NNOs for continuous functions. Subsequently, he investigated neural network operators activated by the logistic function and hyperbolic tangent function in one-dimensional and multi-dimensional cases [ 2 , 3 , 16 , 17 , 18 ] . After that, Costarelli and Spigler [ 5 , 6 ] examined a unified approach for a general class of sigmoidal functions. Later, Costarelli and Vinti [ 8 , 19 ] studied the max-product versions of these operators and improved the rate of approximation. Since max-product operators accelerate the rate of approximation, these are extensively used in approximation theory [ 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 , 28 , 29 , 30 , 31 , 32 ] . It was Bede and his colleagues who first obtained a pseudo-linear approach in approximation theory [ 25 ] . Here, changing the algebraic structure of fields of real numbers with max-product semiring, max-min semiring, and semirings with generated pseudo-operations, the authors obtained pseudo-linear versions of the Shepard operator [ 26 ] . Moreover, the authors achieved a higher level of approximation accuracy in the max-product case along with reduced computational time complexity in both the max-product and max-min cases [ 39 ] . We note that although max-min operators are primarily associated with fuzzy theory [ 33 , 34 ] , because of their approximation capabilities and lower computational complexity, max-min operators have recently begun to be studied in approximation theory [ 35 , 36 , 37 , 38 ] . In this paper, we use the following notations: \mathcal{R}:=[a_{1},b_{1}]\times\cdots\times[a_{r},b_{r}]\subset\mathbb{R}^{r},\text{a multivariate box-domain in $\mathbb{R}^{r}$,} \bigvee_{i\in J}a_{i}:=\sup\{a_{i}\in\mathbb{R}:i\in J\}, and \bigwedge_{i\in J}b_{i}:=\inf\{b_{i}\in\mathbb{R}:i\in J\}, where J is any set of indices. The r dimensional maximum (supremum) operation \;\vee\cdots\vee_{(k_{1},\ldots,k_{r})\in\mathbb{Z}^{r}}\; is indicated by “ \;\vee_{\bar{k}\in\mathbb{Z}^{r}}\; ”. Clearly, if the cardinality of J is finite, then supremum and infimum in the above definitions reduce to a maximum and a minimum, respectively. \rho_{\mu}(\bar{y}):=\varphi_{\mu}(y_{1})\,\varphi_{\mu}(y_{2})\cdots\varphi_{\mu}(y_{r}),\qquad\bar{y}=(y_{1},\ldots,y_{r})\in\mathbb{R}^{r}. is the multivariate density function, where \varphi_{\mu}(y):=\frac{\mu(y+1)-\mu(y-1)}{2},\qquad y\in\mathbb{R}. For a given \bar{y}\in\mathcal{R} , n\in\mathbb{N} and \delta>0 , we define B_{\delta,n}(\bar{y}):=\left\{\bar{k}\in J_{n}:\left|\left|\frac{\bar{k}}{n}-\bar{y}\right|\right|_{2}>\delta\right\}. Lemma 1.1. [ 25 ] The maximum and minimum operations follow the following properties. ( C_{1} ) If for any a_{k},b_{k}\in\mathbb{R} (k\in\mathbb{N}) satisfying \displaystyle\bigvee_{k\in\mathbb{N}}a_{k}<\infty or \displaystyle\bigvee_{k\in\mathbb{N}}b_{k}<\infty , then we get \left|\;\bigvee_{k\in\mathbb{N}}a_{k}\;-\;\bigvee_{k\in\mathbb{N}}b_{k}\;\right|\;\leq\;\bigvee_{k\in\mathbb{N}}|a_{k}-b_{k}|. Here, we should state that the above lemma is also valid for all k\in\mathbb{Z} . ( C_{2} ) If x,y,z\in[0,1] , then |\,x\wedge y-x\wedge z\,|\;\leq\;x\wedge|\,y-z\,|. The neural network operator F_{n} defined as F_{n}(h,\bar{y}):=\frac{\displaystyle\sum_{k_{1}=\lceil na_{1}\rceil}^{\lfloor nb_{1}\rfloor}\cdots\sum_{k_{r}=\lceil na_{r}\rceil}^{\lfloor nb_{r}\rfloor}h\left(\frac{\bar{k}}{n}\right)\rho_{\mu}(n\bar{y}-\bar{k})}{\displaystyle\sum_{k_{1}=\lceil na_{1}\rceil}^{\lfloor nb_{1}\rfloor}\cdots\sum_{k_{r}=\lceil na_{r}\rceil}^{\lfloor nb_{r}\rfloor}\rho_{\mu}(n\bar{y}-\bar{k})},\qquad\bar{y}\in\mathcal{R}, was introduced by Anastassiou [ 17 ] , where \lceil\cdot\rceil and \lfloor\cdot\rfloor are used to denote the ceiling and integer part, respectively. Later in [ 19 ] , the summation in (1.3) was replace with maximum operation. In the maximum operation setting, Costarelli and Vinti [ 19 ] constructed the multivariate max-product neural network operator given by (1.4) F^{(M)}_{n}(h;\bar{y}):=\frac{\displaystyle\bigvee_{\bar{k}\in J^{r}_{n}}\left(h\!\left(\frac{\bar{k}}{n}\right)\rho_{\mu}(n\bar{y}-\bar{k})\right)}{\displaystyle\bigvee_{\bar{k}\in J^{r}_{n}}\rho_{\mu}(n\bar{y}-\bar{k})},\qquad\bar{y}\in\mathcal{R}, here J^{r}_{n}=\{\lceil na_{1}\rceil,\lfloor nb_{1}\rfloor\}\times\cdots\times\{\lceil na_{r}\rceil,\lfloor nb_{r}\rfloor\}\subset\mathbb{R}^{r},\bar{k}=(k_{1},\cdots,k_{r}) and the superscript (M) in the operator F^{(M)}_{n} denote the max-product operator. Besides the pointwise and uniform convergence theorems of the above operators, the authors in [ 8 , 19 ] also investigated the quasi-interpolation (QI) operators aiming at approximating functions on \mathbb{R}^{r} . For this purpose, the indices of the summation and maximum operations were replaced with \mathbb{Z}^{r} to J^{r}_{n} in the definitions of the operators (1.3) and (1.4) . Recently, Aslan [ 39 ] has introduced max-min neural network operators defined as: (1.5) F^{(m)}_{n}h(y):=\displaystyle\bigvee_{k=\lceil{na}\rceil}^{\lfloor{nb}\rfloor}\left[h\!\left(\frac{k}{n}\right)\wedge\left(\frac{\varphi_{\mu}(ny-k)}{\displaystyle\bigvee_{d=\lceil{na}\rceil}^{\lfloor{nb}\rfloor}\varphi_{\mu}(ny-d)}\right)\right],\qquad y\in[a,b], where n\in\mathbb{N} is so large that \lceil na\rceil\leq\lfloor nb\rfloor . Here, the superscript (m) of F^{(m)}_{n} denotes the max-min operator. This operator performs better than the classical neural network operator. However, it is slightly outperformed by the max-product neural network operator. The computational time and complexity are almost the same in all cases [ 39 ] . It is intriguing to achieve a multivariate extension of the results demonstrated by Aaslan [ 39 ] because neurocomputing processes typically include high dimensional data. For this reason, in this paper, we construct neural network operators in the max-min setting for the multivariate type function. Furthermore, we demonstrate that our well-define multivariate max-min neural network operator is pseudo-linear. We establish both pointwise and uniform convergence properties for the operator. Then, using the modulus of continuity and multivariate generalized absolute moment, we derive a rate of approximation. Also similar results are obtained for multivariate max-min type QI operators. At the end, we present some numerical examples and provide some graphical representation. Definition 1.2. Let h:\mathcal{R}\to[0,1] be given. Then the multivariate extension of the operation (1.5), denoted by \mathcal{L}_{n} , is defined as: (1.6) \mathcal{L}_{n}(h;\bar{y}):=\bigvee_{\bar{k}\in J^{r}_{n}}\left[h\!\left(\frac{\bar{k}}{n}\right)\wedge\left(\frac{\rho_{\mu}(n\bar{y}-\bar{k})}{\displaystyle\bigvee_{\bar{d}\in J^{r}_{n}}\rho_{\mu}(n\bar{y}-\bar{d})}\right)\right],\qquad\bar{y}\in\mathcal{R}, where n\in\mathbb{N} is so large such that \lceil na_{i}\rceil\leq\lceil nb_{i}\rceil , for all i\in\{1\dotsc r\} . Contrary to max-product and classical neural network operators, the max-min neural network operator is not homogeneous, that is, for every \alpha\in(0,1) , \mathcal{L}_{n}(\alpha h)\neq\alpha\mathcal{L}_{n}(h). In this paper, we consider non-decreasing

Read the complete text