Simplex–FEM Networks (SiFEN): learning a triangulated function approximator

Chaymae Yahyati, Ismail Lamaakal, Khalid El Makkaoui, Ibrahim Ouahbi, Yassine Maleh · 2025

Read Simplex–FEM Networks (SiFEN): learning a triangulated function approximator by Chaymae Yahyati, Ismail Lamaakal, Khalid El Makkaoui, Ibrahim Ouahbi, Yassine Maleh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04804.txt.

Introduction

Chaymae Yahyati leads five authors with SiFEN, a learned function approximator built like a finite element field. The predictor lays a learned triangular mesh over a possibly warped input space. Each query touches exactly one simplex and a handful of basis functions.

Bernstein-Bézier polynomials of chosen degree give smooth pieces on each triangle. Training adds shape regularization, coverage terms, and differentiable edge flips end to end. Under standard assumptions, the classic finite element accuracy rate is recovered. Explicit locality and sparse activation make the model cache-friendly, a practical edge for fast prediction on structured problems.

Catalog record

CREATORChaymae Yahyati, Ismail Lamaakal, Khalid El Makkaoui, Ibrahim Ouahbi, Yassine Maleh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE94 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-04804

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Simplex–FEM Networks (SiFEN): learning a triangulated function approximator Chaymae Yahyati, Ismail Lamaakal, Khalid El Makkaoui, Ibrahim Ouahbi, Yassine Maleh Abstract We introduce Simplex–FEM Networks (SiFEN) , a learned piecewise-polynomial predictor that represents f : ℝ d → ℝ k f:\mathbb{R}^{d}\to\mathbb{R}^{k} as a globally C r C^{r} finite-element field on a learned simplicial mesh in an optionally warped input space. Each query activates exactly one simplex and at most d + 1 d+1 basis functions via barycentric coordinates, yielding explicit locality, controllable smoothness, and cache-friendly sparsity. SiFEN pairs degree- m m Bernstein–Bézier polynomials with a light invertible warp and trains end-to-end with shape regularization, semi-discrete OT coverage, and differentiable edge flips. Under standard shape-regularity and bi-Lipschitz warp assumptions, SiFEN achieves the classic FEM approximation rate M − m / d M^{-m/d} with M M mesh vertices. Empirically, on synthetic approximation tasks, tabular regression/classification, and as a drop-in head on compact CNNs, SiFEN matches or surpasses MLPs and KANs at matched parameter budgets, improves calibration (lower ECE/Brier), and reduces inference latency due to geometric locality. These properties make SiFEN a compact, interpretable, and theoretically grounded alternative to dense MLPs and edge-spline networks. 1 Introduction Neural predictors are typically realized either as dense compositions of linear maps and fixed nonlinearities (MLPs) ( 13 ; 27 ) or as architectures that place learnable functions on edges (e.g., KANs) ( 41 ) . Both distribute capacity globally: every input traverses many activations, and improvements in expressivity often arrive with increased depth/width and less transparent geometry ( 47 ; 54 ; 67 ) . We propose a different viewpoint: make the predictor geometric and local (see Table 4 ). SiFEN represent f:\mathbb{R}^{d}!\to!\mathbb{R}^{k} as a finite–element field on a learned simplicial mesh in a (possibly warped) coordinate system ( 11 ; 8 ; 30 ; 14 ) . At inference, a query x is optionally mapped to y=\Phi_{\theta}(x) , located in the active simplex \sigma(y) , and evaluated with degree– m Bernstein–Bézier polynomials using barycentric coordinates ( 19 ; 26 ) . Exactly one simplex is active and at most d{+}1 basis functions contribute, producing hard sparsity, cache–friendly memory access, and explicit smoothness control ( C^{r} ) via linear continuity constraints across shared faces ( 28 ; 36 ; 51 ) . SiFEN couples modern training with classical approximation guarantees. The mesh (vertices and triangulation) is learned alongside polynomial coefficients and the optional warp through an objective that balances task loss with shape regularity (aspect–ratio/volume barriers) ( 64 ; 59 ; 34 ) , coverage via semi–discrete optimal transport ( 45 ; 32 ; 38 ) , continuity penalties ( 36 ) , and warp conditioning (bounded Jacobian/Lipschitz flows) ( 4 ; 9 ) . Local edge flips provide differentiable topology updates that improve element quality ( 55 ; 56 ) . Under standard FEM assumptions (shape-regular mesh, bounded warp Jacobian), degree– m SiFEN attains the expected M^{-m/d} error decay with M mesh vertices ( 11 ; 8 ) , offering principled knobs—mesh size M and degree m —to trade accuracy for compute and memory. Throughout, we assume a shape-regular simplicial mesh (bounded aspect ratios) and an invertible, bi-Lipschitz input warp \Phi_{\theta} with bounded Jacobian condition number. These assumptions are standard in FEM and match the regularizers we apply during training (shape and coverage barriers; warp conditioning). See Appx S for formal statements and constants. We evaluate SiFEN in three regimes: (i) synthetic approximation tasks spanning smooth, piecewise–smooth, and discontinuous targets in d\!\in\!\{2,5,10\} ; (ii) tabular regression and classification; and (iii) vision heads that replace the MLP classifier atop compact CNNs while freezing the backbone. At matched parameter budgets, SiFEN consistently matches or surpasses MLPs and KANs, with the largest gains on piecewise–smooth targets and near decision boundaries, where calibration improves markedly (lower ECE/Brier) ( 23 ) and selective–risk curves shift favorably. Practical efficiency follows from locality: average inference cost is point location O(\log M) plus evaluation of (d{+}1)B_{m}k coefficients, which reduces CPU latency versus dense heads of the same size, and stores coefficients in block–contiguous tables per simplex. Contributions. (1) We introduce SiFEN , a learned finite–element predictor that is globally C^{r} and sparse by construction , activating only one simplex and at most d{+}1 basis functions per input. (2) We provide an end–to–end training recipe that learns the mesh, coefficients, and an optional invertible warp with shape regularization, coverage via semi–discrete OT, and differentiable local flips for topology improvement. (3) We analyze approximation behavior (recovering M^{-m/d} rates under standard assumptions) and demonstrate strong empirical performance and calibration on synthetic, tabular, and CNN–head benchmarks at fixed parameter budgets, alongside favorable latency due to geometric locality. Relation to prior work. SiFEN differs from mixture–of–experts: there is no soft gating or averaging over many experts; exactly one cell is active and continuity arises from face constraints ( 29 ; 31 ; 62 ; 21 ; 15 ; 36 ; 51 ) . Compared to MLPs (dense, globally coupled) and KANs (edge–wise splines with dense routing), SiFEN provides explicit geometric partitions, controllable smoothness, and predictable scaling with mesh size and degree ( 27 ; 47 ; 61 ; 41 ; 11 ; 8 ; 3 ) . This offers a complementary—and often more interpretable—design point for function approximation and prediction. 2 SiFEN Explained SiFEN approximate f:\mathbb{R}^{d}\!\to\!\mathbb{R}^{k} by learning (i) a light geometric warp \Phi_{\theta} of the input space, (ii) a simplicial mesh \mathcal{T} with vertices V=\{v_{i}\}_{i=1}^{M} in the warped domain, and (iii) local Bernstein–Bézier polynomials on each simplex with global continuity constraints (see Appx G , M and O ). SiFEN differs from MLPs (dense nonlinear compositions) and KANs (edge-wise splines) by making geometry explicit: exactly one simplex is active per input (see Appx D ), so at most d{+}1 basis functions are touched. 1) Optional geometric warp. Given x\!\in\!\mathbb{R}^{d} , we map to y=\Phi_{\theta}(x) . We use a small, invertible (piecewise) smooth \Phi_{\theta} to (a) reduce anisotropy, (b) improve mesh regularity, and (c) concentrate vertices where data density is high. Two practical parameterizations: 1. Monotone triangular map (coupling-layer style): for j=1,\dots,d y_{j}=a_{j}(x_{1:j-1})\,x_{j}+b_{j}(x_{1:j-1}),\quad a_{j}(\cdot)>0, (1) with a_{j}=\zeta(\tilde{a}_{j}) for positivity. Jacobian is triangular; \det J_{\Phi}=\prod_{j}a_{j} . 2. Volume-controlled flow: y=x+\sum_{\ell=1}^{L}u_{\ell}(x)\,\psi_{\ell}(x) with small L and divergence control via \|\nabla\!\cdot u_{\ell}\| penalties. We regularize \Phi_{\theta} by \mathcal{R}_{\mathrm{warp}}(\Phi_{\theta})=\mathbb{E}_{x\sim\mathcal{S}}\Big[\underbrace{\|J_{\Phi}(x)\|_{F}^{2}+\|J_{\Phi}(x)^{-1}\|_{F}^{2}}_{\text{conditioning}}\;+\;\beta\cdot\underbrace{(\log|\det J_{\Phi}(x)|)^{2}}_{\text{volume control}}\Big], (2) estimated on minibatches. Setting \Phi_{\theta}=\mathrm{Id} recovers a purely geometric model. 2) Learned simplicial mesh. In y -space we learn M vertices V and a triangulation \mathcal{T} . Each simplex \sigma=\{v_{i_{0}},\ldots,v_{i_{d}}\} induces barycentric coordinates \lambda(y)\!\in\!\Delta^{d} defined by \lambda_{j}^{\sigma}(y)=\frac{\det\big([v_{i_{0}}\!-\!y,\ldots,v_{i_{j-1}}\!-\!y,\,v_{i_{j+1}}\!-\!y,\ldots,v_{i_{d}}\!-\!y]\big)}{\det\big([v_{i_{0}}\!-\!v_{i_{d}},\ldots,v_{i_{d-1}}\!-\!v_{i_{d}}]\big)}\!,\quad j\in\{0,\dots,d\},\ \sum_{j}\lambda_{j}^{\sigma}(y)=1. (3) We maintain shape-regularity with \mathcal{R}_{\mathrm{shape}}(V,\mathcal{T})=\sum_{\sigma\in\mathcal{T}}\Big[\underbrace{\phi\!\Big(\tfrac{R_{\text{circ}}(\sigma)}{r_{\text{in}}(\sigma)}\Big)}_{\text{aspect penalty}}\;+\;\underbrace{\psi\big(\mathrm{vol}(\sigma)\big)}_{\text{small-volume barrier}}\Big]. (4) where \phi(u)=\max(0,\,u-\kappa_{0})^{2} penalizes skinny simplexes ( \kappa_{0} e.g. 2.5 – 4 ), and \psi(v)=\mathbf{1}[v<v_{0}]\,(v_{0}/v-1)^{2} prevents collapse. In 2D we allow edge flips \{a,b\}\!\leftrightarrow\!\{c,d\} when the minimum angle increases (or Delaunay violation decreases); gradients are propagated with a straight-through estimator (STE) that treats the chosen adjacency as constant on backward. 3) Local polynomials with global continuity. On each simplex \sigma , we use degree- m Bernstein–Bézier basis functions over \lambda(y) : f_{\sigma}(y)=\sum_{\alpha\in\mathbb{N}^{d+1},\;|\alpha|=m}c_{\sigma,\alpha}\;\mathrm{B}_{\alpha}\!\big(\lambda(y)\big),\qquad\mathrm{B}_{\alpha}(\lambda)=\binom{m}{\alpha}\prod_{j=0}^{d}\lambda_{j}^{\alpha_{j}}. (5) with B_{m}=\binom{m+d}{d} basis terms per simplex and coefficients c_{\sigma,\alpha}\in\mathbb{R}^{k} . C^{0} continuity across a shared face \tau=\sigma\cap\sigma^{\prime} requires equality of face control points: \forall\,\alpha:\ |\alpha|=m,\ \alpha_{j^{\star}}=0\ \Rightarrow\ c_{\sigma,\alpha}=c_{\sigma^{\prime},P_{\sigma\to\sigma^{\prime}}(\alpha)}, (6) where j^{\star} indexes the vertex absent from the face in \sigma and P_{\sigma\to\sigma^{\prime}}

Read the complete text