CFNN: Continued Fraction Neural Network
Chao Wang, Xuancheng Zhou, Ruilin Hou, Xiaoyu Cheng, Ruiyi Ding · 2026
Read CFNN: Continued Fraction Neural Network by Chao Wang, Xuancheng Zhou, Ruilin Hou, Xiaoyu Cheng, Ruiyi Ding (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20634.txt.
Introduction
Wang and co-authors build neural networks from continued fractions. Plain multilayer networks struggle with sharp curves and singular points in science data. Their CFNN design bakes in a rational form, which fits such shapes well. They prove fast convergence and give stability guarantees. Three variants handle the risk of recursive instability. Tests beat plain networks in precision with far fewer parameters. Noise robustness rose up to 47 fold in their trials.
Catalog record
| CREATOR | Chao Wang, Xuancheng Zhou, Ruilin Hou, Xiaoyu Cheng, Ruiyi Ding |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85150 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.20634
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CFNN: Continued Fraction Neural Network Chao Wang, Xuancheng Zhou, Ruilin Hou, Xiaoyu Cheng, Ruiyi Ding Abstract The accurate characterization of non-linear functional manifolds with local singularities and sharp transitions is a fundamental challenge in scientific computing. While Multi-Layer Perceptrons (MLPs) dominate function approximation, their inherent polynomial inductive bias leads to a pronounced “spectral bias”, causing failure in resolving high-curvature features without prohibitive parameter scaling. Here, we introduce Continued Fraction Neural Networks (CFNNs), a novel architectural family that transcends these limitations by integrating the rigorous representation efficiency of continued fractions with gradient-based optimization. By parameterizing fractional terms as projection-based scalar polynomial transformations, CFNNs provide a “rational inductive bias” that aligns with Padé approximation theory, enabling the CFNN family to capture complex asymptotic behaviors and discontinuities with extreme parameter frugality. We provide formal approximation bounds demonstrating exponential convergence rates with respect to model depth and polynomial degree, along with rigorous stability guarantees for the proposed rational parameterizations. To overcome the recursive instability of deep fractional structures, we develop three specialized implementations: CFNN-Boost, which utilizes stage-wise additive modeling; CFNN-MoE, which partitions the input manifold using anisotropic radial basis function gated experts for adaptive feature space weighting; and CFNN-Hybrid, which combines parallel rational units with skip connections and provably bounded gradients. Benchmark results across diverse mathematical manifolds and real-world physical modeling tasks demonstrate that CFNNs consistently outperform MLPs in precision while requiring one to two orders of magnitude fewer parameters. Notably, CFNNs exhibit up to a 47-fold improvement in noise robustness and produce feature attributions consistent with underlying physical laws. By bridging the gap between black-box flexibility and white-box transparency, the CFNN family establishes a reliable “grey-box” paradigm for high-precision modeling in AI-driven scientific research. keywords Continued Fraction, Rational Inductive Bias, Grey-box Modeling 1 Introduction Function approximation stands as a cornerstone of modern scientific discovery, spanning disciplines from computational physics to complex dynamical system modeling 9 . At its core, the challenge lies in identifying mathematical representations capable of accurately characterizing high-dimensional, nonlinear mappings 13 . While Multi-Layer Perceptrons (MLPs) have achieved remarkable success in modeling unstructured data, their application to precision scientific computing reveals fundamental structural limitations 28 . Most notably, standard neural architectures exhibit a pronounced “spectral bias”, effectively capturing low-frequency global trends but struggling to resolve local near-singularities, sharp transitions, or intrinsic rational structures 31 ; 14 . Conventional strategies to mitigate these deficiencies frequently incur substantial computational costs, leading to parameter redundancy, numerical instability, and a lack of physical interpretability critical for scientific validation 19 ; 8 . An alternative paradigm for function representation, with deep roots in classical numerical analysis, is the theory of Continued Fractions 43 . Distinguished by their nested fractional structure and profound connection to Padé approximation theory, continued fractions offer unparalleled efficiency in modeling both local singularities and global asymptotic behaviors with a minimal set of parameters 37 ; 6 . However, the seamless integration of continued fractions into modern gradient-based optimization frameworks has remained an elusive goal 32 . Their deeply recursive nonlinear nature presents formidable challenges, including severe gradient instability and significant parallelization bottlenecks on modern hardware, which have historically restricted their adoption in deep learning 10 . To bridge this gap, we introduce the Continued Fraction Neural Network (CFNN) family, a novel architectural framework designed to synthesize the robust representation capabilities of continued fractions with the flexibility of contemporary deep learning. We propose a systematic parameterization that models fractional terms as projection-based scalar polynomial transformations, thereby ensuring analytical tractability and structural transparency. Crucially, we establish formal approximation bounds demonstrating that CFNN approximation errors decay exponentially with respect to the product of continued fraction depth and polynomial degree, in stark contrast to the polynomial decay rates of standard MLPs. Furthermore, we provide rigorous stability analysis characterizing the gradient boundedness and Lipschitz continuity properties of our regularized rational parameterizations. To address the optimization challenges inherent in deep recursion, we develop three specialized variants tailored to distinct topological challenges: CFNN-Boost employs stage-wise additive modeling to directly capture functional discontinuities and abrupt transitions through residual-based refinement; CFNN-MoE achieves adaptive isolation of local singularities via anisotropic RBF-gated expert partitioning, enabling flexible approximation of heterogeneous manifolds with varying degrees of regularity through learnable feature space weighting; and CFNN-Hybrid integrates parallel rational units with regularized denominators to efficiently fit continuous manifolds exhibiting extreme curvature while maintaining absolute numerical stability and provably bounded gradients across the real domain. Through a multi-dimensional evaluation encompassing special mathematical functions and diverse real-world modeling tasks, we demonstrate that the CFNN family consistently achieves superior approximation accuracy while requiring one to two orders of magnitude fewer parameters than calibrated MLPs. Furthermore, CFNNs exhibit a remarkable 47-fold improvement in noise suppression and extract feature hierarchies highly consistent with underlying physical laws. By balancing extreme expressivity with “grey-box” transparency, the CFNN family provides a powerful and interpretable modeling tool for the next generation of AI-driven scientific research. 2 Results 2.1 Optimization landscapes and structural scalability challenges The representational potency of CFNNs originates from their nested recursive structures, which mirror the exceptional function approximation capabilities of classical continued fractions. However, this recursive depth introduces significant optimization hurdles, specifically manifesting as severe gradient instability during training 32 ; 10 . This instability exacerbates as the network depth increases; as illustrated in Fig. 1 , the foundational CFNN architecture exhibits abrupt loss spikes and prolonged oscillatory plateaus, with training error rising to the 10^{7} scale before partially collapsing. By contrast, CFNN-Hybrid and CFNN-Boost decrease smoothly throughout training, while CFNN-MoE remains stable but converges to a visibly higher loss level in the zoomed late-epoch view. Such stochasticity in the optimization landscape fundamentally constrains the model’s ability to achieve high-precision functional fitting 38 . Theoretical frameworks suggest that increasing the depth of a continued fraction should monotonically enhance its representational capacity 42 ; 35 . Paradoxically, our experiments challenge this conventional wisdom in the context of neural optimization. By evaluating CFNNs of varying depths while maintaining a constant polynomial order, we observed a critical performance regression. Notably, the foundational CFNN reaches its best performance around depth 4, but then deteriorates sharply at depth 6 and only partially recovers thereafter, as shown in Fig. 3 . These phenomena suggest a structural limitation inherent in the basic CFNN formulation: its expressive power is highly sensitive to the specific recursive topology. The accumulation of gradient stochasticity across deeper layers creates a convoluted optimization manifold, leading to a profound divergence between theoretical representational limits and actual empirical performance. To address these bottlenecks, we constructed and benchmarked three architectural variants: CFNN-Boost, CFNN-MoE, and CFNN-Hybrid, designed to preserve the rational inductive bias while enhancing learning stability. These variants demonstrate a marked improvement in gradient regularity compared to the foundational CFNN. As shown in Fig. 2 , the foundational CFNN exhibits by far the largest gradient fluctuation, with a standard deviation of 9.69, whereas CFNN-Hybrid, CFNN-MoE, and CFNN-Boost reduce this value to 0.68, 0.33, and 0.01, respectively. This ordering is consistent with the smoother training trajectories observed in Fig. 1 , although the lowest gradient variance does not necessarily imply the lowest final fitting error. Crucially, these variants also exhibit robust parameter scalability. As illustrated in Fig. 3 , CFNN-Hybrid shows the strongest and most persistent improvement with depth,