Neural Statistical Functions
Daniel Xu, Yuxin Xie, Minghao Guo, Haixu Wu, Wojciech Matusik · 2026
Read Neural Statistical Functions by Daniel Xu, Yuxin Xie, Minghao Guo, Haixu Wu, Wojciech Matusik (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11327.txt.
Introduction
Xu and four colleagues introduce neural statistical functions, models that give stats directly instead of running a model again and again to sample. Old deep learning works case by case, so finding integrals, quantiles or maxima over ranges costs many runs. Their prefix statistics idea turns varied stat functions into one interval-conditional frame. An identity between prefix stats and single-case regression serves as the learning goal, and tests show up to a hundredfold fewer model runs.
Catalog record
| CREATOR | Daniel Xu, Yuxin Xie, Minghao Guo, Haixu Wu, Wojciech Matusik |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60296 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.11327
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Neural Statistical Functions Daniel Xu, Yuxin Xie, Minghao Guo, Haixu Wu, Wojciech Matusik Abstract Classical deep learning typically operates on individual cases. Despite its success, real-world usage often requires repeated inference to estimate statistical quantities for complex decision-making tasks involving uncertainty or extreme-value analysis, resulting in substantial latency. We introduce neural statistical functions , a new family of models learned from pre-trained single-sample predictors and scattered data samples, which can directly infer statistics over continuous operating condition ranges without explicit sampling. By introducing the notion of prefix statistics , we transform and unify diverse statistical functions ( e.g. , integrals, quantiles, and maxima) into an interval-conditional framework, in which a principled identity between the prefix statistics and the individual-case regression serves as the learning objective. Neural statistical functions achieve strong performance in estimating essential statistics of complex physical processes, including accumulated energy in dynamical systems, quantiles of aerodynamic responses, and maximum stress in crash processes, while achieving up to a 100 × \times reduction in model evaluations. 1 Introduction Deep learning has become widely used to build neural surrogates for expensive or complex forward systems [ 1 , 8 , 35 , 15 , 34 ] . For example, in physics simulation, given a geometry design together with an operating condition, the neural surrogate predicts the physical response, e.g. , pressure, stress, or energy [ 23 , 36 , 35 ] . While neural surrogates have substantially accelerated scientific discovery and engineering [ 36 , 22 , 2 ] , the standard interface remains single-condition prediction: the model is queried at one specified condition and returns the corresponding response. However, many deployment-time queries are not single-condition predictions. In design, planning, and reliability analysis, the required output is often a statistic of the response over a range of possible conditions: accumulated cost over a time window, failure probabilities over uncertain loads, or maximum stress over impact angles. A standard approach is Monte Carlo sampling or dense sweeping: repeatedly evaluate the simulator or its neural surrogate at many conditions, then compute the desired statistic, which can become prohibitively expensive [ 3 , 5 ] for numerical solvers and remain non-negligible for neural surrogates that output large spatial fields [ 37 ] . Figure 1 : This paper adopts a new prefix view for statistics. Consider industrial crash-test design as an example. Let \mathbf{x}\in\mathbb{R}^{N\times d} denote the spatial, geometric, or state representation at which a quantity of interest is evaluated ( e.g. , geometry of designed shapes), c represents the operating conditions ( e.g. , impact angle during crash), and \boldsymbol{h}(\mathbf{x},c) is the targeted quantity ( e.g. , inner stress). The standard approach to computing statistical properties \boldsymbol{h}_{\text{Stat}}(\cdot,\cdot) within the varying condition interval [c_{0},c_{1}] can be formalized as: \boldsymbol{h}_{\text{Stat}}(\mathbf{x},[c_{0},c_{1}])=\operatorname{Stat}\big(\{\boldsymbol{h}(\mathbf{x},c);c\sim[c_{0},c_{1}]\subseteq[c_{\text{min}},c_{\text{max}}]\}\big), (1) where \operatorname{Stat}(\cdot) is the targeted statistical function and may denote an integral, quantile, maximum, or other statistic. The above formalization is naturally compatible with existing single-condition inference conventions shown in Figure 1 (a), where we can learn a neural network \boldsymbol{h}_{\theta}\approx\boldsymbol{h} for single-sample regression [ 19 , 36 ] . However, such a single-case view incurs high computation cost due to multiple inferences and cannot easily adapt to changes in the condition interval, which requires a new round of sampling. Figure 2 : Number of model inferences to achieve comparable accuracy under three experimental scenarios. Compared to the single-condition inference model, neural statistical functions do not rely on unwieldy sampling operations, thereby significantly reducing the number of model inferences. We depart from this convention by adopting a new perspective on the varying-condition regression task, which we call the prefix view. As demonstrated in Figure 1 (b), rather than learning the specific quantity under a single operating condition c , we propose to learn the neural network to approximate the prefix statistics \tilde{\boldsymbol{h}}(\mathbf{x},\cdot) . Taking integral estimation as an example, let \tilde{\boldsymbol{h}}(\mathbf{x},c) denote the accumulated response from c_{\min} to c . Then the integral over any interval [c_{0},c_{1}] can be recovered by simple subtraction, which can be formally described as: \boldsymbol{h}_{\text{integral}}(\mathbf{x},[c_{0},c_{1}])=\tilde{\boldsymbol{h}}_{\text{integral}}(\mathbf{x},c_{1})-\tilde{\boldsymbol{h}}_{{\text{integral}}}(\mathbf{x},c_{0}),\ \text{where}\ \tilde{\boldsymbol{h}}_{{\text{integral}}}(\mathbf{x},c)=\int_{c_{\text{min}}}^{c}\boldsymbol{h}(\mathbf{x},u)\mathrm{d}u. (2) This new parameterization frees statistics estimation from unwieldy sampling operations by leveraging the non-linear approximation capacity of neural networks to fit \tilde{\boldsymbol{h}}(\cdot,\cdot) , which leads to a family of deep learning models we call neural statistical functions . Introducing the prefix view does not, however, by itself, ensure successful training and adoption of neural statistical functions for general statistical quantities. In addition to introducing this new type of neural network, we also construct the whole training and inference pipeline. 1) Regarding inference generalizability, although the prefix view is natural for integral, it is non-trivial to extend this idea to more complex statistics, e.g. , quantile and maxima, whose underlying statistical functions are not additive over intervals. Through a set of principled mathematical transformations, we demonstrate that these widely used statistics can be accurately calculated or approximated based on the prefix integral for a transformed function, which enables the general use of neural statistical functions. 2) Regarding training efficiency, rather than directly using the prefix integral computed from ground-truth data as supervision, which may also be extremely time-consuming and biased due to data sparsity, we find a principled identity that connects prefix statistics and individual-case regression model \boldsymbol{h}(\cdot,\cdot) , and further derive an efficient and stable learning objective. With neural statistical functions, we achieve accurate and efficient estimation of essential statistics of diverse processes, including accumulated energy in dynamical systems, quantiles of aerodynamic responses, and maximum stress in crash, achieving up to two orders of magnitude lower latency while maintaining comparable accuracy, demonstrating its potential in complex decision-making. 2 Related Work As a new type of neural network, neural statistical functions define a complete training–inference paradigm. While technically distinct, they are conceptually related to several lines of prior work. Integral in neural networks Integrals appear widely in neural networks as a basic operation in model architectures [ 10 , 11 ] and generative models [ 14 , 21 , 32 , 13 ] . As a pioneering work, Neural ODE [ 10 ] reformulates the representation learning in multilayer neural networks as a continuous-time integral, where the neural network learns the derivative of hidden states. Extending the numerical integral from model depth to real-world time, Neural ODE can be applied to simulate dynamic processes [ 29 ] . Recently, diffusion models have been developed based on multi-step denoising, where the numerical integral is adopted for inference [ 14 , 21 ] . Specifically, Mean Flow [ 13 ] proposes to directly learn the average velocity with one neural network, which does not rely on numerical integration along the denoising steps. Unlike prior work, our models focus on the statistical estimation over varying conditions and present a general framework for statistics beyond integral. Stochastic analysis As a representative decision-making task involving varying circumstances, mechanical design commonly uses stochastic analysis to study system behavior under varying conditions. Classical approaches such as stochastic finite element method (FEM) [ 33 , 18 ] provide principled tools for such analysis, but they can be computationally expensive despite developments in acceleration techniques. Although neural networks have been developed as efficient surrogates for numerical methods [ 17 , 6 ] , prior work focuses on deterministic methods, where