Inference Functionals and Observation Operators for Distributional Statistical Models
R. Labouriau · 2026
Read Inference Functionals and Observation Operators for Distributional Statistical Models by R. Labouriau (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19189.txt.
Introduction
Rodrigo Labouriau extends inference functions to spread models, where each measure is a distribution kernel pair. The move rests on one insight: good likelihood results converge and follow a normal shape because the result is the root of a regular rule, not peak likelihood. He adds viewing operators mapping models to a viewing space, and defines new rules from them. The frame covers point data, censored interval data, convolutional measures, and transform stats. He proves convergence and a normal shape, with Godambe optimality and Fisher bounds beating operators and rules.
Catalog record
| CREATOR | R. Labouriau |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85355 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.19189
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Inference Functionals and Observation Operators for Distributional Statistical Models e-mail: [email protected] and [email protected] R. Labouriau Abstract This paper generalises the classical notion of inference function (Godambe, 1960) to distributional statistical models—models in which each probability measure is represented by a distribution–kernel pair ( T θ , φ ) ∈ 𝒮 ′ ( ℝ ) × 𝒮 ( ℝ ) (T_{\theta},\varphi)\in\mathcal{S}^{\prime}(\mathbb{R})\times\mathcal{S}(\mathbb{R}) . This generalisation is strategically motivated: the most useful properties of maximum likelihood estimation—consistency and asymptotic normality—derive not from the maximisation of the likelihood per se, but from the fact that the MLE is the root of a regular inference function (the score equation). Extending inference functions to the distributional setting therefore provides access to an optimality theory for models that lack classical densities or finite moments. The extension requires enlarging the notion of observation. We introduce observation operators 𝒪 : 𝒮 ′ ( ℝ ) → 𝒴 \mathcal{O}:\mathcal{S}^{\prime}(\mathbb{R})\to\mathcal{Y} that map distributional models to an observation space, and define inference functionals as estimating equations composed with these operators. The resulting framework encompasses classical point observations, interval-censored data, convolutional measurements, and transform-based statistics as special cases. We establish the asymptotic theory (consistency, asymptotic normality, Godambe optimality) under mild conditions and derive a hierarchy of information bounds—classical Fisher information dominates the information available through the observation operator, which in turn dominates the information captured by any inference functional—via the Hájek–Le Cam convolution theorem. The two gaps in the hierarchy quantify distinct sources of information loss: the observation mechanism and the choice of inference functional, respectively. Concrete examples include sinusoidal inference functions for heavy-tailed distributions, interval-censored location inference, elliptically contoured models, and the treatment of nuisance parameters via the Bhapkar–Godambe projection. Keywords: Inference functions, observation operators, distributional statistical models, Godambe information, Hájek–Le Cam convolution theorem. MSC 2020: 62F12, 62B15,62F10, 46F10, 62F35. 1 Introduction The aim of this paper is to extend the theory of inference functions to statistical models defined through distributional representations, thereby placing estimating-function methodology on a foundation that does not require classical densities or finite moments. In classical statistics, the theory of inference functions, initiated by Godambe (1960) [ 6 ] , provides a unifying framework for the construction and comparison of estimating equations. An inference function is a function \psi(x,\theta) of the data x and the parameter \theta , and the estimator \hat{\theta} is defined as the root of the estimating equation \sum_{i=1}^{n}\psi(X_{i},\theta)=0 . The maximum likelihood estimator is a special case: it is the root of the score equation \sum_{i}\partial_{\theta}\log f_{\theta}(X_{i})=0 . The key insight of Godambe’s programme is that the most attractive properties of maximum likelihood—consistency and asymptotic normality—arise not from the maximisation of the likelihood function but from the structure of the associated score equation. Specifically, the score is a regular inference function satisfying an unbiasedness condition ( \mathrm{E}_{\theta}[\psi(X,\theta)]=0 ), a sensitivity condition (non-degeneracy of \mathrm{E}_{\theta}[\partial_{\theta}\psi] ), and a variability condition (finiteness of \mathrm{E}_{\theta}[\psi^{2}] ), and it is these structural properties—not the global optimisation—that drive the asymptotic theory. This has a strategic consequence: for models where the classical likelihood is unavailable—whether because the model is distributional, the observations are not point evaluations, or the moments needed for standard estimating equations do not exist—the natural path is to generalise the inference function itself, rather than to seek a generalised likelihood. Distributional statistical models, developed in the companion paper [ 12 ] , encode each probability measure P_{\theta} as a pair (T_{\theta},\varphi) , where T_{\theta}\in\mathcal{S}^{\prime}(\mathbb{R}) is a tempered distribution and \varphi\in\mathcal{S}(\mathbb{R}) is a fixed Schwartz kernel shared across the parametric family. The pairing \langle T_{\theta},\psi\varphi\rangle replaces the classical expectation \mathrm{E}_{\theta}[\psi(X)] and is well defined for all functions \psi such that \psi\varphi\in\mathcal{S}(\mathbb{R}) —in particular, for all polynomials, so that moments of all orders exist unconditionally, even for distributions (such as the Cauchy or stable laws) whose classical moments are undefined. To generalise inference functions to this setting, one must first confront a conceptual question: what, precisely, does it mean to “observe” a distributional model? In classical statistics, an observation is a point evaluation: the random variable X_{i} takes the value x_{i} , and the inference function \psi(x_{i},\theta) is evaluated at that point. This presupposes that the underlying quantity has a well-defined value at each point. But as Strichartz (1994, Chapter 1) observes in the context of distribution theory, this assumption is often physically unrealistic. A thermometer, for instance, does not measure the temperature f(x) at a single point x ; rather, the bulb of the thermometer has a nonzero spatial extent, and what is actually measured is a weighted average \int f(y)\,\varphi(y)\,dy , where \varphi describes the response profile of the instrument. The measured quantity is not a point evaluation of f but the action of a linear functional on f . This everyday observation—that physical measurements are operators acting on the underlying quantity, not point evaluations—has deep consequences when combined with the programme of generalising inference functions. If the model is distributional and the observations are operators, then an inference function must be a functional of the operator output, not of a point value. This leads to the central concept of the present paper: an observation operator \mathcal{O}:\mathcal{S}^{\prime}(\mathbb{R})\to\mathcal{Y} that maps the distributional model to an observation space \mathcal{Y} , and an inference functional \Psi(Y,\theta) defined on the observed data Y=\mathcal{O}(T_{X}) . We use the term inference functional rather than inference function to reflect that \Psi acts on distributional objects; when the observation operator reduces to point evaluation, inference functionals reduce to classical inference functions in the sense of Godambe. The observation-operator formulation reveals a natural hierarchy of three conceptual layers. At the most general level ( Layer I ), observations are genuinely distributional: they are the output of linear operators acting on \mathcal{S}^{\prime}(\mathbb{R}) —interval functionals, convolutional measurements, spectral transforms—and the inference functional acts on operator-valued data. At an intermediate level ( Layer II ), observations are classical point values, but the inference functions are constructed from distributional identities—weak characteristic functions, oscillatory equations, weak moments—that do not require densities or finite classical moments; distributional constructions enter at the inferential level, not at the observational level. At the most classical level ( Layer III ), the score equation \sum_{i}\psi(X_{i},\theta)=0 is recovered as the special case in which the observation operator is point evaluation and the kernel weight is absorbed into the inference function. The paper develops these layers in the order I \to II \to III: the broadest conceptual framework is presented first, then specialised to transform-based methods, and finally connected to classical estimating-function theory. Beyond the conceptual unification, the operator-theoretic viewpoint yields a concrete structural result. The observation operator \mathcal{O} induces a pushforward model \{P_{\theta}^{\mathcal{O}}\} on the observation space \mathcal{Y} , and under standard regularity conditions this family is locally asymptotically normal (LAN). The Hájek–Le Cam convolution theorem then guarantees that every regular estimator \hat{\theta}_{n} based on the pushforward data satisfies \sqrt{n}(\hat{\theta}_{n}-\theta)\;\xrightarrow{\;\mathcal{D}\;}N\bigl(0,\,I_{\mathcal{O}}(\theta)^{-1}\bigr)*M, where I_{\mathcal{O}}(\theta) is the Fisher information of the pushforward model and M is a non-negative-definite noise distribution. The Godambe information G_{\Psi} of any inference functional \Psi satisfies G_{\Psi}\leq I_{\mathcal{O}} , and this inequality is a corollary of the convolution theorem, not a subjective choice of optimality criterion. The resulting hierarchy I_{\mathrm{classical}}(\theta)\;\geq\;I_{\mathcal{O}}(\theta)\;\geq\;G_{\Psi}(\theta) (1) decomposes information loss into two distinct and interpretable sources: the gap I_{\mathrm{classical}}-I_{\mathcal{O}}