Flatness of location-scale-shape models under the Wasserstein metric
Ayumu Fukushi, Yoshinori Nakanishi-Ohno, Takeru Matsuda · 2025
Read Flatness of location-scale-shape models under the Wasserstein metric by Ayumu Fukushi, Yoshinori Nakanishi-Ohno, Takeru Matsuda (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-09959.txt.
Introduction
Ayumu Fukushi, Yoshinori Nakanishi-Ohno, and Takeru Matsuda examine the geometry of a family of probability laws under the Wasserstein metric, which measures distance between laws by transport cost. One-dimensional location-scale models are known to be flat in this geometry. They are flat in themselves, and they sit flat in the larger space too. The authors present a location-scale-shape model that adds a shape parameter controlling tail heaviness, generalizing several laws used in extreme-value theory.
For this richer family, they show the geometry splits. The model is intrinsically flat, meaning its internal curvature vanishes. Yet it is extrinsically curved, meaning it bends inside the ambient space of laws. The contrast separates two notions of flatness that coincide for the simpler location-scale case and clarifies the shape family's structure.
Catalog record
| CREATOR | Ayumu Fukushi, Yoshinori Nakanishi-Ohno, Takeru Matsuda |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-09959
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Flatness of location-scale-shape models under the Wasserstein metric Ayumu Fukushi, Yoshinori Nakanishi-Ohno, Takeru Matsuda Abstract In Wasserstein geometry, one-dimensional location–scale models are flat both intrinsically and extrinsically-that is, they are curvature-free as well as totally geodesic in the space of probability distributions. In this study, we introduce a class of one-dimensional statistical models, termed the location–scale–shape model, which generalizes several distributions used in extreme-value theory. This model has a shape parameter that specifies the tail heaviness. We investigate the Wasserstein geometry of the location-scale-shape model and show that it is intrinsically flat but extrinsically curved. Keywords: Wasserstein geometry, Wasserstein information matrix, location-scale-shape model, displacement interpolation 1 Introduction In information geometry, a parametric family of probability distributions is called a statistical model. By viewing the parameters as coordinates, one regards the model as a manifold, equips it with various metrics and connections, and studies the resulting geometric properties; this viewpoint has many applications in statistics, machine learning, and related areas. In particular, the geometry induced by the Kullback–Leibler (KL) divergence has been extensively studied, and its close relationship to maximum likelihood estimation is well known [ 3 ] . The Wasserstein distance is a central notion of distance between probability distributions in statistics and machine learning [ 7 , 19 , 20 ] . It arises from the field of optimal transport, and the associated geometry is known as the Wasserstein geometry [ 22 , 23 ] . The associated metric is also known as Otto metric [ 18 ] . In contrast to the KL divergence, the Wasserstein distance is a genuine metric (symmetric and satisfying the triangle inequality) and remains meaningful even when the supports of the distributions differ. Also, the Wasserstein distance reflects the metric structure of the underlying space through transportation cost. Motivated by the fact that the Fisher information matrix arises as the second-order approximation to the KL divergence, Li and Zhao [ 14 ] proposed the Wasserstein information matrix. The intrinsic geometry induced by the Wasserstein information matrix and its statistical implications have been studied recently [ 2 , 5 , 6 , 13 , 12 , 14 ] . Whereas the Wasserstein distance does not admit a closed form in general, it is obtained in closed form in location-scale models [ 10 ] . This is the basis of recent studies on the Wasserstein geometry of location-scale models and its statistical application [ 1 , 2 , 15 ] . Geometrically, location-scale models are intrinsically flat as Riemannian manifolds under the metric proposed by [ 14 ] . Moreover, they are totally geodesic with respect to the \mathrm{L}^{2} -Wasserstein distance (i.e., closed under displacement interpolation). In this paper, we introduce the class of location-scale-shape models as an extension of the location-scale models and study its Wasserstein geometry. The shape parameter we introduce controls the tail heaviness, which is often the focus of statistical analysis. In particular, the generalized extreme value and generalized Pareto distributions—central to extreme value statistics, which concerns inference on rare events [ 9 ] —are not location-scale models but are the location-scale-shape models. We show that, as in earlier work on location–scale models, location–scale–shape models are intrinsically flat, however they are not extrinsically flat. This paper is organized as follows. In Section 2, we give a brief review of the framework by Li and Zhao [ 14 ] on the Wasserstein scores and the Wasserstein information matrix. In Section 3, we introduce the location-scale-shape model and derive its Wasserstein score functions and the Wasserstein information matrix. In Section 4, we discuss the Wasserstein–geometric properties of the location-scale-shape models. In particular, although the intrinsic curvature induced by the Wasserstein information matrix vanishes, the models is not totally geodesic with respect to the Wasserstein distance, i.e., it is not extrinsically flat when embedded in the Wasserstein space. 2 Preliminaries 2.1 Wasserstein information matrix On a measure space (\mathfrak{X},\mathfrak{B},\nu) , a family of probability density functions \mathcal{S} with parameter space \Theta , an open subset of \mathbb{R}^{n} , given by \mathcal{S}=\{p(x;\theta)\mid\theta\in\Theta\}, is called a statistical model. In information geometry, a statistical model is regarded as a manifold with \Theta as a system of local coordinates, and one studies the relationship between geometric properties and the statistical properties of models and estimators. Let (\mathfrak{X},d) be a complete separable metric space and let p\geq 1 . Denote by \mathcal{P}_{p}(\mathfrak{X}) the set of all Borel probability measures on (\mathfrak{X},d) with finite p -th moment: \displaystyle\mathcal{P}_{p}(\mathfrak{X})=\bigl\{\pi:\text{Borel probability measure on }(\mathfrak{X},d)\ \bigm|\ \int_{\mathfrak{X}}d(x,x_{0})^{p}\,\differential\mu(x)<\infty\,\bigr\}. (1) We define the L^{p} -Wasserstein distance W_{p}(\mu_{1},\mu_{2}) on \mathcal{P}_{p}(\mathfrak{X}) by \displaystyle W_{p}(\mu_{1},\mu_{2})^{p}:=\inf_{\pi\in\Pi(\mu_{1},\mu_{2})}\int_{\mathfrak{X}\times\mathfrak{X}}d(x,y)^{p}\differential\pi(x,y), (2) where \displaystyle\Pi(\mu_{1},\mu_{2})=\Bigl\{\,\pi\in\mathcal{P}_{k}(\mathfrak{X}\times\mathfrak{X})\ \Bigm|\ \pi(A\times\mathfrak{X})=\mu_{1}(A),\ \pi(\mathfrak{X}\times B)=\mu_{2}(B)\ (A,B\in\mathcal{B}(\mathfrak{X}))\Bigr\}. In what follows, we focus on the space \mathcal{P}_{2}(\mathbb{R}^{d}) , taking \mathfrak{X}=\mathbb{R}^{d} , p=2 , and d to be the Euclidean distance on \mathbb{R}^{d} . Li and Zhao [ 14 ] introduced analogues of the Fisher score function and Fisher information matrix on a statistical model \mathcal{S}\subset\mathcal{P}_{2}(\mathbb{R}^{d}) under the \mathrm{L}^{2} -Wasserstein distance. The Wasserstein score functions \Phi^{W}_{i}(x;\theta) , i=1,\dots,n , are defined as the solutions to the Poisson-type partial differential equation \displaystyle\nabla_{x}\cdot\bigl(p(x;\theta)\,\nabla_{x}\Phi^{W}_{i}(x;\theta)\bigr) \displaystyle=-\frac{\partial}{\partial\theta_{i}}p(x;\theta), (3) \displaystyle\mathbb{E}_{\theta}[\Phi^{W}_{i}(X;\theta)] \displaystyle=0, (4) where \nabla_{x} denotes the gradient with respect to x and \nabla_{x}\cdot denotes the divergence operator. Note that equation ( 3 ) is the parametric analogue of the continuity equation which, in optimal transport theory, characterizes geodesics in the \mathcal{P}_{2}(\mathbb{R}^{d}) . In a related direction, [ 6 ] introduced Wasserstein score functions for the case where \mathfrak{X} is a discrete space equipped with a undirected graph structure. The Wasserstein score functions are analogous to the Fisher score functions \frac{\partial\log p(x;\theta)}{\partial\theta^{i}} . We denote the Fisher score functions by \Phi^{F}_{i}(x;\theta) . We define the Wasserstein information matrix I^{W}(\theta) by \displaystyle I^{W}(\theta)_{ij}=\int\Phi^{W}_{i}(x;\theta)\,\frac{\partial p(x;\theta)}{\partial\theta^{j}}\,\differential x=\mathbb{E}_{\theta}\!\left[\nabla_{x}\Phi^{W}_{i}(x;\theta)^{\top}\nabla_{x}\Phi^{W}_{j}(x;\theta)\right]. (5) Same as the Fisher metric induced by the Fisher information matrix, the Wasserstein information matrix induces a Riemannian metric on \mathcal{S} . We call this the Wasserstein metric and denote it by g_{W} . This metric is also known as the Otto metric [ 18 ] . The Wasserstein information matrix is analogous to the Fisher information matrix I^{F}(\theta)_{ij}=\int\Phi^{F}_{i}(x;\theta)\frac{\partial p(x;\theta)}{\partial\theta^{j}}\differential x . The Wasserstein information matrix provides a second-order approximation of the \mathrm{L}^{2} -Wasserstein distance: \displaystyle W_{2}(p_{\theta},p_{\theta+\Delta\theta})=\tfrac{1}{2}\,\Delta\theta^{\top}I^{W}(\theta)\,\Delta\theta+o(\|\Delta\theta\|^{2}). This parallels the classical fact that the Fisher information matrix is the second-order approximation of the Kullback–Leibler divergence. Li and Zhao [ 14 ] also introduced an analogue of the maximum likelihood estimator and a new covariance notion; they derived a Wasserstein-–Cramér-–Rao inequality showing that the inverse of I^{W}(\theta) gives a lower bound on the estimation variance. We omit the details here. 2.2 Location-scale model Let f be a probability density function on \mathbb{R} , and let \theta=(\mu,\sigma) with \mu\in\mathbb{R} and \sigma>0 . The two-para statistical model \displaystyle p(x;\theta)=\frac{1}{\sigma}f\!\left(\frac{x-\mu}{\sigma}\right) is called the location-scale model, and we write \mathcal{M}_{f}=\quantity{p(x;\theta)\mid\theta\in\bbr\times\bbr_{>0}} . Here, \mu is the location parameter and \sigma is the scale parameter. For location-scale models, the Wasserstein distance ( 2 ) admits a closed form; moreover, they are totally geodesic in \mathcal{P}_{2}(\mathbb{R}) with respect to the \mathrm{L}^{2} -Wasserstein distance (i.e., closed under displacement interpolation) [ 10 ] . In the location-scale family, the Wasserstein score functions are \displaystyle\Phi_{\mu}^{W}(x;\theta) \displaystyle=x-\mathbb{E}_{\theta}[X], (6) \displaystyle\Phi_{\sigma}^{W}(x;\theta) \displaystyle=\frac{(x-\mu)^{2}}{2\sigma}-\frac{V_{\theta}[X]+(\mathbb{E}_{\theta}[X]-\mu)^{2}}{2\sigma}, (7) and the Wasserstein information matrix I^{W}(\theta) is \displaystyle I^{W}(\theta)=\begin{pmatrix}1&{\mathbb{E}_{\theta}[X]-\mu\over\sigma}\\ {\mathbb{E}_{\theta}[X]-\mu\over\sigma}&{V_{\theta}[X]\over\sigma^{2}}\end{pmatrix}. (8) Note that if f has mean