Minmax Exclusivity Classes for Power-Type Loss Functions

Stanisław M. S. Halkiewicz · 2025

Read Minmax Exclusivity Classes for Power-Type Loss Functions by Stanisław M. S. Halkiewicz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12447.txt.

Introduction

Stanisław Halkiewicz asks which choices of loss function actually change the best decision in statistical problems, in a 2025 paper. Practitioners pick losses from families, such as a quantile level or a margin rule. Many picks may lead to the very same optimal rule. Others flip the answer entirely. Knowing which features matter saves needless debate.

Two losses count as compatible when they share an optimal decision. Groups of compatible losses form the classes of the paper's title. For quantile scores, the answer turns out to be the quantile level itself. For margin losses, a single invariant decides the class. The theory sorts cosmetic choices from real ones. Forecasters and machine learning users gain clarity on loss selection.

Catalog record

CREATORStanisław M. S. Halkiewicz
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-12447

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Minmax Exclusivity Classes for Power-Type Loss Functions Stanisław M. S. Halkiewicz Abstract In statistical decision theory, the choice of loss function fundamentally shapes which estimators qualify as optimal. This paper introduces and develops the general concept of exclusivity classes of loss functions: subsets of loss functions such that no estimator can be optimal (according to a specified notion) for losses lying in different classes. We focus on the case of minmax optimality and define minmax exclusivity classes , demonstrating that the classical family of power-type loss functions L p ​ ( θ , a ) = | θ − a | p L_{p}(\theta,a)=|\theta-a|^{p} forms such a class. Under standard regularity and smoothness assumptions, we prove that no estimator can be simultaneously minmax for losses belonging to two distinct L p L_{p} classes. This result is obtained via a perturbation argument relying on differentiability of risk functionals and the conic structure of loss spaces. We formalize the framework of exclusivity partitions, distinguishing trivial and realizable structures, and analyze their algebraic properties. These results open a broader inquiry into the geometry of estimator optimality, and the potential classification of the loss function space via exclusivity principles. keywords [class=MSC] Primary 62C20 , 62C05 ; secondary 62F10 , 47L07 keywords minmax estimators , loss functions , mathematical statistics ?? Department of Applied Mathematics, AGH University of Cracow Name, ?? 1 Introduction The choice of loss function is fundamental in statistical decision theory, as it determines how estimation errors are evaluated and penalized. Different loss functions yield different notions of estimator optimality, shaping the selection of statistical procedures. One of the most widely studied optimality criteria is the minmax principle , introduced by Wald 1950 , which advocates selecting an estimator that minimizes the worst-case expected loss over the parameter space. This principle was further developed in the foundational works of Cam 1986 and Brown 1986 , and is systematically presented in standard references such as Berger 1985 . Recent contributions continue to refine its scope in both classical and modern settings [ 11 , 4 , 5 ] . Formally, let \theta denote a parameter in a statistical model, and let X be the observed data with distribution P_{\theta} . For a loss function L(\theta,a) and an estimator a(X) , the frequentist risk is defined by R(\theta,a)=\mathbb{E}_{\theta}[L(\theta,a(X))]. (1) An estimator a^{*} is said to be minmax if it satisfies \sup_{\theta}R(\theta,a^{*})=\inf_{a}\sup_{\theta}R(\theta,a), (2) i.e., it minimizes the maximum risk over all parameter values. It is well known that the form of the loss function critically affects which estimators are minmax. Under squared-error loss L(\theta,a)=(\theta-a)^{2} , the sample mean is minmax for the location parameter of i.i.d. normal observations (see 8 , Ch. 5 ). In contrast, under absolute-error loss L(\theta,a)=|\theta-a| , the sample median achieves the minmax risk [ 6 ] . These classical examples illustrate that distinct loss functions yield distinct minmax estimators, raising a natural question: can a single estimator be minmax for more than one type of loss? In this paper, we develop a general framework for addressing this question. We introduce the notion of exclusivity classes of loss functions—collections of losses such that no estimator is optimal (with respect to a given criterion) for losses drawn from different classes. An exclusivity class reflects the idea that the optimality of an estimator is inherently tied to the form of the loss used. When the optimality criterion is minmaxity, we speak of minmax exclusivity classes . As a first case study, we examine the family of power-type loss functions, given by L_{p}(\theta,a)=|\theta-a|^{p},\qquad p>0, (3) which includes the absolute-error ( p=1 ) and squared-error ( p=2 ) losses as special cases. Earlier asymptotic theory has studied minmax procedures under fixed L_{p} losses [ 7 , 9 ] , but these works did not address whether minmaxity could persist across different exponents p and q . In particular, it has remained an open question whether a single estimator could be minmax under both L_{p} and L_{q} for p\neq q . We resolve this question under mild regularity and smoothness assumptions, proving that no estimator can be minmax for both L_{p} and L_{q} when p\neq q . That is, the power-type loss classes \mathcal{L}_{p} form disjoint minmax exclusivity classes. The proof relies on a perturbative argument exploiting differences in the local curvature of risk functionals under different L_{p} losses. Beyond this main result, we initiate a broader investigation of exclusivity classes and their structure. We formalize a general theory of exclusivity regions and realizable exclusivity partitions, and show that the L_{p} power classes are closed under positive scaling, forming convex cones in the ambient space of loss functions. These geometric and algebraic properties suggest a deeper slicing of the loss function space along optimality boundaries, raising new questions about the classification of loss functions via exclusivity. The remainder of the paper is organized as follows. Section 2 provides formal definitions and notation, including loss spaces, risk functions, and exclusivity classes. In Section 3 , we develop the general theory of exclusivity partitions. Section 5 investigates the algebraic structure of loss function classes. Section 4 states our main theorem on the exclusivity of minmax estimators for power-type losses. The formal proof is presented in Section 6 . Finally, Section 7 discusses open problems and future directions for research. 2 Preliminaries In this section, we introduce the notation and foundational concepts used throughout the paper. We adopt a frequentist decision-theoretic framework for the estimation problem, defining estimators, loss functions, and risk, and then formalizing the minmax criterion. For completeness, we summarize all relevant notation here. Definition 2.1 (Parameter space) . Let \Theta\subseteq\mathbb{R} denote the parameter space , i.e., the set of all possible values of the unknown parameter \theta . We assume \Theta is a nonempty closed interval (possibly unbounded), and that the true parameter value lies in its interior. We consider a statistical model \{P_{\theta}:\theta\in\Theta\} , where X is a random variable taking values in a measurable space \mathcal{X} , and P_{\theta} denotes the distribution of X under parameter \theta . Definition 2.2 (Estimator) . An estimator is a measurable function \hat{\theta}:\mathcal{X}\to\mathbb{R} producing an estimate of \theta based on the observed data X . We denote the set of all admissible estimators by \mathscr{D} . For any \hat{\theta}\in\mathscr{D} , we write \hat{\theta}(X) for the realized estimate. Remark 2.3 (Oracle estimators) . The function \delta(X)=\theta minimizes the pointwise loss L(\theta,a)=|\theta-a|^{p} for all p>0 , but it is not a valid estimator since it depends on the unknown parameter \theta . Estimators must be measurable functions of the observed data X alone. Throughout, we restrict attention to estimators \delta\in\mathscr{D} that are data-based decision rules. The oracle rule \delta(X)=\theta is excluded from consideration. Definition 2.4 (Loss function) . A loss function is a measurable map L:\Theta\times\Theta\to[0,\infty) that quantifies the cost incurred when the true parameter value is \theta but action a\in\Theta is taken. It is typically required that L(\theta,\theta)=0 for all \theta\in\Theta , and that L(\theta,a) increases as a deviates from \theta . A classical example is the squared-error loss: L(\theta,a)=(\theta-a)^{2}. (4) Definition 2.5 (Power-class loss functions) . For any exponent p>0 , the power-class of loss functions is defined as \mathcal{L}_{p}:=\left\{L\in\mathscr{L}\;\middle|\;L(\theta,a)=c|\theta-a|^{p}+o\left(|\theta-a|^{p}\right)\text{ as }a\to\theta,\text{ for some }c>0\right\}, (5) where the small-

Read the complete text