Estimating ordered variance of two scale mixture of normal distributions

Shrajal Bajpai, Lakshmi Kanta Patra · 2026

Read Estimating ordered variance of two scale mixture of normal distributions by Shrajal Bajpai, Lakshmi Kanta Patra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19868.txt.

Introduction

Shrajal Bajpai and Lakshmi Kanta Patra work on estimating variances that are known to come in a fixed order. Their data model mixes two normal distributions at different scales. Component-wise estimation asks for each variance separately while respecting the order. Two loss functions frame the problem: squared error loss and entropy loss.

The authors derive general results on when one estimator improves on another. From those results they construct estimators that beat the standard best affine equivariant estimator. Ordered parameters arise wherever theory fixes a ranking in advance. Better estimators sharpen tests and intervals in such problems. The work is a careful piece of decision theory with practical statistical payoff.

Catalog record

CREATORShrajal Bajpai, Lakshmi Kanta Patra
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-19868

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Estimating ordered variance of two scale mixture of normal distributions Shrajal Bajpai, Lakshmi Kanta Patra Abstract This study investigates component wise estimation of ordered variances of scale mixture of two normal distributions. For this study two special loss functions are considered namely squared error loss function and entropy loss function. We have derived the general improvement results and based on these results the estimators that outperform BAEE are obtained. Moreover under certain sufficient conditions a class of improved estimators is proposed for both loss functions. As a special case of scale mixture of normal distribution the results are applied to the multivariate t-distribution and obtained the improvement results. For this case a detailed numerical comparison is carried out which validates our theoretical findings. Keywords : Mixture models, squared error loss, entropy loss, multivariate t t distribution, improved estimators. 1 Introduction In various real-life scenarios, the experimenter often confronts prior information about the restrictions on parameters. For example, humidity levels in cities located near coastal regions are generally higher than those in inland towns. It is natural to assume the average pollution level of an industrial city is higher than that of a non-industrial city. Thus, it is natural to take some order restrictions on the parameter in statistical models. Numerous researchers studied the problem of estimating order-restricted parameters of various probability distributions. Some earlier works in this direction are on developing a maximum likelihood estimator when the parameters satisfy an order restriction. For a relevant discussion in this direction, we refer to 1 , 22 , 23 , 10 and 26 . In the past, several authors discussed the problem of finding improved estimators of the ordered parameters of various probability distributions. For some initial work on finding improved estimators of the ordered parameters of normal and exponential distributions, we refer to 6 , 11 , 15 , 27 , 13 , 12 , 14 , 7 . 8 investigated the problem of estimating the restricted normal means. The authors proposed several estimators and established the inadmissibility of the usual estimator. 25 discussed the estimation of restricted normal mean vector with known variance under the quadratic loss function when means are restricted to a polyhedral convex cone. They obtained a generalized Bayes estimator and studied its properties. The authors proved that the generalized Bayes estimator is minimax and admissible in the one-or two-dimensional case, but can be improved by a shrinkage estimator when the dimension is greater than two. 24 discussed the estimation of the common variance of two normal populations with ordered means under the scale invariant quadratic loss function. They proved the inadmissibility of usual estimators by proposing some dominating estimators. Estimation of ordered normal means under Linex loss has been studied by 9 . They proved that under certain sufficient conditions, the plug-in estimator dominates the unrestricted MLE. 3 considered the problem of estimating the common mean of two normal populations having ordered variance. They proposed estimators that dominate the usual estimator. The estimation of ordered means of a bivariate normal distribution has been studied by 18 under a sum-squared error loss function. The authors considered the estimation problem for both cases, that is, equal and unequal variances. For each case, a class of minimax estimators is proposed that improves upon the usual estimators. 16 considered the minimax estimation of common variance and common precision of two normal populations with ordered means under an invariant loss function. In this work, the authors showed the inadmissibility of the best affine equivariant estimator and MLE by proposing various dominating estimators. 2 investigated the estimation of the ordered variances of two normal populations with a common mean under the quadratic loss function. BAEE and its improvements are derived for ordered variances. Moreover, the authors estimated the smallest standard deviation of k(\geq 2) normal populations. They demonstrated the inadmissibility of BAEE for the smallest standard deviation by proposing improved equivariant estimators. 4 explored the point and interval estimation of powers of scale parameters of two normal populations having a common mean. Maximum likelihood and plug-in estimators have been proposed. The authors have proved inadmissibility of the best affine equivariant estimator. Moreover, in this work, the authors have proposed several interval estimators. In recent years, the improved estimation of the scale parameter in mixture models has been studied by 19 , 20 , 21 , and 17 . The ordered parameter estimation for the mixture of normal distribution models has not been previously studied. In this article, we consider estimating ordered variances of scale mixture of multivariate normal distribution. Let Y_{1},\dots,Y_{n} are p dimensional random vector having joint density \displaystyle f(y_{1},\dots,y_{n},\theta,\sigma^{2})=\int\frac{\tau^{np/2}}{(2\pi)^{np/2}\sigma^{np}}\exp\left(-\frac{\tau}{2\sigma^{2}}\sum_{i=1}^{n}(y_{i}-\theta)^{t}(y_{i}-\theta)\right)d\Pi(\tau) (1.1) Interpretation of ( 1.1 ), is for given \tau>0 we have Y_{1},\dots,Y_{n} are i.i.d with normal N_{p}(\theta,\frac{\sigma^{2}}{\tau}I_{p}) . This model is named as scale mixture of normal distribution. Here \tau is the mixing parameter having distribution \Pi(\tau) . So for a given \tau , sufficiency reduces to \bar{Y}\sim N_{p}(\theta,\frac{\sigma^{2}}{n\tau}I_{p}) , S\sim\frac{\sigma^{2}}{\tau}\chi^{2}_{p(n-1)} and both are independent. In this article we consider two scale mixture of normal models as, given \tau>0 \boldsymbol{X_{1}}\sim N_{p}(\boldsymbol{\theta}_{1},\frac{\sigma_{1}^{2}}{\tau}I),~~S_{1}\sim\frac{\sigma_{1}^{2}}{\tau}\chi^{2}_{m_{1}}~~\mbox{ and }~~\boldsymbol{X_{2}}\sim N_{q}(\boldsymbol{\theta}_{2},\frac{\sigma_{2}^{2}}{\tau}I),~~S_{2}\sim\frac{\sigma_{2}^{2}}{\tau}\chi^{2}_{m_{2}} (1.2) with the order restriction \sigma_{1}\leq\sigma_{2} and \boldsymbol{\theta}_{1}\in\mathbb{R}^{p},\boldsymbol{\theta}_{2}\in\mathbb{R}^{q} and \boldsymbol{X_{1}} , S_{1} , \boldsymbol{X_{2}} and S_{2} are independently distributed. We take T_{1}=\|\boldsymbol{X_{1}}\|^{2} and T_{2}=\|\boldsymbol{X_{2}}\|^{2} . Then T_{1}\sim\frac{\sigma_{1}^{2}}{\tau}\chi^{2}_{p}(\nu_{1}),~\nu_{1}=\frac{\tau\|\boldsymbol{\theta_{1}}\|^{2}}{\sigma^{2}_{1}}~~\mbox{ and }~~T_{2}\sim\frac{\sigma^{2}_{2}}{\tau}\chi^{2}_{q}(\nu_{2}),~\nu_{2}=\frac{\tau\|\boldsymbol{\theta_{2}}\|^{2}}{\sigma^{2}_{2}}. So T_{1}|L=l\sim\frac{\sigma_{1}^{2}}{\tau}\chi^{2}_{p+2l} and T_{2}|K=k\sim\frac{\sigma_{2}^{2}}{\tau}\chi^{2}_{q+2k} , where L and K are Poisson random variable with parameter \nu_{1} and \nu_{2} respectively. We will consider component wise estimation of \sigma_{i}^{2} , i=1,2 with respect to the following loss functions. \displaystyle\mbox{Squared error loss~}:~L_{1}(\delta,\sigma^{2})=\left(\delta/\sigma^{2}-1\right)^{2} \displaystyle\mbox{Entropy loss~}:~L_{2}(\delta,\sigma^{2})=(\delta/\sigma^{2})-\ln(\delta/\sigma^{2})-1 At first we use the principal of invariance. So we consider the affine group of transformations \mathcal{G}_{a_{i},b_{i}}=\left\{g_{a_{i},b_{i}}(x)=a_{i}x+b_{i},i=1,2,a_{i}>0,b_{i}\in\mathbb{R}\right\} Under this group, the form of the affine equivariant estimators of \sigma_{i}^{2} can be obtained as \delta_{\alpha_{i}}(\boldsymbol{X_{i}},\underline{S_{i}})=\alpha_{i}S_{i} (1.3) where \alpha_{i}>0 is a constant. The following lemma provides the BAEE of \sigma^{2}_{i} . Lemma 1.1 (i) For the squared error loss function L_{1}(t)=(t-1)^{2} , the BAEE of \sigma_{i}^{2} is \delta^{Q}_{0i}=\alpha_{iQ}S_{i} , where \alpha_{iQ}=\frac{E(\tau^{-1})}{(2+m_{i})E(\tau^{-2})} . (ii) For the entropy loss function L_{2}(t)=t-\ln t-1 , the BAEE of \sigma_{i}^{2} is \delta^{E}_{0i}=\alpha_{iE}S_{i} where \alpha_{iE}=\frac{m_{i}}{E(\tau^{-1})}. The rest of the paper is organized as follows. In Section 2 , we have discussed the improved estimation of \sigma_{1}^{2} . We have proposed estimators that dominate the BAEE under the squared error loss function and the entropy loss function. Furthermore, a class of estimators that improves upon the BAEE is given. In Section 3 , estimation of \sigma_{2}^{2} is considered. Improvement results similar to those in Section 2 are also obtained for this case. As an application we have obtained improved estimators of the ordered scale parameters of multivariate t- distribution. Finally, a simulation study has been carried out to asses the risk performance of the proposed estimators. 2 Estimation of \sigma_{1}^{2} In this section, we will consider the improved estimation of \sigma^{2}_{1} . Here, we are going to prove that the BAEE of \sigma^{2}_{1} is inadmissible by deriving an improved estimator. Consider a broader class of estimators based on S_{1} and S_{2} . \mathcal{C}_{1}=\left\{{\delta_{\phi_{1}}=\phi_{1}(Z_{1})S_{1}\big|Z_{1}=\frac{S_{2}}{S_{1}}},\ \phi_{1}\ \text{is positive measurable function}\right\}. It is observed that for BAEE \delta_{01}^{Q} and \delta_{01}^{E} , \phi_{1}(Z_{1})=\alpha_{1Q}, and \alpha_{1E} respectively. Risk function of the estimator \delta_{\phi_{1}} under squared error loss function is R(\delta_{\phi_{1}},\sigma^{2}_{1},\sigma^{2}_{2})=E\Big[\Big(\frac{\phi_{1}(Z_{1})S_{1}}{\sigma_{1}^{2}}-1\Big)^{2}\Big]=\;E\left[E\left\{\Big(\frac{\phi_{1}(Z_{1})S_{1}}{\sigma_{1}^{2}}-1\Big)^{2}\Big|Z_{1}\right\}\right]. To find a minimizer of the risk of \delta_{\phi_{1}} ,

Read the complete text