An asymptotic expansion of Wishart distribution when the population eigenvalues are infinitely dispersed

Takemura and Sheena [A. Takemura, Y. Sheena, Distribution of eigenvalues and eigenvectors of Wishart matrix when the population eigenvalues are infinitely dispersed and its application to minimax estimation of covariance matrix, J. Multivariate Anal. 94 (2005) 271–299] derived the asymptotic joint distribution of the eigenvalues and the eigenvectors of a Wishart matrix when the population eigenvalues become infinitely dispersed. They also showed necessary conditions for an estimator of the population covariance matrix to be tail minimax for typical loss functions by calculating the asymptotic risk of the estimator. In this paper, we further examine those distributions and risks by means of an asymptotic expansion. We obtain the asymptotic expansion of the distribution function of relevant elements of the sample eigenvalues and eigenvectors. We also derive the asymptotic expansion of the risk function of a scale and orthogonally equivariant estimator with respect to Stein’s loss. As an application, we prove non-minimaxity of Stein’s and Haff’s estimators, which has been an open problem for a long time.     

A new estimator of covariance matrix

The problem of estimating a covariance matrix is considered in this paper. Using the so-called partial Iwasawa coordinates of the covariance matrix, a new improved estimator dominating the James-Stein estimator is proposed. The results of a simulation study verifies that the new estimator provides a substantial improvement in risk under Stein's loss.     

Dominating james-stein positive-part estimator for normal mean with unknown covariance matrix

Assume that we have a random sample of size n from p-variate normal population and we wish to estimate the mean vector under quadratic loss with respect to the inverse of the unknown covariance matrix, A class of superior estimators to James-Stein positive part estimator is given when n>max{9p+10,13p-7}, based on the argument by Shao and Strawderman(1994).     

Improved minimax estimation of a normal precision matrix

Let S_{p × p} have a Wishart distribution with parameter matrix Σ and n degrees of freedom. We consider here the problem of estimating the precision matrix Σ^?1 under the loss functions L₁(σ) tr (σ) - log |σ| and L₂(σ) = tr (σ). James-Stein-type estimators have been derived for an arbitrary p. We also obtain an orthogonal invariant and a diagonal invariant minimax estimator under both loss functions. A Monte-Carlo simulation study indicates that the risk improvement of the orthogonal invariant estimators over the James-Stein type estimators, the Haff (1979) estimator, and the “testimator” given by Sinha and Ghosh (1987) is substantial.     

Improved estimation of the mean vector for student-t model

Improved James-Stein type estimation of the mean vector μ of a multovaroate Student-t population of dimension p with ν degrees of freedom is considered. In addition to the sample data, uncertain prior information on the value of the mean vector, in the form of a null hypothesis, is used for the estiamtion. The usual maximum liklihood estimator((mle) of μ is obtained and a test statistic for testing H₀:μ=μ₀ is derived. Based on the mle of μ and the tes statistic the preliminary test estimator (PTE), Stein-type shrinkage estimator (SE) and positive-rule shrinkage esiimator (PRSE) are defined. The bias and the quadratic risk of the estimators are evaiuated. The relative performances of the estimators are mvestigated by analyzing the risks under different condltlons It is observed that the FRSE dommates over he other three estimators, regardless of the vaiidity of the null hypothesis and the value ν.     

Two-stage james-stein estimators of the mean based on prior knowledge

We suggest five types of two-stage James-Stein type estimators of the mean vector μ based on prior knowledge about μ and two-stage sampling scheme proposed by Waikar and Katti(1971) Their risks are evaluated and calculated to compare with two-stage estimator suggested by Waikar and Katti(1971) when the prior form of an initial estimate of μ is 0. We find that the five estimators suggested here all have high efficiencies in large dimensions and/or in large value of ratio of two sample sizes at each stage.     

Shrinkage estimation of location parameters in a multivariate skew-normal distribution

Abstract

This paper studies decision theoretic properties of Stein type shrinkage estimators in simultaneous estimation of location parameters in a multivariate skew-normal distribution with known skewness parameters under a quadratic loss. The benchmark estimator is the best location equivariant estimator which is minimax. A class of shrinkage estimators improving on the best location equivariant estimator is constructed when the dimension of the location parameters is larger than or equal to four. An empirical Bayes estimator is also derived, and motivated from the Bayesian procedure, we suggest a simple skew-adjusted shrinkage estimator and show its dominance property. The performances of these estimators are investigated by simulation.     

Minimaxity of empirical bayes estimators of the means of independent normal variables with unequal variances

The problem of simultaneous estimation of normal means is considered when variances are unequal and the loss is sum of squared errors. Minimaxity or non-minimaxity of empirical Bayes estimators is investigated when the common prior distribution is given by normal one with mean 0. Minimaxity results for the case when the loss is a weighted sum of squared errors is also given. Monte Carlo simulation results are given to compare the risk behavior of the empirical Bayes estimator with those of other minimax ones.     

An Explicit Formula for the Risk of the Positive-Part James-Stein Estimator

When estimating a normal mean vector with variance known up to a multiplicative factor, it is well known that the positive-part James-Stein estimator is not admissible, but until now, no one has been able to exhibit a uniformly better estimator. We propose here an explicit formula for the risk of the positive-part James-Stein estimator.     

Minimax Estimation of the Bounded Parameter of Some Discrete Distributions Under LINEX Loss Function

For a class of discrete distributions, including Poisson(θ), Generalized Poisson(θ), Borel(m, θ), etc., we consider minimax estimation of the parameter θ under the assumption it lies in a bounded interval of the form [0, m] and a LINEX loss function. Explicit conditions for the minimax estimator to be Bayes with respect to a boundary supported prior are given. Also for Bernoulli(θ)-distribution, which is not in the mentioned class of discrete distributions, we give conditions for which the Bayes estimator of θ ∈ [0, m], m < 1 with respect to a boundary supported prior is minimax under LINEX loss function. Numerical values are given for the largest values of m for which the corresponding Bayes estimators of θ are minimax.     

Estimating the common hazard rate of two exponential distributions with ordered location parameters

This paper is concerned with estimating the common hazard rate of two exponential distributions with unknown and ordered location parameters under a general class of bowl-shaped scale invariant loss functions. The inadmissibility of the best affine equivariant estimator is established by deriving an improved estimator. Another estimator is obtained which improves upon the best affine equivariant estimator. A class of improving estimators is derived using the integral expression of risk difference approach of Kubokawa [A unified approach to improving equivariant estimators. Ann Statist. 1994;22(1):290–299]. These results are applied to specific loss functions. It is further shown that these estimators can be derived for four important sampling schemes: (i) complete and i.i.d. sample, (ii) record values, (iii) type-II censoring, and (iv) progressive Type-II censoring. A simulation study is carried out for numerically comparing the risk performance of these proposed estimators.     

A comparison of mixed and minimax estimators of linear models

In this paper the stochastic properties of two estimators of linear models, mixed and minimax, based on different types of prior information, are compared using quadratic risk as the criterion for superiority. A necessary and sufficient condition for the minimax estimator to be superior to the comparable mixed estimator is derived as well as a simpler necessary but not sufficient condition.     

Performance of Preliminary Test Estimator Under Linex Loss Function

This article describes two bivariate geometric distributions. We investigate characterizations of bivariate geometric distributions using conditional failure rates and study properties of the bivariate geometric distributions. The bivariate models are fitted to real-life data using the Method of Moments, Maximum Likelihood, and Bayes Estimators. Two methods of moments estimators, in each bivariate geometric model, are compared and evaluated for their performance in terms of bias vector and covariance matrix. This comparison is done through a Monte Carlo simulation. Chi-square goodness-of-fit tests are used to evaluate model performance.     

Sequential shrinkage estimation of independent normal means with unkown variances

The Paper considers estimation of the p(> 3)-variate normal mean when the variance-covariance matrix is diagonal with unknown diagonal elements. A class of James-Stein estimators is developed, and is compared with the sample mean under an empirical minimax stopping rule. Asymptotic risk expansions are provided for both the sequential sample mean and the sequential James-Stein estimators. It is shown that the James-Stein estimators dominate the sample mean in a certain asymptotic sense.     

Simultaneous equivariant estimation of the parameters of matrix scale and matrix location-scale models

Eaton and Olkin (1987) discussed the problem of best equivariant estimator of the matrix scale parameter with respect to different scalar loss functions. Edwin Prabakaran and Chandrasekar (1994) developed simultaneous equivariant estimation approach and illustrated the method with examples. The problems considered in this paper are simultaneous equivariant estimation of the parameters of (i) a matrix scale model and (ii) a multivariate location-scale model. By considering matrix loss function (Klebanov, Linnik and Ruhin, 1971) a characterization of matrix minimum risk equivariant (MMRE) estimator of the matrix parameter is obtained in each case. Illustrative examples are provided in which MMRE estimators are obtained with respect to two matrix loss functions.     

Estimation of the location parameter and the average worth of the selected subset of two parameter exponential populations under LINEX loss function

Suppose a subset of populations is selected from k exponential populations with unknown location parameters θ₁, θ₂, …, θ_k and common known scale parameter σ. We consider the estimation of the location parameter of the selected population and the average worth of the selected subset under an asymmetric LINEX loss function. We show that the natural estimator of these parameters is biased and find the uniformly minimum risk-unbiased (UMRU) estimator of these parameters. In the case of k = 2, we find the minimax estimator of the location parameter of the smallest selected population. Furthermore, we compare numerically the risk of UMRU, minimax, and the natural estimators.     

Ridge regression estimators in the linear regression models with non-spherical errors

The present paper considers a family of ordinary ridge regression estimators in the linear regression model when the disturbances covariance matrix depends upon a few unknown parameters. An asymptotic expansion for the distribution of the ridge regression estimator is developed and under the quadratic loss function its asymptotic risk is compared with that of the feasible GLS estimator.     

A non stochastic ridge regression estimator and comparison with the James-Stein estimator

Abstract

This article presents a non-stochastic version of the Generalized Ridge Regression estimator that arises from a discussion of the properties of a Generalized Ridge Regression estimator whose shrinkage parameters are found to be close to their upper bounds. The resulting estimator takes the form of a shrinkage estimator that is superior to both the Ordinary Least Squares estimator and the James-Stein estimator under certain conditions. A numerical study is provided to investigate the range of signal to noise ratio under which the new estimator dominates the James-Stein estimator with respect to the prediction mean square error.     

Effect of heteroscedasticity between treatment groups on mixed‐effects models for repeated measures

Mixed‐effects models for repeated measures (MMRM) analyses using the Kenward‐Roger method for adjusting standard errors and degrees of freedom in an “unstructured” (UN) covariance structure are increasingly becoming common in primary analyses for group comparisons in longitudinal clinical trials. We evaluate the performance of an MMRM‐UN analysis using the Kenward‐Roger method when the variance of outcome between treatment groups is unequal. In addition, we provide alternative approaches for valid inferences in the MMRM analysis framework. Two simulations are conducted in cases with (1) unequal variance but equal correlation between the treatment groups and (2) unequal variance and unequal correlation between the groups. Our results in the first simulation indicate that MMRM‐UN analysis using the Kenward‐Roger method based on a common covariance matrix for the groups yields notably poor coverage probability (CP) with confidence intervals for the treatment effect when both the variance and the sample size between the groups are disparate. In addition, even when the randomization ratio is 1:1, the CP will fall seriously below the nominal confidence level if a treatment group with a large dropout proportion has a larger variance. Mixed‐effects models for repeated measures analysis with the Mancl and DeRouen covariance estimator shows relatively better performance than the traditional MMRM‐UN analysis method. In the second simulation, the traditional MMRM‐UN analysis leads to bias of the treatment effect and yields notably poor CP. Mixed‐effects models for repeated measures analysis fitting separate UN covariance structures for each group provides an unbiased estimate of the treatment effect and an acceptable CP. We do not recommend MMRM‐UN analysis using the Kenward‐Roger method based on a common covariance matrix for treatment groups, although it is frequently seen in applications, when heteroscedasticity between the groups is apparent in incomplete longitudinal data.     

Feasible robust estimator in restricted semiparametric regression models based on the LTS approach

Under some nonstochastic linear restrictions based on either additional information or prior knowledge in a semiparametric regression model, a family of feasible generalized robust estimators for the regression parameter is proposed. The least trimmed squares (LTS) method proposed by Rousseeuw as a highly robust regression estimator is a statistical technique for fitting a regression model based on the subset of h observations (out of n) whose least-square fit possesses the smallest sum of squared residuals. The coverage h may be set between n/2 and n. The LTS estimator involves computing the hyperplane that minimizes the sum of the smallest h squared residuals. For practical purpose, it is assumed that the covariance matrix of the error term is unknown and thus feasible estimators are replaced. Then, we develop an algorithm for the LTS estimator based on feasible methods. Through the Monte Carlo simulation studies and a real data example, performance of the feasible type of robust estimators is compared with the classical ones in restricted semiparametric regression models.