Minimax property of stein's estimator

Stein's estimator and some other estimators of the mean of a K-variate normal distribution are known to dominate the maximum likelihood estimator under quadratic loss for K > 3, and are therefore minimax. In this paper it is shown that the minimax property of Stein's rule is preserved with respect to a generalized loss function.     

Generalized james-stein estimatoes

Let the p-component vector X be normally distributed with mean θ and covariance σ²I where I denotes the identity matrix. Stein's estimator of θ is kown to dominate the usual estimator X for p ≥ 3, We obtain a family of estimators which dominate Stein's estimator for p≥ 3     

Monotonic minimax estimators of a 2×2 covariance matrix

Let S : 2 × 2 have a nonsingular Wishart distribution with unknown matrix σ and n degrees of freedom. For estimating σ two families of mimmax estimators, with respect to the entropy loss, are presented. These estimators are of the form σ(S) = Rø(L)R^t where R is orthogonal, L and Φ are diagonal, and RLR^T = S. Conditions under which the components of Φ and L follow the same order relation [i.e., writing Φ = diag(Φ₁,Φ₂) and L = diag(l₁,/₂) with l₁ ≥ l₂, we have Φ₁ ≥ Φ₂] are established. Comparisons with Stein's estimators and other orthogonally invariant estimators are discussed.     

Minimax estimation of normal precisions via expansion estimators

In this paper, the simultaneous estimation of the precision parameters of k normal distributions is considered under the squared loss function in a decision-theoretic framework. Several classes of minimax estimators are derived by using the chi-square identity, and the generalized Bayes minimax estimators are developed out of the classes. It is also shown that the improvement on the unbiased estimators is characterized by the superharmonic function. This corresponds to Stein's [1981. Estimation of the mean of a multivariate normal distribution. Ann. Statist. 9, 1135–1151] result in simultaneous estimation of normal means.     

Wavelet threshold based on Stein's unbiased risk estimators of restricted location parameter in multivariate normal

In this paper, the problem of estimating the mean vector under non-negative constraints on location vector of the multivariate normal distribution is investigated. The value of the wavelet threshold based on Stein''s unbiased risk estimators is calculated for the shrinkage estimator in restricted parameter space. We suppose that covariance matrix is unknown and we find the dominant class of shrinkage estimators under Balance loss function. The performance evaluation of the proposed class of estimators is checked through a simulation study by using risk and average mean square error values.     

Multiparameter estimation in truncated power series distributions under the stein's loss

LetX ₁,…,X _p be p(≥2)independent random variables, where each X.has a distribution belonging to a one parameter truncated power series

distribution. The problem is to estimate simultaneously the unknown parameters under asymmetric loss developed by James and Stein (Proc. Fourth Berkeley Symp. Math. Statist. Prob. 1, 361-380). Several new classes of dominating estimators are obtained by solving a certain difference inequality.     

Estimation of a scale parameter in mixture models with unknown location

Estimation of the scale parameter in mixture models with unknown location is considered under Stein's loss. Under certain conditions, the inadmissibility of the “usual” estimator is established by exhibiting better estimators. In addition, robust improvements are found for a specified submodel of the original model. The results are applied to mixtures of normal distributions and mixtures of exponential distributions. Improved estimators of the variance of a normal distribution are shown to be robust under any scale mixture of normals having variance greater than the variance of that normal distribution. In particular, Stein's (Ann. Inst. Statist. Math. 16 (1964) 155) and Brewster's and Zidek's (Ann. Statist. 2 (1974) 21) estimators obtained under the normal model are robust under the t model, for arbitrary degrees of freedom, and under the double-exponential model. Improved estimators for the variance of a t distribution with unknown and arbitrary degrees of freedom are also given. In addition, improved estimators for the scale parameter of the multivariate Lomax distribution (which arises as a certain mixture of exponential distributions) are derived and the robustness of Zidek's (Ann. Statist. 1 (1973) 264) and Brewster's (Ann. Statist. 2 (1974) 553) estimators of the scale parameter of an exponential distribution is established under a class of modified Lomax distributions.     

Order-preserving Estimators and an Inequality on the Integration of Zonal Polynomial

ABSTRACT

Suppose X , p × p p.d. random matrix, has the distribution which depends on a p × p p.d. parameter matrix Σ and this distribution is orthogonally invariant. The orthogonally invariant estimator of Σ which has the eigenvalues of the same order as the eigenvalues of X is called order-preserving. We conjecture that a non-order-preserving estimator is dominated by modified order-preserving estimators with respect to the entropy (Stein's) loss function. We show that an inequality on the integration of zonal polynomial is sufficient for this conjecture. We also prove this inequality for the case p = 2.     

Estimation of a multivariate normal covariance matrix under a certain structure

We consider the estimation of Σ of the p-dimensional normal distribution N_p (0, Σ) when Σ?=?θ₀ I_p ?+?θ₁ aa′, where a is an unknown p-dimensional normalized vector and θ₀?>?0, θ₁?≥?0 are also unknown. First, we derive the restricted maximum likelihood (REML) estimator. Second, we propose a new estimator, which dominates the REML estimator with respect to Stein's loss function. Finally, we carry out Monte Carlo simulation to investigate the magnitude of the new estimator's superiority.     

THE MULTIPLE CORRELATION COEFFICIENT AND FISHER'S A STATISTIC1

Fisher's A statistic, often called the adjusted R² statistic, is shown to be a close approximation to the maximum likelihood estimate of the multiple correlation coefficient, p², based on the marginal distribution of R². Expansions for the estimate are obtained. The same methods lead to maximum marginal likelihood estimators for the noncentrality parameters for noncentral X² and F.     

The empirical Bayes estimators of the parameter of the Poisson distribution with a conjugate gamma prior under Stein's loss function

For the hierarchical Poisson and gamma model, we calculate the Bayes posterior estimator of the parameter of the Poisson distribution under Stein's loss function which penalizes gross overestimation and gross underestimation equally and the corresponding Posterior Expected Stein's Loss (PESL). We also obtain the Bayes posterior estimator of the parameter under the squared error loss and the corresponding PESL. Moreover, we obtain the empirical Bayes estimators of the parameter of the Poisson distribution with a conjugate gamma prior by two methods. In numerical simulations, we have illustrated: The two inequalities of the Bayes posterior estimators and the PESLs; the moment estimators and the Maximum Likelihood Estimators (MLEs) are consistent estimators of the hyperparameters; the goodness-of-fit of the model to the simulated data. The numerical results indicate that the MLEs are better than the moment estimators when estimating the hyperparameters. Finally, we exploit the attendance data on 314 high school juniors from two urban high schools to illustrate our theoretical studies.     

Multiparameter estimation of discrete exponential distributions

Let X₁, …, X_p be independent random variables, all having the same distribution up to a possibly varying unspecified parameter, where each of the p distributions belongs to the family of one parameter discrete exponential distributions. The problem is to estimate the unknown parameters simultaneously. Hudson (1978) shows that the minimum variance unbiased estimator (MVUE) of the parameters is inadmissible under squared error loss, and estimators better than the MVUE are proposed. Essentially, these estimators shrink the MVUE towards the origin. In this paper, we indicate that estimators shifting the MVUE towards a point different from the origin or a point determined by the observations can be obtained.     

Improved shrinkage estimators for the mean vector of a scale mixture of normals with unknown variance

The problem of estimating the mean θ of a not necessarily normal p-variate (p > 3) distribution with unknown covariance matrix of the form σ²A (A a known diagonal matrix) on the basis of n_i > 2 observations on each coordinate X_t (1 < i < p) is considered. It is argued that the class of scale (or variance) mixtures of normal distributions is a reasonable class to study. Assuming the loss function is quadratic, a large class of improved shrinkage estimators is developed in the case of a balanced design. We generalize results of Berger and Strawderman for one observation in the known-variance case. This methodology also permits the development of a new class of minimax shrinkage estimators of the mean of a p-variate normal distribution for an unbalanced design. Numerical calculations show that the improvements in risk can be substantial.     

Tests for the mean of a multivariate normal population

We study the problem of testing: H₀ : μ ∈ P against H₁ : μ ? P, based on a random sample of N observations from a p-dimensional normal distribution N_p(μ, Σ) with Σ > 0 and P a closed convex positively homogeneous set. We develop the likelihood-ratio test (LRT) for this problem. We show that the union-intersection principle leads to a test equivalent to the LRT. It also gives a large class of tests which are shown to be admissible by Stein's theorem (1956). Finally, we give the α-level cutoff points for the LRT.     

A computational study of a quasi-PORT methodology for VaR based on second-order reduced-bias estimation

In this paper, we deal with the estimation, under a semi-parametric framework, of the Value-at-Risk (VaR) at a level p, the size of the loss occurred with a small probability p. Under such a context, the classical VaR estimators are the Weissman–Hill estimators, based on any intermediate number k of top-order statistics. But these VaR estimators do not enjoy the adequate linear property of quantiles, contrarily to the PORT VaR estimators, which depend on an extra tuning parameter q, with 0≤q<1. We shall here consider ‘quasi-PORT’ reduced-bias VaR estimators, for which such a linear property is obtained approximately. They are based on a partially shifted version of a minimum-variance reduced-bias (MVRB) estimator of the extreme value index (EVI), the primary parameter in Statistics of Extremes. Due to the stability on k of the MVRB EVI and associated VaR estimates, we propose the use of a heuristic stability criterion for the choice of k and q, providing applications of the methodology to simulated data and to log-returns of financial stocks.     

Design considerations for small experiments and simple logistic regression

Inference for a generalized linear model is generally performed using asymptotic approximations for the bias and the covariance matrix of the parameter estimators. For small experiments, these approximations can be poor and result in estimators with considerable bias. We investigate the properties of designs for small experiments when the response is described by a simple logistic regression model and parameter estimators are to be obtained by the maximum penalized likelihood method of Firth [Firth, D., 1993, Bias reduction of maximum likelihood estimates. Biometrika, 80, 27–38]. Although this method achieves a reduction in bias, we illustrate that the remaining bias may be substantial for small experiments, and propose minimization of the integrated mean square error, based on Firth's estimates, as a suitable criterion for design selection. This approach is used to find locally optimal designs for two support points.     

Nonparametric estimation of 100(1 − p)% expected shortfall: p → 0 as sample size is increased

Expected shortfall (ES) is a well-known measure of extreme loss associated with a risky asset or portfolio. For any 0 < p < 1, the 100(1 ? p) percent ES is defined as the mean of the conditional loss distribution, given the event that the loss exceeds (1 ? p)th quantile of the marginal loss distribution. Estimation of ES based on asset return data is an important problem in finance. Several nonparametric estimators of the expected shortfall are available in the literature. Using Monte Carlo simulations, we compare the accuracy of these estimators under the condition that p → 0 as n → ∞ for several asset return time series models, where n is the sample size. Not much seems to be known regarding the properties of the ES estimators under this condition. For p close to zero, the ES measures an extreme loss in the right tail of the loss distribution of the asset or portfolio. Our simulations and real-data analysis provide insight into the effect of varying p with n on the performance of nonparametric ES estimators.     

Growth of tuber crops and almost sure band for quantiles

Some tuber crops are governed by memoryless property of exponential distribution leading to a mixture distribution with heavy tail. Quantile-based estimators may then be appropriate than mean as a measure of central tendency. We prove almost sure representation theorems for sample quantiles in a general setup of U statistics, under slightly stronger assumption than assuming the existence of a continuously differentiable distribution function F for the kernel h. We obtain almost sure (a.s.) upper and lower estimate for F^{? 1}(p), p ∈ (0, 1) as a band for p varying. As an application, dataset arising from two varieties of potato cultivation are analyzed.     

The Bayes rule of the variance parameter of the hierarchical normal and inverse gamma model under Stein's loss

For the variance parameter of the hierarchical normal and inverse gamma model, we analytically calculate the Bayes rule (estimator) with respect to a prior distribution IG (alpha, beta) under Stein's loss function. This estimator minimizes the posterior expected Stein's loss (PESL). We also analytically calculate the Bayes rule and the PESL under the squared error loss. Finally, the numerical simulations exemplify that the PESLs depend only on alpha and the number of observations. The Bayes rules and PESLs under Stein's loss are unanimously smaller than those under the squared error loss.     

Estimation of the common mean of two univariate normal populations

The problem of estimating the common mean μ of two univariate normal populations with unknown and unequal variances is considered from a decision-theoretic point of view. We restrict our attention to an appropriate class C and its three subclasses C_0C1C2of un-biased estimates of μ. We consider the usual estimate μ⁰ of μ which is the weighted linear combination of the sample means with weights as reciprocals of the sample variances. Its admissibility in C₀ and extended admissibility in C is proved. Admissible estimates in C₁ and C₂are also obtained.The loss is always assumed to be squared error. The question of admissibility of μ⁰ in the class of all estimators is still open.