On the Sampling Performance of an Improved Stein Inequality Restricted Estimator

Using the Stein (1964) variance estimator, this paper defines a modified Stein inequality constrained estimator and derives its exact risk under quadratic loss. Numerical evaluations show that over a wide range of the parameter space, the modified Stein inequality constrained estimator has lower risk than the traditional Stein inequality constrained estimator introduced by Judge et al . (1984).     

ON THE USE OF THE STEIN VARIANCE ESTIMATOR IN THE DOUBLE k-CLASS ESTIMATOR IN REGRESSION

This paper investigates the predictive mean squared error performance of a modified double k-class estimator by incorporating the Stein variance estimator. Recent studies show that the performance of the Stein rule estimator can be improved by using the Stein variance estimator. However, as we demonstrate below, this conclusion does not hold in general for all members of the double k-class estimators. On the other hand, an estimator is found to have smaller predictive mean squared error than the Stein variance-Stein rule estimator, over quite large parts of the parameter space.     

Stein type confidence interval of the disturbance variance in a linear regression model with multivariate student-t distributed errors

This paper considers the interval estimation of the disturbance variance in a linear regression model with multivariate Student-t errors. The distribution function of the Stein type estimator under multivariate Student-t errors is derived, and the coverage probability of the Stein type confidence interval which is constructed under the normality assumption is numerically calculated under the multivariate Student-t distribution. It is shown that the coverage probability of the Stein type confidence interval is sometimes much smaller than the nominal level, and that it is larger than that of the usual confidence interval in almost all cases. For the case when it is known that errors have a multivariate Student-t distribution, sufficient conditions under which the Stein type confidence interval improves on the usual confidence interval are given, and the coverage probability of the stein type confidence interval is numerically evaluated.     

Improving on the sample covariance matrix for a complex elliptically contoured distribution

In this paper the problem of estimating the scale matrix in a complex elliptically contoured distribution (complex ECD) is addressed. An extended Haff–Stein identity for this model is derived. It is shown that the minimax estimators of the covariance matrix obtained under the complex normal model remain robust under the complex ECD model when the Stein loss function is employed.     

Semiparametric Stein estimators

Stein [Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. In Proc. 3rd Berkeley symp. math. statist. and pro. (pp. 197–206). University of California Press], in his seminal paper, came up with the surprising discovery that the sample mean is an inadmissible estimator of the population mean in three or higher dimensions under squared error loss. The past five decades have witnessed multiple extensions and variations of Stein’s results. In this paper we develop Stein-type estimators in a semiparametric framework and prove their coordinatewise asymptotic dominance over the sample mean in terms of Bayes risks.     

The exact mean squared error risks of preliminary test type estimators for the multivariate normal mean

The exact mean squared error risks of the preliminary test estimtor and the Sclove modified Stein rule estimator (Sclove, Morris and Radhakrishnan, 1972) for the multivariate normal mean are computed and their risks are compared with the risks of Stein estimators.     

The stein effect and bayesian analysis: a reexamination

The Stein, that one could improve frequentist risk by combining “independent” problems, has long been an intriguing paradox to statistics. We briefly review the Bayesian view of the paradox, and indicate that previous justifications of the Stein effect, through concerns of “Bayesian robustness,” were misleading. In the course of doing so, several existing robust Bayesian and Stein-effect estimators are compared for a variety of situations.     

Half-normal approximation for statistics of symmetric simple random walk

In 2013, Döbler used Stein’s method to obtain the uniform bounds in half-normal approximation for three statistics of a symmetric simple random walk; the maximum value, the number of returns to the origin and the number of sign changes up to a given time n. In this paper, we give the non-uniform bounds for these statistics by using Stein’s method and the concentration inequality approach.     

Confidence sets and the stein effect

The problem of improving upon the usual set estimator of a multivariate normal mean has only recently seen significant advances. Improved sets that take advantage of the Stein effect have been constructed. It is shown here that the Stein effect is so powerful that one can construct improved confidence sets that can have zero radius on a set of positive probability. Other, somewhat more sensible, sets which attain arbitrarily small radius are also constructed, and it is argued that one way to eliminate unreasonable confidence sets is through a conditional evaluation.     

Stein rule prediction of the composite target function in a general linear regression model

This paper considers the problem of simultaneous prediction of the actual and average values of the dependent variable in a general linear regression model. Utilizing the philosophy of Stein rule procedure, a family of improved predictors for a linear function of the actual and expected value of the dependent variable for the forecast period has been proposed. An unbiased estimator for the mean squared error (MSE) matrix of the proposed family of predictors has been obtained and dominance of the family of Stein rule predictors over the best linear unbiased predictor (BLUP) has been established under a quadratic loss function.     

A class of shrinkage estimators in linear regression

We consider the problem of using shrinkage estimators that shrink towards subspaces in linear regression, in particular subspaces spanned by principal components. This is especially important when multicollinearity is present and the number of predictors is not small compared to the sample size. New theoretical results about Stein estimation are used to get estimators with lower theoretical risk than standard Stein estimators used by Oman (1991). Application of the techniques to real data is largely successful.     

Estimation of the mean of a spherically symmetric distribution with constraints on the norm

The authors consider the problem of estimating, under quadratic loss, the mean of a spherically symmetric distribution when its norm is supposed to be known and when a residual vector is available. They give a necessary and sufficient condition for the optimal James‐Stein estimator to dominate the usual estimator. Various examples are given that are not necessarily variance mixtures of normal distributions. Consideration is also given to an alternative class of robust James‐Stein type estimators that take into account the residual vector. A more general domination condition is given for this class.     

On the use of the Stein variance estimator in the double <Emphasis Type="Italic">k</Emphasis>-class estimator when each individual regression coefficient is estimated

In this paper we consider the double k-class estimator which incorporates the Stein variance estimator. This estimator is called the SVKK estimator. We derive the explicit formula for the mean squared error (MSE) of the SVKK estimator for each individual regression coefficient. It is shown analytically that the MSE performance of the Stein-rule estimator for each individual regression coefficient can be improved by utilizing the Stein variance estimator. Also, MSE’s of several estimators included in a family of the SVKK estimators are compared by numerical evaluations.     

Equivariant estimation under the pitman closeness criterion

For the point estimation in models with group structures, an invariance approach to deriving superior estimators is discussed in the Pitman closeness (PC) criterion. When the maximal invariant statistic is parameter-free, that is, ancillary, the closest equivariant estimator to the true value in the PC criterion is presented. On the other hand, as an example where a distribution of the maximalinvariant statistic depends on unknown parameters, the paper treats the Stein problem in estimation of a variance and obtains an improved estimator in the PC criterion by Stein's invariance approach. Also the Stein problem in simultaneous estimation of a location vector of a spherical symmetric distribution is studied.     

A Note on the Comparison of the Stein Estimator and the James-Stein Estimator

The seminal work of Stein (1956 Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. Proc. Third Berkeley Symp. Mathemat. Statist. Probab., University of California Press, 1:197–206. [Google Scholar]) showed that the maximum likelihood estimator (MLE) of the mean vector of a p-dimensional multivariate normal distribution is inadmissible under the squared error loss function when p ? 3 and proposed the Stein estimator that dominates the MLE. Later, James and Stein (1961 James, W., Stein, C. (1961). Estimation with quadratic loss. Proc. Fourth Berkeley Symp. Mathemat. Statist. Probab., University of California Press, 1:361–379. [Google Scholar]) proposed the James-Stein estimator for the same problem and received much more attention than the original Stein estimator. We re-examined the Stein estimator and conducted an analytic comparison with the James-Stein estimator. We found that the Stein estimator outperforms the James-Stein estimator under certain scenarios and derived the sufficient conditions.     

Comparison of the Stein and the usual estimators for the regression error variance under the Pitman nearness criterion when variables are omitted

This paper compares the Stein and the usual estimators of the error variance under the Pitman nearness (PN) criterion in a regression model which is mis-specified due to missing relevant explanatory variables. The exact expression of the PN-probability is derived and numerically evaluated. Contrary to the well-known result under mean squared errors (MSE), with the PN criterion the Stein variance estimator is uniformly dominated by the usual estimator when no relevant variables are excluded from the model. With an increased degree of model mis-specification, neither estimator strictly dominates the other. The authors are grateful to two anonymous referees for their valuable comments. Also, the first author is grateful to the Japan Society for the Promotion of Science for partial financial support.     

Invariance,Optimality, and a 1-Observation Confidence Interval for a Normal Mean

In a 1965 Decision Theory course at Stanford University, Charles Stein began a digression with “an amusing problem”: is there a proper confidence interval for the mean based on a single observation from a normal distribution with both mean and variance unknown? Stein introduced the interval with endpoints ± c|X| and showed indeed that for c large enough, the minimum coverage probability (over all values for the mean and variance) could be made arbitrarily near one. While the problem and coverage calculation were in the author’s hand-written notes from the course, there was no development of any optimality result for the interval. Here, the Hunt–Stein construction plus analysis based on special features of the problem provides a “minimax” rule in the sense that it minimizes the maximum expected length among all procedures with fixed coverage (or, equivalently, maximizes the minimal coverage among all procedures with a fixed expected length). The minimax rule is a mixture of two confidence procedures that are equivariant under scale and sign changes, and are uniformly better than the classroom example or the natural interval X ± c|X|?.     

Shrinkage and modification techniques in estimation of variance and the related problems: A review

One of the surprising decision-theoretic results Charles Stein discovered is the inadmissibility of the uniformly minimum variance unbiased estirnator(UMVUE) of the variance of a normal distribution with an unknown mean. Some methods for deriving estimators better than the UMVUE were given by Stein. Brown, Brewster and Zidek. Recently Kubokawa established a novel approach, called the IERD method, by use of which one gets a unified class of improved estimators including their previous procedures. This paper gives a review for a series of these decision-theoretical developments as well as surveys the study of the variance-estimation problem from various aspects. Related to this issue, the paper enumerates several topics with the situations where the usual plain estimators are required to be shrunken or modified, and gives reasonable procedures improving the usual ones through the IERD method.     

The Risk of James–Stein and Lasso Shrinkage

This article compares the mean-squared error (or ?₂ risk) of ordinary least squares (OLS), James–Stein, and least absolute shrinkage and selection operator (Lasso) shrinkage estimators in simple linear regression where the number of regressors is smaller than the sample size. We compare and contrast the known risk bounds for these estimators, which shows that neither James–Stein nor Lasso uniformly dominates the other. We investigate the finite sample risk using a simple simulation experiment. We find that the risk of Lasso estimation is particularly sensitive to coefficient parameterization, and for a significant portion of the parameter space Lasso has higher mean-squared error than OLS. This investigation suggests that there are potential pitfalls arising with Lasso estimation, and simulation studies need to be more attentive to careful exploration of the parameter space.     

On a generalized stein estimator of regression coefficients

This paper studies a generalized Stein estimator of regression coefficients. The small disturbance approximations for the bias and mean square error matrix of the estimator are derived and a necessary and sufficient condition is obtained for the estimator to dominate the ordinary least squares estimator under the mean square error criterion.