On the use of the Stein variance estimator in the double <Emphasis Type="Italic">k</Emphasis>-class estimator when each individual regression coefficient is estimated

In this paper we consider the double k-class estimator which incorporates the Stein variance estimator. This estimator is called the SVKK estimator. We derive the explicit formula for the mean squared error (MSE) of the SVKK estimator for each individual regression coefficient. It is shown analytically that the MSE performance of the Stein-rule estimator for each individual regression coefficient can be improved by utilizing the Stein variance estimator. Also, MSE’s of several estimators included in a family of the SVKK estimators are compared by numerical evaluations.     

Asymptotic mean squared error of constrained James–Stein estimators

In this paper, we consider the asymptotic expansion of the MSE of constrained James–Stein estimators. We provide an estimator of the MSE which is asymptotically valid upto O(m⁻¹). A simulation study is undertaken to evaluate the performance of these estimators.     

On a class of shrinkage estimators of vector of regression coefficients the

This paper studies a class of shrinkage estimators of the vector of regression coefficients. The small disturbance approximations for the bias and the mean squared error matrix of the estimator are derived. In the sense of mean squared error, these estimators dominate the least squares estimator and the generalized Stein estimator developed by Hosmane (1988).     

ON THE USE OF THE STEIN VARIANCE ESTIMATOR IN THE DOUBLE k-CLASS ESTIMATOR IN REGRESSION

This paper investigates the predictive mean squared error performance of a modified double k-class estimator by incorporating the Stein variance estimator. Recent studies show that the performance of the Stein rule estimator can be improved by using the Stein variance estimator. However, as we demonstrate below, this conclusion does not hold in general for all members of the double k-class estimators. On the other hand, an estimator is found to have smaller predictive mean squared error than the Stein variance-Stein rule estimator, over quite large parts of the parameter space.     

Simultaneous estimation of coefficients of variation

An improved asymptotic estimation theory for the coefficient of variation γ is developed under the homogeneity hypothesis that several coefficients of variation are the same. Assuming that homogeneity holds, it is advantageous to combine the data to estimate the common coefficient of variation. However, the combined estimator becomes inconsistent when the equality of the hypothesis does not hold. In this situation, estimators based on pretest and (James and Stein, 1961. Estimation with quadratic loss. Proceeding of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, pp. 361–379) principles are proposed. Asymptotic properties of the shrinkage estimator, positive-part and pretest estimators are discussed and compared with the standard and combined estimators. It is demonstrated that the positive part estimator utilizes the sample and nonsample information in a superior way relative to the ordinary shrinkage estimator.     

On the Sampling Performance of an Improved Stein Inequality Restricted Estimator

Using the Stein (1964) variance estimator, this paper defines a modified Stein inequality constrained estimator and derives its exact risk under quadratic loss. Numerical evaluations show that over a wide range of the parameter space, the modified Stein inequality constrained estimator has lower risk than the traditional Stein inequality constrained estimator introduced by Judge et al . (1984).     

On a generalized stein estimator of regression coefficients

This paper studies a generalized Stein estimator of regression coefficients. The small disturbance approximations for the bias and mean square error matrix of the estimator are derived and a necessary and sufficient condition is obtained for the estimator to dominate the ordinary least squares estimator under the mean square error criterion.     

Estimating the variance of a normal population by utilizing the information in a sample from a second related normal population

A class of estimators of the variance σ₁ ² of a normal population is introduced, by utilization the information in a sample from a second normal population with different mean and variance σ₂ ², under the restriction that σ₁ ²?≤?σ₂ ². Simulation results indicate that some members of this class are more efficient than the usual minimum variance unbiased estimator (MVUE) of σ₁ ², Stein estimator and Mehta and Gurland estimator. The case of known and unknown means are considered.     

A Note on the Comparison of the Stein Estimator and the James-Stein Estimator

The seminal work of Stein (1956 Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. Proc. Third Berkeley Symp. Mathemat. Statist. Probab., University of California Press, 1:197–206. [Google Scholar]) showed that the maximum likelihood estimator (MLE) of the mean vector of a p-dimensional multivariate normal distribution is inadmissible under the squared error loss function when p ? 3 and proposed the Stein estimator that dominates the MLE. Later, James and Stein (1961 James, W., Stein, C. (1961). Estimation with quadratic loss. Proc. Fourth Berkeley Symp. Mathemat. Statist. Probab., University of California Press, 1:361–379. [Google Scholar]) proposed the James-Stein estimator for the same problem and received much more attention than the original Stein estimator. We re-examined the Stein estimator and conducted an analytic comparison with the James-Stein estimator. We found that the Stein estimator outperforms the James-Stein estimator under certain scenarios and derived the sufficient conditions.     

SHRINKAGE, PRETEST AND ABSOLUTE PENALTY ESTIMATORS IN PARTIALLY LINEAR MODELS

We consider a partially linear model in which the vector of coefficients β in the linear part can be partitioned as ( β ₁, β ₂) , where β ₁ is the coefficient vector for main effects (e.g. treatment effect, genetic effects) and β ₂ is a vector for ‘nuisance’ effects (e.g. age, laboratory). In this situation, inference about β ₁ may benefit from moving the least squares estimate for the full model in the direction of the least squares estimate without the nuisance variables (Steinian shrinkage), or from dropping the nuisance variables if there is evidence that they do not provide useful information (pretesting). We investigate the asymptotic properties of Stein‐type and pretest semiparametric estimators under quadratic loss and show that, under general conditions, a Stein‐type semiparametric estimator improves on the full model conventional semiparametric least squares estimator. The relative performance of the estimators is examined using asymptotic analysis of quadratic risk functions and it is found that the Stein‐type estimator outperforms the full model estimator uniformly. By contrast, the pretest estimator dominates the least squares estimator only in a small part of the parameter space, which is consistent with the theory. We also consider an absolute penalty‐type estimator for partially linear models and give a Monte Carlo simulation comparison of shrinkage, pretest and the absolute penalty‐type estimators. The comparison shows that the shrinkage method performs better than the absolute penalty‐type estimation method when the dimension of the β ₂ parameter space is large.     

Estimating variances of strata in ranked set sampling

In RSS, the variance of observations in each ranked set plays an important role in finding an optimal design for unbalanced RSS and in inferring the population mean. The empirical estimator (i.e., the sample variance in a given ranked set) is most commonly used for estimating the variance in the literature. However, the empirical estimator does not use the information in the entire data over different ranked sets. Further, it is highly variable when the sample size is not large enough, as is typical in RSS applications. In this paper, we propose a plug-in estimator for the variance of each set, which is more efficient than the empirical one. The estimator uses a result in order statistics which characterizes the cumulative distribution function (CDF) of the rth order statistics as a function of the population CDF. We analytically prove the asymptotic normality of the proposed estimator. We further apply it to estimate the standard error of the RSS mean estimator. Both our simulation and empirical study show that our estimators consistently outperform existing methods.     

Remainder Markov systematic sampling

Systematic sampling is the simplest and easiest of the most common sampling methods. However, when the population size N cannot be evenly divided by the sampling size n, systematic sampling cannot be performed. Not only is it difficult to determine the sampling interval k equivalent to the sampling probability of the sampling unit, but also the sample size will be inconstant and the sample mean will be a biased estimator of the population mean. To solve this problem, this paper introduces an improved method for systematic sampling: the remainder Markov systematic sampling method. This new method involves separately finding the first-order and second-order inclusion probabilities. This approach uses the Horvitz-Thompson estimator as an unbiased estimator of the population mean to find the variance of the estimator. This study examines the effectiveness of the proposed method for different super-populations.     

Comparison of the Stein and the usual estimators for the regression error variance under the Pitman nearness criterion when variables are omitted

This paper compares the Stein and the usual estimators of the error variance under the Pitman nearness (PN) criterion in a regression model which is mis-specified due to missing relevant explanatory variables. The exact expression of the PN-probability is derived and numerically evaluated. Contrary to the well-known result under mean squared errors (MSE), with the PN criterion the Stein variance estimator is uniformly dominated by the usual estimator when no relevant variables are excluded from the model. With an increased degree of model mis-specification, neither estimator strictly dominates the other. The authors are grateful to two anonymous referees for their valuable comments. Also, the first author is grateful to the Japan Society for the Promotion of Science for partial financial support.     

An extension of the ranked set sampling theory

This paper is concerned with ranked set sampling theory which is useful to estimate the population mean when the order of a sample of small size can be found without measurements or with rough methods. Consider n sets of elements each set having size m. All elements of each set are ranked but only one is selected and quantified. The average of the quantified elements is adopted as the estimator. In this paper we introduce the notion of selective probability which is a generalization of a notion from Yanagawa and Shirahata (1976). Uniformly optimal unbiased procedures are found for some (n,m). Furthermore, procedures which are unbiased for all distributions and are good for symmetric distributions are studied for (n,m) which do not allow uniformly optimal unbiased procedures.     

The exact mean squared error risks of preliminary test type estimators for the multivariate normal mean

The exact mean squared error risks of the preliminary test estimtor and the Sclove modified Stein rule estimator (Sclove, Morris and Radhakrishnan, 1972) for the multivariate normal mean are computed and their risks are compared with the risks of Stein estimators.     

An exact small sample theory for post-stratification

A genuine small sample theory for post-stratification is developed in this paper. This includes the definition of a ratio estimator of the population mean ?, the derivation of its bias and its exact variance and a discussion of variance estimation. The estimator has both a within strata component of variance which is comparable with that obtained in proportional allocation stratified sampling and a between strata component of variance which will tend to zero as the overall sample size becomes large. Certain optimality properties of the estimator are obtained. The generalization of post-stratification from the simple random sampling to post-stratification used in conjunction with stratification and multi-stage designs is discussed.     

An explicit formula for the risk of James-Stein estimators

Expressions for the risk of a Stein estimator and its principal derivatives involve a well-defined. but nonevaluated. expectation term. Stein (1966) has suggested a second-order approximation. In this paper we present an alternative exact expression.     

On estimating the mean of the selected normal population in two-stage adaptive designs

Adaptive design is widely used in clinical trials. In this paper, we consider the problem of estimating the mean of the selected normal population in two-stage adaptive designs. Under the LINEX and L₂ loss functions, admissibility and minimax results are derived for some location invariant estimators of the selected normal mean. The naive sample mean estimator is shown to be inadmissible under the LINEX loss function and to be not minimax under both loss functions.     

Estimating a multivariate treatment effect under a biased allocation rule

In a clinical trial with a biased allocation rule whereby all and only those patients at risk are given the new treatment, Robbins and Zhang (1989) derived an asymptotically normal and efficient estimator of the mean difference between the new and old treatments on those at risk. This paper with the use of a well known identity of Stein (1981) generalizes the result to the multivariate situation.