Sequential shrinkage estimation of independent normal means with unkown variances

The Paper considers estimation of the p(> 3)-variate normal mean when the variance-covariance matrix is diagonal with unknown diagonal elements. A class of James-Stein estimators is developed, and is compared with the sample mean under an empirical minimax stopping rule. Asymptotic risk expansions are provided for both the sequential sample mean and the sequential James-Stein estimators. It is shown that the James-Stein estimators dominate the sample mean in a certain asymptotic sense.     

A note on james-stein and bayes empiricl bayes estimators

In an empirical Bayes decision problem, a simple class of estimators is constructed that dominate the James-Stein

estimator, A prior distribution A is placed on a restricted (normal) class G of priors to produce a Bayes empirical Bayes estimator, The Bayes empirical Bayes estimator is smooth, admissible, and asymptotically optimal. For certain A rate of convergence to minimum Bayes risk is 0(n^-1)uniformly on G. The results of a Monte Carlo study are presented to demonstrate the favorable risk bebhavior of the Bayes estimator In comparison with other competitors including the James-Stein estimator.     

Estimation of a multivariate mean with constraints on the norm

Estimation of the mean θ of a spherical distribution with prior knowledge concerning the norm ||θ|| is considered. The best equivariant estimator is obtained for the local problem ||θ|| = λ₀, and its risk is evaluated. This yields a sharp lower bound for the risk functions of a large class of estimators. The risk functions of the best equivariant estimator and the best linear estimator are compared under departures from the assumption ||θ|| = λ₀.     

A class of modified stein estimators with easily computable risk functions

Consider the problem of estimating the mean of a p (≥3)-variate multi-normal distribution with identity variance-covariance matrix and with unweighted sum of squared error loss. A class of minimax, noncomparable (i.e. no estimate in the class dominates any other estimate in the class) estimates is proposed; the class contains rules dominating the simple James-Stein estimates. The estimates are essentially smoothed versions of the scaled, truncated James-Stein estimates studied by Efron and Morris. Explicit and analytically tractable expressions for their risks are obtained and are used to give guidelines for selecting estimates within the class.     

Two-stage james-stein estimators of the mean based on prior knowledge

We suggest five types of two-stage James-Stein type estimators of the mean vector μ based on prior knowledge about μ and two-stage sampling scheme proposed by Waikar and Katti(1971) Their risks are evaluated and calculated to compare with two-stage estimator suggested by Waikar and Katti(1971) when the prior form of an initial estimate of μ is 0. We find that the five estimators suggested here all have high efficiencies in large dimensions and/or in large value of ratio of two sample sizes at each stage.     

On selecting the best population

This paper deals with the problem of selecting the “best” population from a given number of populations in a decision theoretic framework. The class of selection rules considered is based on a suitable partition of the sample space. A selection rule is given which is shown to have certain optimum properties among the selection rules in the given class for a mal rules are known.     

Simultaneous estimation of the multivariate normal mean under balanced loss function

This paper considers simultaneous estimation of multivariate normal mean vector using Zellner's(1994) balanced loss function which is defined as follows:

where 0 < w < 1 and for i = 1,…,p and j = 1,…,n, X_ij is distributed as normal with mean θi and variance 1. It is shown that the sample mean, X, is admissible when p <3. For p ≥3, we obtain that James-Stein type estimator which has uniformly smaller risk than that of sample mean X.     

ON EMPIRICAL BAYES STOPPING TIMES

We consider the empirical Bayes decision theory where the component problems are the optimal fixed sample size decision problem and a sequential decision problem. With these components, an empirical Bayes decision procedure selects both a stopping rule function and a terminal decision rule function. Empirical Bayes stopping rules are constructed for each case and the asymptotic behaviours are investigated.     

Dominating james-stein positive-part estimator for normal mean with unknown covariance matrix

Assume that we have a random sample of size n from p-variate normal population and we wish to estimate the mean vector under quadratic loss with respect to the inverse of the unknown covariance matrix, A class of superior estimators to James-Stein positive part estimator is given when n>max{9p+10,13p-7}, based on the argument by Shao and Strawderman(1994).     

Improved estimation in Lognormal regression models

Lognormal regression model with unknown error variance is considered. We give a class of estimators of the regression coefficients vector improving upon traditional estimator when the number of independent variables is at least three. The relationship between these estimators on one hand and James-Stein type estimators of the normal mean and improved estimators of the normal variance on another hand is discussed.     

A decision theoretic approach to a distribution–free compound classification problem

A compound decision problem with component decision problem being the classification of a random sample as having come from one of the finite number of univariate populations is investigated. The Bayesian approach is discussed. A distribution–free decision rule is presented which has asymptotic risk equal to zero. The asymptotic efficiencies of these rules are discussed.

The results of a compter simulation are presented which compares the Bayes rule to the distribution–free rule under the assumption of normality. It is found that the distribution–free rule can be recommended in situations where certain key lo cation parameters are not known precisely and/or when certain distributional assumptions are not satisfied.     

An Explicit Formula for the Risk of the Positive-Part James-Stein Estimator

When estimating a normal mean vector with variance known up to a multiplicative factor, it is well known that the positive-part James-Stein estimator is not admissible, but until now, no one has been able to exhibit a uniformly better estimator. We propose here an explicit formula for the risk of the positive-part James-Stein estimator.     

Estimation of the mean of a spherically symmetric distribution with constraints on the norm

The authors consider the problem of estimating, under quadratic loss, the mean of a spherically symmetric distribution when its norm is supposed to be known and when a residual vector is available. They give a necessary and sufficient condition for the optimal James‐Stein estimator to dominate the usual estimator. Various examples are given that are not necessarily variance mixtures of normal distributions. Consideration is also given to an alternative class of robust James‐Stein type estimators that take into account the residual vector. A more general domination condition is given for this class.     

A modified least-failures sampling procedure for bernoulli subset selection

We restrict attention to a class of Bernoulli subset selection procedures which take observations one-at-a-time and can be compared directly to the Gupta-Sobel single-stage procedure. For the criterion of minimizing the expected total number of observations required to terminate experimentation, we show that optimal sampling rules within this class are not of practical interest. We thus turn to procedures which, although not optimal, exhibit desirable behavior with regard to this criterion. A procedure which employs a modification of the so-called least-failures sampling rule is proposed, and is shown to possess many desirable properties among a restricted class of Bernoulli subset selection procedures. Within this class, it is optimal for minimizing the number of observations taken from populations excluded from consideration following a subset selection experiment, and asymptotically optimal for minimizing the expected total number of observations required. In addition, it can result in substantial savings in the expected total num¬ber of observations required as compared to a single-stage procedure, thus it may be de¬sirable to a practitioner if sampling is costly or the sample size is limited.     

PERFORMANCE GUARANTEES FOR INDIVIDUALIZED TREATMENT RULES

Because many illnesses show heterogeneous response to treatment, there is increasing interest in individualizing treatment to patients [11]. An individualized treatment rule is a decision rule that recommends treatment according to patient characteristics. We consider the use of clinical trial data in the construction of an individualized treatment rule leading to highest mean response. This is a difficult computational problem because the objective function is the expectation of a weighted indicator function that is non-concave in the parameters. Furthermore there are frequently many pretreatment variables that may or may not be useful in constructing an optimal individualized treatment rule yet cost and interpretability considerations imply that only a few variables should be used by the individualized treatment rule. To address these challenges we consider estimation based on l(1) penalized least squares. This approach is justified via a finite sample upper bound on the difference between the mean response due to the estimated individualized treatment rule and the mean response due to the optimal individualized treatment rule.     

Γ-Optimal decision procedures for selecting the best population in randomized complete block design

In randomized complete block design, we face the problem of selecting the best population. If some partial information about the unknown parameters is available, then we wish to delermine the optimal decisin rule to select the best population.

In this paper, in the class of natural selection rules, we employ the Γ-optimal criterion to determine optimal decision rules that will minimize the maximum expected risk over the class of some partial information. Furthermore, the traditional hypothesis testing is briefly discussed from the view point of ranking and selecting.     

One sided acceptance sampling by variables: the case of the laplace distribution

The theory of acceptance sampling by variables is well known when the underlying distribution is normal. When the normality assumption is not true, using the usual normal case method can be quite misleading. In this paper we deal with the Laplace distribution for both the standard deviation known and then unknown. We establish a decision rule for accepting a lot of product containing a defective proportion p. We determine the density function of the decision rule statistic, for small and large sample sizes. We give some practical ways to choose the sample size and the acceptance constant to obtain a desired operating characteristic curve     

Regularization through variable selection and conditional MLE with application to classification in high dimensions

It is often the case that high-dimensional data consist of only a few informative components. Standard statistical modeling and estimation in such a situation is prone to inaccuracies due to overfitting, unless regularization methods are practiced. In the context of classification, we propose a class of regularization methods through shrinkage estimators. The shrinkage is based on variable selection coupled with conditional maximum likelihood. Using Stein's unbiased estimator of the risk, we derive an estimator for the optimal shrinkage method within a certain class. A comparison of the optimal shrinkage methods in a classification context, with the optimal shrinkage method when estimating a mean vector under a squared loss, is given. The latter problem is extensively studied, but it seems that the results of those studies are not completely relevant for classification. We demonstrate and examine our method on simulated data and compare it to feature annealed independence rule and Fisher's rule.     

Improved estimation of the mean vector for student-t model

Improved James-Stein type estimation of the mean vector μ of a multovaroate Student-t population of dimension p with ν degrees of freedom is considered. In addition to the sample data, uncertain prior information on the value of the mean vector, in the form of a null hypothesis, is used for the estiamtion. The usual maximum liklihood estimator((mle) of μ is obtained and a test statistic for testing H₀:μ=μ₀ is derived. Based on the mle of μ and the tes statistic the preliminary test estimator (PTE), Stein-type shrinkage estimator (SE) and positive-rule shrinkage esiimator (PRSE) are defined. The bias and the quadratic risk of the estimators are evaiuated. The relative performances of the estimators are mvestigated by analyzing the risks under different condltlons It is observed that the FRSE dommates over he other three estimators, regardless of the vaiidity of the null hypothesis and the value ν.     

On shrinkage m-estimators of location parameters

For a general class of continuous ( and marginally symmetric ) inultivariate distributions, based on suitable M-statistics ( involving bounded but possibly discontinuous score generating functions), shrinkage estimators of location are considered. These estimators are based on the James-Stein type rule and incorporates the idea of preliminary test estimation too. The main emphasis is laid on the study of asymptotic tdistributional ) risk properties of these est-innators, and asymptotic tin-) adraissibility results are also studied under fairly general regularity conditions.