Risk behavior of a pre-test estimator for normal variance with the Stein-type estimator

In this paper, we examine the risk behavior of a pre-test estimator for normal variance with the Stein-type estimator. The one-sided pre-test is conducted for the null hypothesis that the population variance is equal to a specific value, and the Stein-type estimator is used if the null hypothesis is rejected. A sufficient condition for the pre-test estimator to dominate the Stein-type estimator is shown.     

Choosing shrinkage estimators for regression problems

A Bayesian formulation of the canonical form of the standard regression model is used to compare various Stein-type estimators and the ridge estimator of regression coefficients, A particular (“constant prior”) Stein-type estimator having the same pattern of shrinkage as the ridge estimator is recommended for use.     

Stein-type estimation in logistic regression models based on minimum ϕ-divergence estimators

In this paper we present a study of Stein-type estimators for the unknown parameters in logistic regression models when it is suspected that the parameters may be restricted to a subspace of the parameter space. The Stein-type estimators studied are based on the minimum phi-divergence estimator instead on the maximum likelihood estimator as well as on phi-divergence test statistics.     

Performance of the stein-type two-parameter estimator in multiple linear regression model

In this article, we consider the Stein-type approach to the estimation of the regression parameter in a multiple regression model under a multicollinearity situation. The Stein-type two-parameter estimator is proposed when it is suspected that the regression parameter may be restricted to a subspace. The bias and the quadratic risk of the proposed estimator are derived and compared with the two-parameter estimator (TPE), the restricted TPE and the preliminary test TPE. The conditions of superiority of the proposed estimator are obtained. Finally, a real data example is provided to illustrate some of the theoretical results.     

Double shrunken selection operator

The least absolute shrinkage and selection operator (LASSO) is a prominent estimator which selects significant (under some sense) features and kills insignificant ones. Indeed the LASSO shrinks features larger than a noise level to zero. In this article, we force LASSO to be shrunken more by proposing a Stein-type shrinkage estimator emanating from the LASSO, namely the Stein-type LASSO. The newly proposed estimator proposes good performance in risk sense numerically. Variants of this estimator have smaller relative MSE and prediction error, compared to the LASSO, in the analysis of prostate cancer dataset.     

A note on classical Stein-type estimators in elliptically contoured models

In this paper the conditions under which a broad class of Stein-type estimators dominates the best invariant unbiased estimator of the mean of an elliptically contoured population have been established. The superiority conditions are derived for both known and unknown scale structures. Also an example is given when the general scale matrix is assumed to be known in linear regression.     

A note on Stein-type shrinkage estimator in partial linear models

In this paper, an exact sufficient condition for the dominance of the Stein-type shrinkage estimator over the usual unbiased estimator in a partial linear model is exhibited. Comparison result is then done under the balanced loss function. It is assumed that the vector of disturbances is typically distributed according to the law belonging to the sub-class of elliptically contoured models. It is also shown that the dominance condition is robust. Furthermore, a nonparametric estimation after estimation of the linear part is added for detecting the efficiency of the obtained results.     

Combining coordinates in simultaneous estimation of normal means

The problem of combining coordinates in Stein-type estimators, when simultaneously estimating normal means, is considered. The question of deciding whether to use all coordinates in one combined shrinkage estimator or to separate into groups and use separate shrinkage estimators on each group is considered. A Bayesian viewpoint is (of necessity) taken, and it is shown that the ‘combined’ estimator is, somewhat surprisingly, often superior.     

On the choice of co-ordinates in simultaneous estimation of normal means under misspecification of normal priors

The problem of choice of coordinates in Stein-type estimators,when simultaneously estimating normal means, is considered. The question of deciding whether to use all coordinates in one combined shrinkage estimators or to separate into groups and use separate shrinkage estimators on each group is considered in the situation in which part of the prior information may be " misspecified". It is observed that the amount of misspecification determines whether to use the combined shrinkage estimator the separate shrinkage estimator.     

Constructing estimators of a mean vector through orthogonal reparametrization and differential equations

The simultaneous estimation of a mean vector is explored by reparametrizing it into its direction and norm components. A type of Pythagorean relation is employed to construct an estimate of the norm component, which results in solving an ordinary amerenuai equation, me james-Diem estimator is snown to be optimum in a class of estimators derived from general solutions of the ordinary differential equation. A new Stein-type estimator in the case of the inverse Gaussian distribution is constructed.     

Performances of the Positive-Rule Stein-Type Ridge Estimator in a Linear Regression Model with Spherically Symmetric Error Distributions

In this article, the positive-rule Stein-type ridge estimator (PSRE) is introduced for the parameters in a multiple linear regression model with spherically symmetric error distributions when it is suspected that the parameter vector may be restricted to a linear manifold. The bias and quadratic risk functions of the PSRE are derived and compared with some related competing estimators in literatures. Particularly, some sufficient conditions are derived for superiority of the PSRE over the ordinary ridge estimator, the restricted ridge estimator and the preliminary test ridge estimator, respectively. Furthermore, some graphical results are provided to illustrate some of the theoretical results.     

Positive-rule stein-type almost unbiased ridge estimator in linear regression model

Abstract

In this article, when it is suspected that regression coefficients may be restricted to a subspace, we discuss the parameter estimation of regression coefficients in a multiple regression model. Then, in order to improve the preliminary test almost ridge estimator, we study the positive-rule Stein-type almost unbiased ridge estimator based on the positive-rule stein-type shrinkage estimator and almost unbiased ridge estimator. After that, quadratic bias and quadratic risk values of the new estimator are derived and compared with some relative estimators. And we also discuss the option of parameter k. Finally, we perform a real data example and a Monte Carlo study to illustrate theoretical results.     

Meta-analysis,pretest, and shrinkage estimation of kurtosis parameters

An asymptotic theory for the improved estimation of kurtosis parameter vector is developed for multi-sample case using uncertain prior information (UPI) that several kurtosis parameters are the same. Meta-analysis is performed to obtain pooled estimator, as it is a statistical methodology for pooling quantitative evidence. Pooled estimator is a good choice when assumption of homogeneity holds but it becomes inconsistent as assumption violates, therefore pretest and Stein-type shrinkage estimators are proposed as they combine sample and nonsample information in a superior way. Asymptotic properties of suggested estimators are discussed and their risk comparisons are also mentioned.     

New estimators of distribution functions

ABSTRACT

This article considers the estimation of a distribution function F_X(x) based on a random sample X₁, X₂, …, X_n when the sample is suspected to come from a close-by distribution F₀(x). The new estimators, namely the preliminary test (PTE) and Stein-type estimator (SE) are defined and compared with the “empirical distribution function” (edf) under local departure. In this case, we show that Stein-type estimators are superior to edf and PTE is superior to edf when it is close to F₀(x). As a by-product similar estimators are proposed for population quantiles.     

Semiparametric Stein estimators

Stein [Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. In Proc. 3rd Berkeley symp. math. statist. and pro. (pp. 197–206). University of California Press], in his seminal paper, came up with the surprising discovery that the sample mean is an inadmissible estimator of the population mean in three or higher dimensions under squared error loss. The past five decades have witnessed multiple extensions and variations of Stein’s results. In this paper we develop Stein-type estimators in a semiparametric framework and prove their coordinatewise asymptotic dominance over the sample mean in terms of Bayes risks.     

Unbiased estimation of the MSE matrices of improved estimators in linear regression

Stein-rule and other improved estimators have scarcely been used in empirical work. One major reason is that it is not easy to obtain precision measures for these estimators. In this paper, we derive unbiased estimators for both the mean squared error (MSE) and the scaled MSE matrices of a class of Stein-type estimators. Our derivation provides the basis for measuring the estimators' precision and constructing confidence bands. Comparisons are made between these MSE estimators and the least squares covariance estimator. For illustration, the methodology is applied to data on energy consumption.     

Merging data from multiple sources: pretest and shrinkage perspectives

In this article, we have developed asymptotic theory for the simultaneous estimation of the k means of arbitrary populations under the common mean hypothesis and further assuming that corresponding population variances are unknown and unequal. The unrestricted estimator, the Graybill-Deal-type restricted estimator, the preliminary test, and the Stein-type shrinkage estimators are suggested. A large sample test statistic is also proposed as a pretest for testing the common mean hypothesis. Under the sequence of local alternatives and squared error loss, we have compared the asymptotic properties of the estimators by means of asymptotic distributional quadratic bias and risk. Comprehensive Monte-Carlo simulation experiments were conducted to study the relative risk performance of the estimators with reference to the unrestricted estimator in finite samples. Two real-data examples are also furnished to illustrate the application of the suggested estimation strategies.     

Estimation of the shape parameter of a Pareto distribution

We consider the problem of estimating the shape parameter of a Pareto distribution with unknown scale under an arbitrary strictly bowl-shaped loss function. Classes of estimators improving upon minimum risk equivariant estimator are derived by adopting Stein, Brown, and Kubokawa techniques. The classes of estimators are shown to include some known procedures such as Stein-type and Brewster and Zidek-type estimators from literature. We also provide risk plots of proposed estimators for illustration purpose.     

Distribution and density functions of the feasible generalized ridge regression estimator

In this paper, we derive the distribution and density functions of the feasible generalized ridge regression (GRR) estimator. It is shown that when the absolute value of a regression coefficient is close to zero, the distribution of the feasible GRR estimator is bimodal and has thinner tails than that of the OLS estimator.     

Application of Stein-type estimation in combining regression estimates from replicated experiments

This paper considers the application of Stein-type estimation procedure for the coefficients in a linear regression model when data are available from replicated experiment. Two families of estimators characterized by a single scalar are proposed and their large sample asymptotic properties are derived. These are utilized for comparing the performances of the two estimators along with the conventional estimator and conditions for the superiority of one estimator over the other are deduced.