Preliminary test Liu-type estimators based on W,LR, and LM test statistics in a regression model

This article discusses the preliminary test approach for the regression parameter in multiple regression model. The preliminary test Liu-type estimators based on the Wald (W), Likelihood ratio (LR), and Lagrangian multiplier(LM) tests are presented, when it is supposed that the regression parameter may be restricted to a subspace. We also give the bias and mean squared error of the proposed estimators and the superior of the proposed estimators is also discussed.     

Performance of some new preliminary test ridge regression estimators and their properties

The problem of estimation of the regression coefficients in a multiple regression model is considered under multicollinearity situation when it is suspected that the regression coefficients may be restricted to a subspace. We present the estimators of the regression coefficients combining the idea of preliminary test and ridge regression methodology. Accordingly, we consider three estimators, namely, the unrestricted ridge regression estimator (URRE), the restricted ridge regression estimator (RRRE), and finally, the preliminary test ridge regression estimator (PTRRE). The biases, variancematrices and mean square errors (mse) of the estimators are derived and compared with the usual estimators. Regions of optimality of the estimators are determined by studying the mse criterion. The conditions of superiority of the estimators over the traditional estimators as in Saleh and Han (1990) and Ali and Saleh (1991) have also been discussed.     

Comparison of preliminary test estimators based on generalized order statistics from proportional hazard family using Pitman measure of closeness

In this article, based on generalized order statistics from a family of proportional hazard rate model, we use a statistical test to generate a class of preliminary test estimators and shrinkage preliminary test estimators for the proportionality parameter. These estimators are compared under Pitman measure of closeness (PMC) as well as MSE criteria. Although the PMC suffers from non transitivity, in the first class of estimators, it has the transitivity property and we obtain the Pitman-closest estimator. Analytical and graphical methods are used to show the range of parameter in which preliminary test and shrinkage preliminary test estimators perform better than their competitor estimators. Results reveal that when the prior information is not too far from its real value, the proposed estimators are superior based on both mentioned criteria.     

A family of shrinkage estimators for the square of mean in normal distribution

This paper is devoted to the problem of estimating the square of population mean (μ²) in normal distribution when a prior estimate or guessed value σ₀ ² of the population variance σ² is available. We have suggested a family of shrinkage estimators , say, for μ² with its mean squared error formula. A condition is obtained in which the suggested estimator is more efficient than Srivastava et al’s (1980) estimator T_min. Numerical illustrations have been carried out to demonstrate the merits of the constructed estimator over T_min. It is observed that some of these estimators offer improvements over T_min particularly when the population is heterogeneous and σ² is in the vicinity of σ₀ ².     

Mean square error matrix comparisons of estimators in linear regression

The aim of this paper is to provide criteria which allow to compare two estimators of the parameter vector in the linear regression model with respect to their mean square error matrices, where the main interest is focussed on the case when the difference of the covariance matrices is singular. The results obtained are applied to equality restricted and pretest estimators.     

Generalized preliminary test stochastic restricted estimator in the linear regression model

ABSTRACT

In this paper, we propose three generalized estimators, namely, generalized unrestricted estimator (GURE), generalized stochastic restricted estimator (GSRE), and generalized preliminary test stochastic restricted estimator (GPTSRE). The GURE can be used to represent the ridge estimator, almost unbiased ridge estimator (AURE), Liu estimator, and almost unbiased Liu estimator. When stochastic restrictions are available in addition to the sample information, the GSRE can be used to represent stochastic mixed ridge estimator, stochastic restricted Liu estimator, stochastic restricted almost unbiased ridge estimator, and stochastic restricted almost unbiased Liu estimator. The GPTSRE can be used to represent the preliminary test estimators based on mixed estimator. Using the GPTSRE, the properties of three other preliminary test estimators, namely preliminary test stochastic mixed ridge estimator, preliminary test stochastic restricted almost unbiased Liu estimator, and preliminary test stochastic restricted almost unbiased ridge estimator can also be discussed. The mean square error matrix criterion is used to obtain the superiority conditions to compare the estimators based on GPTSRE with some biased estimators for the two cases for which the stochastic restrictions are correct, and are not correct. Finally, a numerical example and a Monte Carlo simulation study are done to illustrate the theoretical findings of the proposed estimators.     

Preliminary Test Regression Estimator When two Prior Values of Population Mean (μx) of an Auxiliary Variable (x) are Available

A regression estimator using two prior values of population mean (μ_x) of an auxiliary variable (x) is proposed after a preliminary test of closeness of these prior values to the true valueμ_x. The proposed preliminary test regression estimator has been found to be more efficient in general than the usual regression estimator when prior values are used in place of μ_xwithout preliminary test of significance. The efficiency of the proposed estimator over the usual regression estimator has also been computed for different values of Δ₀, Δ₁, n, and ρ, which showed considerable gain in precision.     

Evaluation of the predictive performance of the r-k and r-d class estimators

Multiple linear regression models are frequently used in predicting unknown values of the response variable y. In this case, a regression model's ability to produce an adequate prediction equation is of prime importance. This paper discusses the predictive performance of the r-k and r-d class estimators compared to ordinary least squares (OLS), principal components, ridge regression and Liu estimators and between each other. The theoretical results are illustrated using Portland cement data and a region is established where the r-k and the r-d class estimators are uniformly superior to the other mentioned estimators.     

MSE performance of the weighted average estimators consisting of shrinkage estimators when each individual regression coefficient is estimated

In this paper, we analytically derive the exact formula for the mean squared error (MSE) of two weighted average (WA) estimators for each individual regression coefficient. Further, we execute numerical evaluations to investigate small sample properties of the WA estimators, and compare the MSE performance of the WA estimators with the other shrinkage estimators and the usual OLS estimator. Our numerical results show that (1) the WA estimators have smaller MSE than the other shrinkage estimators and the OLS estimator over a wide region of parameter space; (2) the range where the relative MSE of the WA estimator is smaller than that of the OLS estimator gets narrower as the number of explanatory variables k increases.     

Pooling reliability functions

In this article large sample pooling procedures for reliability functions of an exponential life testing model is considered. Asymptotic properties of shrinkage estimation procedure subsequent to preliminary tests are developed. It is shown that the proposed estimator possesses substantially snakker asymptotic mean squared error than the usual estimator in a region of the lparameter space. Relative efficiencies of the purposed estimators to the usual estimators are obtained and recommendations of the level of the preliminary tests are provided. Relative dominance picture of the estimators is presented. It is shown that the proposed estimator provides a wider dominance range over usual estimator than the usual preliminary test estimator. More importantly, the size of the preliminary test is meaningful. Simulation studies is also carried out to appraise the performance of the estimators when samples are small.     

On the boundary properties of Bernstein polynomial estimators of density and distribution functions

For density and distribution functions supported on [0,1], Bernstein polynomial estimators are known to have optimal mean integrated squared error (MISE) properties under the usual smoothness conditions on the function to be estimated. These estimators are also known to be well-behaved in terms of bias: they have uniform bias over the entire unit interval. What is less known, however, is that some of these estimators do experience a boundary effect, but of a different nature than what is seen with the usual kernel estimators.     

The exact mean squared error risks of preliminary test type estimators for the multivariate normal mean

The exact mean squared error risks of the preliminary test estimtor and the Sclove modified Stein rule estimator (Sclove, Morris and Radhakrishnan, 1972) for the multivariate normal mean are computed and their risks are compared with the risks of Stein estimators.     

Improved estimation for the autocovariances of a Gaussian stationary process

For a Gaussian stationary process with mean μ and autocovariance function γ(·), we consider to improve the usual sample autocovariances with respect to the mean squares error (MSE) loss. For the cases μ=0 and μ≠0, we propose sort of empirical Bayes type estimators Γ? and Γ?, respectively. Then their MSE improvements upon the usual sample autocovariances are evaluated in terms of the spectral density of the process. Concrete examples for them are provided. We observe that if the process is near to a unit root process the improvement becomes quite large. Thus, consideration for estimators of this type seems important in many fields, e.g., econometrics.     

Ratio and product estimators in stratified random sampling

Khoshnevisan et al. [2007. A general family of estimators for estimating population mean using known value of some population parameter(s). Far East Journal of Theoretical Statistics 22, 181–191] have introduced a family of estimators using auxiliary information in simple random sampling. They have showed that these estimators are more efficient than the classical ratio estimator and that the minimum value of the mean square error (MSE) of this family is equal to the value of MSE of regression estimator. In this article, we adapt the estimators in this family to the stratified random sampling and motivated by the estimator in Searls [1964. Utilization of known coefficient of kurtosis in the estimation procedure of variance. Journal of the American Statistical Association 59, 1225–1226], we also propose a new family of estimators for the stratified random sampling. The expressions of bias and MSE of the adapted and proposed families are derived in a general form. Besides, considering the minimum cases of these MSE equations, the efficient conditions between the adapted and proposed families are obtained. Moreover, these theoretical findings are supported by a numerical example with original data.     

Bayesian shrinkage estimators for a measure of dispersion of an inverse gaussian distribution

The Bayesian shrinkage estimation for a measure of dispersion with known mean is studied for the inverse Gaussian distribution. An optimum choice of the shrinkage factor and the properties of the proposed Bayesian shrinkage estimators are being studied. It is shown that these estimators have smaller risk than the usual estimator of the reciprocal measure of dispersion.     

MSE performance of the weighted average estimators consisting of shrinkage estimators

In this paper, we consider a regression model and propose estimators which are the weighted averages of two estimators among three estimators; the Stein-rule (SR), the minimum mean squared error (MMSE), and the adjusted minimum mean-squared error (AMMSE) estimators. It is shown that one of the proposed estimators has smaller mean-squared error (MSE) than the positive-part Stein-rule (PSR) estimator over a moderate region of parameter space when the number of the regression coefficients is small (i.e., 3), and its MSE performance is comparable to the PSR estimator even when the number of the regression coefficients is not so small.     

A sufficient condition for the MSE dominance of the positive-part shrinkage estimator when each individual regression coefficient is estimated in a misspecified linear regression model

In this paper, assuming that there exist omitted explanatory variables in the specified model, we derive the exact formula for the mean squared error (MSE) of a general family of shrinkage estimators for each individual regression coefficient. It is shown analytically that when our concern is to estimate each individual regression coefficient, the positive-part shrinkage estimators have smaller MSE than the original shrinkage estimators under some conditions even when the relevant regressors are omitted. Also, by numerical evaluations, we showed the effects of our theorem for several specific cases. It is shown that the positive-part shrinkage estimators have smaller MSE than the original shrinkage estimators for wide region of parameter space even when there exist omitted variables in the specified model.     

On some pre-test and Stein-rule phi-divergence test estimators in the independence model of categorical data

For the model of independence in a two way contingency table, shrinkage estimators based on minimum φ$\phi$-divergence estimators and φ$\phi$-divergence statistics are considered. These estimators are based on the James–Stein-type rule and incorporate the idea of preliminary test estimator. The asymptotic bias and risk are obtained under contiguous alternative hypotheses, and on the basis of them a comparison study is carried out.     

Comparison of linex and quadratic bayes estimators foe the rayleigh distribution

In this paper, the Bayes estimators for the parameter, the reliability function, and failure rate function of the Rayleigh distribution are obtained when based on complete or type II censored samples. Some types of the linex loss function are used. Comparieons in terms of risks of those under linex loss and squared error loss function with Bayes estimators relative to squared error loss function are made, Numerical example and simulation example are included.