On the minimum mean squared error estimators in a regression model

In this paper we analyze the properties of two estimators oroposed by Farebrother (1975) for linear regression models.     

Theory of nonparametric statistics for rounded-off data with applications

This article gives a unified account of nonparametric statistics, covering testing, estimating, multiple comparisons, analysis of variance and regression, for rounded-off data, with ties handled by the average scores method. The theory is illustrated by means of numerous applications to the Biomedical, Engineering and Behavioral Sciences.     

Good ridge estimators based on prior information

Ridge regression is re-examined and ridge estimators based on prior information are introduced. A necessary and sufficient condition is given for such ridge estimators to yield estimators of every nonnull linear combination of the regression coefficients with smaller mean square error than that of the Gauss-Markov best linear unbiased estimator.     

Error misspecification and properties of the simple ridge estimator

This paper gives necessary and sufficient conditions for the ridge estimator applied to an error misspecified regression model to dominate the generalised least squares estimator. It is shown that the requirements for mean square error dominance are more stringent than in the correct specification case.     

On ridge parameter estimators under stochastic subspace hypothesis

This paper considers several estimators for estimating the restricted ridge parameter estimators. A simulation study has been conducted to compare the performance of these estimators. Based on the simulation study we found that, increasing the correlation between the independent variables has positive effect on the mean square error (MSE). However, increasing the value of ρ has negative effect on MSE. When the sample size increases, the MSE decreases even when the correlation between the independent variables is large. Two real life examples have been considered to illustrate the performance of the estimators.     

Using improved estimation strategies to combat multicollinearity

In this approach, some generalized ridge estimators are defined based on shrinkage foundation. Completely under the suspicion that some sub-space restrictions may occur, we present the estimators of the regression coefficients combining the idea of preliminary test estimator and Stein-rule estimator with the ridge regression methodology for normal models. Their exact risk expressions in addition to biases are derived and the regions of optimality of the estimators are exactly determined along with some numerical analysis. In this regard, the ridge parameter is determined in different disciplines.     

A new estimator combining the ridge regression and the restricted least squares methods of estimation

It is well-known in the literature on multicollinearity that one of the major consequences of multicollinearity on the ordinary least squares estimator is that the estimator produces large sampling variances, which in turn might inappropriately lead to exclusion of otherwise significant coefficients from the model. To circumvent this problem, two accepted estimation procedures which are often suggested are the restricted least squares method and the ridge regression method. While the former leads to a reduction in the sampling variance of the estimator, the later ensures a smaller mean square error value for the estimator. In this paper we have proposed a new estimator which is based on a criterion that combines the ideas underlying these two estimators. The standard properties of this new estimator have been studied in the paper. It has also been shown that this estimator is superior to both the restricted least squares as well as the ordinary ridge regression estimators by the criterion of mean sauare error of the estimator of the regression coefficients when the restrictions are indeed correct. The conditions for superiority of this estimator over the other two have also been derived for the situation when the restrictions are not correct.     

Fractional principal components regression: a general approach to biased estimators

Several biased estimators have been proposed as alternatives to the least squares estimator when multicollinearity is present in the multiple linear regression model. The ridge estimator and the principal components estimator are two techniques that have been proposed for such problems. In this paper the class of fractional principal component estimators is developed for the multiple linear regression model. This class contains many of the biased estimators commonly used to combat multicollinearity. In the fractional principal components framework, two new estimation techniques are introduced. The theoretical performances of the new estimators are evaluated and their small sample properties are compared via simulation with the ridge, generalized ridge and principal components estimators     

An examination of recent criticisms of ridge regression simulation designs

In this paper we carefully examine three propositions asserting that certain simulation studies are biased in favour of ridge regression and find them to be ill-founded.     

A generalized step-up-down multiple test procedure

A generalization of step-up and step-down multiple test procedures is proposed. This step-up-down procedure is useful when the objective is to reject a specified minimum number, q, out of a family of k hypotheses. If this basic objective is met at the first step, then it proceeds in a step-down manner to see if more than q hypotheses can be rejected. Otherwise it proceeds in a step-up manner to see if some number less than q hypotheses can be rejected. The usual step-down procedure is the special case where q = 1, and the usual step-up procedure is the special case where q = k. Analytical and numerical comparisons between the powers of the step-up-down procedures with different choices of q are made to see how these powers depend on the actual number of false hypotheses. Examples of application include comparing the efficacy of a treatment to a control for multiple endpoints and testing the sensitivity of a clinical trial for comparing the efficacy of a new treatment with a set of standard treatments.