Tuning Parameter Selection and Various Good Fitting Characteristics for the Liu-Type Estimator in Linear Regression

Liu (2003 Liu , K. ( 2003 ). Using Liu-Type estimator to combat collinearity . Commun. Statist. Theor. Meth. 32 ( 5 ): 1009 – 1020 .Taylor & Francis Online], Web of Science ®] , Google Scholar]) proposed the Liu-Type estimator (LTE) to combat the well-known multicollinearity problem in linear regression. In this article, various better fitting characteristics of the LTE than those of the ordinary ridge regression estimator (Hoerl and Kennard, 1970 Hoerl , A. E. , Kennard , R. W. ( 1970 ). Ridge regression: Biased estimation for non-orthogonal problems . Technometrics 12 : 55 – 67 .Taylor & Francis Online], Web of Science ®] , Google Scholar]) are considered. In particular, we derived two methods to determine the parameter d for the LTE and find that the ridge parameter k could serve for regularization of an ill-conditioned design matrix, while the other parameter d could be used for tuning the fit quality. In addition, the coefficients of regression, coefficient of multiple determination, residual error variance, and generalized cross validation (GCV) of the prediction quality are very stable, and as the ridge parameter increases they eventually reach asymptotic levels, which produces robust regression models. Furthermore, a Monte Carlo evaluation of these features is also given to illustrate some of the theoretical results.