Performance of some ridge regression estimators for the multinomial logit model

This article considers several estimators for estimating the ridge parameter k for multinomial logit model based on the work of Khalaf and Shukur (2005 Khalaf, G., and G. Shukur. 2005. Choosing ridge parameters for regression problems. Commun. Statist. Theor. Meth., 34:1177–1182.Taylor &; Francis Online], Web of Science ®] , Google Scholar]), Alkhamisi et al. (2006 Alkhamisi, M., G. Khalaf, and G. Shukur. 2006. Some modifications for choosing ridge parameters. Commun. Statist. Theor. Meth. 35:2005–2020.Taylor &; Francis Online], Web of Science ®] , Google Scholar]), and Muniz et al. (2012 Muniz, G., B. M. G. Kibria, K. Månsson, and G. Shukur. 2012. On developing ridge regression parameters: A graphical investigation. in SORT. 36: 115–138.Web of Science ®] , Google Scholar]). The mean square error (MSE) is considered as the performance criterion. A simulation study has been conducted to compare the performance of the estimators. Based on the simulation study we found that increasing the correlation between the independent variables and the number of regressors has negative effect on the MSE. However, when the sample size increases the MSE decreases even when the correlation between the independent variables is large. Based on the minimum MSE criterion some useful estimators for estimating the ridge parameter k are recommended for the practitioners.