A generalization and Bayesian interpretation of ridge-type estimators with good prior means

Pliskin (1987) and Trenkler (1988) compared ridge-type estimators with good prior means. From a Bayesian viewpoint, these estimators are special cases of Bayesestimators and the mean square error matrix comparisons can be made in the more general case.     

Some remarks on a ridge-type-estimator and good prior means

Pliskin (1987) compared modified ridge regression estimators based on prior information with respect to their mean square error matrices. A further characterization of good prior mean is given here, and the case of different ridge parameters is also considered.     

Performance of the almost unbiased ridge-type principal component estimator in logistic regression model

ABSTRACT

This article considers some different parameter estimation methods in logistic regression model. In order to overcome multicollinearity, the almost unbiased ridge-type principal component estimator is proposed. The scalar mean squared error of the proposed estimator is derived and its properties are investigated. Finally, a numerical example and a simulation study are presented to show the performance of the proposed estimator.     

A non stochastic ridge regression estimator and comparison with the James-Stein estimator

Abstract

This article presents a non-stochastic version of the Generalized Ridge Regression estimator that arises from a discussion of the properties of a Generalized Ridge Regression estimator whose shrinkage parameters are found to be close to their upper bounds. The resulting estimator takes the form of a shrinkage estimator that is superior to both the Ordinary Least Squares estimator and the James-Stein estimator under certain conditions. A numerical study is provided to investigate the range of signal to noise ratio under which the new estimator dominates the James-Stein estimator with respect to the prediction mean square error.     

A new biased estimator based on ridge estimation

In this paper we introduce a new biased estimator for the vector of parameters in a linear regression model and discuss its properties. We show that our new biased estimator is superior, in the mean square error(mse) sense, to the ordinary least squares (OLS) estimator, the ordinary ridge regression (ORR) estimator and the Liu estimator. We also compare the performance of our new biased estimator with two other special Liu-type estimators proposed in Liu (2003). We illustrate our findings with a numerical example based on the widely analysed dataset on Portland cement.     

On necessary and sufficient condition for superiority of ridge estimator over least squares estimator

The necessary and sufficient condition is obtained such that ridge estimator is better than the least squares estimator relative to the matrix mean square error.     

A new stochastic mixed Liu estimator in linear regression model

Abstract

To overcome multicollinearity, a new stochastic mixed Liu estimator is presented and its efficiency is considered. We also compare the proposed estimators in the sense of matrix mean squared error criteria. Finally a numerical example and a simulation study are given to show the performance of the estimators.     

A two-parameter estimator in the negative binomial regression model

In this article, a two-parameter estimator is proposed to combat multicollinearity in the negative binomial regression model. The proposed two-parameter estimator is a general estimator which includes the maximum likelihood (ML) estimator, the ridge estimator (RE) and the Liu estimator as special cases. Some properties on the asymptotic mean-squared error (MSE) are derived and necessary and sufficient conditions for the superiority of the two-parameter estimator over the ML estimator and sufficient conditions for the superiority of the two-parameter estimator over the RE and the Liu estimator in the asymptotic mean-squared error (MSE) matrix sense are obtained. Furthermore, several methods and three rules for choosing appropriate shrinkage parameters are proposed. Finally, a Monte Carlo simulation study is given to illustrate some of the theoretical results.     

A New Two-Parameter Estimator in Linear Regression

This article is concerned with the parameter estimation in linear regression model. To overcome the multicollinearity problem, a new two-parameter estimator is proposed. This new estimator is a general estimator which includes the ordinary least squares (OLS) estimator, the ridge regression (RR) estimator, and the Liu estimator as special cases. Necessary and sufficient conditions for the superiority of the new estimator over the OLS, RR, Liu estimators, and the two-parameter estimator proposed by Ozkale and Kaciranlar (2007 Ozkale , M. R. , Kaciranlar , S. ( 2007 ). The restricted and unrestricted two-parameter estimators . Commun. Statist. Theor. Meth. 36 : 2707 – 2725 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) in the mean squared error matrix (MSEM) sense are derived. Furthermore, we obtain the estimators of the biasing parameters and give a numerical example to illustrate some of the theoretical results.     

Ridge estimator with correlated errors and two-stage ridge estimator under inequality restrictions

Liew (1976a Liew, C.K. (1976a). A two-stage least-squares estimation with inequality restrictions on parameters. Rev. Econ. Stat. LVIII(2):234–238.[Crossref], [Web of Science ®] , [Google Scholar]) introduced generalized inequality constrained least squares (GICLS) estimator and inequality constrained two-stage and three-stage least squares estimators by reducing primal–dual relation to problem of Dantzig and Cottle (1967 Dantzig, G.B., Cottle, R.W. (1967). Positive (semi-) definite matrices and mathematical programming. In: Abadie, J., ed. Nonlinear Programming (pp. 55–73). Amsterdam: North Holland Publishing Co. [Google Scholar]), Cottle and Dantzig (1974 Cottle, R.W., Dantzig, G.B. (1974). Complementary pivot of mathematical programming. In: Dantzig, G.B., Eaves, B.C., eds. Studies in OptimizationVol. 10. Washington: Mathematical Association of America. [Google Scholar]) and solving with Lemke (1962 Lemke, C.E. (1962). A method of solution for quadratic programs. Manage. Sci. 8(4):442–453.[Crossref], [Web of Science ®] , [Google Scholar]) algorithm. The purpose of this article is to present inequality constrained ridge regression (ICRR) estimator with correlated errors and inequality constrained two-stage and three-stage ridge regression estimators in the presence of multicollinearity. Untruncated variance–covariance matrix and mean square error are derived for the ICRR estimator with correlated errors, and its superiority over the GICLS estimator is examined via Monte Carlo simulation.     

On huntseerger type shrinkage estimator

This paper is concerned with Hintsberger type weighted shrinkage estimator of a parameter when a target value of the same is available. Expressions for the bias and the mean squared error of the estimator are derived. Some results concerning the bias, existence of uniformly minimum mean squared error estimator etc. are proved. For certain c to ices of the weight function, numerical results are presented for the pretest type weighted shrinkage estimator of the mean of normal as well as exponential distributions.     

Optimal generalized logistic estimator

In this paper, we propose a new efficient estimator namely Optimal Generalized Logistic Estimator (OGLE) for estimating the parameter in a logistic regression model when there exists multicollinearity among explanatory variables. Asymptotic properties of the proposed estimator are also derived. The performance of the proposed estimator over the other existing estimators in respect of Scalar Mean Square Error criterion is examined by conducting a Monte Carlo simulation.     

A test statistic to choose between Liu-type and least-squares estimator based on mean square error criteria

In this study, the necessary and sufficient conditions for the Liu-type (LT) biased estimator are determined. A test for choosing between the LT estimator and least-squares estimator is obtained by using these necessary and sufficient conditions. Also, a simulation study is carried out to compare this estimator against the ridge estimator. Furthermore, a numerical example is given for defined test statistic.     

Trimmed least squares estimator as best trimmed linear conditional estimator for linear regression model

A class of trimmed linear conditional estimators based on regression quantiles for the linear regression model is introduced. This class serves as a robust analogue of non-robust linear unbiased estimators. Asymptotic analysis then shows that the trimmed least squares estimator based on regression quantiles ( Koenker and Bassett ( 1978 ) ) is the best in this estimator class in terms of asymptotic covariance matrices. The class of trimmed linear conditional estimators contains the Mallows-type bounded influence trimmed means ( see De Jongh et al ( 1988 ) ) and trimmed instrumental variables estimators. A large sample methodology based on trimmed instrumental variables estimator for confidence ellipsoids and hypothesis testing is also provided.     

Particle swarm optimization based Liu-type estimator

In this study, a new method for the estimation of the shrinkage and biasing parameters of Liu-type estimator is proposed. Because k is kept constant and d is optimized in Liu’s method, a (k, d) pair is not guaranteed to be the optimal point in terms of the mean square error of the parameters. The optimum (k, d) pair that minimizes the mean square error, which is a function of the parameters k and d, should be estimated through a simultaneous optimization process rather than through a two-stage process. In this study, by utilizing a different objective function, the parameters k and d are optimized simultaneously with the particle swarm optimization technique.     

A modified Liu-type estimator with an intercept term under mixture experiments

We consider ridge regression with an intercept term under mixture experiments. We propose a new estimator which is shown to be a modified version of the Liu-type estimator. The so-called compound covariate estimator is applied to modify the Liu-type estimator. We then derive a formula of the total mean squared error (TMSE) of the proposed estimator. It is shown that the new estimator improves upon existing estimators in terms of the TMSE, and the performance of the new estimator is invariant under the change of the intercept term. We demonstrate the new estimator using a real dataset on mixture experiments.     

The feasible generalized restricted ridge regression estimator

The presence of autocorrelation in errors and multicollinearity among the regressors have undesirable effects on the least-squares regression. There are a wide range of methods which are proposed to overcome the usefulness of the ordinary least-squares estimator or the generalized least-squares estimator, such as the Stein-rule, restricted least-squares or ridge estimator. Therefore, we introduce a new feasible generalized restricted ridge regression (FGRR) estimator to examine multicollinearity and autocorrelation problems simultaneously for the general linear regression model. We also derive some statistical properties of the FGRR estimator and comparisons have been conducted using matrix mean-square error. Moreover, a Monte Carlo simulation experiment is performed to investigate the performance of the proposed estimator over the others.     

An evaluation of ridge estimator in linear mixed models: an example from kidney failure data

This paper is concerned with the ridge estimation of fixed and random effects in the context of Henderson's mixed model equations in the linear mixed model. For this purpose, a penalized likelihood method is proposed. A linear combination of ridge estimator for fixed and random effects is compared to a linear combination of best linear unbiased estimator for fixed and random effects under the mean-square error (MSE) matrix criterion. Additionally, for choosing the biasing parameter, a method of MSE under the ridge estimator is given. A real data analysis is provided to illustrate the theoretical results and a simulation study is conducted to characterize the performance of ridge and best linear unbiased estimators approach in the linear mixed model.     

Alternative moment approximations for berkson's minimum logit chi-squared estimator

Expressions are derived for the bias to order J^-1 , the variance to order J^-2 and the mean squared error to order J^-2 of Berkson's minimum logit chi-squared estimator where J is the number of distinct design points. These moment approximations are numerically compared to Monte Carlo estimates of the true moments and the moment approximations of Amemiya (1980) which are appropriate when the “average” number of observations per design point is large. They are used to compare the mean squared error of the minimum logit chi-squared estimator to that of the maximum likelihood estimator and to investigate the effect of bias on confidence intenrals constructed using the minimum logit chi-squared estimator.