Liu-type estimator in semiparametric regression models

In this paper, we introduced a Liu-type estimator for the vector of parameters β in a semiparametric regression model. We also obtained the semiparametric restricted Liu-type estimator for the parametric component in a semiparametric regression model. The ideas in the paper are illustrated in a real data example and in a Monte Carlo simulation study.     

On the performance of the Jackknifed Liu-type estimator in linear regression model

In this paper, we are proposing a modified jackknife Liu-type estimator (MJLTE) that was created by combining the ideas underlying both the Liu-type estimator (LTE) and the jackknifed Liu-type estimator (JLTE). We will also present the necessary and sufficient conditions for superiority of the MJLTE over the LTE and JLTE, in terms of mean square error matrix criterion. Finally, a real data example and a Monte Carlo simulation are also given to illustrate theoretical results.     

Performance of the difference-based Liu-type estimator in partially linear model

This paper discusses the parameter estimation in a partially linear model. We proposed a difference-based Liu-type estimator of the unknown parameters in the partially linear model. The asymptotically properties of the proposed estimator are discussed. We propose a iterative method to choose the biasing parameters. Finally, a simulation study and a numerical example are presented to explain the performance of the estimators.     

On the weighted mixed Liu-type estimator under unbiased stochastic restrictions

In this article, we introduce the weighted mixed Liu-type estimator (WMLTE) based on the weighted mixed and Liu-type estimator (LTE) in linear regression model. We will also present necessary and sufficient conditions for superiority of the weighted mixed Liu-type estimator over the weighted mixed estimator (WME) and Liu type estimator (LTE) in terms of mean square error matrix (MSEM) criterion. Finally, a numerical example and a Monte Carlo simulation is also given to show the theoretical results.     

A New Robust Regression Method Based on Particle Swarm Optimization

Regression analysis is one of methods widely used in prediction problems. Although there are many methods used for parameter estimation in regression analysis, ordinary least squares (OLS) technique is the most commonly used one among them. However, this technique is highly sensitive to outlier observation. Therefore, in literature, robust techniques are suggested when data set includes outlier observation. Besides, in prediction a problem, using the techniques that reduce the effectiveness of outlier and using the median as a target function rather than an error mean will be more successful in modeling these kinds of data. In this study, a new parameter estimation method using the median of absolute rate obtained by division of the difference between observation values and predicted values by the observation value and based on particle swarm optimization was proposed. The performance of the proposed method was evaluated with a simulation study by comparing it with OLS and some other robust methods in the literature.     

The distribution of the Liu-type estimator of the biasing parameter in elliptically contoured models

We derive the density function of the stochastic shrinkage parameters of the Liu-type estimator in elliptical models. The correctness of derivation is checked by simulations. A real data application is also provided.     

A test statistic to choose between Liu-type and least-squares estimator based on mean square error criteria

In this study, the necessary and sufficient conditions for the Liu-type (LT) biased estimator are determined. A test for choosing between the LT estimator and least-squares estimator is obtained by using these necessary and sufficient conditions. Also, a simulation study is carried out to compare this estimator against the ridge estimator. Furthermore, a numerical example is given for defined test statistic.     

Comments on “On the weighted mixed Liu-type estimator under unbiased stochastic restrictions”

We make some comments about the paper of Yildiz (2017 Yildiz, N. 2017. On the weighted mixed Liu-type estimator under unbiased stochastic restrictions. Communications in Statistics Simulation and Computation 46 (9):7238–48. do?:10.1080/03610918.2016.1235189.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) and correct the theorems in that paper.     

Preliminary test Liu-type estimators based on W,LR, and LM test statistics in a regression model

This article discusses the preliminary test approach for the regression parameter in multiple regression model. The preliminary test Liu-type estimators based on the Wald (W), Likelihood ratio (LR), and Lagrangian multiplier(LM) tests are presented, when it is supposed that the regression parameter may be restricted to a subspace. We also give the bias and mean squared error of the proposed estimators and the superior of the proposed estimators is also discussed.     

A modified Liu-type estimator with an intercept term under mixture experiments

We consider ridge regression with an intercept term under mixture experiments. We propose a new estimator which is shown to be a modified version of the Liu-type estimator. The so-called compound covariate estimator is applied to modify the Liu-type estimator. We then derive a formula of the total mean squared error (TMSE) of the proposed estimator. It is shown that the new estimator improves upon existing estimators in terms of the TMSE, and the performance of the new estimator is invariant under the change of the intercept term. We demonstrate the new estimator using a real dataset on mixture experiments.     

Particle swarm optimization-based variable selection in Poisson regression analysis via information complexity-type criteria

Modeling of count responses is widely performed via Poisson regression models. This paper covers the problem of variable selection in Poisson regression analysis. The basic emphasis of this paper is to present the usefulness of information complexity-based criteria for Poisson regression. Particle swarm optimization (PSO) algorithm was adopted to minimize the information criteria. A real dataset example and two simulation studies were conducted for highly collinear and lowly correlated datasets. Results demonstrate the capability of information complexity-type criteria. According to the results, information complexity-type criteria can be effectively used instead of classical criteria in count data modeling via the PSO algorithm.     

Liu-Type Logistic Estimator

It is known that multicollinearity inflates the variance of the maximum likelihood estimator in logistic regression. Especially, if the primary interest is in the coefficients, the impact of collinearity can be very serious. To deal with collinearity, a ridge estimator was proposed by Schaefer et al. The primary interest of this article is to introduce a Liu-type estimator that had a smaller total mean squared error (MSE) than the Schaefer's ridge estimator under certain conditions. Simulation studies were conducted that evaluated the performance of this estimator. Furthermore, the proposed estimator was applied to a real-life dataset.     

Using Liu-Type Estimator to Combat Collinearity

Abstract

Linear regression model and least squares method are widely used in many fields of natural and social sciences. In the presence of collinearity, the least squares estimator is unstable and often gives misleading information. Ridge regression is the most common method to overcome this problem. We find that when there exists severe collinearity, the shrinkage parameter selected by existing methods for ridge regression may not fully address the ill conditioning problem. To solve this problem, we propose a new two-parameter estimator. We show using both theoretic results and simulation that our new estimator has two advantages over ridge regression. First, our estimator has less mean squared error (MSE). Second, our estimator can fully address the ill conditioning problem. A numerical example from literature is used to illustrate the results.     

Ridge estimator with correlated errors and two-stage ridge estimator under inequality restrictions

Liew (1976a Liew, C.K. (1976a). A two-stage least-squares estimation with inequality restrictions on parameters. Rev. Econ. Stat. LVIII(2):234–238.[Crossref], [Web of Science ®] , [Google Scholar]) introduced generalized inequality constrained least squares (GICLS) estimator and inequality constrained two-stage and three-stage least squares estimators by reducing primal–dual relation to problem of Dantzig and Cottle (1967 Dantzig, G.B., Cottle, R.W. (1967). Positive (semi-) definite matrices and mathematical programming. In: Abadie, J., ed. Nonlinear Programming (pp. 55–73). Amsterdam: North Holland Publishing Co. [Google Scholar]), Cottle and Dantzig (1974 Cottle, R.W., Dantzig, G.B. (1974). Complementary pivot of mathematical programming. In: Dantzig, G.B., Eaves, B.C., eds. Studies in OptimizationVol. 10. Washington: Mathematical Association of America. [Google Scholar]) and solving with Lemke (1962 Lemke, C.E. (1962). A method of solution for quadratic programs. Manage. Sci. 8(4):442–453.[Crossref], [Web of Science ®] , [Google Scholar]) algorithm. The purpose of this article is to present inequality constrained ridge regression (ICRR) estimator with correlated errors and inequality constrained two-stage and three-stage ridge regression estimators in the presence of multicollinearity. Untruncated variance–covariance matrix and mean square error are derived for the ICRR estimator with correlated errors, and its superiority over the GICLS estimator is examined via Monte Carlo simulation.     

A non stochastic ridge regression estimator and comparison with the James-Stein estimator

Abstract

This article presents a non-stochastic version of the Generalized Ridge Regression estimator that arises from a discussion of the properties of a Generalized Ridge Regression estimator whose shrinkage parameters are found to be close to their upper bounds. The resulting estimator takes the form of a shrinkage estimator that is superior to both the Ordinary Least Squares estimator and the James-Stein estimator under certain conditions. A numerical study is provided to investigate the range of signal to noise ratio under which the new estimator dominates the James-Stein estimator with respect to the prediction mean square error.     

A new biased estimator based on ridge estimation

In this paper we introduce a new biased estimator for the vector of parameters in a linear regression model and discuss its properties. We show that our new biased estimator is superior, in the mean square error(mse) sense, to the ordinary least squares (OLS) estimator, the ordinary ridge regression (ORR) estimator and the Liu estimator. We also compare the performance of our new biased estimator with two other special Liu-type estimators proposed in Liu (2003). We illustrate our findings with a numerical example based on the widely analysed dataset on Portland cement.     

Comment on a generalized stochastic restricted ridge regression estimator

In this note, we make some comments about the paper of Alheety and Kibria (2014 Alheety, M.I., Kibria, B.M.G. (2014). A generalized stochastic restricted ridge regression estimator. Commun. Stat. Theor. Meth. 43:4415–4427.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) and correct the wrongly proved Theorems in that paper.     

Improved Liu estimator in a linear regression model

In this paper, we mainly aim to introduce the notion of improved Liu estimator (ILE) in the linear regression model y=Xβ+e. The selection of the biasing parameters is investigated under the PRESS criterion and the optimal selection is successfully derived. We make a simulation study to show the performance of ILE compared to the ordinary least squares estimator and the Liu estimator. Finally, the main results are applied to the Hald data.     

A ridge-type estimator and good prior means

Swindel (1976) introduced a modified ridge regression estimator based on prior information. A necessary and sufficient condition is derived for Swindel's proposed estimator to have lower risk than the conventional ordinary ridge regression estimator when both estimators are computed using the same value of k.