Some conditions for optimality of the almost unbiased estimators of regression coefficients

The purpose of this paper is to examine the asymptotic properties of the operational almost unbiased estimator of regression coefficients which includes almost unbiased ordinary ridge estimator a s a special case. The small distrubance approximations for the bias and mean square error matrix of the estimator are derived. As a consequence, it is proved that, under certain conditions, the estimator is more efficient than a general class of estimators given by Vinod and Ullah (1981). Also it is shown that, if the ordinary ridge estimator (ORE) dominates the ordinary least squares estimator then the almost unbiased ordinary ridge estimator does not dominate ORE under the mean square error criterion.     

Efficiency of the generalized-difference-based weighted mixed almost unbiased two-parameter estimator in partially linear model

In this paper, a generalized difference-based estimator is introduced for the vector parameter β in partially linear model when the errors are correlated. A generalized-difference-based almost unbiased two-parameter estimator is defined for the vector parameter β. Under the linear stochastic constraint r = Rβ + e, we introduce a new generalized-difference-based weighted mixed almost unbiased two-parameter estimator. The performance of this new estimator over the generalized-difference-based estimator and generalized- difference-based almost unbiased two-parameter estimator in terms of the MSEM criterion is investigated. The efficiency properties of the new estimator is illustrated by a simulation study. Finally, the performance of the new estimator is evaluated for a real dataset.     

On the restricted almost unbiased estimators in linear regression

In this paper, the restricted almost unbiased ridge regression estimator and restricted almost unbiased Liu estimator are introduced for the vector of parameters in a multiple linear regression model with linear restrictions. The bias, variance matrices and mean square error (MSE) of the proposed estimators are derived and compared. It is shown that the proposed estimators will have smaller quadratic bias but larger variance than the corresponding competitors in literatures. However, they will respectively outperform the latter according to the MSE criterion under certain conditions. Finally, a simulation study and a numerical example are given to illustrate some of the theoretical results.     

On the Stochastic Restricted Almost Unbiased Estimators in Linear Regression Model

In this article, the stochastic restricted almost unbiased ridge regression estimator and stochastic restricted almost unbiased Liu estimator are proposed to overcome the well-known multicollinearity problem in linear regression model. The quadratic bias and mean square error matrix of the proposed estimators are derived and compared. Furthermore, a numerical example and a Monte Carlo simulation are given to illustrate some of the theoretical results.     

On the almost unbiased ridge regression estimator

The purpose of this paper is two-fold. One is to compare the almost unbiased generalized ridge regression (AUGRR) estimator proposed by Singh, Chaubey and Dwivedi (1986) with the generalized ridge regression (GRR) estimator and with the ordinary least squares (OLS) estimator in terms of the mean squared error criterion. Second is to examine small sample properties of the operational almost unbiased ordinary ridge regression (AUORR) estimator by Monte Carlo experiments.     

Efficiency of an almost unbiased two-parameter estimator in linear regression model

This paper deals with parameter estimation in the linear regression model and an almost unbiased two-parameter estimator is introduced. The performance of this new estimator over the ordinary least-squares estimator and the two-parameter estimator [M.R. Özkale and S. Kaçiranlar, The restricted and unrestricted two-parameter estimator, Comm. Statist. Theory Methods 36 (2007), pp. 2707–2725] in terms of scalar mean-squared error criterion is investigated and a simulation study is done.     

On the predictive performance of the almost unbiased Liu estimator

ABSTRACT

Regression models are usually used in forecasting (predicting) unknown values of the response variable y. This article considers the predictive performance of the almost unbiased Liu estimator compared to the ordinary least-squares estimator, principal component regression estimator, and Liu estimator. Finally, we present a numerical example to explain the theoretical results and we obtain a region where the almost unbiased Liu estimator is uniformly superior to the ordinary least-squares estimator, principal component regression estimator, and Liu estimator.     

On preliminary test almost unbiased two-parameter estimator in linear regression model with student's t errors

In this paper, the preliminary test approach to the estimation of the linear regression model with student's t errors is considered. The preliminary test almost unbiased two-parameter estimator is proposed, when it is suspected that the regression parameter may be restricted to a constraint. The quadratic biases and quadratic risks of the proposed estimators are derived and compared under both null and alternative hypotheses. The conditions of superiority of the proposed estimators for departure parameter and biasing parameters k and d are derived, respectively. Furthermore, a real data example and a Monte Carlo simulation study are provided to illustrate some of the theoretical results.     

On small sample properties of the almost unbiased generalized ridge estimator

The purpose of this paper is to examine small sample properties of the operational almost unbiased generalized ridge estimator (E) . The exact first two moments of theAUGRE are derived. It is shown that although the reduction of the bias of the AUGRE is substantial, the AUGRE is rather inefficient than the generalized ridge estimator without the bias correction in a wide range of a noncen-trality parameter in terms of the mean square error.     

Performance of the almost unbiased ridge-type principal component estimator in logistic regression model

ABSTRACT

This article considers some different parameter estimation methods in logistic regression model. In order to overcome multicollinearity, the almost unbiased ridge-type principal component estimator is proposed. The scalar mean squared error of the proposed estimator is derived and its properties are investigated. Finally, a numerical example and a simulation study are presented to show the performance of the proposed estimator.     

Preliminary test almost unbiased two-parameter estimators with student’s t errors and conflicting test statistics

Abstract

In this paper, we consider the preliminary test approach to the estimation of the regression parameter in a multiple regression model under multicollinearity situation. The preliminary test almost unbiased two-parameter estimators based on the Wald, the Likelihood ratio, and the Lagrangian multiplier tests are given, when it is suspected that the regression parameter may be restricted to a subspace and the regression error is distributed with multivariate Student’s t errors. The bias and quadratic risk of the proposed estimators are derived and compared. Furthermore, a Monte Carlo simulation is provided to illustrate some of the theoretical results.     

Mean Squared Error Matrix Comparisons of Some Restricted Almost Unbiased Estimators

In this article, we introduce two almost unbiased estimators for the vector of unknown parameters in a linear regression model when additional linear restrictions on the parameter vector are assumed to hold. Superiority of the two estimators under the mean squared error matrix (MSEM) is discussed. Furthermore, a numerical example and simulation study are given to illustrate some of the theoretical results.     

On the restricted almost unbiased Liu estimator in the logistic regression model

It is known that when the multicollinearity exists in the logistic regression model, variance of maximum likelihood estimator is unstable. As a remedy, in the context of biased shrinkage Liu estimation, Chang introduced an almost unbiased Liu estimator in the logistic regression model. Making use of his approach, when some prior knowledge in the form of linear restrictions are also available, we introduce a restricted almost unbiased Liu estimator in the logistic regression model. Statistical properties of this newly defined estimator are derived and some comparison results are also provided in the form of theorems. A Monte Carlo simulation study along with a real data example are given to investigate the performance of this estimator.     

MORE ON THE PRE-TEST ESTIMATOR IN RIDGE REGRESSION

ABSTRACT

The problem of estimation of the regression coefficients in a multiple regression model is considered under a multicollinearity situation when it is suspected that the regression coefficients may be restricted to a subspace. The objective of this paper is to compare the usual preliminary test estimator and the preliminary test ridge regression estimator in the sense of the dispersion matrix of one dominating that of the other. In particular we proved two results giving necessary and sufficient conditions for the superiority of the preliminary test ridge regression estimator over the preliminary test estimator associated with the δ = 0 (or Δ = 0) and δ ≠ 0 (or Δ ≠ 0).     

Generalized preliminary test stochastic restricted estimator in the linear regression model

ABSTRACT

In this paper, we propose three generalized estimators, namely, generalized unrestricted estimator (GURE), generalized stochastic restricted estimator (GSRE), and generalized preliminary test stochastic restricted estimator (GPTSRE). The GURE can be used to represent the ridge estimator, almost unbiased ridge estimator (AURE), Liu estimator, and almost unbiased Liu estimator. When stochastic restrictions are available in addition to the sample information, the GSRE can be used to represent stochastic mixed ridge estimator, stochastic restricted Liu estimator, stochastic restricted almost unbiased ridge estimator, and stochastic restricted almost unbiased Liu estimator. The GPTSRE can be used to represent the preliminary test estimators based on mixed estimator. Using the GPTSRE, the properties of three other preliminary test estimators, namely preliminary test stochastic mixed ridge estimator, preliminary test stochastic restricted almost unbiased Liu estimator, and preliminary test stochastic restricted almost unbiased ridge estimator can also be discussed. The mean square error matrix criterion is used to obtain the superiority conditions to compare the estimators based on GPTSRE with some biased estimators for the two cases for which the stochastic restrictions are correct, and are not correct. Finally, a numerical example and a Monte Carlo simulation study are done to illustrate the theoretical findings of the proposed estimators.     

Performances of the Positive-Rule Stein-Type Ridge Estimator in a Linear Regression Model with Spherically Symmetric Error Distributions

In this article, the positive-rule Stein-type ridge estimator (PSRE) is introduced for the parameters in a multiple linear regression model with spherically symmetric error distributions when it is suspected that the parameter vector may be restricted to a linear manifold. The bias and quadratic risk functions of the PSRE are derived and compared with some related competing estimators in literatures. Particularly, some sufficient conditions are derived for superiority of the PSRE over the ordinary ridge estimator, the restricted ridge estimator and the preliminary test ridge estimator, respectively. Furthermore, some graphical results are provided to illustrate some of the theoretical results.     

Linearized Ridge Regression Estimator Under the Mean Squared Error Criterion in a Linear Regression Model

This article mainly aims to study the superiority of the notion of linearized ridge regression estimator (LRRE) under the mean squared error criterion in a linear regression model. Firstly, we derive uniform lower bound of MSE for the class of the generalized shrinkage estimator (GSE), based on which it is shown that the optimal LRRE is the best estimator in the class of GSE's. Secondly, we propose the notion of the almost unbiased completeness and show that LRRE possesses such a property. Thirdly, the simulation study is given, from which it indicates that the LRRE performs desirably. Finally, the main results are applied to the well known Hald data.     

Best Quadratic Unbiased Prediction in a General Linear Model with Stochastic Regression Coefficients

In this article, we discuss on how to predict a combined quadratic parametric function of the form β′ H β + hσ² in a general linear model with stochastic regression coefficients denoted by y  =  X β +  e . Firstly, the quadratic predictability of β′ H β + hσ² is investigated to obtain a quadratic unbiased predictor (QUP) via a general method of structuring an unbiased estimator. This QUP is also optimal in some situations and therefore we hope it will be a fine predictor. To show this idea, we apply the Lagrange multipliers method to this problem and finally reach the expected conclusion through permutation matrix techniques.     

Efficiency of two classes of stochastic restricted almost unbiased type principal component estimators in linear regression model

In this paper, we introduce two new classes of estimators called the stochastic restricted almost unbiased ridge-type principal component estimator (SRAURPCE) and the stochastic restricted almost unbiased Liu-type principal component estimator (SRAURPCE) to overcome the well-known multicollinearity problem in linear regression model. For the two cases when the restrictions are true and not true, necessary and sufficient conditions for the superiority of the proposed estimators are derived and compared, respectively. Furthermore, a Monte Carlo simulation study and a numerical example are given to illustrate the performance of the proposed estimators.     

On the almost unbiased generalized liu estimator and unbiased estimation of the bias and mse

In this paper, we derive the almost unbiased generalized Liu estimator and examine an exact unbiased estimator of the bias and mean squared error of the feasible generalized Liu estimator . We compare the almost unbiased generalized Liu estimator (AUGLE) with the generalized Liu estimator (GLE) and with the ordinary least squares estimator (OLSE).