A new stochastic mixed ridge estimator in linear regression model

This paper is concerned with the parameter estimation in linear regression model with additional stochastic linear restrictions. To overcome the multicollinearity problem, a new stochastic mixed ridge estimator is proposed and its efficiency is discussed. Necessary and sufficient conditions for the superiority of the stochastic mixed ridge estimator over the ridge estimator and the mixed estimator in the mean squared error matrix sense are derived for the two cases in which the parametric restrictions are correct and are not correct. Finally, a numerical example is also given to show the theoretical results.     

A weighted stochastic restricted ridge estimator in partially linear model

In this article, we consider the estimation of a partially linear model when stochastic linear restrictions on the parameter components are assumed to hold. Based on the weighted mixed estimator, profile least-squares method, and ridge method, a weighted stochastic restricted ridge estimator of the parametric component is introduced. The properties of the new estimator are also discussed. Finally, a simulation study is given to show the performance of the new estimator.     

Estimation in Singular Linear Models with Stochastic Linear Restrictions and Linear Equality Restrictions

This article is concerned with the parameter estimation in a singular linear regression model with stochastic linear restrictions and linear equality restrictions simultaneously. A new estimator is introduced and it is proved that the proposed estimator is superior to the least squares estimator and singular mixed estimator in the mean squared error sense under certain conditions.     

The relative efficiency of the restricted estimators in linear regression models

This paper deals with the problem of multicollinearity in a multiple linear regression model with linear equality restrictions. The restricted two parameter estimator which was proposed in case of multicollinearity satisfies the restrictions. The performance of the restricted two parameter estimator over the restricted least squares (RLS) estimator and the ordinary least squares (OLS) estimator is examined under the mean square error (MSE) matrix criterion when the restrictions are correct and not correct. The necessary and sufficient conditions for the restricted ridge regression, restricted Liu and restricted shrunken estimators, which are the special cases of the restricted two parameter estimator, to have a smaller MSE matrix than the RLS and the OLS estimators are derived when the restrictions hold true and do not hold true. Theoretical results are illustrated with numerical examples based on Webster, Gunst and Mason data and Gorman and Toman data. We conduct a final demonstration of the performance of the estimators by running a Monte Carlo simulation which shows that when the variance of the error term and the correlation between the explanatory variables are large, the restricted two parameter estimator performs better than the RLS estimator and the OLS estimator under the configurations examined.     

Two Kinds of Restricted Estimators in Singular Linear Regression

In this article, the parameter estimators in singular linear model with linear equality restrictions are considered. The restricted root estimator and the generalized restricted root estimator are proposed and some properties of the estimators are also studied. Furthermore, we compare them with the restricted unified least squares estimator and show their sufficient conditions under which their superior over the restricted unified least squares estimator in terms of mean squares error, and discuss the choice of the unknown parameters of the generalized restricted root estimator.     

Restricted ridge estimator in the logistic regression model

It is known that when the multicollinearity exists in the logistic regression model, variance of maximum likelihood estimator is unstable. As a remedy, Schaefer et al. presented a ridge estimator in the logistic regression model. Making use of the ridge estimator, when some linear restrictions are also present, we introduce a restricted ridge estimator in the logistic regression model. Statistical properties of this newly defined estimator will be studied and comparisons are done in the simulation study in the sense of mean squared error criterion. A real-data example and a simulation study are introduced to discuss the performance of this estimator.     

Estimation in Singular Linear Models with Stochastic Linear Restrictions

This article generalizes the ordinary mixed estimator (OME) in theory, and obtains the estimator of the unknown regression parameters in singular linear models with stochastic linear restrictions: singular mixed estimator (SME). We also give some properties of SME obtained in this article, and prove that it is superior to unrestricted least squared estimator (LSE) in singular linear models in the sense of the covariance matrix and generalized mean square error (GMSE). After that, we also have a discussion about the two-stage estimator of SME. The result we give in this article could be regarded as generalizations of both OME and unrestricted LSE at the same time.     

On the restricted almost unbiased Liu estimator in the logistic regression model

It is known that when the multicollinearity exists in the logistic regression model, variance of maximum likelihood estimator is unstable. As a remedy, in the context of biased shrinkage Liu estimation, Chang introduced an almost unbiased Liu estimator in the logistic regression model. Making use of his approach, when some prior knowledge in the form of linear restrictions are also available, we introduce a restricted almost unbiased Liu estimator in the logistic regression model. Statistical properties of this newly defined estimator are derived and some comparison results are also provided in the form of theorems. A Monte Carlo simulation study along with a real data example are given to investigate the performance of this estimator.     

Principal components regression estimator and a test for the restrictions

In this article, we introduce restricted principal components regression (RPCR) estimator by combining the approaches followed in obtaining the restricted least squares estimator and the principal components regression estimator. The performance of the RPCR estimator with respect to the matrix and the generalized mean square error are examined. We also suggest a testing procedure for linear restrictions in principal components regression by using singly and doubly non-central F distribution.     

Recursive improvement of estimates in a Gauss-Markov model with linear restrictions

The minimum-dispersion linear unbiased estimator of a set of estimable functions in a general Gauss-Markov model with double linear restrictions is considered. The attention is focused on developing a recursive formula in which an initial estimator, obtained from the unrestricted model, is corrected with respect to the restrictions successively incorporated into the model. The established formula generalizes known results developed for the simple Gauss-Markov model.     

Econometric Reviews

This paper considers the problem of estimating a nonlinear statistical model subject to stochastic linear constraints among unknown parameters. These constraints represent prior information which originates from a previous estimation of the same model using an alternative database. One feature of this specification allows for the disign matrix of stochastic linear restrictions to be estimated. The mixed regression technique and the maximum likelihood approach are used to derive the estimator for both the model coefficients and the unknown elements of this design matrix. The proposed estimator whose asymptotic properties are studied, contains as a special case the conventional mixed regression estimator based on a fixed design matrix. A new test of compatibility between prior and sample information is also introduced. Thesuggested estimator is tested empirically with both simulated and actual marketing data.     

Generalized mixed estimator for nonlinear models: a maximum likelihood approach

This paper considers the problem of estimating a nonlinear statistical model subject to stochastic linear constraints among unknown parameters. These constraints represent prior information which originates from a previous estimation of the same model using an alternative database. One feature of this specification allows for the disign matrix of stochastic linear restrictions to be estimated. The mixed regression technique and the maximum likelihood approach are used to derive the estimator for both the model coefficients and the unknown elements of this design matrix. The proposed estimator whose asymptotic properties are studied, contains as a special case the conventional mixed regression estimator based on a fixed design matrix. A new test of compatibility between prior and sample information is also introduced. Thesuggested estimator is tested empirically with both simulated and actual marketing data.     

The Joint Treatment of Exact and Stochastic Restrictions

In regression analysis both exact and stochastic extraneous information may be represented via restrictions on the parameters of a linear model which then may be estimated by applying constrained generalized least squares. It is shown that this estimator can be recast as a computationally simpler estimator that is a combination of the ordinary least squares estimator and the discrepancy between the OLS estimator and both types of restrictions. The variance of the restricted parameters is explicitly shown to depend on the variance of the extraneous information.     

Modified Restricted Almost Unbiased Liu Estimator in Linear Regression Model

In this article we introduce a modified restricted almost unbiased Liu estimator in linear regression model which satisfies the linear restrictions. The mean squared error matrix (MSEM) of the proposed estimator is derived and compared with the corresponding competitors in literature. Finally, a numerical example and a Monte Carlo simulation are given to illustrate some of the theoretical results.     

Local Influence Analysis for The Ridge Regression Under Stochastic Linear Restrictions

In this article, we assess the local influence for the ridge regression of linear models with stochastic linear restrictions in the spirit of Cook by using the log-likelihood of the stochastic restricted ridge regression estimator. The diagnostics under the perturbations of constant variance, responses and individual explanatory variables are derived. We also assess the local influence of the stochastic restricted ridge regression estimator under the approach suggested by Billor and Loynes. At the end, a numerical example on the Longley data is given to illustrate the theoretic results.     

Ridge regression methodology in partial linear models with correlated errors

In this article, a generalized restricted difference-based ridge estimator is defined for the vector parameter in a partial linear model when the errors are dependent. It is suspected that some additional linear constraints may hold on to the whole parameter space. The estimator is a generalization of the well-known restricted least-squares estimator and is confined to the (affine) subspace which is generated by the restrictions. The risk functions of the proposed estimators are derived under balanced loss function. Finally, the performance of the new estimators is evaluated by a simulated data set.     

Restricted minimax estimation in semiparametric linear models

Abstract

In this article we develop the minimax estimation approach of general linear models to the semiparametric linear models when the parameters are simultaneously constrained by an ellipsoid and linear restrictions. Combining sample information and prior constraints the minimax estimator is obtained and compared with partially least square estimator by theoretical and simulation methods.     

Restricted Ridge Estimators of the Parameters in Semiparametric Regression Model

In this article, we introduce a ridge estimator for the vector of parameters β in a semiparametric model when additional linear restrictions on the parameter vector are assumed to hold. We also obtain the semiparametric restricted ridge estimator for the parametric component in the semiparametric regression model. The ideas in this article are illustrated with a data set consisting of housing prices and through a comparison of the performances of the proposed and related estimators via a Monte Carlo simulation.     

Parameter estimation under orthant restrictions

The authors consider the estimation of linear functions of a multivariate parameter under orthant restrictions. These restrictions are considered both for location models and for the Poisson distribution. For these models, situations are characterized for which the restricted maximum likelihood estimator dominates the unrestricted one for the estimation of any linear function of the parameter. The results obtained point directly to the importance of the dimension of the parameter space, the central direction of the cone and its vertex in these cases. Special attention is given to examples, such as the one‐way analysis of variance, where the estimation of individual interesting linear functions of the parameter, as the coordinates and the differences between them, is also treated.     

A Generalized Stochastic Restricted Ridge Regression Estimator

In this article, we introduce a new stochastic restricted estimator for the unknown vector parameter in the linear regression model when stochastic linear restrictions on the parameters hold. We show that the new estimator is a generalization of the ordinary mixed estimator (OME), Liu estimator (LE), ordinary ridge estimator (ORR), (k-d) class estimator, stochastic restricted Liu estimator (SRLE), and stochastic restricted ridge estimator (SRRE). Performance of the new estimator in comparison to other estimators in terms of the mean squares error matrix (MMSE) is examined. Numerical example from literature have been given to illustrate the results.