Robust estimation for the coefficient of a first order autoregressive process

Nonparametric methods, Theil's method and Hussain's method have been applied to simple linear regression problems for estimating the slope of the regression line.We extend these methods and propose a robust estimator to estimate the coefficient of a first order autoregressive process under various distribution shapes, A simulation study to compare Theil's estimator, Hus-sain's estimator, the least squares estimator, and the proposed estimator is also presented.     

On necessary and sufficient condition for superiority of ridge estimator over least squares estimator

The necessary and sufficient condition is obtained such that ridge estimator is better than the least squares estimator relative to the matrix mean square error.     

Bias reduction of the maximum-likelihood estimator for a conditional Gaussian MA(1) model

In this paper, we consider an estimation for the unknown parameters of a conditional Gaussian MA(1) model. In the majority of cases, a maximum-likelihood estimator is chosen because the estimator is consistent. However, for small sample sizes the error is large, because the estimator has a bias of O(n^{? 1}). Therefore, we provide a bias of O(n^{? 1}) for the maximum-likelihood estimator for the conditional Gaussian MA(1) model. Moreover, we propose new estimators for the unknown parameters of the conditional Gaussian MA(1) model based on the bias of O(n^{? 1}). We investigate the properties of the bias, as well as the asymptotical variance of the maximum-likelihood estimators for the unknown parameters, by performing some simulations. Finally, we demonstrate the validity of the new estimators through this simulation study.     

On a generalized stein estimator of regression coefficients

This paper studies a generalized Stein estimator of regression coefficients. The small disturbance approximations for the bias and mean square error matrix of the estimator are derived and a necessary and sufficient condition is obtained for the estimator to dominate the ordinary least squares estimator under the mean square error criterion.     

Improvement of the Liu estimator in linear regression model

In the presence of stochastic prior information, in addition to the sample, Theil and Goldberger (1961) introduced a Mixed Estimator for the parameter vector β in the standard multiple linear regression model (T,Xβ,σ² I). Recently, the Liu estimator which is an alternative biased estimator for β has been proposed by Liu (1993). In this paper we introduce another new Liu type biased estimator called Stochastic restricted Liu estimator for β, and discuss its efficiency. The necessary and sufficient conditions for mean squared error matrix of the Stochastic restricted Liu estimator to exceed the mean squared error matrix of the mixed estimator will be derived for the two cases in which the parametric restrictions are correct and are not correct. In particular we show that this new biased estimator is superior in the mean squared error matrix sense to both the Mixed estimator and to the biased estimator introduced by Liu (1993).     

Finite sample properties of beale's ratio estimator

In this paper, the exact blas and mean square error of Beale's ratio estimator are derived under a blvariate normal nlodel in the form of an infinite series. It is found that some conventional large sample approxlmatlons are extremely poor if the relative variance of the auxlllary variable X is large. It is also brought out through this.study that Beale's estimator of the population mean seems to be more efficient than the usual sanple mean under the condition resulting from the large sample comparison of the customary ratio estimator and the usual sample mean.     

Trimmed least squares estimator as best trimmed linear conditional estimator for linear regression model

A class of trimmed linear conditional estimators based on regression quantiles for the linear regression model is introduced. This class serves as a robust analogue of non-robust linear unbiased estimators. Asymptotic analysis then shows that the trimmed least squares estimator based on regression quantiles ( Koenker and Bassett ( 1978 ) ) is the best in this estimator class in terms of asymptotic covariance matrices. The class of trimmed linear conditional estimators contains the Mallows-type bounded influence trimmed means ( see De Jongh et al ( 1988 ) ) and trimmed instrumental variables estimators. A large sample methodology based on trimmed instrumental variables estimator for confidence ellipsoids and hypothesis testing is also provided.     

Generalized preliminary test stochastic restricted estimator in the linear regression model

ABSTRACT

In this paper, we propose three generalized estimators, namely, generalized unrestricted estimator (GURE), generalized stochastic restricted estimator (GSRE), and generalized preliminary test stochastic restricted estimator (GPTSRE). The GURE can be used to represent the ridge estimator, almost unbiased ridge estimator (AURE), Liu estimator, and almost unbiased Liu estimator. When stochastic restrictions are available in addition to the sample information, the GSRE can be used to represent stochastic mixed ridge estimator, stochastic restricted Liu estimator, stochastic restricted almost unbiased ridge estimator, and stochastic restricted almost unbiased Liu estimator. The GPTSRE can be used to represent the preliminary test estimators based on mixed estimator. Using the GPTSRE, the properties of three other preliminary test estimators, namely preliminary test stochastic mixed ridge estimator, preliminary test stochastic restricted almost unbiased Liu estimator, and preliminary test stochastic restricted almost unbiased ridge estimator can also be discussed. The mean square error matrix criterion is used to obtain the superiority conditions to compare the estimators based on GPTSRE with some biased estimators for the two cases for which the stochastic restrictions are correct, and are not correct. Finally, a numerical example and a Monte Carlo simulation study are done to illustrate the theoretical findings of the proposed estimators.     

On the weighted mixed Liu-type estimator under unbiased stochastic restrictions

In this article, we introduce the weighted mixed Liu-type estimator (WMLTE) based on the weighted mixed and Liu-type estimator (LTE) in linear regression model. We will also present necessary and sufficient conditions for superiority of the weighted mixed Liu-type estimator over the weighted mixed estimator (WME) and Liu type estimator (LTE) in terms of mean square error matrix (MSEM) criterion. Finally, a numerical example and a Monte Carlo simulation is also given to show the theoretical results.     

On the inadmssibelity of ridge estimator in a linear model

The necessary and sufficient conditions for the inadmissibility of the ridge regression is discussed under two different criteria, namely, average loss and Pitman nearness. Although the two criteria are very different, same conclusions are obtained. The loss functions considered in this article are th likelihood loss function and the Mahalanobis loss function. The two loss functions are motivated from the point of view of classification of two normal populations. Under the Mahalanobis loss it is demonstrated that the ridge regression is always inadmissible as long as the errors are assumed to be symmetrically distributed about the origin.     

On the estimates of the parameters of the first order autoregressive process

Two methods of estimation for the parameters of an AR(1) process which are based on a non-linear least-squares approach are presented. On the basis of some simulation results they are compared with two maximum likelihood estimates and their relative merits are discussed.     

A modified Liu-type estimator with an intercept term under mixture experiments

We consider ridge regression with an intercept term under mixture experiments. We propose a new estimator which is shown to be a modified version of the Liu-type estimator. The so-called compound covariate estimator is applied to modify the Liu-type estimator. We then derive a formula of the total mean squared error (TMSE) of the proposed estimator. It is shown that the new estimator improves upon existing estimators in terms of the TMSE, and the performance of the new estimator is invariant under the change of the intercept term. We demonstrate the new estimator using a real dataset on mixture experiments.     

Efficiencies of six almost unbiased ratio estimators under a particular model

Efficiencies of six almost unbiased estimators for the ratio of population means of two characters, are compared under a linear regression model.     

Asymptotic cumulants of the minimum phi-divergence estimator for categorical data under possible model misspecification

Abstract

The asymptotic cumulants of the minimum phi-divergence estimators of the parameters in a model for categorical data are obtained up to the fourth order with the higher-order asymptotic variance under possible model misspecification. The corresponding asymptotic cumulants up to the third order for the studentized minimum phi-divergence estimator are also derived. These asymptotic cumulants, when a model is misspecified, depend on the form of the phi-divergence. Numerical illustrations with simulations are given for typical cases of the phi-divergence, where the maximum likelihood estimator does not necessarily give best results. Real data examples are shown using log-linear models for contingency tables.     

Shrinkage estimator of regression model under asymmetric loss

This article investigates the performance of the shrinkage estimator (SE) of the parameters of a simple linear regression model under the LINEX loss criterion. The risk function of the estimator under the asymmetric LINEX loss is derived and analyzed. The moment-generating functions and the first two moments of the estimators are also obtained. The risks of the SE have been compared numerically with that of pre-test and least-square estimators (LSEs) under the LINEX loss criterion. The numerical comparison reveals that under certain conditions the LSE is inadmissible, and the SE is the best among the three estimators.     

Relative efficiency of first difference estimator in panel data regression with serially correlated error components

We consider the pooled cross-sectional and time series regression model when the disturbances follow a serially correlated one-way error components. In this context we discovered that the first difference estimator for the regression coefficients is equivalent to the generalized least squares estimator irrespective of the particular form of the regressor matrix when the disturbances are generated by a first order autoregressive process where the autocorrelation is close to unity.     

On the equality of usual and amemiya's partially generalized least squares estimator

Equivalent conditions are derived for the equality of GLSE (generalized least squares estimator) and partially GLSE (PGLSE), the latter introduced by Amemiya (1983). By adopting a more general approach the ordinary least squares estimator (OLSE) can shown to be a special PGLSE. Furthcrmore, linearly restricted estimators proposed by Balestra (1983) are investigated in this context. To facilitate the comparison of estimators extensive use of oblique and orthogonal projectors is made.     

Bias in the ordinary least squares estimator in the dynamic linear regression model with autocorrelated disturbances

We consider the bias in the Ordinary Least Squares estimator in the linear regression model with a lagged dependent variable as regressor. Results are obtained with independent and auto-correlated disturbances. Asymptotic results are obtained analytically, and finite sample results based on a Monte Carlo study. The substantial biases found suggest the need for an alternative estimator to Ordinary Least Squares and powerful tests for autocorrelated disturbances in the dynamic model.     

Positive-rule stein-type almost unbiased ridge estimator in linear regression model

Abstract

In this article, when it is suspected that regression coefficients may be restricted to a subspace, we discuss the parameter estimation of regression coefficients in a multiple regression model. Then, in order to improve the preliminary test almost ridge estimator, we study the positive-rule Stein-type almost unbiased ridge estimator based on the positive-rule stein-type shrinkage estimator and almost unbiased ridge estimator. After that, quadratic bias and quadratic risk values of the new estimator are derived and compared with some relative estimators. And we also discuss the option of parameter k. Finally, we perform a real data example and a Monte Carlo study to illustrate theoretical results.     

The performance of the adaptive optimal estimator under the extended balanced loss function

The adaptive optimal estimator of Farebrother (1975) is discussed by many authors, but the goodness of fitted model criterion that is used to investigate the performance of estimators is quite often ignored. Shalabh, Toutenburg, and Heumann (2009) proposed the extended balanced loss function in which the mean squared error and the Zellner's balanced loss function are just special cases of it. In this paper, we discuss the performance of the adaptive optimal estimator of Farebrother (1975) under the extended balanced loss function. Moreover, a Monte Carlo simulation experiment is conducted to examine the performance of the estimator in finite samples.