Rank-based ridge estimation in multiple linear regression

Multicollinearity and model misspecification are frequently encountered problems in practice that produce undesirable effects on classical ordinary least squares (OLS) regression estimator. The ridge regression estimator is an important tool to reduce the effects of multicollinearity, but it is still sensitive to a model misspecification of error distribution. Although rank-based statistical inference has desirable robustness properties compared to the OLS procedures, it can be unstable in the presence of multicollinearity. This paper introduces a rank regression estimator for regression parameters and develops tests for general linear hypotheses in a multiple linear regression model. The proposed estimator and the tests have desirable robustness features against the multicollinearity and model misspecification of error distribution. Asymptotic behaviours of the proposed estimator and the test statistics are investigated. Real and simulated data sets are used to demonstrate the feasibility and the performance of the estimator and the tests.     

第三类Tobit模型的半参数估计方法

本文给出第三类Tobit模型的一种新的半参数估计方法。在独立性假设下,利用主方程和选择方程中可观察受限因变量的条件生存函数所满足的关系式,构造第三类Tobit模型参数的一步联立估计量。在已知选择方程中参数一致性估计量的条件下,这种方法也可用于构造主方程模型参数 的两步估计量。本文证明了所提出的一步联立估计量和两步估计量的一致性和渐近正态性。实验模拟表明,我们提出的估计量在有限样本下具有良好表现,且一步联立估计量的有限样本表现优于或接近于Chen（1997）的估计量。     

Bias in the ordinary least squares estimator in the dynamic linear regression model with autocorrelated disturbances

We consider the bias in the Ordinary Least Squares estimator in the linear regression model with a lagged dependent variable as regressor. Results are obtained with independent and auto-correlated disturbances. Asymptotic results are obtained analytically, and finite sample results based on a Monte Carlo study. The substantial biases found suggest the need for an alternative estimator to Ordinary Least Squares and powerful tests for autocorrelated disturbances in the dynamic model.     

处理效应模型的理论拓展及在政策评价中的应用

现有文献在利用处理效应模型评估政策时,模型中的假设条件局限性大多较强,在实际应用中很难验证,且一旦这些假设错误,就会引起参数估计的不一致。本文首先在非参数框架下提出了一种关于处理效应模型的半参数估计方法,其既不对模型中的函数形式做任何假定,也允许误差项的联合分布是广义异方差形式,从而大大减少因模型误设而引起的估计偏误。考虑到处理效应的内生性问题,提出了一个两步估计量。第一步关于选择方程进行非参数估计;第二步在结果方程中,利用工具变量法估计平均处理效应。其次,对估计量的大样本性质进行分析,表明了估计量的一致性和渐近正态性质。再次,通过蒙特卡罗模拟与已有估计方法进行比较,结果表明本文的方法具有较强的稳健性。最后,本文将该方法应用于研究高新技术企业认证政策对企业盈利能力影响,研究发现该政策提升了高新技术企业的盈利能力,并且相比于国有企业,该政策对民营企业促进效应更大。     

Optimal generalized logistic estimator

In this paper, we propose a new efficient estimator namely Optimal Generalized Logistic Estimator (OGLE) for estimating the parameter in a logistic regression model when there exists multicollinearity among explanatory variables. Asymptotic properties of the proposed estimator are also derived. The performance of the proposed estimator over the other existing estimators in respect of Scalar Mean Square Error criterion is examined by conducting a Monte Carlo simulation.     

Finite sample properties of an HPT estimator when each individual regression coefficient is estimated in a misspecified linear regression model

ABSTRACT

In this paper, assuming that there exist omitted variables in the specified model, we analytically derive the exact formula for the mean squared error (MSE) of a heterogeneous pre-test (HPT) estimator whose components are the ordinary least squares (OLS) and feasible ridge regression (FRR) estimators. Since we cannot examine the MSE performance analytically, we execute numerical evaluations to investigate small sample properties of the HPT estimator, and compare the MSE performance of the HPT estimator with those of the FRR estimator and the usual OLS estimator. Our numerical results show that (1) the HPT estimator is more efficient when the model misspecification is severe; (2) the HPT estimator with the optimal critical value obtained under the correctly specified model can be safely used even when there exist omitted variables in the specified model.     

Choice of Parametric Accelerated Life and Proportional Hazards Models for Survival Data: Asymptotic Results

We discuss the impact of misspecifying fully parametric proportional hazards and accelerated life models. For the uncensored case, misspecified accelerated life models give asymptotically unbiased estimates of covariate effect, but the shape and scale parameters depend on the misspecification. The covariate, shape and scale parameters differ in the censored case. Parametric proportional hazards models do not have a sound justification for general use: estimates from misspecified models can be very biased, and misleading results for the shape of the hazard function can arise. Misspecified survival functions are more biased at the extremes than the centre. Asymptotic and first order results are compared. If a model is misspecified, the size of Wald tests will be underestimated. Use of the sandwich estimator of standard error gives tests of the correct size, but misspecification leads to a loss of power. Accelerated life models are more robust to misspecification because of their log-linear form. In preliminary data analysis, practitioners should investigate proportional hazards and accelerated life models; software is readily available for several such models.     

When are two step estimators efficient?

Kruskal's theorem is used to provide simple and elegant alternative derivations of the efficiency of some two step estimators (2SE) for models containing anticipated and unanticipated variables. Several new results are established: 2SE is not efficient for a structural equation with current and lagged values of both anticipated and unanticipated variables; 2SE is always efficient for the parameter associated with the current unanticipated variable, and for the parameter associated with the lagged unanticipated variable if there is no lagged dependent variable in the expectations equation; the inclusion of additional regressors in the structural equation and contemporaneous correlation of the structural and expectations errors can both be analysed in a straightforward manner; the single-equation generalized least squares estimator can be as efficient as the systems maximum likelihood estimator.     

Efficient score tests for heteroskedasticity in micro-economics

Kruskal's theorem is used to provide simple and elegant alternative derivations of the efficiency of some two step estimators (2SE) for models containing anticipated and unanticipated variables. Several new results are established: 2SE is not efficient for a structural equation with current and lagged values of both anticipated and unanticipated variables; 2SE is always efficient for the parameter associated with the current unanticipated variable, and for the parameter associated with the lagged unanticipated variable if there is no lagged dependent variable in the expectations equation; the inclusion of additional regressors in the structural equation and contemporaneous correlation of the structural and expectations errors can both be analysed in a straightforward manner; the single-equation generalized least squares estimator can be as efficient as the systems maximum likelihood estimator.     

Trimmed least squares estimator as best trimmed linear conditional estimator for linear regression model

A class of trimmed linear conditional estimators based on regression quantiles for the linear regression model is introduced. This class serves as a robust analogue of non-robust linear unbiased estimators. Asymptotic analysis then shows that the trimmed least squares estimator based on regression quantiles ( Koenker and Bassett ( 1978 ) ) is the best in this estimator class in terms of asymptotic covariance matrices. The class of trimmed linear conditional estimators contains the Mallows-type bounded influence trimmed means ( see De Jongh et al ( 1988 ) ) and trimmed instrumental variables estimators. A large sample methodology based on trimmed instrumental variables estimator for confidence ellipsoids and hypothesis testing is also provided.     

A Note on Nonlinear Cointegration,Misspecification, and Bimodality

We derive the asymptotic distribution of the ordinary least squares estimator in a regression with cointegrated variables under misspecification and/or nonlinearity in the regressors. We show that, under some circumstances, the order of convergence of the estimator changes and the asymptotic distribution is non-standard. The t-statistic might also diverge. A simple case arises when the intercept is erroneously omitted from the estimated model or in nonlinear-in-variables models with endogenous regressors. In the latter case, a solution is to use an instrumental variable estimator. The core results in this paper also generalise to more complicated nonlinear models involving integrated time series.     

Performance of the principal component two-parameter estimator in misspecified linear regression model

In this article, we consider the performance of the principal component two-parameter estimator in situation of multicollinearity for misspecified linear regression model where misspecification is due to omission of some relevant explanatory variables. The conditions of superiority of the principal component two-parameter estimator over some estimators under the Mahalanobis loss function by the average loss criterion are derived. Furthermore, a real data example and a Monte Carlo simulation study are provided to illustrate some of the theoretical results.     

On the sensitivity of pre-test estimators to covariance misspecification

In statistical and econometric practice it is not uncommon to find that regression parameter estimates obtained using estimated generalized least squares (EGLS) do not differ much from those obtained through ordinary least squares (OLS), even when the assumption of spherical errors is violated. To investigate if one could ignore non-spherical errors, and legitimately continue with OLS estimation under the non-spherical disturbance setting, Banerjee and Magnus (1999) developed statistics to measure the sensitivity of the OLS estimator to covariance misspecification. Wan et al. (2007) generalized this work by allowing for linear restrictions on the regression parameters. This paper extends the aforementioned studies by exploring the sensitivity of the equality restrictions pre-test estimator to covariance misspecification. We find that the pre-test estimators can be very sensitive to covariance misspecification, and the degree of sensitivity of the pre-test estimator often lies between that of its unrestricted and restricted components. In addition, robustness to non-normality is investigated. It is found that existing results remain valid if elliptically symmetric, instead of normal, errors are assumed.     

Quantile regression estimation for distortion measurement error data

We study the quantile estimation methods for the distortion measurement error data when variables are unobserved and distorted with additive errors by some unknown functions of an observable confounding variable. After calibrating the error-prone variables, we propose the quantile regression estimation procedure and composite quantile estimation procedure. Asymptotic properties of the proposed estimators are established, and we also investigate the asymptotic relative efficiency compared with the least-squares estimator. Simulation studies are conducted to evaluate the performance of the proposed methods, and a real dataset is analyzed as an illustration.     

On Optimum Regression Estimator for Population Mean Using Two Auxiliary Variables in Simple Random Sampling

In this paper, a difference-in-regression estimator is proposed by using two auxiliary variables in simple random sampling. Variance of proposed estimator up to the first order of approximation is compared with other competing estimators. Additionally, by taking the known value of one of the population regression coefficients, another version of the proposed estimator is also obtained. The proposed estimator is found optimum in the class of estimators based on two auxiliary variables. A simulation study is carried out in support with theoretical results. If only the means of auxiliary variables are available, another estimator can be obtained for large trivariate normal population.     

Modified maximum likelihood estimator under the Jones and Faddy's skew t-error distribution for censored regression model

It is well-known that classical Tobit estimator of the parameters of the censored regression (CR) model is inefficient in case of non-normal error terms. In this paper, we propose to use the modified maximum likelihood (MML) estimator under the Jones and Faddy''s skew t-error distribution, which covers a wide range of skew and symmetric distributions, for the CR model. The MML estimators, providing an alternative to the Tobit estimator, are explicitly expressed and they are asymptotically equivalent to the maximum likelihood estimator. A simulation study is conducted to compare the efficiencies of the MML estimators with the classical estimators such as the ordinary least squares, Tobit, censored least absolute deviations and symmetrically trimmed least squares estimators. The results of the simulation study show that the MML estimators work well among the others with respect to the root mean square error criterion for the CR model. A real life example is also provided to show the suitability of the MML methodology.     

Stein-type estimation using ranked set sampling

In this study, we consider the application of the James–Stein estimator for population means from a class of arbitrary populations based on ranked set sample (RSS). We consider a basis for optimally combining sample information from several data sources. We succinctly develop the asymptotic theory of simultaneous estimation of several means for differing replications based on the well-defined shrinkage principle. We showcase that a shrinkage-type estimator will have, under quadratic loss, a substantial risk reduction relative to the classical estimator based on simple random sample and RSS. Asymptotic distributional quadratic biases and risks of the shrinkage estimators are derived and compared with those of the classical estimator. A simulation study is used to support the asymptotic result. An over-riding theme of this study is that the shrinkage estimation method provides a powerful extension of its traditional counterpart for non-normal populations. Finally, we will use a real data set to illustrate the computation of the proposed estimators.     

Asymptotic cumulants of the estimator of the canonical parameter in the exponential family

Asymptotic cumulants of the maximum likelihood estimator of the canonical parameter in the exponential family are obtained up to the fourth order with the added higher-order asymptotic variance. In the case of a scalar parameter, the corresponding results with and without studentization are given. These results are also obtained for the estimators by the weighted score, especially for those using the Jeffreys prior. The asymptotic cumulants are used for reducing bias and mean square error to improve a point estimator and for interval estimation to have higher-order accuracy. It is shown that the kurtosis to squared skewness ratio of the sufficient statistic plays a fundamental role.     

Estimation of parameters of mixed failure time distribution

The problem of estimation of parameters of a mixture of degenerate and exponential distributions is considered. A new sampling scheme is proposed and the exact bias and the mean square error (MSE) of the maximum likelihood estimators of the parameters is derived. Moment estimators, their approximate biases and the MSE are obtained. Asymptotic distributions of the estimators are also obtained for both the cases.     

Aalen's linear model for doubly censored data

Double censoring often occurs in registry studies when left censoring is present in addition to right censoring. In this work, we examine estimation of Aalen's nonparametric regression coefficients based on doubly censored data. We propose two estimation techniques. The first type of estimators, including ordinary least squared (OLS) estimator and weighted least squared (WLS) estimators, are obtained using martingale arguments. The second type of estimator, the maximum likelihood estimator (MLE), is obtained via expectation-maximization (EM) algorithms that treat the survival times of left censored observations as missing. Asymptotic properties, including the uniform consistency and weak convergence, are established for the MLE. Simulation results demonstrate that the MLE is more efficient than the OLS and WLS estimators.