Asymptotic normality of the lengths of a class of nonparametric confidence intervals for a regression parameter

In the linear regression model, the asymptotic distributions of certain functions of confidence bounds of a class of confidence intervals for the regression parameter arc investigated. The class of confidence intervals we consider in this paper are based on the usual linear rank statistics (signed as well as unsigned). Under suitable assumptions, if the confidence intervals are based on the signed linear rank statistics, it is established that the lengths, properly normalized, of the confidence intervals converge in law to the standard normal distributions; if the confidence intervals arc based on the unsigned linear rank statistics, it is then proved that a linear function of the confidence bounds converges in law to a normal distribution.     

Consistency,asymptotic unbiasedness and bounds on the bias of s2 in the linear regression model with error component disturbances

The OLS estimator of the disturbance variance in the linear regression model with error component disturbances is shown to be weakly consistent and asymptotically unbiased without any restrictions on the regressor matrix. Also, simple exact bounds on the expected value of s² are given for both the one-way and two-way error component models.     

Multivariate Tests of Mean-Variance Efficiency and Spanning With a Large Number of Assets and Time-Varying Covariances

We develop a finite-sample procedure to test the mean-variance efficiency and spanning hypotheses, without imposing any parametric assumptions on the distribution of model disturbances. In so doing, we provide an exact distribution-free method to test uniform linear restrictions in multivariate linear regression models. The framework allows for unknown forms of nonnormalities as well as time-varying conditional variances and covariances among the model disturbances. We derive exact bounds on the null distribution of joint F statistics to deal with the presence of nuisance parameters, and we show how to implement the resulting generalized nonparametric bounds tests with Monte Carlo resampling techniques. In sharp contrast to the usual tests that are not even computable when the number of test assets is too large, the power of the proposed test procedure potentially increases along both the time and cross-sectional dimensions.     

Reducing errors-in-variables bias in linear regression using compact genetic algorithms

A new technique is devised to mitigate the errors-in-variables bias in linear regression. The procedure mimics a 2-stage least squares procedure where an auxiliary regression which generates a better behaved predictor variable is derived. The generated variable is then used as a substitute for the error-prone variable in the first-stage model. The performance of the algorithm is tested by simulation and regression analyses. Simulations suggest the algorithm efficiently captures the additive error term used to contaminate the artificial variables. Regressions provide further credit to the simulations as they clearly show that the compact genetic algorithm-based estimate of the true but unobserved regressor yields considerably better results. These conclusions are robust across different sample sizes and different variance structures imposed on both the measurement error and regression disturbances.     

Bias in the ordinary least squares estimator in the dynamic linear regression model with autocorrelated disturbances

We consider the bias in the Ordinary Least Squares estimator in the linear regression model with a lagged dependent variable as regressor. Results are obtained with independent and auto-correlated disturbances. Asymptotic results are obtained analytically, and finite sample results based on a Monte Carlo study. The substantial biases found suggest the need for an alternative estimator to Ordinary Least Squares and powerful tests for autocorrelated disturbances in the dynamic model.     

Multivariate Bayesian variable selection and prediction

The multivariate regression model is considered with p regressors. A latent vector with p binary entries serves to identify one of two types of regression coefficients: those close to 0 and those not. Specializing our general distributional setting to the linear model with Gaussian errors and using natural conjugate prior distributions, we derive the marginal posterior distribution of the binary latent vector. Fast algorithms aid its direct computation, and in high dimensions these are supplemented by a Markov chain Monte Carlo approach to sampling from the known posterior distribution. Problems with hundreds of regressor variables become quite feasible. We give a simple method of assigning the hyperparameters of the prior distribution. The posterior predictive distribution is derived and the approach illustrated on compositional analysis of data involving three sugars with 160 near infrared absorbances as regressors.     

Evaluations of generalized order statistics from bounded populations

We consider generalized order statistics with arbitrary model parameters based on distributions supported on finite intervals. We determine optimal bounds on the expectations of arbitrary linear combinations of centered generalized order statistics gauged in support length scale units. More precise representations of bounds are obtained for single generalized order statistics and respective differences.     

Note on a linear model with errors in the variables and with trend

The least squares estimate of the slope parameter of a simple linear model with errors in the variables is typically biased. However the bias vanishes asymptotically for increasing sample size if the regressor variable follows a linear trend. For this case asymptotic expansion formulas for bias and variance of the least squares estimator are derived from exact expressions presented by Richardson and Wu (1970) and certain bounds to these expressions given by Friedmann (1990).     

结构突变趋势平稳过程与随机趋势过程的虚假回归研究

 内容提要：在已有研究的基础上,本文更为深入的研究含有结构突变的趋势平稳变量与随机趋势变量间的虚假回归问题。本文推导出OLS估计下DW统计量、F统计量以及R2的极限分布,并且将回归模型扩展到动态情形下,推导出用于Granger因果检验的F统计量的极限分布;采用Monte Carlo模拟方法分析了数据生成过程的各项参数对各统计量有限样本分布的影响;最后,本文分析了在有限样本下,数据生成过程的各项参数对虚假回归及虚假Granger因果关系发生概率的影响。     

The role of the constant and linear terms in cointegration analysis of nonstationary variables

The autoregressive model for cointegrated variables is analyzed with respect to the role of the constant and linear terms. Various models for 1(1) variables defined by restrictions on the deterministic terms are discussed, and it is shown that statistical inference can be performed by reduced rank regression. The asymptotic distributions of the test statistics and estimators are found. A similar analysis is given for models for 1(2) variables with a constant term.     

The role of the constant and linear terms in cointegration analysis of nonstationary variables

The autoregressive model for cointegrated variables is analyzed with respect to the role of the constant and linear terms. Various models for 1(1) variables defined by restrictions on the deterministic terms are discussed, and it is shown that statistical inference can be performed by reduced rank regression. The asymptotic distributions of the test statistics and estimators are found. A similar analysis is given for models for 1(2) variables with a constant term.     

Component selection norms for principal components regression

Multicollinearity or near exact linear dependence among the vectors of regressor variables in a multiple linear regression analysis can have important effects on the quality of least squares parameter estimates. One frequently suggested approach for these problems is principal components regression. This paper investigates alternative variable selection procedures and their implications for such an analysis.     

A Nonparametric Test of the Predictive Regression Model

This article considers testing the significance of a regressor with a near unit root in a predictive regression model. The procedures discussed in this article are nonparametric, so one can test the significance of a regressor without specifying a functional form. The results are used to test the null hypothesis that the entire function takes the value of zero. We show that the standardized test has a normal distribution regardless of whether there is a near unit root in the regressor. This is in contrast to tests based on linear regression for this model where tests have a nonstandard limiting distribution that depends on nuisance parameters. Our results have practical implications in testing the significance of a regressor since there is no need to conduct pretests for a unit root in the regressor and the same procedure can be used if the regressor has a unit root or not. A Monte Carlo experiment explores the performance of the test for various levels of persistence of the regressors and for various linear and nonlinear alternatives. The test has superior performance against certain nonlinear alternatives. An application of the test applied to stock returns shows how the test can improve inference about predictability.     

Some statistical analysis issues at the World Fertility Survey

"The World Fertility Survey carried out cross-sectional probability surveys of fertility in more than 40 developing countries between 1972 and 1984. Statistical issues in regression analysis of the data are reviewed, including treatment of interactions, the selection of regressor variables, and appropriate linear models for rate variables. Similar issues arise in many other applications of regression to observational data."     

Measure of location-based estimators in simple linear regression

In this note we consider certain measure of location-based estimators (MLBEs) for the slope parameter in a linear regression model with a single stochastic regressor. The median-unbiased MLBEs are interesting as they can be robust to heavy-tailed samples and, hence, preferable to the ordinary least squares estimator (LSE). Two different cases are considered as we investigate the statistical properties of the MLBEs. In the first case, the regressor and error is assumed to follow a symmetric stable distribution. In the second, other types of regressions, with potentially contaminated errors, are considered. For both cases the consistency and exact finite-sample distributions of the MLBEs are established. Some results for the corresponding limiting distributions are also provided. In addition, we illustrate how our results can be extended to include certain heteroskedastic and multiple regressions. Finite-sample properties of the MLBEs in comparison to the LSE are investigated in a simulation study.     

Lack-of-fit testing of a regression model with response missing at random

This paper proposes a class of lack-of-fit tests for fitting a linear regression model when some response variables are missing at random. These tests are based on a class of minimum integrated square distances between a kernel type estimator of a regression function and the parametric regression function being fitted. These tests are shown to be consistent against a large class of fixed alternatives. The corresponding test statistics are shown to have asymptotic normal distributions under null hypothesis and a class of nonparametric local alternatives. Some simulation results are also presented.     

Test of hypotheses in panel data models when the regressor and disturbances are possibly non-stationary

This paper considers the problem of hypothesis testing in a simple panel data regression model with random individual effects and serially correlated disturbances. Following Baltagi et al. (Econom. J. 11:554–572, 2008), we allow for the possibility of non-stationarity in the regressor and/or the disturbance term. While Baltagi et al. (Econom. J. 11:554–572, 2008) focus on the asymptotic properties and distributions of the standard panel data estimators, this paper focuses on testing of hypotheses in this setting. One important finding is that unlike the time-series case, one does not necessarily need to rely on the “super-efficient” type AR estimator by Perron and Yabu (J. Econom. 151:56–69, 2009) to make an inference in the panel data. In fact, we show that the simple t-ratio always converges to the standard normal distribution, regardless of whether the disturbances and/or the regressor are stationary.     

A Survey of Weak Instruments and Weak Identification in Generalized Method of Moments

Weak instruments arise when the instruments in linear instrumental variables (IV) regression are weakly correlated with the included endogenous variables. In generalized method of moments (GMM), more generally, weak instruments correspond to weak identification of some or all of the unknown parameters. Weak identification leads to GMM statistics with nonnormal distributions, even in large samples, so that conventional IV or GMM inferences are misleading. Fortunately, various procedures are now available for detecting and handling weak instruments in the linear IV model and, to a lesser degree, in nonlinear GMM.     

Tighter bounds and simplified estimation for moments of some rank statistics

Improved lower bounds are obtained for two parameters λ(F) and μ(F) which occur in the variances of linear rank statistics studied by Doksum, Hollander, and Lehmann. Simplified algorithms are developed for efficient estimation of the parameters. The tighter bounds are used to investigate a slightly conservative approach which eliminates lengthy estimation procedures altoget-her, her, with great computational savings.     

Relative efficiency of first difference estimator in panel data regression with serially correlated error components

We consider the pooled cross-sectional and time series regression model when the disturbances follow a serially correlated one-way error components. In this context we discovered that the first difference estimator for the regression coefficients is equivalent to the generalized least squares estimator irrespective of the particular form of the regressor matrix when the disturbances are generated by a first order autoregressive process where the autocorrelation is close to unity.