Nonlinear regression models with general distortion measurement errors

This paper considers nonlinear regression models when neither the response variable nor the covariates can be directly observed, but are measured with both multiplicative and additive distortion measurement errors. We propose conditional variance and conditional mean calibration estimation methods for the unobserved variables, then a nonlinear least squares estimator is proposed. For the hypothesis testing of parameter, a restricted estimator under the null hypothesis and a test statistic are proposed. The asymptotic properties for the estimator and test statistic are established. Lastly, a residual-based empirical process test statistic marked by proper functions of the regressors is proposed for the model checking problem. We further suggest a bootstrap procedure to calculate critical values. Simulation studies demonstrate the performance of the proposed procedure and a real example is analysed to illustrate its practical usage.     

The frisch-waugh theorem and generalized least squares

We discuss the standard linear regression model with nonspherical disturbances, where some regressors are annihilated by considering only the residuals from an auxiliary regression, and where, analogous to the Frisch-Waugh procedure, the original GLS procedure is applied to the transformed data. We call this procedure pseudo-GLS and give conditions for pseudo-GL5 to be equal to genuine GLS. We also show via examples that these conditions are often violated in empirical applications, and that the Frisch-Waugh Theorem still “works” with nonspherical disturbances if efficient estimation is applied to both the original and the transformed data.     

The frisch-waugh theorem and generalized least squares

We discuss the standard linear regression model with nonspherical disturbances, where some regressors are annihilated by considering only the residuals from an auxiliary regression, and where, analogous to the Frisch-Waugh procedure, the original GLS procedure is applied to the transformed data. We call this procedure pseudo-GLS and give conditions for pseudo-GL5 to be equal to genuine GLS. We also show via examples that these conditions are often violated in empirical applications, and that the Frisch-Waugh Theorem still “works” with nonspherical disturbances if efficient estimation is applied to both the original and the transformed data.     

Selection of regressors in econometrics: parametric and nonparametric methods selection of regressors in econometrics

The present paper addresses the selection-of-regressors issue into a general discrimination framework. We show how this framework is useful in unifying various procedures for selecting regressors and helpful in understanding the different strategies underlying these procedures. We review selection of regressors in linear, nonlinear and nonparametric regression models. In each case we successively consider model selection criteria and hypothesis testing procedures.     

Selection of regressors in econometrics: parametric and nonparametric methods selection of regressors in econometrics

The present paper addresses the selection-of-regressors issue into a general discrimination framework. We show how this framework is useful in unifying various procedures for selecting regressors and helpful in understanding the different strategies underlying these procedures. We review selection of regressors in linear, nonlinear and nonparametric regression models. In each case we successively consider model selection criteria and hypothesis testing procedures.     

Bias From Censored Regressors

We study the bias that arises from using censored regressors in estimation of linear models. We present results on bias in ordinary least aquares (OLS) regression estimators with exogenous censoring and in instrumental variable (IV) estimators when the censored regressor is endogenous. Bound censoring such as top-coding results in expansion bias, or effects that are too large. Independent censoring results in bias that varies with the estimation method—attenuation bias in OLS estimators and expansion bias in IV estimators. Severe biases can result when there are several regressors and when a 0–1 variable is used in place of a continuous regressor.     

Testing inference in variable dispersion beta regressions

The class of beta regression models proposed by Ferrari and Cribari-Neto [Beta regression for modelling rates and proportions, Journal of Applied Statistics 31 (2004), pp. 799–815] is useful for modelling data that assume values in the standard unit interval (0, 1). The dependent variable relates to a linear predictor that includes regressors and unknown parameters through a link function. The model is also indexed by a precision parameter, which is typically taken to be constant for all observations. Some authors have used, however, variable dispersion beta regression models, i.e., models that include a regression submodel for the precision parameter. In this paper, we show how to perform testing inference on the parameters that index the mean submodel without having to model the data precision. This strategy is useful as it is typically harder to model dispersion effects than mean effects. The proposed inference procedure is accurate even under variable dispersion. We present the results of extensive Monte Carlo simulations where our testing strategy is contrasted to that in which the practitioner models the underlying dispersion and then performs testing inference. An empirical application that uses real (not simulated) data is also presented and discussed.     

Two‐Sample Bootstrap Hypothesis Tests for Three‐Dimensional Labelled Landmark Data

Abstract. We investigate resampling methodologies for testing the null hypothesis that two samples of labelled landmark data in three dimensions come from populations with a common mean reflection shape or mean reflection size‐and‐shape. The investigation includes comparisons between (i) two different test statistics that are functions of the projection onto tangent space of the data, namely the James statistic and an empirical likelihood statistic; (ii) bootstrap and permutation procedures; and (iii) three methods for resampling under the null hypothesis, namely translating in tangent space, resampling using weights determined by empirical likelihood and using a novel method to transform the original sample entirely within refection shape space. We present results of extensive numerical simulations, on which basis we recommend a bootstrap test procedure that we expect will work well in practise. We demonstrate the procedure using a data set of human faces, to test whether humans in different age groups have a common mean face shape.     

Asymptotic Properties of OLS Estimates in Autoregressions with Bounded or Slowly Growing Deterministic Trends

ABSTRACT

We propose a general method of modeling deterministic trends for autoregressions. The method relies on the notion of L ₂-approximable regressors previously developed by the author. Some facts from the theory of functions play an important role in the proof. In its present form, the method encompasses slowly growing regressors, such as logarithmic trends, and leaves open the case of polynomial trends.     

The exact power function of an exact test of a regression model against multiple separate alternatives

A common procedure for testing a regression model against separate alternatives is to check the statistical significance of predictions from the latter appended as artificial regressors in the model under test. This paper derives the previously-unknown exact small-sample power function of such a procedure. It is then demonstrated that the procedure is biased in small samples.     

Finite sample power of Cliff–Ord-type tests for spatial disturbance correlation in linear regression

The paper considers tests against autocorrelation among the disturbances in linear regression models that can be expressed as ratios of quadratic forms. It shows that such tests are, in general, not unbiased and that power can even drop to zero for certain regressors and spatial weight matrices. Whether or not this can happen is however easily diagnosed for given regressors and for given spatial weights.     

Modified first-difference estimator in a panel data model with unobservable factors both in the errors and the regressors when the time dimension is small

Panel data models with factor structures in both the errors and the regressors have received considerable attention recently. In these models, the errors and the regressors are correlated and the standard estimators are inconsistent. This paper shows that, for such models, a modified first-difference estimator (in which the time and the cross-sectional dimensions are interchanged) is consistent as the cross-sectional dimension grows but the time dimension is small. Although the estimator has a non standard asymptotic distribution, t and F tests have standard asymptotic distribution under the null hypothesis.     

Semiparametric non-linear time series model selection

Summary.  Semiparametric time series regression is often used without checking its suitability, resulting in an unnecessarily complicated model. In practice, one may encounter computational difficulties caused by the curse of dimensionality. The paper suggests that to provide more precise predictions we need to choose the most significant regressors for both the parametric and the nonparametric time series components. We develop a novel cross-validation-based model selection procedure for the simultaneous choice of both the parametric and the nonparametric time series components, and we establish some asymptotic properties of the model selection procedure proposed. In addition, we demonstrate how to implement it by using both simulated and real examples. Our empirical studies show that the procedure works well.     

Two sample inference in functional linear models

We propose a method of comparing two functional linear models in which explanatory variables are functions (curves) and responses can be either scalars or functions. In such models, the role of parameter vectors (or matrices) is played by integral operators acting on a function space. We test the null hypothesis that these operators are the same in two independent samples. The complexity of the test statistics increases as we move from scalar to functional responses and relax assumptions on the covariance structure of the regressors. They all, however, have an asymptotic chi‐squared distribution with the number of degrees of freedom which depends on a specific setting. The test statistics are readily computable using the R package fda , and have good finite sample properties. The test is applied to egg‐laying curves of Mediterranean flies and to data from terrestrial magnetic observatories. The Canadian Journal of Statistics © 2009 Statistical Society of Canada     

Assessing Lund's critical values for testing for outliers in linear regression models

This note assesses Lund's critical bounds as approximations to the critical values of a size-a test for detecting single outlier in a multiple linear regression model. A Monte Carlo experiment shows that the empirical sizes are very close to the nominal sizes, and the regressors have little effect on the empirical sizes. Lund's tables are revised to higher accuracy.     

Confidence Sets for Cointegrating Coefficients Based on Stationarity Tests

Standard methods for inference in cointegrating systems require all the variables to have exact unit roots and are not at all robust even to slight violations of this condition. In this article, I consider an alternative approach to inference in a cointegrating system. This involves testing the hypothesis that a cointegrating vector takes on a specified value by testing for the stationarity of the associated residual. Confidence sets for the cointegrating vector can be constructed by exploiting the equivalence between tests and confidence sets. This method has the advantage that it remains valid even if the regressors have roots that are not exactly equal to unity.     

OLS and IV estimation of regression models including endogenous interaction terms

We analyze a class of linear regression models including interactions of endogenous regressors and exogenous covariates. We show how to generate instrumental variables using the nonlinear functional form of the structural equation when traditional excluded instruments are unknown. We propose to use these instruments with identification robust IV inference. We furthermore show that, whenever functional form identification is not valid, the ordinary least squares (OLS) estimator of the coefficient of the interaction term is consistent and standard OLS inference applies. Using our alternative empirical methods we confirm recent empirical findings on the nonlinear causal relation between financial development and economic growth.     

PMSE dominance of the positive-part shrinkage estimator in a regression model with proxy variables

Consider a linear regression model with some relevant regressors are unobservable. In such a situation, we estimate the model by using the proxy variables as regressors or by simply omitting the relevant regressors. In this paper, we derive the explicit formula of predictive mean squared error (PMSE) of a general family of shrinkage estimators of regression coefficients. It is shown analytically that the positive-part shrinkage estimator dominates the ordinary shrinkage estimator even when proxy variables are used in place of the unobserved variables. Also, as an example, our result is applied to the double k-class estimator proposed by Ullah and Ullah (Double k-class estimators of coefficients in linear regression. Econometrica. 1978;46:705–722). Our numerical results show that the positive-part double k-class estimator with proxy variables has preferable PMSE performance.     

Semiparametric Spatial Autoregressive Models With Endogenous Regressors: With an Application to Crime Data

This study considers semiparametric spatial autoregressive models that allow for endogenous regressors, as well as the heterogenous effects of these regressors across spatial units. For the model estimation, we propose a semiparametric series generalized method of moments estimator. We establish that the proposed estimator is both consistent and asymptotically normal. As an empirical illustration, we apply the proposed model and method to Tokyo crime data to estimate how the existence of a neighborhood police substation (NPS) affects the household burglary rate. The results indicate that the presence of an NPS helps reduce household burglaries, and that the effects of some variables are heterogenous with respect to residential distribution patterns. Furthermore, we show that using a model that does not adjust for the endogeneity of NPS does not allow us to observe the significant relationship between NPS and the household burglary rate. Supplementary materials for this article are available online.     

Eliminating the omitted variable bias by a regime-switching approach

This work shows a procedure that aims to eliminate or reduce the bias caused by omitted variables by means of the so-called regime-switching regressions. There is a bias estimation whenever the statistical (linear) model is under-specified, that is, when there are some omitted variables and they are correlated with the regressors. This work shows how an appropriate specification of a regime-switching model (independent or Markov-switching) can eliminate or reduce this correlation, hence the estimation bias. A demonstration is given, together with some Monte Carlo simulations. An empirical verification, based on Fisher's equation, is also provided.