COMPARING TESTS OF AUTOREGRESSIVE VERSUS MOVING AVERAGE ERRORS IN REGRESSION MODELS USING BAHADUR’S ASYMPTOTIC RELATIVE EFFICIENCY

ABSTRACT

The purpose of this paper is to use Bahadur's asymptotic relative efficiency measure to compare the performance of various tests of autoregressive (AR) versus moving average (MA) error processes in regression models. Tests to be examined include non-nested procedures of the models against each other, and classical procedures based upon testing both the AR and MA error processes against the more general autoregressive-moving average model.     

Alternative approaches to testing non-nested models with autocorrelated disturbances

Since departures from the classical assumptions regarding the disturbances in a linear tegression model arise frequently in empirical application, deveral computationally Straightforward procedutes are presented in this paper for testiog non-nested models when the disturbances of these models follow first- or higher-order autoregressive processes. Anempirical example is used to illustrate how the procedures may be used to test competing Keynesian and New Classical non-nested models of unemployment for the U.S using annual time series data for 1955-85.     

Inference after separated hypotheses testing: an empirical investigation for linear models

Model selection problems arise while constructing unbiased or asymptotically unbiased estimators of measures known as discrepancies to find the best model. Most of the usual criteria are based on goodness-of-fit and parsimony. They aim to maximize a transformed version of likelihood. For linear regression models with normally distributed error, the situation is less clear when two models are equivalent: are they close to or far from the unknown true model? In this work, based on stochastic simulation and parametric simulation, we study the results of Vuong's test, Cox's test, Akaike's information criterion, Bayesian information criterion, Kullback information criterion and bias corrected Kullback information criterion and the ability of these tests to discriminate between non-nested linear models.     

Joint tests of non-nested models and general error specifications

This paper is concerned with joint tests of non-nested models and simultaneous departures from homoskedasticity, serial independence and normality of the disturbance terms. Locally equivalent alternative models are used to construct joint tests since they provide a convenient way to incorporate more than one type of departure from the classical conditions. The joint tests represent a simple asymptotic solution to the “pre-testing” problem in the context of non-nested linear regression models. Our simulation results indicate that the proposed tests have good finite sample properties.     

A robust test for non-nested hypotheses

This paper uses a modified rank score test for non-nested linear regression models. The modified rank score test is robust with respect to models with non-normal distributions and can be viewed as a robust version of the J test of Davidson and MacKinnon (Econometrica 49:781–793, 1981). Therefore, this test does not require a specification of error density function and is easy to implement. Also, a modified rank score test for multiple non-nested models is provided. Monte Carlo simulation results show that the test has good finite sample performances. Financial applications for two competing theories, the capital asset pricing model and the arbitrage pricing theory, are considered herein. Empirical evidence from the modified rank score test shows that the former is a better model for asset pricing.     

Model specification tests against non-nested alternatives

Non-nested hypothesis tests provide a way to test the specification of an econometric model against the evidence provided by one or more non-nested alternatives. This paper surveys the recent literature on non-nested hypothesis testing in the context of regression and related models. Much of the purely statistical 1iterature which has evolved from the fundamental work of Cox (1961, 1962) is discussed briefly or not at all. Instead, emphasis is placed on those techniques which are easy to employ in practice and are likely to be useful to applied workers.     

Model specification tests against non-nested alternatives

Non-nested hypothesis tests provide a way to test the specification of an econometric model against the evidence provided by one or more non-nested alternatives. This paper surveys the recent literature on non-nested hypothesis testing in the context of regression and related models. Much of the purely statistical 1iterature which has evolved from the fundamental work of Cox (1961, 1962) is discussed briefly or not at all. Instead, emphasis is placed on those techniques which are easy to employ in practice and are likely to be useful to applied workers.     

C472. The expected value of a conditional variance: An upper bound

The article derives Bartlett corrections for improving the chi-square approximation to the likelihood ratio statistics in a class of symmetric nonlinear regression models. This is a wide class of models which encompasses the t model and several other symmetric distributions with longer-than normal tails. In this paper we present, in matrix notation, Bartlett corrections to likelihood ratio statistics in nonlinear regression models with errors that follow a symmetric distribution. We generalize the results obtained by Ferrari, S. L. P. and Arellano-Valle, R. B. (1996). Modified likelihood ratio and score tests in linear regression models using the t distribution. Braz. J. Prob. Statist., 10, 15–33, who considered a t distribution for the errors, and by Ferrari, S. L. P. and Uribe-Opazo, M. A. (2001). Corrected likelihood ratio tests in a class of symmetric linear regression models. Braz. J. Prob. Statist., 15, 49–67, who considered a symmetric linear regression model. The formulae derived are simple enough to be used analytically to obtain several Bartlett corrections in a variety of important models. We also present simulation results comparing the sizes and powers of the usual likelihood ratio tests and their Bartlett corrected versions.     

Improved Score Tests in Symmetric Linear Regression Models

The class of symmetric linear regression models has the normal linear regression model as a special case and includes several models that assume that the errors follow a symmetric distribution with longer-than-normal tails. An important member of this class is the t linear regression model, which is commonly used as an alternative to the usual normal regression model when the data contain extreme or outlying observations. In this article, we develop second-order asymptotic theory for score tests in this class of models. We obtain Bartlett-corrected score statistics for testing hypotheses on the regression and the dispersion parameters. The corrected statistics have chi-squared distributions with errors of order O(n ^?3/2), n being the sample size. The corrections represent an improvement over the corresponding original Rao's score statistics, which are chi-squared distributed up to errors of order O(n ^?1). Simulation results show that the corrected score tests perform much better than their uncorrected counterparts in samples of small or moderate size.     

Some pitfalls of tests of separate families of hypotheses: normality vs. lognormality

It is often desirable to test non-nested hypotheses. Cox (1961, 1962) proposed forming a log-likelihood ratio from their maxima and then comparing this value to its expected value under the null hypothesis. Pitfalls exists when we apply Cox's test to the special case of testing normality versus lognormality. Pesaran (1981) and Kotz (1973) pointed out the slow convergence rate of the Cox's test. In this paper, this fact has been reemphasized; moreover, we propose an alternative likelihood ratio test which remedies problems arising from negative estimates of the asymptotic variance of Cox's test statistic and is uniformly more powerful than most commonly used tests.     

A Test for Slope Heterogeneity in Fixed Effects Models

Typical panel data models make use of the assumption that the regression parameters are the same for each individual cross-sectional unit. We propose tests for slope heterogeneity in panel data models. Our tests are based on the conditional Gaussian likelihood function in order to avoid the incidental parameters problem induced by the inclusion of individual fixed effects for each cross-sectional unit. We derive the Conditional Lagrange Multiplier test that is valid in cases where N → ∞ and T is fixed. The test applies to both balanced and unbalanced panels. We expand the test to account for general heteroskedasticity where each cross-sectional unit has its own form of heteroskedasticity. The modification is possible if T is large enough to estimate regression coefficients for each cross-sectional unit by using the MINQUE unbiased estimator for regression variances under heteroskedasticity. All versions of the test have a standard Normal distribution under general assumptions on the error distribution as N → ∞. A Monte Carlo experiment shows that the test has very good size properties under all specifications considered, including heteroskedastic errors. In addition, power of our test is very good relative to existing tests, particularly when T is not large.     

Hierarchical Variable Selection in Polynomial Regression Models

Significance tests on coefficients of lower-order terms in polynomial regression models are affected by linear transformations. For this reason, a polynomial regression model that excludes hierarchically inferior predictors (i.e., lower-order terms) is considered to be not well formulated. Existing variable-selection algorithms do not take into account the hierarchy of predictors and often select as “best” a model that is not hierarchically well formulated. This article proposes a theory of the hierarchical ordering of the predictors of an arbitrary polynomial regression model in m variables, where m is any arbitrary positive integer. Ways of modifying existing algorithms to restrict their search to well-formulated models are suggested. An algorithm that generates all possible well-formulated models is presented.     

Hypothesis testing in smoothing spline models

Nonparametric regression models are often used to check or suggest a parametric model. Several methods have been proposed to test the hypothesis of a parametric regression function against an alternative smoothing spline model. Some tests such as the locally most powerful (LMP) test by Cox et al. (Cox, D., Koh, E., Wahba, G. and Yandell, B. (1988). Testing the (parametric) null model hypothesis in (semiparametric) partial and generalized spline models. Ann. Stat., 16, 113–119.), the generalized maximum likelihood (GML) ratio test and the generalized cross validation (GCV) test by Wahba (Wahba, G. (1990). Spline models for observational data. CBMS-NSF Regional Conference Series in Applied Mathematics, SIAM.) were developed from the corresponding Bayesian models. Their frequentist properties have not been studied. We conduct simulations to evaluate and compare finite sample performances. Simulation results show that the performances of these tests depend on the shape of the true function. The LMP and GML tests are more powerful for low frequency functions while the GCV test is more powerful for high frequency functions. For all test statistics, distributions under the null hypothesis are complicated. Computationally intensive Monte Carlo methods can be used to calculate null distributions. We also propose approximations to these null distributions and evaluate their performances by simulations.     

Tests of heteroscedasticity and correlation in multivariate t regression models with AR and ARMA errors

Heteroscedasticity checking in regression analysis plays an important role in modelling. It is of great interest when random errors are correlated, including autocorrelated and partial autocorrelated errors. In this paper, we consider multivariate t linear regression models, and construct the score test for the case of AR(1) errors, and ARMA(s,d) errors. The asymptotic properties, including asymptotic chi-square and approximate powers under local alternatives of the score tests, are studied. Based on modified profile likelihood, the adjusted score test is also developed. The finite sample performance of the tests is investigated through Monte Carlo simulations, and also the tests are illustrated with two real data sets.     

Change-Point Detection in Two-Phase Regression with Inequality Constraints on the Regression Parameters

Two-phase regression models with inequality constraints on the regression coefficients and with a small number of measurements is considered. A new test based on the likelihood ratio in linear model with inequality constraints for the presence of a change-point is proposed. Numerical approximations to the powers against various alternatives are given and compared with the powers of the likelihood ratio test in the two-phase regression models without inequality constraints, the backwards CUSUM test, and the k-linear-r-ahead recursive residuals tests. Performance of related likelihood based estimators of the change-point is briefly studied in a Monte Carlo experiment.     

Comparisons of some bivariate regression models

The bivariate negative binomial regression (BNBR) and the bivariate Poisson log-normal regression (BPLR) models have been used to describe count data that are over-dispersed. In this paper, a new bivariate generalized Poisson regression (BGPR) model is defined. An advantage of the new regression model over the BNBR and BPLR models is that the BGPR can be used to model bivariate count data with either over-dispersion or under-dispersion. In this paper, we carry out a simulation study to compare the three regression models when the true data-generating process exhibits over-dispersion. In the simulation experiment, we observe that the bivariate generalized Poisson regression model performs better than the bivariate negative binomial regression model and the BPLR model.     

Model selection using union-intersection principle for non nested models

In this article, we have extended the Vuong’s (1989 Vuong, Q.H. (1989). Likelihood ratio tests for model selection and non-nested hypothesis. Econometrica. 57:307–333.[Crossref], [Web of Science ®] , [Google Scholar]) model selection test to three models in accordance to union-intersection principle. Using the Kullback–Leibler criterion to measure the closeness of a model to the truth, we propose a simple likelihood ratio-based statistics for testing the null hypothesis that the competing models are equally close to the true data-generating process against the alternative hypothesis that at least one model is closer. We show that the distribution of the test statistic is asymptotically equal to the distribution of the maximum of dependent random variables with bivariate folded standard normal distribution. The density function of the maximum of dependent random variables with elliptically contoured distributions has been obtained by other researchers, but, not for distributions which do not belong to the elliptically contoured distributions family. In this article, the exact distribution of the maximum of dependent random variables with bivariate folded standard normal distribution is calculated as an asymptotic distribution of the proposed test statistic. The test is directional and is derived successively for the cases where the competing models are non nested and whether three, two, one, or none of them are misspecified.     

Tests of regression coefficients under ridge regression models

This paper investigates two “non-exact” t-type tests, t( k₂) and t(k₂), of the individual coefficients of a linear regression model, based on two ordinary ridge estimators. The reported results are built on a simulation study covering 84 different models. For models with large standard errors, the ridge-based t-tests have correct levels with considerable gain in powers over those of the least squares t-test, t(0). For models with small standard errors, t(k₁) is found to be liberal and is not safe to use while, t(k₂) is found to slightly exceed the nominal level in few cases. When tie two ridge tests art: not winners, the results indicate that they don't loose much against t(0).     

Model-free predictor tests in survival regression through sufficient dimension reduction

In this article, we test the effects of predictors in survival regression through two well-known sufficient dimension reduction methods. Since the usual sufficient dimension reduction methods do not require pre-specified models, the predictor effect tests can be considered model-free. All of the test statistics have χ ² distributions. Numerical studies of the proposed predictor effect tests in various simulations and real data application are presented.