Adaptive estimation of vector autoregressive models with time-varying variance: Application to testing linear causality in mean

Linear vector autoregressive (VAR) models where the innovations could be unconditionally heteroscedastic are considered. The volatility structure is deterministic and quite general, including breaks or trending variances as special cases. In this framework we propose ordinary least squares (OLS), generalized least squares (GLS) and adaptive least squares (ALS) procedures. The GLS estimator requires the knowledge of the time-varying variance structure while in the ALS approach the unknown variance is estimated by kernel smoothing with the outer product of the OLS residual vectors. Different bandwidths for the different cells of the time-varying variance matrix are also allowed. We derive the asymptotic distribution of the proposed estimators for the VAR model coefficients and compare their properties. In particular we show that the ALS estimator is asymptotically equivalent to the infeasible GLS estimator. This asymptotic equivalence is obtained uniformly with respect to the bandwidth(s) in a given range and hence justifies data-driven bandwidth rules. Using these results we build Wald tests for the linear Granger causality in mean which are adapted to VAR processes driven by errors with a nonstationary volatility. It is also shown that the commonly used standard Wald test for the linear Granger causality in mean is potentially unreliable in our framework (incorrect level and lower asymptotic power). Monte Carlo experiments illustrate the use of the different estimation approaches for the analysis of VAR models with time-varying variance innovations.     

A simple investigation of the Granger-causality test in integrated-cointegrated VAR systems

The size and power of various generalization tests for the Granger-causality in integrated-cointegrated VAR systems are considered. By using Monte Carlo methods, properties of eight versions of the test are studied in two different forms, the standard form and the modified form by Dolado & Lütkepohl (1996) in a study confined to properties of the Wald test only. In their study as well as in ours, both the standard and the modified Wald tests are shown to perform badly especially in small samples. We find, however, that the corrected LR tests exhibit correct size even in small samples. The power of the test is higher when the true VAR(2) model is estimated, and the modified test loses information by estimating the extra coefficients. The same is true when considering the power results in the VAR(3) model, and the power of the tests is somewhat lower than those in the VAR(2).     

Testing for nonzero impulse responses in vector autoregressive processes

Impulse response functions are often used to investigate the relationships between the components of a VAR (vector autoregressive) process. A hypothesis of particular interest is that a variable does not react to impulses in another variable, i.e., the impulse responses are zero. Two types of tests for such hypotheses are considered. The first type is based on finite-order VAR assumptions and the second allows for possibly infinite-order processes. It is found that both types of tests have to be used cautiously because small sample and asymptotic properties may differ substantially.     

Likelihood Ratio Tests for Fixed Model Terms using Residual Maximum Likelihood

Likelihood ratio tests for fixed model terms are proposed for the analysis of linear mixed models when using residual maximum likelihood estimation. Bartlett-type adjustments, using an approximate decomposition of the data, are developed for the test statistics. A simulation study is used to compare properties of the test statistics proposed, with or without adjustment, with a Wald test. A proposed test statistic constructed by dropping fixed terms from the full fixed model is shown to give a better approximation to the asymptotic χ²-distribution than the Wald test for small data sets. Bartlett adjustment is shown to improve the χ²-approximation for the proposed tests substantially.     

Simultaneous estimation and inference for multiple response variables

Multivariate data arise frequently in biomedical and health studies where multiple response variables are collected across subjects. Unlike a univariate procedure fitting each response separately, a multivariate regression model provides a unique opportunity in studying the joint evolution of various response variables. In this paper, we propose two estimation procedures that improve estimation efficiency for the regression parameter by accommodating correlations among the response variables. The proposed procedures do not require knowledge of the true correlation structure nor does it estimate the parameters associated with the correlation. Theoretical and simulation results confirm that the proposed estimators are more efficient than the one obtained from the univariate approach. We further propose simple and powerful inference procedures for a goodness-of-fit test that possess the chi-squared asymptotic properties. Extensive simulation studies suggest that the proposed tests are more powerful than the Wald test based on the univariate procedure. The proposed methods are also illustrated through the mother’s stress and children’s morbidity study.     

Hypothesis Testing of Hazard Ratio Parameters in Marginal Models for Multivariate Failure Time Data

Marginal hazard models for multivariate failure time data have been studied extensively in recent literature. However, standard hypothesis test statistics based on the likelihood method are not exactly appropriate for this kind of model. In this paper, extensions of the three commonly used likelihood hypothesis test statistics are discussed. Generalized Wald, generalized score and generalized likelihood ratio tests for hazard ratio parameters in a marginal hazard model for multivariate failure time data are proposed and their asymptotic distributions examined. The finite sample properties of these statistics are studied through simulations. The proposed method is applied to data from Busselton Population Health Surveys.     

Testing for multivariate heteroscedasticity

In this article, we propose a testing technique for multivariate heteroscedasticity, which is expressed as a test of linear restrictions in a multivariate regression model. Four test statistics with known asymptotical null distributions are suggested, namely the Wald, Lagrange multiplier (LM), likelihood ratio (LR) and the multivariate Rao F-test. The critical values for the statistics are determined by their asymptotic null distributions, but bootstrapped critical values are also used. The size, power and robustness of the tests are examined in a Monte Carlo experiment. Our main finding is that all the tests limit their nominal sizes asymptotically, but some of them have superior small sample properties. These are the F, LM and bootstrapped versions of Wald and LR tests.     

Small-Sample Properties of GMM-Based Wald Tests

This article assesses the small-sample properties of generalized-method-of-moments-based Wald statistics by using (a) a vector white-noise process and (b) an equilibrium business-cycle model as the data-generating mechanisms. In many cases, the small-sample size of the Wald tests exceeds its asymptotic size and increases sharply with the number of hypotheses being jointly tested. We argue that this is mostly due to difficulty in estimating the spectral-density matrix of the residuals. Estimators of this matrix that impose restrictions implied by the model or the null hypothesis substantially improve the properties of the Wald statistics.     

Statistic inference for a single-index ARCH-M model

For a single-index autoregressive conditional heteroscedastic (ARCH-M) model, estimators of the parametric and non parametric components are proposed by the profile likelihood method. The research results had shown that all the estimators have consistency and the parametric estimators have asymptotic normality. We extend this line of research by deriving the asymptotic normality of the non parametric estimator. Based on the asymptotic properties, we propose Wald statistic and generalized likelihood ratio statistic to investigate the testing problems for ARCH effect and goodness of fit, respectively. A simulation study is conducted to evaluate the finite-sample performance of the proposed estimation methodology and testing procedure.     

On power and sample size calculations for Wald tests in generalized linear models

A Wald test-based approach for power and sample size calculations has been presented recently for logistic and Poisson regression models using the asymptotic normal distribution of the maximum likelihood estimator, which is applicable to tests of a single parameter. Unlike the previous procedures involving the use of score and likelihood ratio statistics, there is no simple and direct extension of this approach for tests of more than a single parameter. In this article, we present a method for computing sample size and statistical power employing the discrepancy between the noncentral and central chi-square approximations to the distribution of the Wald statistic with unrestricted and restricted parameter estimates, respectively. The distinguishing features of the proposed approach are the accommodation of tests about multiple parameters, the flexibility of covariate configurations and the generality of overall response levels within the framework of generalized linear models. The general procedure is illustrated with some special situations that have motivated this research. Monte Carlo simulation studies are conducted to assess and compare its accuracy with existing approaches under several model specifications and covariate distributions.     

Asymptotic relative efficiency of wald tests in measurement error models

In this paper, asymptotic relative efficiency (ARE) of Wald tests for the Tweedie class of models with log-linear mean, is considered when the aux¬iliary variable is measured with error. Wald test statistics based on the naive maximum likelihood estimator and on a consistent estimator which is obtained by using Nakarnura's (1990) corrected score function approach are defined. As shown analytically, the Wald statistics based on the naive and corrected score function estimators are asymptotically equivalents in terms of ARE. On the other hand, the asymptotic relative efficiency of the naive and corrected Wald statistic with respect to the Wald statistic based on the true covariate equals to the square of the correlation between the unobserved and the observed co-variate. A small scale numerical Monte Carlo study and an example illustrate the small sample size situation.     

Statistical estimation and comparison of group-specific bivariate correlation coefficients in family-type clustered studies

Bivariate correlation coefficients (BCCs) are often calculated to gauge the relationship between two variables in medical research. In a family-type clustered design where multiple participants from same units/families are enrolled, BCCs can be defined and estimated at various hierarchical levels (subject level, family level and marginal BCC). Heterogeneity usually exists between subject groups and, as a result, subject level BCCs may differ between subject groups. In the framework of bivariate linear mixed effects modeling, we define and estimate BCCs at various hierarchical levels in a family-type clustered design, accommodating subject group heterogeneity. Simplified and modified asymptotic confidence intervals are constructed to the BCC differences and Wald type tests are conducted. A real-world family-type clustered study of Alzheimer disease (AD) is analyzed to estimate and compare BCCs among well-established AD biomarkers between mutation carriers and non-carriers in autosomal dominant AD asymptomatic individuals. Extensive simulation studies are conducted across a wide range of scenarios to evaluate the performance of the proposed estimators and the type-I error rate and power of the proposed statistical tests.Abbreviations: BCC: bivariate correlation coefficient; BLM: bivariate linear mixed effects model; CI: confidence interval; AD: Alzheimer’s disease; DIAN: The Dominantly Inherited Alzheimer Network; SA: simple asymptotic; MA: modified asymptoticKEYWORDS: Bivariate correlation coefficient, bivariate linear mixed effects model, parameter estimation, confidence interval, hypothesis testing, type-I error/size and power     

Likelihood-Based Inference for Weak Exogeneity in I(2) Cointegrated VAR Models

This article develops limit theory for likelihood analysis of weak exogeneity in I(2) cointegrated vector autoregressive (VAR) models incorporating deterministic terms. Conditions for weak exogeneity in I(2) VAR models are reviewed, and the asymptotic properties of conditional maximum likelihood estimators and a likelihood-based weak exogeneity test are then investigated. It is demonstrated that weak exogeneity in I(2) VAR models allows us to conduct asymptotic conditional inference based on mixed Gaussian distributions. It is then proved that a log-likelihood ratio test statistic for weak exogeneity in I(2) VAR models is asymptotically χ² distributed. The article also presents an empirical illustration of the proposed test for weak exogeneity using Japan's macroeconomic data.     

Nonparametric Tests for Comparing Several Coefficients of Variation

We consider the problem of comparing (k + 1) coefficients of variation. We are interested in testing the null hypothesis that the coefficients of variation are equal against each of the alternatives: (a) some populations have different coefficients of variation and (b) the coefficients of variation are ordered. Three nonparametric test statistics are proposed and their asymptotic theory is developed. We compared the proposed tests together with another parametric test using two Monte Carlo studies to estimate their probabilities of Type I error and powers. An illustration of the proposed tests using a real data set is given.     

The effect of spillover on the Granger causality test

In this paper, we investigate the properties of the Granger causality test in stationary and stable vector autoregressive models under the presence of spillover effects, that is, causality in variance. The Wald test and the WW test (the Wald test with White's proposed heteroskedasticity-consistent covariance matrix estimator imposed) are analyzed. The investigation is undertaken by using Monte Carlo simulation in which two different sample sizes and six different kinds of data-generating processes are used. The results show that the Wald test over-rejects the null hypothesis both with and without the spillover effect, and that the over-rejection in the latter case is more severe in larger samples. The size properties of the WW test are satisfactory when there is spillover between the variables. Only when there is feedback in the variance is the size of the WW test slightly affected. The Wald test is shown to have higher power than the WW test when the errors follow a GARCH(1,1) process without a spillover effect. When there is a spillover, the power of both tests deteriorates, which implies that the spillover has a negative effect on the causality tests.     

A monte carlo study of the wald,lm, and lr tests in a heteroscedastic linear model

In this paper, we examine by Monte Carlo experiments the small sample properties of the W (Wald), LM (Lagrange Multiplier) and LR (Likelihood Ratio) tests for equality between sets of coefficients in two linear regressions under heteroscedasticity. The small sample properties of the size-corrected W, LM and LR tests proposed by Rothenberg (1984) are also examined and it is shown that the performances of the size-corrected W and LM tests are very good. Further, we examine the two-stage test which consists of a test for homoscedasticity followed by the Chow (1960) test if homoscedasticity is indicated or one of the W, LM or LR tests if heteroscedasticity should be assumed. It is shown that the pretest does not reduce much the bias in the size when the sizecorrected citical values are used in the W, LM and LR tests.     

Permutation Tests for Linear Models

Several approximate permutation tests have been proposed for tests of partial regression coefficients in a linear model based on sample partial correlations. This paper begins with an explanation and notation for an exact test. It then compares the distributions of the test statistics under the various permutation methods proposed, and shows that the partial correlations under permutation are asymptotically jointly normal with means 0 and variances 1. The method of Freedman & Lane (1983) is found to have asymptotic correlation 1 with the exact test, and the other methods are found to have smaller correlations with this test. Under local alternatives the critical values of all the approximate permutation tests converge to the same constant, so they all have the same asymptotic power. Simulations demonstrate these theoretical results.     

ROBUST ESTIMATION FOR A SIMPLE EXPONENTIAL MODEL1

A Hodges-Lehmann type estimator (Hodges and Lehmann, 1963) is proposed for the parameter p in the simple exponential model (1) y=1-exp.(-ρx)+ε Some exact and asymptotic properties of the proposed estimator are also given.     

Testing the Null Hypothesis of Nonstationary Long Memory Against the Alternative Hypothesis of a Nonlinear Ergodic Model

Interest in the interface of nonstationarity and nonlinearity has been increasing in the econometric literature. This paper provides a formal method of testing for nonstationary long memory against the alternative of a particular form of nonlinear ergodic processes; namely, exponential smooth transition autoregressive processes. In this regard, the current paper provides a significant generalization to existing unit root tests by allowing the null hypothesis to encompass a much larger class of nonstationary processes. The asymptotic theory associated with the proposed Wald statistic is derived, and Monte Carlo simulation results confirm that the Wald statistics have reasonably correct size and good power in small samples. In an application to real interest rates and the Yen real exchange rates, we find that the tests are able to distinguish between these competing processes in most cases, supporting the long-run Purchasing Power Parity (PPP) and Fisher hypotheses. But, there are a few cases in which long memory and nonlinear ergodic processes display similar characteristics and are thus confused with each other in small samples.     

A REVIEW OF SYSTEMS COINTEGRATION TESTS

The literature on systems cointegration tests is reviewed and the various sets of assumptions for the asymptotic validity of the tests are compared within a general unifying framework. The comparison includes likelihood ratio tests, Lagrange multiplier and Wald type tests, lag augmentation tests, tests based on canonical correlations, the Stock-Watson tests and Bierens' nonparametric tests. Asymptotic results regarding the power of these tests and previous small sample simulation studies are discussed. Further issues and proposals in the context of systems cointegration tests are also considered briefly. New simulations are presented to compare the tests under uniform conditions. Special emphasis is given to the sensitivity of the test performance with respect to the trending properties of the DGP.