A monte carlo comparison of tests based on the durbin-watson statistic with other autocorrelation tests in dynamic models

This paper examines the sampling properties of a number of serial correlation tests in dynamic linear models which include one or two lags of the dependent variable. Among the tests considered are the Durbin-Watson (DW) bounds test, modified versions of the DW proposed recently by King and Wu and Inder, Durbin's m test, Inder's point optimal test and a Hausman type test. Sampling designs include models with one or two lags of the dependent variable. The m, Hausman, and Inder's tests have the best performance, while Inder's modified DW test appears to be better than the other DW based tests. Results also suggest that tests are less powerful and more sensitive to design parameters in models with higher dynamics, with the DW-based tests being the most sensitive.     

The application of the durbin-watson test to the dynamic regression model under normal and non-normal errors

Until recently, a difficulty with applying the Durbin-Watson (DW) test to the dynamic linear regression model has been the lack of appropriate critical values. Inder (1986) used a modified small-disturbance distribution (SDD) to find approximate critical values. King and Wu (1991) showed that the exact SDD of the DW statistic is equivalent to the distribution of the DW statistic from the regression with the lagged dependent variables replaced by their means. Unfortunately, these means are unknown although they could be estimated by the actual variable values. This provides a justification for using the exact critical values of the DW statistic from the regression with the lagged dependent variables treated as non-stochastic regressors. Extensive Monte Carlo experiments are reported in this paper. They show that this approach leads to reasonably accurate critical values, particularly when two lags of the dependent variable are present. Robustness to non-normality is also investigated.     

The application of the durbin-watson test to the dynamic regression model under normal and non-normal errors

Until recently, a difficulty with applying the Durbin-Watson (DW) test to the dynamic linear regression model has been the lack of appropriate critical values. Inder (1986) used a modified small-disturbance distribution (SDD) to find approximate critical values. King and Wu (1991) showed that the exact SDD of the DW statistic is equivalent to the distribution of the DW statistic from the regression with the lagged dependent variables replaced by their means. Unfortunately, these means are unknown although they could be estimated by the actual variable values. This provides a justification for using the exact critical values of the DW statistic from the regression with the lagged dependent variables treated as non-stochastic regressors. Extensive Monte Carlo experiments are reported in this paper. They show that this approach leads to reasonably accurate critical values, particularly when two lags of the dependent variable are present. Robustness to non-normality is also investigated.     

基于辅助回归模型的空间Hausman检验

 基于面板数据空间误差分量模型,提出空间Hausman检验,并通过数理推导,构造辅助回归模型的空间Hausman检验,进而通过Monte Carlo模拟实验,研究空间Hausman检验,以及辅助回归空间Hausman检验的有限样本性质。研究结果表明,空间Hausman检验能有效矫正空间面板数据下经典Hausman检验的水平扭曲,但随着空间相关性和样本量增大,其水平扭曲偏离理想值;辅助回归空间Hausman检验始终保持理想的水平扭曲。此外,二者均具有优越的检验功效。     

Separated hypotheses testing for autoregressive models with non-negative residuals

Normal residual is one of the usual assumptions in autoregressive model but sometimes in practice we are faced with non-negative residuals. In this paper, we have derived modified maximum likelihood estimators of parameters of the residuals and autoregressive coefficient. Also asymptotic distribution of modified maximum likelihood estimators in both stationary and non-stationary models are computed. So that, we can derive asymptotic distribution of unit root, Vuong's and Cox's tests statistics in stationary situation. Using simulation, it shows that Akaike information criterion and Vuong's test work to select the optimal autoregressive model with non-negative residuals. Sometimes Vuong's test select two competing models as equivalent models. These models may be suitable or unsuitable equivalent models. So we consider Cox's test to make inference after model selection. Kolmogorov–Smirnov test confirms our results. Also we have computed tracking interval for competing models to choosing between two close competing models when Vuong's test and Cox's test cannot detect the differences.     

Durbin–Watson and Generalized Durbin–Watson Tests for Autocorrelations and Randomness

The Durbin–Watson (DW) test for lag 1 autocorrelation has been generalized (DWG) to test for autocorrelations at higher lags. This includes the Wallis test for lag 4 autocorrelation. These tests are also applicable to test for the important hypothesis of randomness. It is found that for small sample sizes a normal distribution or a scaled beta distribution by matching the first two moments approximates well the null distribution of the DW and DWG statistics. The approximations seem to be adequate even when the samples are from nonnormal distributions. These approximations require the first two moments of these statistics. The expressions of these moments are derived.     

A comparison of multivariate signal discrimination techniques

This paper investigates several techniques to discriminate two multivariate stationary signals. The methods considered include Gaussian likelihood ratio tests for variance equality, a chi-squared time-domain test, and a spectral-based test. The latter two tests assess equality of the multivariate autocovariance function of the two signals over many different lags. The Gaussian likelihood ratio test is perhaps best viewed as principal component analyses (PCA) without dimension reduction aspects; it can be modified to consider covariance features other than variances via dimension augmentation tactics. A simulation study is constructed that shows how one can make inappropriate conclusions with PCA tests, even when dimension augmentation techniques are used to incorporate non-zero lag autocovariances into the analysis. The various discrimination methods are first discussed. A simulation study then illuminates the various properties of the methods. In this pursuit, calculations are needed to identify several multivariate time series models with specific autocovariance properties. To demonstrate the applicability of the methods, nine US and Canadian weather stations from three distinct regions are clustered. Here, the spectral clustering perfectly identified distinct regions, the chi-squared test performed marginally, and the PCA/likelihood ratio method did not perform well.     

Modified likelihood ratio tests for unit gamma regressions

Regression analyses are commonly performed with doubly limited continuous dependent variables; for instance, when modeling the behavior of rates, proportions and income concentration indices. Several models are available in the literature for use with such variables, one of them being the unit gamma regression model. In all such models, parameter estimation is typically performed using the maximum likelihood method and testing inferences on the model''s parameters are usually based on the likelihood ratio test. Such a test can, however, deliver quite imprecise inferences when the sample size is small. In this paper, we propose two modified likelihood ratio test statistics for use with the unit gamma regressions that deliver much more accurate inferences when the number of data points in small. Numerical (i.e. simulation) evidence is presented for both fixed dispersion and varying dispersion models, and also for tests that involve nonnested models. We also present and discuss two empirical applications.     

A modified harmonic mean test procedure for variance components

A complete class of tests of variance components is characterized within the class of tests statistics of the form of a ratio of a linear combination of chi-squared random variables to an independent chi-squared random variable. This result is used in the context of general unbalanced mixed models to show that the harmonic mean method results in an inadmissible test of the random treatment effects. The harmonic mean procedure is then modified in such a way that the modified test uniformly dominates the original test. Two competitive tests are the LMP (locally most powerful) and Wald's tests, which have optimal power properties against small and large alternatives, respectively. A Monte Carlo simulation study reveals that the modified test outperforms both the LMP and Wald's tests in badly unbalanced designs and that it is a viable alternative in less unbalanced designs.     

Simple Tests for Exogeneity of a Binary Explanatory Variable in Count Data Regression Models

This article investigates power and size of some tests for exogeneity of a binary explanatory variable in count models by conducting extensive Monte Carlo simulations. The tests under consideration are Hausman contrast tests as well as univariate Wald tests, including a new test of notably easy implementation. Performance of the tests is explored under misspecification of the underlying model and under different conditions regarding the instruments. The results indicate that often the tests that are simpler to estimate outperform tests that are more demanding. This is especially the case for the new test.     

A revisit to test the equality of variances of several populations

We revisit the problem of testing homoscedasticity (or, equality of variances) of several normal populations which has applications in many statistical analyses, including design of experiments. The standard text books and widely used statistical packages propose a few popular tests including Bartlett's test, Levene's test and a few adjustments of the latter. Apparently, the popularity of these tests have been based on limited simulation study carried out a few decades ago. The traditional tests, including the classical likelihood ratio test (LRT), are asymptotic in nature, and hence do not perform well for small sample sizes. In this paper we propose a simple parametric bootstrap (PB) modification of the LRT, and compare it against the other popular tests as well as their PB versions in terms of size and power. Our comprehensive simulation study bursts some popularly held myths about the commonly used tests and sheds some new light on this important problem. Though most popular statistical software/packages suggest using Bartlette's test, Levene's test, or modified Levene's test among a few others, our extensive simulation study, carried out under both the normal model as well as several non-normal models clearly shows that a PB version of the modified Levene's test (which does not use the F-distribution cut-off point as its critical value), and Loh's exact test are the “best” performers in terms of overall size as well as power.     

Tests for Differences in Dispersion Based on Quantiles

It is commonly known that the validity of the F test for testing differences in variability is highly sensitive to the assumption that the population distributions are normal. Hence there is a need for nonparametric tests that do not rely on the assumption of normal population distributions. Several nonparametric tests for testing differences in dispersion have been developed in the past 40 years. These include Mood's test, Klotz's test, and the Siegel-Tukey test. Unfortunately, many of these tests do not have a natural or easily calculated measure of dispersion associated with them. This article introduces a test for differences in dispersion based on quantiles that is easy to compute and readily comprehended by the casual user of statistics.     

Modeling nonlinear time series with local mixtures of generalized linear models

The authors consider a novel class of nonlinear time series models based on local mixtures of regressions of exponential family models, where the covariates include functions of lags of the dependent variable. They give conditions to guarantee consistency of the maximum likelihood estimator for correctly specified models, with stationary and nonstationary predictors. They show that consistency of the maximum likelihood estimator still holds under model misspecification. They also provide probabilistic results for the proposed model when the vector of predictors contains only lags of transformations of the modeled time series. They illustrate the consistency of the maximum likelihood estimator and the probabilistic properties via Monte Carlo simulations. Finally, they present an application using real data.     

Multiple-index approach to multiple autoregressive time series model

Time series which have more than one time dependent variable require building an appropriate model in which the variables not only have relationships with each other, but also depend on previous values in time. Based on developments for a sufficient dimension reduction, we investigate a new class of multiple time series models without parametric assumptions. First, for the dependent and independent time series, we simply use a univariate time series central subspace to estimate the autoregressive lags of the series. Secondly, we extract the successive directions to estimate the time series central subspace for regressors which include past lags of dependent and independent series in a mutual information multiple-index time series. Lastly, we estimate a multiple time series model for the reduced directions. In this article, we propose a unified estimation method of minimal dimension using an Akaike information criterion, for situations in which the dimension for multiple regressors is unknown. We present an analysis using real data from the housing price index showing that our approach is an alternative for multiple time series modeling. In addition, we check the accuracy for the multiple time series central subspace method using three simulated data sets.     

RAO'S SCORE TESTS IN SURVIVAL ANALYSIS: EXAMPLES AND BARTLETT TYPE ADJUSTMENTS

Score method in hypothesis testing is one of Professor C. R. Rao's great contributions to statistics. It provides a simple and unified way to test some simple and composite hypotheses in many statistical problems. Some popular tests in statistical practice derived with the help of intuitions can be shown as score tests under some statistical models. The subject-years test and log-rank test in survival analysis are two of the examples. In this paper, we first introduce these two examples. After formulating these two tests as score tests, we then review some recent results on the Bartlett type adjustments for these tests.     

Inference after separated hypotheses testing: an empirical investigation for linear models

Model selection problems arise while constructing unbiased or asymptotically unbiased estimators of measures known as discrepancies to find the best model. Most of the usual criteria are based on goodness-of-fit and parsimony. They aim to maximize a transformed version of likelihood. For linear regression models with normally distributed error, the situation is less clear when two models are equivalent: are they close to or far from the unknown true model? In this work, based on stochastic simulation and parametric simulation, we study the results of Vuong's test, Cox's test, Akaike's information criterion, Bayesian information criterion, Kullback information criterion and bias corrected Kullback information criterion and the ability of these tests to discriminate between non-nested linear models.     

Empiricial Comparison between Some Model Selection Criteria

Model selection aims to find the best model. Most of the usual criteria are based on goodness of fit and parsimony and aim to maximize a transformed version of likelihood. The situation is less clear when two models are equivalent: are they close to the unknown true model or are they far from it? Based on simulations, we study the results of Vuong's test, Cox's test, AIC and BIC and the ability of these four tests to discriminate between models.     

Confidence intervals and tests on the variance ratio in random models with two variance components

The LM test is modified to test any value of the ratio of two variance components in a mixed effects linear model with two variance components. The test is exact, so it can be used to construct exact confidence intervals on this ratio.Exact Neyman-Pearson (NP) tests on the variance ratio are described.Their powers provide attainable upper bounds on powers of tests on the variance ratio.Efficiencies of LM tests, which include ANOVA tests, and NP tests are compared for unbalanced, random, one-way ANOVA models.Confidence intervals corresponding to LM tests and NP tests are described.     

Vector autoregression and causality: a theoretical overview and simulation study

This paper provides a theoretical overview of Wald tests for Granger causality in levels vector autoregressions (VAR's) and Johansen-type error correction models (ECM's). The theory is based on results in Toda and Phillips (1991a) and allows for stochastic and deterministic trends as well as arbitrary degrees of cointegration. We recommend some operational procedures for conducting Granger causality tests that are based on the Gaussian maximum likelihood estimation of ECM's. These procedures are applicable in the important practical case of testing the causal effects of one variable on another group of variables and vice versa. This paper also investigates the sampling properties of these testing procedures through simulation exercises. Three sequential causality tests in ECM's are compared with conventional causality tests in levels and differences VAR's.     

Optimum M-step,step-stress design with K stress variables

Most of the available literature on accelerated life testing deals with tests that use only one accelerating variable and no other explanatory variables. Frequently, however, there is a need to use more than one accelerating or other experimental variables. Examples include a test of capacitors at higher than usual levels of temperature and voltage, and a test of circuit boards at higher than usual levels of temperature, humidity, and voltage. M-step, step-stress models are extended to include k stress variables. Optimum M-step, step-stress designs with k stress variables are found. The polynomial model is considered as a special case, and a lack of fit test is discussed. Also a goodness-of-fit test is proposed and the appropriateness of using its asymptotic chi-square distribution for small samples is shown.