A monte carlo study of the wald,lm, and lr tests in a heteroscedastic linear model

In this paper, we examine by Monte Carlo experiments the small sample properties of the W (Wald), LM (Lagrange Multiplier) and LR (Likelihood Ratio) tests for equality between sets of coefficients in two linear regressions under heteroscedasticity. The small sample properties of the size-corrected W, LM and LR tests proposed by Rothenberg (1984) are also examined and it is shown that the performances of the size-corrected W and LM tests are very good. Further, we examine the two-stage test which consists of a test for homoscedasticity followed by the Chow (1960) test if homoscedasticity is indicated or one of the W, LM or LR tests if heteroscedasticity should be assumed. It is shown that the pretest does not reduce much the bias in the size when the sizecorrected citical values are used in the W, LM and LR tests.     

Preliminary test Liu-type estimators based on W,LR, and LM test statistics in a regression model

This article discusses the preliminary test approach for the regression parameter in multiple regression model. The preliminary test Liu-type estimators based on the Wald (W), Likelihood ratio (LR), and Lagrangian multiplier(LM) tests are presented, when it is supposed that the regression parameter may be restricted to a subspace. We also give the bias and mean squared error of the proposed estimators and the superior of the proposed estimators is also discussed.     

A Comparison of Analysis of Covariate-Adjusted Residuals and Analysis of Covariance

Various methods to control the influence of a covariate on a response variable are compared. These methods are ANOVA with or without homogeneity of variances (HOV) of errors and Kruskal–Wallis (K–W) tests on (covariate-adjusted) residuals and analysis of covariance (ANCOVA). Covariate-adjusted residuals are obtained from the overall regression line fit to the entire data set ignoring the treatment levels or factors. It is demonstrated that the methods on covariate-adjusted residuals are only appropriate when the regression lines are parallel and covariate means are equal for all treatments. Empirical size and power performance of the methods are compared by extensive Monte Carlo simulations. We manipulated the conditions such as assumptions of normality and HOV, sample size, and clustering of the covariates. The parametric methods on residuals and ANCOVA exhibited similar size and power when error terms have symmetric distributions with variances having the same functional form for each treatment, and covariates have uniform distributions within the same interval for each treatment. In such cases, parametric tests have higher power compared to the K–W test on residuals. When error terms have asymmetric distributions or have variances that are heterogeneous with different functional forms for each treatment, the tests are liberal with K–W test having higher power than others. The methods on covariate-adjusted residuals are severely affected by the clustering of the covariates relative to the treatment factors when covariate means are very different for treatments. For data clusters, ANCOVA method exhibits the appropriate level. However, such a clustering might suggest dependence between the covariates and the treatment factors, so makes ANCOVA less reliable as well.     

A robust test for autocorrelation in the presence of a structural break in variance

It has been known that when there is a break in the variance (unconditional heteroskedasticity) of the error term in linear regression models, a routine application of the Lagrange multiplier (LM) test for autocorrelation can cause potentially significant size distortions. We propose a new test for autocorrelation that is robust in the presence of a break in variance. The proposed test is a modified LM test based on a generalized least squares regression. Monte Carlo simulations show that the new test performs well in finite samples and it is especially comparable to other existing heteroskedasticity-robust tests in terms of size, and much better in terms of power.     

Performance of the shrinkage preliminary test ridge regression estimators based on the conflicting of W,LR and LM tests

The shrinkage preliminary test ridge regression estimators (SPTRRE) based on the Wald (W), the likelihood ratio (LR) and the Lagrangian multiplier (LM) tests are considered in this paper. The bias and the risk functions of the proposed estimators are derived. The regions of optimality of the estimators are determined under the quadratic risk function. Under the null hypothesis, the SPTRRE based on LM test has the smallest risk, followed by the estimators based on LR and W tests. However, the SPTRRE based on W test performs the best followed by the LR and LM based estimators when the parameter moves away from the subspace of the restrictions. The conditions of superiority of the proposed estimator for both ridge and departure parameters are discussed. The optimum choice of the level of significance becomes the traditional choice by using the W test for all non-negative ridge parameters.     

DOUBLE LENGTH ARTIFICIAL REGRESSIONS FOR TESTING SPATIAL DEPENDENCE

This paper derives two simple artificial Double Length Regressions (DLR) to test for spatial dependence. The first DLR tests for spatial lag dependence while the second DLR tests for spatial error dependence. Both artificial regressions utilize only least squares residuals of the restricted model and are therefore easy to compute. These tests are illustrated using two simple examples. In addition, Monte Carlo experiments are performed to study the small sample performance of these tests. As expected, these DLR tests have similar performance to their corresponding LM counterparts.     

Preliminary Test Estimators Induced by Three Large Sample Tests for Stochastic Constraints in a Regression Model with Multivariate Student-t Error

In this article, we consider the preliminary test approach to the estimation of the regression parameter in a multiple regression model with multivariate Student-t distribution. The preliminary test estimators (PTE) based on the Wald (W), Likelihood Ratio (LR), and Lagrangian Multiplier (LM) tests are given under the suspicion of stochastic constraints occurring. The bias, mean square error matr ix (MSEM), and weighted mean square error (WMSE) of the proposed estimators are derived and compared. The conditions of superiority of the proposed estimators are obtained. Finally, we conclude that the optimum choice of the level of significance becomes the traditional choice by using the W test.     

Robust Test for Spatial Error Model: Considering Changes of Spatial Layouts and Distribution Misspecification

This article suggests a robust LM (Lagrange Multiplier) test for spatial error model which not only reduces the influence of spatial lag dependence immensely, but also presents robust changes of spatial layouts and distribution misspecification. Monte Carlo simulation results imply that existing LM tests have serious size and power distortion with the presence of spatial lag dependence, group interaction or nonnormal distribution, but the robust LM test of this article shows well performance.     

More on the Preliminary Test Estimator in Almost Unbiased Liu Regression

This article is concerned with the parameter estimation in linear regression model when it is suspected that the regression coefficients are the subspace of the equality restrictions. The objective of this article is to introduce the preliminary test almost unbiased Liu estimators (PTAULE) based on the Wald (W), the likelihood ratio (LR), and the Lagrangian multiplier (LM) tests and compare the proposed estimators in the sense of the quadratic bias and mean square error (MSE) criterion.     

JACKKNIFE TESTS FOR HETEROSCEDASTICITY IN THE GENERAL LINEAR MODEL

In this paper, tests based on the Jackknife technique are proposed to test for heteroscedasticity in the linear regression model when the errors are non-normal. These are the Jackknifed Goldfeld-Quandt (GQ), and jack-knife related variations of White (H), Lagrange multiplier (LM), Glejser (GL) and Bickel (B) tests. The power of the proposed tests is compared with that of GQ, H, LM, GL and B tests; and the robustness to the error distribution is analyzed under several heteroscedastic assumptions. The GQ test is by far the best test if the error distribution is close to normal, however, GQ test is not robust against non-normal errors. By applying the jackknife technique to the regression a more robust statistic (GQJRG) is produced but the cost is a loss in power. The GQJRG statistic generally is not M powerful as the Bickel (BlOLS) and Glejser (GLlOLS) statistics.     

Tests for Serial Dependence and Other Specification Analysis in Models of Markets in Disequilibrium

The assumption of serial independence of disturbances is the starting point of most of the work done on analyzing market disequilibrium models. We derive tests for serial dependence given normality and homoscedasticity using the Lagrange multiplier (LM) test principle. Although the likelihood function under serial dependence is very complicated and involves multiple integrals of dimensions equal to the sample size, the test statistic we obtain through the LM principle is very simple. We apply the test to the housing-start data of Fair and Jaffee (1972) and study its finite sample properties through simulation. The test seems to perform quite well in finite samples in terms of size and power. We present an analysis of disequilibrium models that assumes that the disturbances are logistic rather than normal. The relative performances of these distributions are investigated by simulation.     

Testing the rate ratio under inverse sampling based on gradient statistic

Inverse sampling is widely applied in studies with dichotomous outcomes, especially when the subjects arrive sequentially or the response of interest is difficult to obtain. In this paper, we investigate the rate ratio test problem under inverse sampling based on gradient statistic with the asymptotic method and parametric bootstrap technique. The gradient statistic has many advantages, for example, it is simple to calculate and competitive with Wald-type, score and likelihood ratio tests in terms of local power. Numerical studies are carried out to evaluate the performance of our gradient test and the existing tests, namely Wald-type, score and likelihood ratio tests. The simulation results suggest that the gradient test based on the parametric bootstrap method has excellent type I error control and large powers even in small sample design. Two real examples, from a heart disease study and a drug comparison study, are applied to illustrate our methods.     

SIMPLE LM TESTS FOR THE UNBALANCED NESTED ERROR COMPONENT REGRESSION MODEL

This paper derives several Lagrange Multiplier tests for the unbalanced nested error component model. Economic data with a natural nested grouping include firms grouped by industry; or students grouped by schools. The LM tests derived include the joint test for both effects as well as the test for one effect conditional on the presence of the other. The paper also derives the standardized versions of these tests, their asymptotic locally mean most powerful version as well as their robust to local misspecification version. Monte Carlo experiments are conducted to study the performance of these LM tests.     

空间回归模型选择的反思

空间计量经济学存在两种最基本的模型:空间滞后模型和空间误差模型,这里旨在重新思考和探讨这两种空间回归模型的选择,结论为:Moran’s I指数可以用来判断回归模型后的残差是否存在空间依赖性;在实证分析中,采用拉格朗日乘子检验判断两种模型优劣是最常见的做法。然而,该检验仅仅是基于统计推断而忽略了理论基础,因此,可能导致选择错误的模型;在实证分析中,空间误差模型经常被选择性遗忘,而该模型的适用性较空间滞后模型更为广泛;实证分析大多缺乏空间回归模型设定的探讨,Anselin提出三个统计量,并且,如果模型设定正确,应该遵从Wald统计量>Log likelihood统计量>LM统计量的排列顺序。     

Testing equality of variances for several normal populations

In this study, we develop a test based on computational approach for the equality of variances of several normal populations. The proposed method is numerically compared with the existing methods. The numeric results demonstrate that the proposed method performs very well in terms of type I error rate and power of test. Furthermore we study the robustness of the tests by using simulation study when the underlying data are from t, exponential and uniform distributions. Finally we analyze a real dataset that motivated our study using the proposed test.     

A parametric bootstrap solution to the MANOVA under heteroscedasticity

In this article, we consider the problem of comparing several multivariate normal mean vectors when the covariance matrices are unknown and arbitrary positive definite matrices. We propose a parametric bootstrap (PB) approach and develop an approximation to the distribution of the PB pivotal quantity for comparing two mean vectors. This approximate test is shown to be the same as the invariant test given in [Krishnamoorthy and Yu, Modified Nel and Van der Merwe test for the multivariate Behrens–Fisher problem, Stat. Probab. Lett. 66 (2004), pp. 161–169] for the multivariate Behrens–Fisher problem. Furthermore, we compare the PB test with two existing invariant tests via Monte Carlo simulation. Our simulation studies show that the PB test controls Type I error rates very satisfactorily, whereas other tests are liberal especially when the number of means to be compared is moderate and/or sample sizes are small. The tests are illustrated using an example.     

A comparison of some conditional and unconditional exact tests for 2x2 contingency tables

In 1935, R.A. Fisher published his well-known “exact” test for 2x2 contingency tables. This test is based on the conditional distribution of a cell entry when the rows and columns marginal totals are held fixed. Tocher (1950) and Lehmann (1959) showed that Fisher s test, when supplemented by randomization, is uniformly most powerful among all the unbiased tests UMPU). However, since all the practical tests for 2x2 tables are nonrandomized - and therefore biased the UMPU test is not necessarily more powerful than other tests of the same or lower size. Inthis work, the two-sided Fisher exact test and the UMPU test are compared with six nonrandomized unconditional exact tests with respect to their power. In both the two-binomial and double dichotomy models, the UMPU test is often less powerful than some of the unconditional tests of the same (or even lower) size. Thus, the assertion that the Tocher-Lehmann modification of Fisher's conditional test is the optimal test for 2x2 tables is unjustified.     

Bayesian unit-root tests for Stochastic Volatility models

In this article, we consider Bayesian inference procedures to test for a unit root in Stochastic Volatility (SV) models. Unit-root tests for the persistence parameter of the SV models, based on the Bayes Factor (BF), have been recently introduced in the literature. In contrast, we propose a flexible class of priors that is non-informative over the entire support of the persistence parameter (including the non-stationarity region). In addition, we show that our model fitting procedure is computationally efficient (using the software WinBUGS). Finally, we show that our proposed test procedures have good frequentist properties in terms of achieving high statistical power, while maintaining low total error rates. We illustrate the above features of our method by extensive simulation studies, followed by an application to a real data set on exchange rates.     

Approximate inference in heteroskedastic regressions: A numerical evaluation

The commonly made assumption that all stochastic error terms in the linear regression model share the same variance (homoskedasticity) is oftentimes violated in practical applications, especially when they are based on cross-sectional data. As a precaution, a number of practitioners choose to base inference on the parameters that index the model on tests whose statistics employ asymptotically correct standard errors, i.e. standard errors that are asymptotically valid whether or not the errors are homoskedastic. In this paper, we use numerical integration methods to evaluate the finite-sample performance of tests based on different (alternative) heteroskedasticity-consistent standard errors. Emphasis is placed on a few recently proposed heteroskedasticity-consistent covariance matrix estimators. Overall, the results favor the HC4 and HC5 heteroskedasticity-robust standard errors. We also consider the use of restricted residuals when constructing asymptotically valid standard errors. Our results show that the only test that clearly benefits from such a strategy is the HC0 test.     

Robust block bootstrap panel predictability tests*

This article develops two block bootstrap-based panel predictability test procedures that are valid under very general conditions. Some of the allowable features include cross-sectional dependence, heterogeneous predictive slopes, persistent predictors, and complex error dynamics, including cross-unit endogeneity. While the first test procedure tests if there is any predictability at all, the second procedure determines the units for which predictability holds in case of a rejection by the first. A weak unit root framework is adopted to allow persistent predictors, and a novel theory is developed to establish asymptotic validity of the proposed bootstrap. Simulations are used to evaluate the performance of our tests in small samples, and their implementation is illustrated through an empirical application to stock returns.