Testing for multivariate heteroscedasticity

In this article, we propose a testing technique for multivariate heteroscedasticity, which is expressed as a test of linear restrictions in a multivariate regression model. Four test statistics with known asymptotical null distributions are suggested, namely the Wald, Lagrange multiplier (LM), likelihood ratio (LR) and the multivariate Rao F-test. The critical values for the statistics are determined by their asymptotic null distributions, but bootstrapped critical values are also used. The size, power and robustness of the tests are examined in a Monte Carlo experiment. Our main finding is that all the tests limit their nominal sizes asymptotically, but some of them have superior small sample properties. These are the F, LM and bootstrapped versions of Wald and LR tests.     

Influence Diagnostics on Testing Linear Hypothesis in Linear Models with Correlated Errors

To assess the influence of observations on the parameter estimates, case deletion diagnostics are commonly used in linear regression models. For linear models with correlated errors we study the influence of observations on testing a linear hypothesis using single and multiple case deletions. The change in likelihood ratio test and F test theoretically is derived and it is shown these tests to be completely determined by two proposed generalized externally studentized residuals. An illustrative example of a real data set is also reported.     

Hypothesis Testing of Hazard Ratio Parameters in Marginal Models for Multivariate Failure Time Data

Marginal hazard models for multivariate failure time data have been studied extensively in recent literature. However, standard hypothesis test statistics based on the likelihood method are not exactly appropriate for this kind of model. In this paper, extensions of the three commonly used likelihood hypothesis test statistics are discussed. Generalized Wald, generalized score and generalized likelihood ratio tests for hazard ratio parameters in a marginal hazard model for multivariate failure time data are proposed and their asymptotic distributions examined. The finite sample properties of these statistics are studied through simulations. The proposed method is applied to data from Busselton Population Health Surveys.     

A likelihood ratio test of a homoscedastic normal mixture against a heteroscedastic normal mixture

It is generally assumed that the likelihood ratio statistic for testing the null hypothesis that data arise from a homoscedastic normal mixture distribution versus the alternative hypothesis that data arise from a heteroscedastic normal mixture distribution has an asymptotic χ ² reference distribution with degrees of freedom equal to the difference in the number of parameters being estimated under the alternative and null models under some regularity conditions. Simulations show that the χ ² reference distribution will give a reasonable approximation for the likelihood ratio test only when the sample size is 2000 or more and the mixture components are well separated when the restrictions suggested by Hathaway (Ann. Stat. 13:795–800, 1985) are imposed on the component variances to ensure that the likelihood is bounded under the alternative distribution. For small and medium sample sizes, parametric bootstrap tests appear to work well for determining whether data arise from a normal mixture with equal variances or a normal mixture with unequal variances.     

Testing Symmetry of a NIG Distribution

Exponential and Weibull models are commonly used models with former being the special case of the latter. In their most general forms, the exponential model involves both threshold and scale parameters whereas the Weibull model involves threshold, scale and shape parameters. The article analyzes the two models in a Bayesian framework and examines the feasibility of generality versus particularity in the sense that it tests for the possibility of (not) having a threshold and/or a shape parameter in the data arising from exponential (Weibull) model. The results are illustrated based on both complete and censored datasets from the models.     

CUSUM charts for monitoring the mean of a multivariate Gaussian process

In this paper control charts for the mean of a multivariate Gaussian process are considered. Using the generalized likelihood ratio approach and the sequential probability ratio test under an additional constraint on the magnitude of the change various types of CUSUM control charts are derived. It is analyzed under which conditions these schemes are directionally invariant. These charts are compared with several other control schemes proposed in literature. The performance of the charts is studied based on the maximum average delay.     

Testing the equality of quantiles for several normal populations

Many procedures exist for testing equality of means or medians to compare several independent distributions. However, the mean or median do not determine the entire distribution. In this article, we propose a new small-sample modification of the likelihood ratio test for testing the equality of the quantiles of several normal distributions. The merits of the proposed test are numerically compared with the existing tests—a generalized p-value method and likelihood ratio test—with respect to their sizes and powers. The simulation results demonstrate that proposed method is satisfactory; its actual size is very close to the nominal level. We illustrate these approaches using two real examples.     

The Use of Permutation Tests for Variance Components in Linear Mixed Models

Standard asymptotic chi-square distribution of the likelihood ratio and score statistics under the null hypothesis does not hold when the parameter value is on the boundary of the parameter space. In mixed models it is of interest to test for a zero random effect variance component. Some available tests for the variance component are reviewed and a new test within the permutation framework is presented. The power and significance level of the different tests are investigated by means of a Monte Carlo simulation study. The proposed test has a significance level closer to the nominal one and it is more powerful.     

INFLUENCE FUNCTION OF THE LIKELIHOOD RATIO TEST STATISTIC FOR MULTIVARIATE NORMAL SAMPLE

ABSTRACT

We derive the influence function of the likelihood ratio test statistic for multivariate normal sample. The derived influence function does not depend on the influence functions of the parameters under the null hypothesis. So we can obtain directly the empirical influence function with only the maximum likelihood estimators under the null hypothesis. Since the derived formula is a general form, it can be applied to influence analysis on many statistical testing problems.     

Bartlett corrections in beta regression models

We consider the issue of performing accurate small-sample testing inference in beta regression models, which are useful for modeling continuous variates that assume values in (0,1), such as rates and proportions. We derive the Bartlett correction to the likelihood ratio test statistic and also consider a bootstrap Bartlett correction. Using Monte Carlo simulations we compare the finite sample performances of the two corrected tests to that of the standard likelihood ratio test and also to its variant that employs Skovgaard's adjustment; the latter is already available in the literature. The numerical evidence favors the corrected tests we propose. We also present an empirical application.     

Upper Bound for p-Value of the Test of Multivariate Normal Ordered Mean Vectors Against all Alternatives

Consider the problem of testing the isotonic of several p-variate normal mean vectors against all alternatives. It is difficult to compute the exact p-value for this problem of testing with the classical method when the covariance matrices are completely unknown. In the present paper, a test statistic is proposed for this problem of testing. A reformulation of the test statistic is given based on the orthogonal projections on the closed convex cones and then the upper bound for p-value of the test statistic is computed.     

A Note on Tests for Zero-Inflation in Correlated Count Data

Zero-inflated Poisson mixed regression models are popular approaches to analyze clustered count data with excess zeros. Prior to application of these models, it is essential to examine the necessity of the adjustment for zero outcomes. The existing literature, however, has focused only on score tests for testing the suitability of zero-inflated models for correlated count data. In view of the observed bias and non-optimal size of score tests, it deserves further investigation of other alternative ways for the test. This article aims to explore the use of the null Wald and likelihood ratio tests for zero-inflation in correlated count data. Our simulation study shows that both the null Wald and likelihood ratio tests outperform the score test of Xiang et al. (2006 Xiang , L. , Lee , A. H. , Yau , K. K. W. , McLachlan , G. J. ( 2006 ). A score test for zero-inflation in correlated count data . Statistics in Medicine 25 : 1660 – 1671 . [Google Scholar]) in terms of statistical power, regardless of the computational convenience of the score test. A bootstrap null Wald statistic is also proposed, which results in improved performance in terms of the size and power of the test.     

Successive comparisons between ordered normal means using isotonic regression estimators

In this study we discuss multiple comparison procedures for checking differences among a sequence of normal means with ordered restriction. Lee and Spurrier (1995 Lee, R.E., Spurrier, J.D. (1995). Successive comparisons between ordered treatments. J. Stat. Plann. Inference 43:323–330.[Crossref], [Web of Science ®] , [Google Scholar]) proposed a multiple comparison procedure which tests the difference between two adjacent means using the difference of sample means. In this study we propose a multiple comparison procedure modifying Lee and Spurrier's (1995 Lee, R.E., Spurrier, J.D. (1995). Successive comparisons between ordered treatments. J. Stat. Plann. Inference 43:323–330.[Crossref], [Web of Science ®] , [Google Scholar]) procedure using isotonic regression estimators instead of sample means. We determine the critical value for pairwise comparisons for a specified significance level. Furthermore, we formulate the power of the test. Finally, we give some numerical examples regarding critical values and power of the test intended to compare our procedure with Lee and Spurrier's (1995 Lee, R.E., Spurrier, J.D. (1995). Successive comparisons between ordered treatments. J. Stat. Plann. Inference 43:323–330.[Crossref], [Web of Science ®] , [Google Scholar]) procedure.     

Hypothesis testing in log-Birnbaum-Saunders regressions

The log-Birnbaum-Saunders regression model introduced by Rieck and Nedelman (1991 Rieck, J. R., Nedelman, J. R. (1991). A log-linear model for the Birnbaum-Saunders distribution. Technometrics 33:51–60. [Google Scholar]) is useful for modeling lifetimes of materials and equipments subject to different conditions. Our goal in this article is twofold. First, we numerically evaluate the finite sample performances of the likelihood ratio, score and Wald tests in the log-Birnbaum-Saunders regression model. Second, we introduce a RESET-like misspecification test for that model. The null hypothesis is that the model is correctly specified which is tested against the alternative hypothesis of model misspecification. The power of the test is evaluated using Monte Carlo simulations. Bootstrap-based inference is also considered. An empirical application is presented and discussed.     

On Testing Sample Selection Bias Under the Multicollinearity Problem

ABSTRACT

This paper reviews and extends the literature on the finite sample behavior of tests for sample selection bias. Monte Carlo results show that, when the “multicollinearity problem” identified by Nawata (1993 Nawata , K. ( 1993 ). A note on the estimation of models with sample-selection biases . Economics Letters 42 : 15 – 24 . [CSA] [CROSSREF] [Crossref], [Web of Science ®] , [Google Scholar]) is severe, (i) the t-test based on the Heckman–Greene variance estimator can be unreliable, (ii) the Likelihood Ratio test remains powerful, and (iii) nonnormality can be interpreted as severe sample selection bias by Maximum Likelihood methods, leading to negative Wald statistics. We also confirm previous findings (Leung and Yu, 1996 Leung , S. F. , Yu , S. ( 1996 ). On the choice between sample selection and two-part models . Journal of Econometrics 72 : 197 – 229 . [CSA] [CROSSREF] [Crossref], [Web of Science ®] , [Google Scholar]) that the standard regression-based t-test (Heckman, 1979 Heckman , J. J. ( 1979 ). Sample selection bias as a specification error . Econometrica 47 : 153 – 161 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]) and the asymptotically efficient Lagrange Multiplier test (Melino, 1982 Melino , A. ( 1982 ). Testing for sample selection bias . Review of Economic Studies 49 : 151 – 153 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]), are robust to nonnormality but have very little power.     

On implementation of a test for Kronecker product covariance structure for multivariate repeated measures data

Under the assumption of multivariate normality the likelihood ratio test is derived to test a hypothesis for Kronecker product structure on a covariance matrix in the context of multivariate repeated measures data. Although the proposed hypothesis testing can be computationally performed by indirect use of Proc Mixed of SAS, the Proc Mixed algorithm often fails to converge. We provide an alternative algorithm. The algorithm is illustrated with two real data sets. A simulation study is also conducted for the purpose of sample size consideration.     

On Testing Sample Selection Bias Under the Multicollinearity Problem

This paper reviews and extends the literature on the finite sample behavior of tests for sample selection bias. Monte Carlo results show that, when the “multicollinearity problem” identified by Nawata (1993) is severe, (i) the t-test based on the Heckman-Greene variance estimator can be unreliable, (ii) the Likelihood Ratio test remains powerful, and (iii) nonnormality can be interpreted as severe sample selection bias by Maximum Likelihood methods, leading to negative Wald statistics. We also confirm previous findings (Leung and Yu, 1996) that the standard regression-based t-test (Heckman, 1979) and the asymptotically efficient Lagrange Multiplier test (Melino, 1982), are robust to nonnormality but have very little power.     

Effect of Dependency in Systems for Multivariate Surveillance

Systems for multivariate on-line surveillance (e.g., outbreak detection) are investigated. Optimal systems for statistical surveillance are based on likelihood ratios. Three systems are compared: based on each marginal density, based on the joint density, and based on the Hotelling's T2. The effect of dependency between the monitored processes is investigated, and the effect of correlation between the change times. When the first change occurs immediately, the three methods give similar delay of an alarm, in the situation with independency. For late changes, T2 has the longest delay, both for independent processes and for processes with a positive covariance.     

Testing for Covariate Effect in the Cox Proportional Hazards Regression Model

This article presents methods for testing covariate effect in the Cox proportional hazards model based on Kullback–Leibler divergence and Renyi's information measure. Renyi's measure is referred to as the information divergence of order γ (γ ≠ 1) between two distributions. In the limiting case γ → 1, Renyi's measure becomes Kullback–Leibler divergence. In our case, the distributions correspond to the baseline and one possibly due to a covariate effect. Our proposed statistics are simple transformations of the parameter vector in the Cox proportional hazards model, and are compared with the Wald, likelihood ratio and score tests that are widely used in practice. Finally, the methods are illustrated using two real-life data sets.     

An Approximation for the Test of the Equality of the Smallest Eigenvalues of a Covariance Matrix

A limiting distribution of the likelihood ratio statistic for the test of the equality of the q smallest eigenvalues of a covariance matrix is obtained. This distribution can be used as an alternative to the chi-squared distribution which is usually used with this test. It is shown that this new method yields reasonable significance levels for those situations in which the chi-squared approximation is inadequate.