Some modifications of levene's test of variance homogeneity

Various modifications of Levene's test of homogeneity of variance are proposed and evaluated, including the use of (i) Satterthwaite's method for correcting degrees of freedom, (ii) data-based power transformations, and (iii) computer simulation. Satterthwaite's correction is shown to be effective in controlling the slightly liberal behaviour of Levene's test in small samples. The use of power transformation turns out to make the test extremely liberal and is not recommended. Modifications which employ computer simulation are exact under normality, and one version, at least, is asymptotically robust of nonnormality. They also posses excellent small-sample properties.     

Book Reviews

The Levene test is a widely used test for detecting differences in dispersion. The modified Levene transformation using sample medians is considered in this article. After Levene's transformation the data are not normally distributed, hence, nonparametric tests may be useful. As the Wilcoxon rank sum test applied to the transformed data cannot control the type I error rate for asymmetric distributions, a permutation test based on reallocations of the original observations rather than the absolute deviations was investigated. Levene's transformation is then only an intermediate step to compute the test statistic. Such a Levene test, however, cannot control the type I error rate when the Wilcoxon statistic is used; with the Fisher–Pitman permutation test it can be extremely conservative. The Fisher–Pitman test based on reallocations of the transformed data seems to be the only acceptable nonparametric test. Simulation results indicate that this test is on average more powerful than applying the t test after Levene's transformation, even when the t test is improved by the deletion of structural zeros.     

A NEW TEST FOR EQUALITY OF VARIANCES FOR k NORMAL POPULATIONS

ABSTRACT

A simple test based on Gini's mean difference is proposed to test the hypothesis of equality of population variances. Using 2000 replicated samples and empirical distributions, we show that the test compares favourably with Bartlett's and Levene's test for the normal population. Also, it is more powerful than Bartlett's and Levene's tests for some alternative hypotheses for some non-normal distributions and more robust than the other two tests for large sample sizes under some alternative hypotheses. We also give an approximate distribution to the test statistic to enable one to calculate the nominal levels and P-values.     

A robust I-sample analysis of means type randomization test for variances for unbalanced designs

Two analysis of means type randomization tests for testing the equality of I variances for unbalanced designs are presented. Randomization techniques for testing statistical hypotheses can be used when parametric tests are inappropriate. Suppose that I independent samples have been collected. Randomization tests are based on shuffles or rearrangements of the (combined) sample. Putting each of the I samples ‘in a bowl’ forms the combined sample. Drawing samples ‘from the bowl’ forms a shuffle. Shuffles can be made with replacement (bootstrap shuffling) or without replacement (permutation shuffling). The tests that are presented offer two advantages. They are robust to non-normality and they allow the user to graphically present the results via a decision chart similar to a Shewhart control chart. A Monte Carlo study is used to verify that the permutation version of the tests exhibit excellent power when compared to other robust tests. The Monte Carlo study also identifies circumstances under which the popular Levene's test fails.     

A modified likelihood ratio test for homogeneity in finite mixture models

Testing for homogeneity in finite mixture models has been investigated by many researchers. The asymptotic null distribution of the likelihood ratio test (LRT) is very complex and difficult to use in practice. We propose a modified LRT for homogeneity in finite mixture models with a general parametric kernel distribution family. The modified LRT has a χ-type of null limiting distribution and is asymptotically most powerful under local alternatives. Simulations show that it performs better than competing tests. They also reveal that the limiting distribution with some adjustment can satisfactorily approximate the quantiles of the test statistic, even for moderate sample sizes.     

A modified likelihood ratio test for the mean direction in the von mises distribution

The likelihood ratio test (LRT) for the mean direction in the von Mises distribution is modified for possessing a common asymptotic distribution both for large sample size and for large concentration parameter. The test statistic of the modified LRT is compared with the F distribution but not with the chi-square distribution usually employed, Good performances of the modified LRT are shown by analytical studies and Monte Carlo simulation studies, A notable advantage of the test is that it takes part in the unified likelihood inference procedures including both the marginal MLE and the marginal LRT for the concentration parameter.     

A score test for overdispersion in Poisson regression based on the generalized Poisson-2 model

Overdispersion is a common phenomenon in Poisson modeling. The generalized Poisson (GP) regression model accommodates both overdispersion and underdispersion in count data modeling, and is an increasingly popular platform for modeling overdispersed count data. The Poisson model is one of the special cases in the collection of models which may be specified by GP regression. Thus, we may derive a test of overdispersion which compares the equi-dispersion Poisson model within the context of the more general GP regression model. The score test has an advantage over the likelihood ratio test (LRT) and over the Wald test in that the score test only requires that the parameter of interest be estimated under the null hypothesis (the Poisson model). Herein, we propose a score test for overdispersion based on the GP model (specifically the GP-2 model) and compare the power of the test with the LRT and Wald tests. A simulation study indicates the proposed score test based on asymptotic standard normal distribution is more appropriate in practical applications.     

Letters to the Editor

Although several authors have indicated that the median test has low power in small samples, it continues to be presented in many statistical textbooks, included in a number of popular statistical software packages, and used in a variety of application areas. We present results of a power simulation study that shows that the median test has noticeably lower power, even for the double exponential distribution for which it is asymptotically most powerful, than other readily available rank tests. We suggest that the median test be “retired” from routine use and recommend alternative rank tests that have superior power over a relatively large family of symmetric distributions.     

A statistical software procedure for exact parametric and nonparametric likelihood-ratio tests for two-sample comparisons

Two-sample comparisons belonging to basic class of statistical inference are extensively applied in practice. There is a rich statistical literature regarding different parametric methods to address these problems. In this context, most of the powerful techniques are assumed to be based on normally distributed populations. In practice, the alternative distributions of compared samples are commonly unknown. In this case, one can propose a combined test based on the following decision rules: (a) the likelihood-ratio test (LRT) for equality of two normal populations and (b) the Shapiro–Wilk (S-W) test for normality. The rules (a) and (b) can be merged by, e.g., using the Bonferroni correction technique to offer the correct comparison of the samples distribution. Alternatively, we propose the exact density-based empirical likelihood (DBEL) ratio test. We develop the tsc package as the first R package available to perform the two-sample comparisons using the exact test procedures: the LRT; the LRT combined with the S-W test; as well as the newly developed DBEL ratio test. We demonstrate Monte Carlo (MC) results and a real data example to show an efficiency and excellent applicability of the developed procedure.     

Robust estimation and testing in one-way ANOVA for Type II censored samples: skew normal error terms

Censoring can be occurred in many statistical analyses in the framework of experimental design. In this study, we estimate the model parameters in one-way ANOVA under Type II censoring. We assume that the distribution of the error terms is Azzalini's skew normal. We use Tiku's modified maximum likelihood (MML) methodology which is a modified version of the well-known maximum likelihood (ML) in the estimation procedure. Unlike ML methodology, MML methodology is non-iterative and gives explicit estimators of the model parameters. We also propose new test statistics based on the proposed estimators. The performances of the proposed estimators and the test statistics based on them are compared with the corresponding normal theory results via Monte Carlo simulation study. A real life data is analysed to show the implementation of the methodology presented in this paper at the end of the study.     

A Parametric Bootstrap Solution to Two-way MANOVA without Interaction under Heteroscedasticity: Fixed and Mixed Models

In this article, we propose a parametric bootstrap (PB) test for heteroscedastic two-way multivariate analysis of variance without Interaction. For the problem of testing equal main effects of factors, we obtain a PB approach and compare it with existing modified Brown–Forsythe (MBF) test and approximate Hotelling T² (AHT) test by an extensive simulation study. The PB test is a symmetric function in samples, and does not depend on the chosen weights used to define the parameters uniquely. Simulation results indicate that the PB test performs satisfactorily for various cell sizes and parameter configurations when the homogeneity assumption is seriously violated, and tends to outperform the AHT test for moderate or larger samples in terms of power and controlling size. The MBF test, the AHT test, and the PB test have similar robustness to violations of underlying assumptions. It is also noted that the same PB test can be used to test the significance of random effect vector in a two-way multivariate mixed effects model with unequal cell covariance matrices.     

Jackknife empirical likelihood method for testing the equality of two variances

In this paper, we propose a nonparametric method based on jackknife empirical likelihood ratio to test the equality of two variances. The asymptotic distribution of the test statistic has been shown to follow χ² distribution with the degree of freedom 1. Simulations have been conducted to show the type I error and the power compared to Levene's test and F test under different distribution settings. The proposed method has been applied to a real data set to illustrate the testing procedure.     

ON LEVENE'S TESTS OF VARIANCE HOMOGENEITY

Levene's tests of homogeneity of treatment variances in completely randomised and randomised complete block experiments are examined. These tests are essentially standard analysis of variance F-tests performed on functions of the absolute values of residuals. It is found that in order to achieve (i) equality of component mean squares under the null hypothesis, and (ii) nominal significance levels, the various standard degrees of freedom need to be modified.     

Testing linear hypotheses in high-dimensional regressions

For a multivariate linear model, Wilk's likelihood ratio test (LRT) constitutes one of the cornerstone tools. However, the computation of its quantiles under the null or the alternative hypothesis requires complex analytic approximations, and more importantly, these distributional approximations are feasible only for moderate dimension of the dependent variable, say p≤20. On the other hand, assuming that the data dimension p as well as the number q of regression variables are fixed while the sample size n grows, several asymptotic approximations are proposed in the literature for Wilk's Λ including the widely used chi-square approximation. In this paper, we consider necessary modifications to Wilk's test in a high-dimensional context, specifically assuming a high data dimension p and a large sample size n. Based on recent random matrix theory, the correction we propose to Wilk's test is asymptotically Gaussian under the null hypothesis and simulations demonstrate that the corrected LRT has very satisfactory size and power, surely in the large p and large n context, but also for moderately large data dimensions such as p=30 or p=50. As a byproduct, we give a reason explaining why the standard chi-square approximation fails for high-dimensional data. We also introduce a new procedure for the classical multiple sample significance test in multivariate analysis of variance which is valid for high-dimensional data.     

Local Fourier tests for structural change based on residuals

We propose a structural change test based on the recursive residuals with the local Fourier series estimators. The statistical properties of the proposed test are derived and the empirical properties are shown via simulation. We also consider other structural change tests based on CUSUM, MOSUM, moving estimates (ME), and empirical distribution functions with the recursive residuals and the ordinary residuals. Empirical powers are calculated in various structural change models for the comparison of those tests. These structural change tests are applied to South Korea's gross domestic product (GDP), South Korean Won to US Dollar currency exchange rates, and South Korea's Okun's law.     

A parametric bootstrap solution to the MANOVA under heteroscedasticity

In this article, we consider the problem of comparing several multivariate normal mean vectors when the covariance matrices are unknown and arbitrary positive definite matrices. We propose a parametric bootstrap (PB) approach and develop an approximation to the distribution of the PB pivotal quantity for comparing two mean vectors. This approximate test is shown to be the same as the invariant test given in [Krishnamoorthy and Yu, Modified Nel and Van der Merwe test for the multivariate Behrens–Fisher problem, Stat. Probab. Lett. 66 (2004), pp. 161–169] for the multivariate Behrens–Fisher problem. Furthermore, we compare the PB test with two existing invariant tests via Monte Carlo simulation. Our simulation studies show that the PB test controls Type I error rates very satisfactorily, whereas other tests are liberal especially when the number of means to be compared is moderate and/or sample sizes are small. The tests are illustrated using an example.     

Testing the equality of several inverse Gaussian means under heterogeneity

Abstract

We consider the problem of testing the equality of several inverse Gaussian means when the scale parameters and sample sizes are possibly unequal. We propose four parametric bootstrap (PB) tests based on the uniformly minimum variance unbiased estimators of parameters. We also compare our proposed tests with the existing ones via an extensive simulation study in terms of controlling the Type I error rate and power performance. Simulation results show the merits of the PB tests.     

RAO'S SCORE TESTS IN SURVIVAL ANALYSIS: EXAMPLES AND BARTLETT TYPE ADJUSTMENTS

Score method in hypothesis testing is one of Professor C. R. Rao's great contributions to statistics. It provides a simple and unified way to test some simple and composite hypotheses in many statistical problems. Some popular tests in statistical practice derived with the help of intuitions can be shown as score tests under some statistical models. The subject-years test and log-rank test in survival analysis are two of the examples. In this paper, we first introduce these two examples. After formulating these two tests as score tests, we then review some recent results on the Bartlett type adjustments for these tests.     

Generalisation of Mood's Test to Factorial Designs to Detect Heterogeneity of Variances

Mood's test, which is a relatively old test (and the oldest non‐parametric test among those tests in its class) for determining heterogeneity of variance, is still being widely used in different areas such as biometry, biostatistics and medicine. Although it is a popular test, it is not suitable for use on a two‐way factorial design. In this paper, Mood's test is generalised to the 2 × 2 factorial design setting and its performance is compared with that of Klotz's test. The power and robustness of these tests are examined in detail by means of a simulation study with 10,000 replications. Based on the simulation results, the generalised Mood's and Klotz's tests can especially be recommended in settings in which the parent distribution is symmetric. As an example application we analyse data from a multi‐factor agricultural system that involves chilli peppers, nematodes and yellow nutsedge. This example dataset suggests that the performance of the generalised Mood test is in agreement with that of the generalised Klotz's test.     

Modified inference about the mean of the exponential distribution using moving extreme ranked set sampling

The maximum likelihood estimator (MLE) and the likelihood ratio test (LRT) will be considered for making inference about the scale parameter of the exponential distribution in case of moving extreme ranked set sampling (MERSS). The MLE and LRT can not be written in closed form. Therefore, a modification of the MLE using the technique suggested by Maharota and Nanda (Biometrika 61:601–606, 1974) will be considered and this modified estimator will be used to modify the LRT to get a test in closed form for testing a simple hypothesis against one sided alternatives. The same idea will be used to modify the most powerful test (MPT) for testing a simple hypothesis versus a simple hypothesis to get a test in closed form for testing a simple hypothesis against one sided alternatives. Then it appears that the modified estimator is a good competitor of the MLE and the modified tests are good competitors of the LRT using MERSS and simple random sampling (SRS).