A Comparative Study of Some Modified Chi-Squared Tests

Some recent results in the theory and applications of modified chi-squared goodness-of-fit tests are briefly discussed. It seems that for the first time power of modified chi-squared type tests for the logistic and three-parameter Weibull distributions based on moment type estimators is studied. Power of different modified tests against some alternatives for equiprobable fixed or random grouping intervals, and for Neyman–Pearson classes is investigated. It is shown that power of test statistic essentially depends on the quantity of Fisher's sample information this statistic uses. Some recommendations on implementing modified chi-squared type tests are given.     

Some multivariate goodness-of-fit tests based on data depth

Based on data depth, three types of nonparametric goodness-of-fit tests for multivariate distribution are proposed in this paper. They are Pearson’s chi-square test, tests based on EDF and tests based on spacings, respectively. The Anderson–Darling (AD) test and the Greenwood test for bivariate normal distribution and uniform distribution are simulated. The results of simulation show that these two tests have low type I error rates and become more efficient with the increase in sample size. The AD-type test performs more powerfully than the Greenwood type test.     

A density-based empirical likelihood ratio goodness-of-fit test for the Rayleigh distribution and power comparison

The Rayleigh distribution has been used to model right skewed data. Rayleigh [On the resultant of a large number of vibrations of the some pitch and of arbitrary phase. Philos Mag. 1880;10:73–78] derived it from the amplitude of sound resulting from many important sources. In this paper, a new goodness-of-fit test for the Rayleigh distribution is proposed. This test is based on the empirical likelihood ratio methodology proposed by Vexler and Gurevich [Empirical likelihood ratios applied to goodness-of-fit tests based on sample entropy. Comput Stat Data Anal. 2010;54:531–545]. Consistency of the proposed test is derived. It is shown that the distribution of the proposed test does not depend on scale parameter. Critical values of the test statistic are computed, through a simulation study. A Monte Carlo study for the power of the proposed test is carried out under various alternatives. The performance of the test is compared with some well-known competing tests. Finally, an illustrative example is presented and analysed.     

Bayesian goodness-of-fit test for censored data

We propose a Bayesian computation and inference method for the Pearson-type chi-squared goodness-of-fit test with right-censored survival data. Our test statistic is derived from the classical Pearson chi-squared test using the differences between the observed and expected counts in the partitioned bins. In the Bayesian paradigm, we generate posterior samples of the model parameter using the Markov chain Monte Carlo procedure. By replacing the maximum likelihood estimator in the quadratic form with a random observation from the posterior distribution of the model parameter, we can easily construct a chi-squared test statistic. The degrees of freedom of the test equal the number of bins and thus is independent of the dimensionality of the underlying parameter vector. The test statistic recovers the conventional Pearson-type chi-squared structure. Moreover, the proposed algorithm circumvents the burden of evaluating the Fisher information matrix, its inverse and the rank of the variance–covariance matrix. We examine the proposed model diagnostic method using simulation studies and illustrate it with a real data set from a prostate cancer study.     

The Sensitivity of Chi-Squared Goodness-of-Fit Tests to the Partitioning of Data

Abstract

The power of Pearson's overall goodness-of-fit test and the components-of-chi-squared or “Pearson analog” tests of Anderson [Anderson, G. (1994). Simple tests of distributional form. J. Econometrics 62:265–276] to detect rejections due to shifts in location, scale, skewness and kurtosis is studied, as the number and position of the partition points is varied. Simulations are conducted for small and moderate sample sizes. It is found that smaller numbers of classes than are used in practice may be appropriate, and that the choice of non-equiprobable classes can result in substantial gains in power.     

New Developments in Statistical Computing: Short Notices and Reviews of New Program Packages,other Sources of Information,and New Products

Graphs are presented on which the empirical distribution function can be plotted to test the assumption of normality by the Lilliefors test. A second set of graphs is presented for using the Lilliefors test on exponential distributions. The graphs allow for tests at the 10 percent, 5 percent, and 1 percent levels of significance. Use of these graphs makes it easy for students in a first course in statistics to test normal and exponential distributions without having to unravel the mystery associated with putting together a chi-squared goodness-of-fit test.     

Unbiased goodness-of-fit tests

Familiar distribution-free goodness-of-fit tests like the Kolmogorov–Smirnov test are all biased tests. In this paper, we show how to compute the bias of any distribution-free goodness-of-fit test that corresponds to a distribution-free confidence band for the cumulative distribution function (CDF). The bias of the Kolmogorov–Smirnov test turns out to be smaller than the biases of other distribution-free goodness-of-fit tests. We also develop a method for obtaining unbiased goodness-of-fit tests, which can then be inverted to obtain unbiased confidence bands for the CDF. Interestingly, only a discrete set of levels are available for the unbiased tests. Our power comparisons show that while removing bias improves the power of a test at some alternatives, it does not improve the overall power properties of the test.     

Comparisons of various types of normality tests

Normality tests can be classified into tests based on chi-squared, moments, empirical distribution, spacings, regression and correlation and other special tests. This paper studies and compares the power of eight selected normality tests: the Shapiro–Wilk test, the Kolmogorov–Smirnov test, the Lilliefors test, the Cramer–von Mises test, the Anderson–Darling test, the D'Agostino–Pearson test, the Jarque–Bera test and chi-squared test. Power comparisons of these eight tests were obtained via the Monte Carlo simulation of sample data generated from alternative distributions that follow symmetric short-tailed, symmetric long-tailed and asymmetric distributions. Our simulation results show that for symmetric short-tailed distributions, D'Agostino and Shapiro–Wilk tests have better power. For symmetric long-tailed distributions, the power of Jarque–Bera and D'Agostino tests is quite comparable with the Shapiro–Wilk test. As for asymmetric distributions, the Shapiro–Wilk test is the most powerful test followed by the Anderson–Darling test.     

An Empirical Analysis of Some Nonparametric Goodness-of-Fit Tests for Censored Data

In this article, we consider some nonparametric goodness-of-fit tests for right censored samples, viz., the modified Kolmogorov, Cramer–von Mises–Smirnov, Anderson–Darling, and Nikulin–Rao–Robson χ² tests. We also consider an approach based on a transformation of the original censored sample to a complete one and the subsequent application of classical goodness-of-fit tests to the pseudo-complete sample. We then compare these tests in terms of power in the case of Type II censored data along with the power of the Neyman–Pearson test, and draw some conclusions. Finally, we present an illustrative example.     

The Appropriateness of Some Common Procedures for Testing the Equality of Two Independent Binomial Populations

For testing the equality of two independent binomial populations the Fisher exact test and the chi-squared test with Yates's continuity correction are often suggested for small and intermediate size samples. The use of these tests is inappropriate in that they are extremely conservative. In this article we demonstrate that, even for small samples, the uncorrected chi-squared test (i.e., the Pearson chi-squared test) and the two-independent-sample t test are robust in that their actual significance levels are usually close to or smaller than the nominal levels. We encourage the use of these latter two tests.     

A stepwise algorithm for selecting category boundaries for the chi-squared goodness-of-fit test

A stepwise algorithm for selecting categories for the chisquared goodness-of-fit test with completely specified continuous null and alternative distributions is described in this paper. The procedure's starting point is an initial partitioning of the sample space into a large number of categories. A second partition with one fewer category is constructed by combining two categories of the original partition. The procedure continues until there are only two categories; the partition in the sequence with the highest estimated power is the one chosen. For illustartive purposes, the performance of the algorithm is evaluated for several hypothesis tests of the from H₀: normal distribution vs. H₁: a specific mixed normal distribution. For each test considered, the partition identified by the algorithm was compared to several equiprobable partitions, including the equiprobable partition with the highest estimated power. In all cases but one, the algorithm identified a parttion with higher estimated power than the best equiprobable partition. Applciations of the procedure are discussed.     

A Goodness-of-Fit Test for Location-Scale Max-Stable Distributions

In this article, a technique based on the sample correlation coefficient to construct goodness-of-fit tests for max-stable distributions with unknown location and scale parameters and finite second moment is proposed. Specific details to test for the Gumbel distribution are given, including critical values for small sample sizes as well as approximate critical values for larger sample sizes by using normal quantiles. A comparison by Monte Carlo simulation shows that the proposed test for the Gumbel hypothesis is substantially more powerful than some other known tests against some alternative distributions with positive skewness coefficient.     

Testing the Fit of Gamma Distributions Using the Empirical Moment Generating Function

ABSTRACT

This article presents goodness-of-fit tests for two and three-parameter gamma distributions that are based on minimum quadratic forms of standardized logarithmic differences of values of the moment generating function and its empirical counterpart. The test statistics can be computed without reliance to special functions and have asymptotic chi-squared distributions. Monte Carlo simulations are used to compare the proposed test for the two-parameter gamma distribution with goodness-of-fit tests employing empirical distribution function or spacing statistics. Two data sets are used to illustrate the various tests.     

Small-sample comparisons for powerdivergence goodness-of-fit statistics for symmetric and skewed simple null hypotheses

Power-divergence goodness-of-fit statistics have asymptotically a chi-squared distribution. Asymptotic results may not apply in small-sample situations, and the exact significance of a goodness-of-fit statistic may potentially be over- or under-stated by the asymptotic distribution. Several correction terms have been proposed to improve the accuracy of the asymptotic distribution, but their performance has only been studied for the equiprobable case. We extend that research to skewed hypotheses. Results are presented for one-way multinomials involving k = 2 to 6 cells with sample sizes N = 20, 40, 60, 80 and 100 and nominal test sizes f = 0.1, 0.05, 0.01 and 0.001. Six power-divergence goodness-of-fit statistics were investigated, and five correction terms were included in the study. Our results show that skewness itself does not affect the accuracy of the asymptotic approximation, which depends only on the magnitude of the smallest expected frequency (whether this comes from a small sample with the equiprobable hypothesis or a large sample with a skewed hypothesis). Throughout the conditions of the study, the accuracy of the asymptotic distribution seems to be optimal for Pearson's X² statistic (the power-divergence statistic of index u = 1) when k > 3 and the smallest expected frequency is as low as between 0.1 and 1.5 (depending on the particular k, N and nominal test size), but a computationally inexpensive improvement can be obtained in these cases by using a moment-corrected h² distribution. If the smallest expected frequency is even smaller, a normal correction yields accurate tests through the log-likelihood-ratio statistic G² (the power-divergence statistic of index u = 0).     

New invariant and consistent chi-squared type goodness-of-fit tests for multivariate normality and a related comparative simulation study

ABSTRACT

New invariant and consistent goodness-of-fit tests for multivariate normality are introduced. Tests are based on the Karhunen–Loève transformation of a multidimensional sample from a population. A comparison of simulated powers of tests and other well-known tests with respect to some alternatives is given. The simulation study demonstrates that power of the proposed McCull test almost does not depend on the number of grouping cells. The test shows an advantage over other chi-squared type tests. However, averaged over all of the simulated conditions examined in this article, the Anderson–Darling type and the Cramer–von Mises type tests seem to be the best.     

An omnibus test of goodness-of-fit for conditional distributions with applications to regression models

We introduce an omnibus goodness-of-fit test for statistical models for the conditional distribution of a random variable. In particular, this test is useful for assessing whether a regression model fits a data set on all its assumptions. The test is based on a generalization of the Cramér–von Mises statistic and involves a local polynomial estimator of the conditional distribution function. First, the uniform almost sure consistency of this estimator is established. Then, the asymptotic distribution of the test statistic is derived under the null hypothesis and under contiguous alternatives. The extension to the case where unknown parameters appear in the model is developed. A simulation study shows that the test has good power against some common departures encountered in regression models. Moreover, its power is comparable to that of other nonparametric tests designed to examine only specific departures.     

A powerful and interpretable alternative to the Jarque–Bera test of normality based on 2nd-power skewness and kurtosis,using the Rao's score test on the APD family

We introduce the 2nd-power skewness and kurtosis, which are interesting alternatives to the classical Pearson's skewness and kurtosis, called 3rd-power skewness and 4th-power kurtosis in our terminology. We use the sample 2nd-power skewness and kurtosis to build a powerful test of normality. This test can also be derived as Rao's score test on the asymmetric power distribution, which combines the large range of exponential tail behavior provided by the exponential power distribution family with various levels of asymmetry. We find that our test statistic is asymptotically chi-squared distributed. We also propose a modified test statistic, for which we show numerically that the distribution can be approximated for finite sample sizes with very high precision by a chi-square. Similarly, we propose a directional test based on sample 2nd-power kurtosis only, for the situations where the true distribution is known to be symmetric. Our tests are very similar in spirit to the famous Jarque–Bera test, and as such are also locally optimal. They offer the same nice interpretation, with in addition the gold standard power of the regression and correlation tests. An extensive empirical power analysis is performed, which shows that our tests are among the most powerful normality tests. Our test is implemented in an R package called PoweR.     

Optimum M-step,step-stress design with K stress variables

Most of the available literature on accelerated life testing deals with tests that use only one accelerating variable and no other explanatory variables. Frequently, however, there is a need to use more than one accelerating or other experimental variables. Examples include a test of capacitors at higher than usual levels of temperature and voltage, and a test of circuit boards at higher than usual levels of temperature, humidity, and voltage. M-step, step-stress models are extended to include k stress variables. Optimum M-step, step-stress designs with k stress variables are found. The polynomial model is considered as a special case, and a lack of fit test is discussed. Also a goodness-of-fit test is proposed and the appropriateness of using its asymptotic chi-square distribution for small samples is shown.     

Multivariate extension of chi-squared univariate normality test

We propose a multivariate extension of the univariate chi-squared normality test. Using a known result for the distribution of quadratic forms in normal variables, we show that the proposed test statistic has an approximated chi-squared distribution under the null hypothesis of multivariate normality. As in the univariate case, the new test statistic is based on a comparison of observed and expected frequencies for specified events in sample space. In the univariate case, these events are the standard class intervals, but in the multivariate extension we propose these become hyper-ellipsoidal annuli in multivariate sample space. We assess the performance of the new test using Monte Carlo simulation. Keeping the type I error rate fixed, we show that the new test has power that compares favourably with other standard normality tests, though no uniformly most powerful test has been found. We recommend the new test due to its competitive advantages.     

On deviations between kernel-type estimators of a distribution density in p ⩾ 2 independent samples

In the article, the tests are constructed for the hypotheses that p ? 2 independent samples have the same distribution density (homogeneity hypothesis) or have the same well-defined distribution density (goodness-of-fit test). The limiting power of the constructed tests is found for some local “close” alternatives.