Unbiased goodness-of-fit tests

Familiar distribution-free goodness-of-fit tests like the Kolmogorov–Smirnov test are all biased tests. In this paper, we show how to compute the bias of any distribution-free goodness-of-fit test that corresponds to a distribution-free confidence band for the cumulative distribution function (CDF). The bias of the Kolmogorov–Smirnov test turns out to be smaller than the biases of other distribution-free goodness-of-fit tests. We also develop a method for obtaining unbiased goodness-of-fit tests, which can then be inverted to obtain unbiased confidence bands for the CDF. Interestingly, only a discrete set of levels are available for the unbiased tests. Our power comparisons show that while removing bias improves the power of a test at some alternatives, it does not improve the overall power properties of the test.     

A TEST FOR THE NONPARAMETRIC TWO SAMPLE SCALE PROBLEM

We propose a distribution-free test for the nonparametric two sample scale problem. Unlike the other tests for this problem, we do not assume that the two distribution functions have a common median. We assume that they have a common quantile of order a (not necessarily 1/2). The test statistic is a modification of the Sukhatme statistic for the scale problem and the Wilcoxon-Mann-Whitney statistic for stochastic dominance. It is shown that the new test is uniformly more efficient (in the Pitman sense) than the Sukhatme test and has very good efficiency when compared to the Mood test.     

A class of k-sample distribution-free tests for location against ordered alternatives

This paper introduces a new class of distribution-free tests for testing the homogeneity of several location parameters against ordered alternatives. The proposed class of test statistics is based on a linear combination of two-sample U-statistics based on subsample extremes. The mean and variance of the test statistic are obtained under the null hypothesis as well as under the sequence of local alternatives. The optimal weights are also determined. It is shown via Pitman ARE comparisons that the proposed class of test statistics performs better than its competitor tests in case of heavy-tailed and long-tailed distributions     

Powers of Discrete Goodness-of-Fit Test Statistics for a Uniform Null Against a Selection of Alternative Distributions

The comparative powers of six discrete goodness-of-fit test statistics for a uniform null distribution against a variety of fully specified alternative distributions are discussed. The results suggest that the test statistics based on the empirical distribution function for ordinal data (Kolmogorov–Smirnov, Cramér–von Mises, and Anderson–Darling) are generally more powerful for trend alternative distributions. The test statistics for nominal (Pearson's chi-square and the nominal Kolmogorov–Smirnov) and circular data (Watson's test statistic) are shown to be generally more powerful for the investigated triangular (∨), flat (or platykurtic type), sharp (or leptokurtic type), and bimodal alternative distributions.     

Tests for symmetry about an unknown value based on the empirical distribution function

A class of Kolmogorov-Smirnov and Cramér-von Mises type statistics for testing symmetry about an unknown value is described. These statistics are not distribution-free, however, and, indeed, are not readily amenable to calculation. A linear rank statistic analog of the first component of the Cramér-von Mises type statistic is investigated. Asymptotic non-null properties of these procedures in the normal case are studied, and an efficiency comparison of the Cramér-vonMises statistic, the linear rank statistic analog, the modified Wil-coxon statistic, and the likelihood ratio test is reported.     

A Simulation Study of the Powers of Three Multiple Comparison Statistics

A normal-theory and two distribution-free statistics used for multiple comparisons of homogeneity of location are compared on simulated data generated from six distributions. The normal-theory statistic is found to be fairly robust to departures from the assumption of normally distributed data of the types considered. The Steel-Dwass statistic is generally more powerful than a Kruskal-Wallis range statistic.     

Kolmogorov–Smirnov test for life test data with hybrid censoring

This work considers goodness-of-fit for the life test data with hybrid censoring. An alternative representation of the Kolmogorov–Smirnov (KS) statistics is provided under Type-I censoring. The alternative representation leads us to approximate the limiting distributions of the KS statistic as a functional of the Brownian bridge for Type-II, Type-I hybrid, and Type-II hybrid censored data. The approximated distributions are used to obtain the critical values of the tests in this context. We found that the proposed KS test procedure for Type-II censoring has more power than the available one(s) in literature.     

Testing for ordered alternatives by combining independent distribution-free block statistics

A class of distribution-free tests for ordered alternatives in a block design is presented. On each block a distribution-free statistic is selected, and a weighted sum of these statistics is then formed. A procedure for selecting the weighting constants which maximize the asymptotic relative efficiency is presented. The improvement in the efficiency of the weighted sum of block statistics over the unweighted sum is considered and proves interesting. Some attention is also given to the idea of using different types of statistics on different blocks.     

Testing the difference between two Kolmogorov–Smirnov values in the context of receiver operating characteristic curves

The maximum vertical distance between a receiver operating characteristic (ROC) curve and its chance diagonal is a common measure of effectiveness of the classifier that gives rise to this curve. This measure is known to be equivalent to a two-sample Kolmogorov–Smirnov statistic; so the absolute difference D between two such statistics is often used informally as a measure of difference between the corresponding classifiers. A significance test of D is of great practical interest, but the available Kolmogorov–Smirnov distribution theory precludes easy analytical construction of such a significance test. We, therefore, propose a Monte Carlo procedure for conducting the test, using the binormal model for the underlying ROC curves. We provide Splus/R routines for the computation, tabulate the results for a number of illustrative cases, apply the methods to some practical examples and discuss some implications.     

A note on the nonparametric test based on theL 1-version of the Cramér-von Mises statistic

We consider the test based on theL ₁-version of the Cramér-von Mises statistic for the nonparametric two-sample problem. Some quantiles of the exact distribution under H₀ of the test statistic are computed for small sample sizes. We compare the test in terms of power against general alternatives to other two-sample tests, namely the Wilcoxon rank sum test, the Smirnov test and the Cramér-von Mises test in the case of unbalanced small sample sizes. The computation of the power is rather complicated when the sample sizes are unequal. Using Monte Carlo power estimates it turns out that the Smirnov test is more sensitive to non stochastically ordered alternatives than the new test. And under location-contamination alternatives the power estimates of the new test and of the competing tests are equal.     

The EWMA sign chart revisited: performance and alternatives without and with ties

The EWMA Sign control chart is an efficient tool for monitoring shifts in a process regardless the observations'' underlying distribution. Recent studies have shown that, for nonparametric control charts, due to the discrete nature of the statistics being used (such as the Sign statistic), it is impossible to accurately compute their Run Length properties using Markov chain or integral equation methods. In this work, a modified nonparametric Phase II EWMA chart based on the Sign statistic is proposed and its exact Run Length properties are discussed. A continuous transformation of the Sign statistic, combined with the classical Markov Chain method, is used for the determination of the chart''s in- and out-of-control Run Length properties. Additionally, we show that when ties occur due to measurement rounding-off errors, the EWMA Sign control chart is no longer distribution-free and a Bernoulli trial approach is discussed to handle the occurrence of ties and makes the proposed chart almost distribution-free. Finally, an illustrative example is provided to show the practical implementation of our proposed chart.     

A modification of the kruskal-wallis statistic for the generalized behrens-fisher problem

The problem of testing the equality of the medians of several populations is considered. Standard distribution-free procedures for this problem require that the populations have the same shape in order to maintain their nominal significance level, ever asymptotically, under the null hypothesis of equal medians , A modification of the Kruskal-Wallis test statistic is proposed which is exactly distribution-free under the usual nonparanetric asswnption that the continuous populations are identical with any shape. It is asymptotically distribution-free when the Continuous populations are asswned to be syrmnetric with equal medians.     

Improvement of the quality of the chi-square approximation for the ADF test on a covariance matrix with a linear structure

The asymptotically distribution-free (ADF) test statistic was proposed by Browne (1984). It is known that the null distribution of the ADF test statistic is asymptotically distributed according to the chi-square distribution. This asymptotic property is always satisfied, even under nonnormality, although the null distributions of other famous test statistics, e.g., the maximum likelihood test statistic and the generalized least square test statistic, do not converge to the chi-square distribution under nonnormality. However, many authors have reported numerical results which indicate that the quality of the chi-square approximation for the ADF test is very poor, even when the sample size is large and the population distribution is normal. In this paper, we try to improve the quality of the chi-square approximation to the ADF test for a covariance matrix with a linear structure by using the Bartlett correction applicable under the assumption of normality. By conducting numerical studies, we verify that the obtained Bartlett correction can perform well even when the assumption of normality is violated.     

Review of Five Multilevel Analysis Programs: BMDP-5V,GENMOD, HLM,ML3, VARCL

A class of statistics is introduced for testing stochastic ordering between two independent distributions. This class includes as a special case the celebrated Mann—Whitney—Wilcoxon statistic. The new class is shown to be asymptotically normal both under the null and nonnull hypotheses. It is distribution-free. Using Pitman's asymptotic efficacy it is shown that for some alternatives the Mann—Whitney—Wilcoxon statistic is the member with the highest efficacy, although for others it is not, and the member with the highest efficacy is identified.     

Foreword (and Preface)

We present new algorithms for computing the exact distributions and p-values of quadratic t-sample distribution-free statistics of Kruskal–Wallis type. These algorithms are presented in terms of generating functions. We show that our algorithm also works for cases with ties and that it is much faster than existing algorithms. Moreover, we show how to use the results for the Kruskal–Wallis type statistics to compute the exact null distribution of the Chacko–Shorack statistic.     

Residual empirical processes for nearly unstable long-memory time series

This paper studies the goodness-of-fit test of the residual empirical process of a nearly unstable long-memory time series. Chan and Ling (2008) showed that the usual limit distribution of the Kolmogorov–Smirnov test statistics does not hold for an unstable autoregressive model. A key question of interest is what happens when this model has a near unit root, that is, when it is nearly unstable. In this paper, it is established that the statistics proposed by Chan and Ling can be generalized to encompass nearly unstable long-memory models. In particular, the limit distribution is expressed as a functional of an Ornstein–Uhlenbeck process that is driven by a fractional Brownian motion. Simulation studies demonstrate that the limit distribution of the statistic possesses desirable finite sample properties and power.     

Distribution-free comparison of hazard rates of two distributions under progressive type-II censoring

Some distribution-free tests have been discussed in the literature with regard to the comparison of hazard rates of two distributions when the available samples are complete. We generalize here Kochar's [S.C. Kochar, A new distribution-free test for the equality of two failure rates, Biometrika 68 (1981), pp. 423–426] test statistic to the case when one available sample is progressively Type-II censored, and then derive its exact null distribution and examine its power properties by means of a Monte Carlo simulation study.     

An exact distribution-free test comparing two multivariate distributions based on adjacency

Summary.  A new test is proposed comparing two multivariate distributions by using distances between observations. Unlike earlier tests using interpoint distances, the new test statistic has a known exact distribution and is exactly distribution free. The interpoint distances are used to construct an optimal non-bipartite matching, i.e. a matching of the observations into disjoint pairs to minimize the total distance within pairs. The cross-match statistic is the number of pairs containing one observation from the first distribution and one from the second. Distributions that are very different will exhibit few cross-matches. When comparing two discrete distributions with finite support, the test is consistent against all alternatives. The test is applied to a study of brain activation measured by functional magnetic resonance imaging during two linguistic tasks, comparing brains that are impaired by arteriovenous abnormalities with normal controls. A second exact distribution-free test is also discussed: it ranks the pairs and sums the ranks of the cross-matched pairs.     

Multivariate goodness-of-fit tests based on statistically equivalent blocks

Various nonparametric procedures are known for the goodness-of-fit test in the univariate case. The distribution-free nature of these procedures does not extend to the multivariate case. In this paper, we consider an application of the theory of statistically equivalent blocks(SEB)to obtain distribution-free procedures for the multivariate case. The sample values are transformed to random variables which are distributed as sample spacings from a uniform distribution on [0, 1], under the null hypothesis. Various test statistics are known, based on the spacings, which are used for testing uniformity in the univariate case. Any of these statistics can be used in the multivariate situation, based on the spacings generated from the SEB. This paper gives an expository development of the theory of SEB and a review of tests for goodness-of-fit, based on sample spacings. To show an application of the SEB, we consider a test of bivariate normality.     

Modified Baumgartner statistics for the two-sample and multisample problems: a numerical comparison

Various non-parametric rank tests based on the Baumgartner statistic have been proposed for testing the location, scale and location–scale parameters. The modified Baumgartner statistics are not suitable for the scale shifts for a two-sample problem. Two modified Baumgartner statistics are proposed by changing the weight function. The suggested statistics are extended to the multisample problem. Some exact critical values of the suggested test statistics are evaluated. Simulations are used to investigate the power of the modified Baumgartner statistics.