The sample breakdown points of tests

Several authors have taken the worst case breakdown measures in analyzing the robustness of a test. In general, these kinds of measures give only a rough picture of breakdown robustness of a test. To overcome this limitation, a new kind of breakdown measure of a test is defined as the smallest proportion of arbitrary outliers in the sample that can distort the test decision. It is called as the sample breakdown point of a test in this paper. A distinct advantage of this new measure is that it is directly concerned with the test decision based on the present sample and with the critical region of the test. The sample breakdown points of several commonly used tests of one-sided or two-sided hypotheses are calculated and their asymptotic properties are also established. By Monte Carlo simulations and asymptotic analysis, we show that the acceptance breakdown of the t-test and the Hotelling T²-test is slightly better than that of the sample mean test. Finally, we prove that, for a one-sided hypothesis testing of location, the sign test has the maximum sample breakdown points asymptotically within a class of M-tests and score-tests.     

An Empirical Analysis of Some Nonparametric Goodness-of-Fit Tests for Censored Data

In this article, we consider some nonparametric goodness-of-fit tests for right censored samples, viz., the modified Kolmogorov, Cramer–von Mises–Smirnov, Anderson–Darling, and Nikulin–Rao–Robson χ² tests. We also consider an approach based on a transformation of the original censored sample to a complete one and the subsequent application of classical goodness-of-fit tests to the pseudo-complete sample. We then compare these tests in terms of power in the case of Type II censored data along with the power of the Neyman–Pearson test, and draw some conclusions. Finally, we present an illustrative example.     

Non-parametric testing for the number of change points in a sequence of independent random variables

A non-parametric procedure is derived for testing for the number of change points in a sequence of independent continuously distributed variables when there is no prior information available. The procedure is based on the Kruskal–Wallis test, which is maximized as a function of all possible places of the change points. The procedure consists of a sequence of non-parametric tests of nested hypotheses corresponding to a decreasing number of change points. The properties of this procedure are analyzed by Monte Carlo methods and compared to a parametric procedure for the case that the variables are exponentially distributed. The critical values are given for sample sizes up to 200.     

A note on a parametric extension of rank tests to the analysis of multifactor experiments within blocks

A general rank test procedure based on an underlying multinomial distribution is suggested for randomized block experiments with multifactor treatment combinations within each block. The Wald statistic for the multinomial is used to test hypotheses about the within–block rankings. This statistic is shown to be related to the one–sample Hotellingt's T² statistic, suggesting a method for computing the test statistic using the standard statistical computer packages.     

Small sample performance of large sample tests for tobit versus p -tobit

Large sample tests for the standard To bit model versus the ^p -Tobit model by Deaton and Irish (1984) are studied. The normalized one-tailed score test by Deaton and Irish (1984) is shown to be a version of Neyman's C(α) test that is valid for the non-standard problem of the null hypothesis lying on the boundary of the parameter space. Then, this paper reports the results of Monte Carlo experiments designed to study the small sample performance of large sample tests for the standard Tobit specification versus the ^p -Tobit specification.     

A NEW TEST FOR EQUALITY OF VARIANCES FOR k NORMAL POPULATIONS

ABSTRACT

A simple test based on Gini's mean difference is proposed to test the hypothesis of equality of population variances. Using 2000 replicated samples and empirical distributions, we show that the test compares favourably with Bartlett's and Levene's test for the normal population. Also, it is more powerful than Bartlett's and Levene's tests for some alternative hypotheses for some non-normal distributions and more robust than the other two tests for large sample sizes under some alternative hypotheses. We also give an approximate distribution to the test statistic to enable one to calculate the nominal levels and P-values.     

Small sample efficiencies of tests based on the method of n rankings

A method is proposed for calculating the small sample powers of rank tests which are based on the method of n rankings. A class of normal shift alternative hypotheses is considered, and Hodges–Lehmann efficiencies are calculated for the Friedman test.     

A class of distribution-free tests for the two-sample slippage problem

A class of distribution-free tests for the two-sample slippage problem, when the random variables take only nonnegative values, is proposed. These tests are consistent and unbiased against the general slippage alternative. Recurrence relations for generating small sample significance points are given. The tests have been compared with the Savage test, the Wilcoxon test and the appropriate locally most powerful rank test by considering Pitman asymptotic relative efficiencies for several alternative hypotheses. Some of these tests exhibit considerable robustness in terms of efficiency for the various alternative hypotheses which are considered.     

Goodness-of-fit tests for location–scale families based on random distance

For location–scale families, we consider a random distance between the sample order statistics and the quasi sample order statistics derived from the null distribution as a measure of discrepancy. The conditional qth quantile and expectation of the random discrepancy on the given sample are chosen as test statistics. Simulation results of powers against various alternatives are illustrated under the normal and exponential hypotheses for moderate sample size. The proposed tests, especially the qth quantile tests with a small or large q, are shown to be more powerful than other prominent goodness-of-fit tests in most cases.     

Two-stage tests of hypotheses in the general linear model

Two-stage (double sample) tests of hypotheses are presented for testing linear hypotheses in the general linear model. General and one-sided alternatives are considered. Computational techniques for computing critical points are discussed. Tables of critical points are presented. An example suggests that two-stage tests can achieve the same power as a fixed sample size test while reducing considerably the expected number of observations required for the test     

A Correlation Test for Normality Based on the Lévy Characterization

A powerful test of fit for normal distributions is proposed. Based on the Lévy characterization, the test statistic is the sample correlation coefficient of normal quantiles and sums of pairs of observations from a random sample. Since the test statistic is location-scale invariant, critical values can be obtained by simulation without estimating any parameters. It is proved that this test is consistent. A power comparison study including some directed tests shows that the proposed test is competitive, it is more powerful than the well-known Jarque–Bera test, and it is comparable to Shapiro–Wilk test against a number of alternatives.     

A tool for systematically comparing the power of tests for normality

In this article, we describe a new approach to compare the power of different tests for normality. This approach provides the researcher with a practical tool for evaluating which test at their disposal is the most appropriate for their sampling problem. Using the Johnson systems of distribution, we estimate the power of a test for normality for any mean, variance, skewness, and kurtosis. Using this characterization and an innovative graphical representation, we validate our method by comparing three well-known tests for normality: the Pearson χ² test, the Kolmogorov–Smirnov test, and the D'Agostino–Pearson K ² test. We obtain such comparison for a broad range of skewness, kurtosis, and sample sizes. We demonstrate that the D'Agostino–Pearson test gives greater power than the others against most of the alternative distributions and at most sample sizes. We also find that the Pearson χ² test gives greater power than Kolmogorov–Smirnov against most of the alternative distributions for sample sizes between 18 and 330.     

A new test for the mean vector in large dimension and small samples

In this article, we consider the problem of testing the mean vector in the multivariate normal distribution, where the dimension p is greater than the sample size N. We propose a new test T_Block and obtain its asymptotic distribution. We also compare the proposed test with other two tests. The simulation results suggest that the performance of the new test is comparable to the existing two tests, and under some circumstances it may have higher power. Therefore, the new statistic can be employed in practice as an alternative choice.     

RAO'S SCORE TESTS IN SURVIVAL ANALYSIS: EXAMPLES AND BARTLETT TYPE ADJUSTMENTS

Score method in hypothesis testing is one of Professor C. R. Rao's great contributions to statistics. It provides a simple and unified way to test some simple and composite hypotheses in many statistical problems. Some popular tests in statistical practice derived with the help of intuitions can be shown as score tests under some statistical models. The subject-years test and log-rank test in survival analysis are two of the examples. In this paper, we first introduce these two examples. After formulating these two tests as score tests, we then review some recent results on the Bartlett type adjustments for these tests.     

The power of the modified Wilcoxon rank-sum test for the one-sided alternative

When testing hypotheses in two-sample problems, the Wilcoxon rank-sum test is often used to test the location parameter, and this test has been discussed by many authors over the years. One modification of the Wilcoxon rank-sum test was proposed by Tamura [On a modification of certain rank tests. Ann Math Stat. 1963;34:1101–1103]. Deriving the exact critical value of the statistic is difficult when the sample sizes are increased. The normal approximation, the Edgeworth expansion, the saddlepoint approximation, and the permutation test were used to evaluate the upper tail probability for the modified Wilcoxon rank-sum test given finite sample sizes. The accuracy of various approximations to the probability of the modified Wilcoxon statistic was investigated. Simulations were used to investigate the power of the modified Wilcoxon rank-sum test for the one-sided alternative with various population distributions for small sample sizes. The method was illustrated by the analysis of real data.     

Testing for normality in linear regression models

The importance of the normal distribution for fitting continuous data is well known. However, in many practical situations data distribution departs from normality. For example, the sample skewness and the sample kurtosis are far away from 0 and 3, respectively, which are nice properties of normal distributions. So, it is important to have formal tests of normality against any alternative. D'Agostino et al. [A suggestion for using powerful and informative tests of normality, Am. Statist. 44 (1990), pp. 316–321] review four procedures Z ²(g ₁), Z ²(g ₂), D and K ² for testing departure from normality. The first two of these procedures are tests of normality against departure due to skewness and kurtosis, respectively. The other two tests are omnibus tests. An alternative to the normal distribution is a class of skew-normal distributions (see [A. Azzalini, A class of distributions which includes the normal ones, Scand. J. Statist. 12 (1985), pp. 171–178]). In this paper, we obtain a score test (W) and a likelihood ratio test (LR) of goodness of fit of the normal regression model against the skew-normal family of regression models. It turns out that the score test is based on the sample skewness and is of very simple form. The performance of these six procedures, in terms of size and power, are compared using simulations. The level properties of the three statistics LR, W and Z ²(g ₁) are similar and close to the nominal level for moderate to large sample sizes. Also, their power properties are similar for small departure from normality due to skewness (γ₁≤0.4). Of these, the score test statistic has a very simple form and computationally much simpler than the other two statistics. The LR statistic, in general, has highest power, although it is computationally much complex as it requires estimates of the parameters under the normal model as well as those under the skew-normal model. So, the score test may be used to test for normality against small departure from normality due to skewness. Otherwise, the likelihood ratio statistic LR should be used as it detects general departure from normality (due to both skewness and kurtosis) with, in general, largest power.     

Data-driven smooth tests for the extreme value distribution

In this paper we present data-driven smooth tests for the extreme value distribution. These tests are based on a general idea of construction of data-driven smooth tests for composite hypotheses introduced by Inglot, T., Kallenberg, W. C. M. and Ledwina, T. [(1997). Data-driven smooth tests for composite hypotheses. Ann. Statist., 25, 1222–1250] and its modification for location-scale family proposed in Janic-Wróblewska, A. [(2004). Data-driven smooth test for a location-scale family. Statistics, in press]. Results of power simulations show that the newly introduced test performs very well for a wide range of alternatives and is competitive with other commonly used tests for the extreme value distribution.     

Small sample power of multivariate nonparametric tests for monotone trend

Bhattacharyya and Kioiz (1966) propose two multivariate nonparametric tests for monotone trend, one involving coordinate-wise Mann statistics and the other, coordinate-wise Spearman statistics. Dietz and Killeen (1981) propose a different test statistic based on coordinate-wise Mann statistics. The Pitman asymptotic relative efficiency of all three tests with respect to a normal theory competitor equals the cube root of the efficiency of a multivariate signed rank test with respect to Hotelling's T2. In this article, the small sample power of the nonparametric tests, the normal theory test, and a Bonferroni approach involving coordinate-wise univariate Mann or Spearman tests is examined in a simulation study. The Mann statistic of Dietz and Killeen and the Spearman statistic of Bhattacharyya and Klotz are found to perform well under both null and alternative hypotheses     

Monte carlo sampling approach to testing nonnested hypothesis: monte carlo results

Alternative ways of using Monte Carlo methods to implement a Cox-type test for separate families of hypotheses are considered. Monte Carlo experiments are designed to compare the finite sample performances of Pesaran and Pesaran's test, a RESET test, and two Monte Carlo hypothesis test procedures. One of the Monte Carlo tests is based on the distribution of the log-likelihood ratio and the other is based on an asymptotically pivotal statistic. The Monte Carlo results provide strong evidence that the size of the Pesaran and Pesaran test is generally incorrect, except for very large sample sizes. The RESET test has lower power than the other tests. The two Monte Carlo tests perform equally well for all sample sizes and are both clearly preferred to the Pesaran and Pesaran test, even in large samples. Since the Monte Carlo test based on the log-likelihood ratio is the simplest to calculate, we recommend using it.