Two separate effects of variance heterogeneity on the validity and power of significance tests of location

Heterogeneity of variances of treatment groups influences the validity and power of significance tests of location in two distinct ways. First, if sample sizes are unequal, the Type I error rate and power are depressed if a larger variance is associated with a larger sample size, and elevated if a larger variance is associated with a smaller sample size. This well-established effect, which occurs in t and F tests, and to a lesser degree in nonparametric rank tests, results from unequal contributions of pooled estimates of error variance in the computation of test statistics. It is observed in samples from normal distributions, as well as non-normal distributions of various shapes. Second, transformation of scores from skewed distributions with unequal variances to ranks produces differences in the means of the ranks assigned to the respective groups, even if the means of the initial groups are equal, and a subsequent inflation of Type I error rates and power. This effect occurs for all sample sizes, equal and unequal. For the t test, the discrepancy diminishes, and for the Wilcoxon–Mann–Whitney test, it becomes larger, as sample size increases. The Welch separate-variance t test overcomes the first effect but not the second. Because of interaction of these separate effects, the validity and power of both parametric and nonparametric tests performed on samples of any size from unknown distributions with possibly unequal variances can be distorted in unpredictable ways.     

Robust nonparametric tests for the two-sample location problem

We construct and investigate robust nonparametric tests for the two-sample location problem. A test based on a suitable scaling of the median of the set of differences between the two samples, which is the Hodges-Lehmann shift estimator corresponding to the Wilcoxon two-sample rank test, leads to higher robustness against outliers than the Wilcoxon test itself, while preserving its efficiency under a broad range of distributions. The good performance of the constructed test is investigated under different distributions and outlier configurations and compared to alternatives like the two-sample t-, the Wilcoxon and the median test, as well as to tests based on the difference of the sample medians or the one-sample Hodges-Lehmann estimators.     

Comparing Nonparametric Tests of Equality of Means for Randomized Block Designs

A number of nonparametric tests are compared empirically for a randomized block layout. We assess tests appropriate for when the data are not consistent with normality or when outliers invalidate traditional analysis of variance (ANOVA) tests. The objective is to assess, within this setting, tests that use ranks within blocks, the rank transform procedure that ranks the complete sample and continuous analogs of the Cochran–Mantel–Haenszel tests. The usual linear model is assumed, and our primary foci are tests of equality of means and component tests that assess linear and quadratic trends in the means. These tests include the traditional Page and Friedman tests. We conclude that the rank transform tests have competitive power and warrant greater use than is currently apparent.     

A comparison of several adaptive tests for paired data

In the last few years, two adaptive tests for paired data have been proposed. One test proposed by Freidlin et al. [On the use of the Shapiro–Wilk test in two-stage adaptive inference for paired data from moderate to very heavy tailed distributions, Biom. J. 45 (2003), pp. 887–900] is a two-stage procedure that uses a selection statistic to determine which of three rank scores to use in the computation of the test statistic. Another statistic, proposed by O'Gorman [Applied Adaptive Statistical Methods: Tests of Significance and Confidence Intervals, Society for Industrial and Applied Mathematics, Philadelphia, 2004], uses a weighted t-test with the weights determined by the data. These two methods, and an earlier rank-based adaptive test proposed by Randles and Hogg [Adaptive Distribution-free Tests, Commun. Stat. 2 (1973), pp. 337–356], are compared with the t-test and to Wilcoxon's signed-rank test. For sample sizes between 15 and 50, the results show that the adaptive test proposed by Freidlin et al. and the adaptive test proposed by O'Gorman have higher power than the other tests over a range of moderate to long-tailed symmetric distributions. The results also show that the test proposed by O'Gorman has greater power than the other tests for short-tailed distributions. For sample sizes greater than 50 and for small sample sizes the adaptive test proposed by O'Gorman has the highest power for most distributions.     

A comparative study of tests for paired lifetime data

In this paper, we investigate different procedures for testing the equality of two mean survival times in paired lifetime studies. We consider Owen’s M-test and Q-test, a likelihood ratio test, the paired t-test, the Wilcoxon signed rank test and a permutation test based on log-transformed survival times in the comparative study. We also consider the paired t-test, the Wilcoxon signed rank test and a permutation test based on original survival times for the sake of comparison. The size and power characteristics of these tests are studied by means of Monte Carlo simulations under a frailty Weibull model. For less skewed marginal distributions, the Wilcoxon signed rank test based on original survival times is found to be desirable. Otherwise, the M-test and the likelihood ratio test are the best choices in terms of power. In general, one can choose a test procedure based on information about the correlation between the two survival times and the skewness of the marginal survival distributions.     

Sample Size Calculation for Rank Tests Comparing K Survival Distributions

Rank tests, such as logrank or Wilcoxon rank sum tests, have been popularly used to compare survival distributions of two or more groups in the presence of right censoring. However, there has been little research on sample size calculation methods for rank tests to compare more than two groups. An existing method is based on a crude approximation, which tends to underestimate sample size, i.e., the calculated sample size has lower power than projected. In this paper we propose an asymptotically correct method and an approximate method for sample size calculation. The proposed methods are compared to other methods through simulation studies.     

Conditional tests in a competing risks model

Testing for equality of competing risks based on their cumulative incidence functions (CIFs) or their cause specific hazard rates (CSHRs) has been considered by many authors. The finite sample distributions of the existing test statistics are in general complicated and the use of their asymptotic distributions can lead to conservative tests. In this paper we show how to perform some of these tests using the conditional distributions of their corresponding test statistics instead (conditional on the observed data). The resulting conditional tests are initially developed for the case of k = 2 and are then extended to k > 2 by performing a sequence of two sample tests and by combining several risks into one. A simulation study to compare the powers of several tests based on their conditional and asymptotic distributions shows that using conditional tests leads to a gain in power. A real life example is also discussed to show how to implement such conditional tests.     

A Multisample Rank Test for Location-Scale Parameters

One of the multisample problems is discussed in this article. A new multisample rank tests based on a k-sample Baumgartner statistic are proposed for testing the location-scale parameters. The exact critical values of proposed statistics are calculated. Simulations are used to investigate the power of proposed statistics for various population distributions.     

Distributions of test statistics for multiple outliers in exponential samples

Null as well as alternative distributions of two types of statistics used to test for multiple outliers in exponential samples are obtained. Of these two types one is based on the ratio of sum of the observations suspected to be outliers to sum of the sample observations and the other is Dixon's type. Powers of the tests based on these statistics are compared.

     

WILCOXON-TYPE RANK-SUM PRECEDENCE TESTS

This paper introduces Wilcoxon‐type rank‐sum precedence tests for testing the hypothesis that two life‐time distribution functions are equal. They extend the precedence life‐test first proposed by Nelson in 1963. The paper proposes three Wilcoxon‐type rank‐sum precedence test statistics—the minimal, maximal and expected rank‐sum statistics—and derives their null distributions. Critical values are presented for some combinations of sample sizes, and the exact power function is derived under the Lehmann alternative. The paper examines the power properties of the Wilcoxon‐type rank‐sum precedence tests under a location‐shift alternative through Monte Carlo simulations, and it compares the power of the precedence test, the maximal precedence test and Wilcoxon rank‐sum test (based on complete samples). Two examples are presented for illustration.     

On the distribution of the correlation coefficient when sampling from a mixture of two bivariate normal densities: Robustness and the effect of outliers

The distribution of the sample correlation coefficient is derived when the population is a mixture of two bivariate normal distributions with zero mean but different covariances and mixing proportions 1 - λ and λ respectively; λ will be called the proportion of contamination. The test of ρ = 0 based on Student's t, Fisher's z, arcsine, or Ruben's transformation is shown numerically to be nonrobust when λ, the proportion of contamination, lies between 0.05 and 0.50 and the contaminated population has 9 times the variance of the standard (bivariate normal) population. These tests are also sensitive to the presence of outliers.     

Tests for cointegration rank and choice of the alternative

This paper discusses likelihood-ratio (LR) tests on the cointegrating (CI) rank which consider any possible dimension of the CI rank under the alternative. The trace test and lambda-max test are obtained as special cases. Limit quantiles for all the tests in the class are derived. It is found that any of these tests can be used to construct an estimator of the CI rank, with no differences in asymptotic properties when the alternative is fixed. The properties of the class of tests are investigated by local asymptotic analysis, a simulation study and an empirical illustration. It is found that all the tests in the class have comparable power, which deteriorates substantially as the number of random walks increases. Tests constructed for a specific class of alternatives present minor power gains for alternatives in the class, and require the alternative to be far from the null. No test in this class is found to be asymptotically (in-)admissible. Some of the new tests in the class can also be arranged to give a constrained estimator of the CI rank, that restricts the minimum number of common trends. The power gains that these tests can obtain by constraining the minimum number of common trends appears to be limited and outweighted by the risk of inconsistency induced by the constrains. As a consequence, no value of the CI rank should be left untested, unless it can be excluded beyond any reasonable doubt.     

Simultaneous inference based on rank statistics in linear models

A class of simultaneous tests based on the aligned rank transform (ART) statistics is proposed for linear functions of parameters in linear models. The asymptotic distributions are derived. The stability of the finite sample behaviour of the sampling distribution of the ART technique is studied by comparing the simulated upper quantiles of its sampling distribution with those of the multivariate t-distribution. Simulation also shows that the tests based on ART have excellent small sample properties and because of their robustness perform better than the methods based on the least-squares estimates.     

An adaptive test for the one-way layout

An adaptive test is proposed for the one-way layout. This test procedure uses the order statistics of the combined data to obtain estimates of percentiles, which are used to select an appropriate set of rank scores for the one-way test statistic. This test is designed to have reasonably high power over a range of distributions. The adaptive procedure proposed for a one-way layout is a generalization of an existing two-sample adaptive test procedure. In this Monte Carlo study, the power and significance level of the F-test, the Kruskal-Wallis test, the normal scores test, and the adaptive test were evaluated for the one-way layout. All tests maintained their significance level for data sets having at least 24 observations. The simulation results show that the adaptive test is more powerful than the other tests for skewed distributions if the total number of observations equals or exceeds 24. For data sets having at least 60 observations the adaptive test is also more powerful than the F-test for some symmetric distributions.     

The two-sample problem with multivariate censored data: a new rank test family

A new rank test family is proposed to test the equality of two multivariate failure times distributions with censored observations. The tests are very simple: they are based on a transformation of the multivariate rank vectors to a univariate rank score and the resulting statistics belong to the familiar class of the weighted logrank test statistics. The new procedure is also applicable to multivariate observations in general, such as repeated measures, some of which may be missing. To investigate the performance of the proposed tests, a simulation study was conducted with bivariate exponential models for various censoring rates. The size and power of these tests against Lehmann alternatives were compared to the size and power of two other tests (Wei and Lachin, 1984 and Wei and Knuiman, 1987). In all simulations the new procedures provide a relatively good power and an accurate control over the size of the test. A real example from the National Cooperative Gallstone Study is given     

Effect of outliers on the GFI quality adjustment index in structural equation model and proposal of alternative indices

This work is intended to suggest modifications in the construction of the GFI index using robust methods for estimating the unrestricted sample covariance matrix, leading to new indices called GFI_(MCD) and GFI_(MVE). The validation of this proposal was made using Monte Carlo simulation methods, considering differences between the unrestricted sample covariance matrix and those imposed by the structural model, and different numbers of outliers generated by distributions with deviations from symmetry and excess kurtosis. It was concluded that for larger samples size (n ? 100), given that the outliers are from distributions that are symmetrical, the GFI_(MCD) and GFI_(MVE) present similar results, including samples with high percentages of outliers.     

Comparing the Survival of Two Groups with an Intermediate Clinical Event

Consider a subject entered on a clinicaltrial in which the major endpoint is a time metric such as deathor time to reach a well defined event. During the observationalperiod the subject may experience an intermediate clinical event.The intermediate clinical event may induce a change in the survivaldistribution. We consider models for the one and two sample problem.The model for the one sample problem enables one to test if theoccurrence of the intermediate event changed the survival distribution.This models provides a way of carrying out non-randomized clinicaltrial to determine if a therapy has benefit. The two sample problemconsiders testing if the probability distributions, with andwithout an intermediate event, are the same. Statistical testsare derived using a semi-Markov or a time dependent mixture model.Simulation studies are carried out to compare these new procedureswith the log rank, stratified log rank and landmark tests. Thenew tests appear to have uniformly greater power than these competitortests. The methods are applied to a randomized clinical trialcarried out by the Aids Clinical Trial Group (ACTG) which comparedlow versus high doses of zidovudine (AZT).     

An Affine-Invariant Generalization of the Wilcoxon Signed-Rank Test for the Bivariate Location Problem

This paper proposes an affine‐invariant test extending the univariate Wilcoxon signed‐rank test to the bivariate location problem. It gives two versions of the null distribution of the test statistic. The first version leads to a conditionally distribution‐free test which can be used with any sample size. The second version can be used for larger sample sizes and has a limiting χ₂² distribution under the null hypothesis. The paper investigates the relationship with a test proposed by Jan & Randles (1994). It shows that the Pitman efficiency of this test relative to the new test is equal to 1 for elliptical distributions but that the two tests are not necessarily equivalent for non‐elliptical distributions. These facts are also demonstrated empirically in a simulation study. The new test has the advantage of not requiring the assumption of elliptical symmetry which is needed to perform the asymptotic version of the Jan and Randles test.     

NONPARAMETRIC TWO SAMPLE TESTS BASED ON AREA STATISTICS

ABSTRACT

Area statistics are sample versions of areas occurring in a probability plot of two distribution functions F and G. This paper presents a unified basis for five statistics of this type. They can be used for various testing problems in the framework of the two sample problem for independent observations, such as testing equality of distributions against inequality or testing stochastic dominance of distributions in one or either direction against nondominance. Though three of the statistics considered have already been suggested in literature, two of them are new and deserve our interest. The finite sample distributions of the statistics (under F=G) can be calculated via recursion formulae. Two tables with critical values of the new statistics are included. The asymptotic distribution of the properly normalized versions of the area statistics are functionals of the Brownian bridge. The distribution functions and quantiles thereof are obtained by Monte Carlo simulation. Finally, the power functions of the two new tests based on area statistics are compared to the power functions of the tests based on the corresponding supremum statistics, i.e., statistics of the Kolmogorov–Smirnov type.     

Wavelet Estimation of an Unknown Function Observed with Correlated Noise

Tests based on rank statistics are introduced to test for systematic changes in a sequence of independent observations. Proposed tests include a rank test analogous to the parametric likelihood ratio test and others analogous to parametric Bayes tests. The tests are usable with either one- or two-sided alternative hypotheses, and their asymptotic distributions are studied. The results of the general model are applied to two special cases, and their asymptotic distributions are also investigated. A Monte Carlo study verifies the applicability of asymptotic critical points in samples of moderate size, and other simulation studies compare power of the competing tests and their special-case versions. Finally, these tests are applied to a data set of traffic fatalities.