An exact two-sample test based on the baumgartner-weiss-schindler statistic and a modification of lepage's test

It is shown that the nonparametric two-saniDle test recently proposed by Baumgartner, WeiB, Schindler (1998, Biometrics, 54, 1129-1135) does not control the type I error rate in case of small sample sizes. We investigate the exact permutation test based on their statistic and demonstrate that this test is almost not conservative. Comparing exact tests, the procedure based on the new statistic has a less conservative size and is, according to simulation results, more powerful than the often employed Wilcoxon test. Furthermore, the new test is also powerful with regard to less restrictive settings than the location-shift model. For example, the test can detect location-scale alternatives. Therefore, we use the test to create a powerful modification of the nonparametric location-scale test according to Lepage (1971, Biometrika, 58, 213-217). Selected critical values for the proposed tests are given.     

Book Reviews

The Levene test is a widely used test for detecting differences in dispersion. The modified Levene transformation using sample medians is considered in this article. After Levene's transformation the data are not normally distributed, hence, nonparametric tests may be useful. As the Wilcoxon rank sum test applied to the transformed data cannot control the type I error rate for asymmetric distributions, a permutation test based on reallocations of the original observations rather than the absolute deviations was investigated. Levene's transformation is then only an intermediate step to compute the test statistic. Such a Levene test, however, cannot control the type I error rate when the Wilcoxon statistic is used; with the Fisher–Pitman permutation test it can be extremely conservative. The Fisher–Pitman test based on reallocations of the transformed data seems to be the only acceptable nonparametric test. Simulation results indicate that this test is on average more powerful than applying the t test after Levene's transformation, even when the t test is improved by the deletion of structural zeros.     

A NONPARAMETRIC TEST FOR THE EQUALITY OF DEPENDENT CORRELATION COEFFICIENTS UNDER NORMALITY

ABSTRACT

A nonparametric testing method for the equality of two correlation coefficients in trivariate normal distribution, namely, one of the variables are common, is discussed. Using a permutation test, we obtain asymptotically exact solutions. The performance of this test is compared with the likelihood ratio test and a method of using the limiting distribution of correlation coefficients.     

A test for the complete independence of high-dimensional random vectors

ABSTRACT

This paper discusses the problem of testing the complete independence of random variables when the dimension of observations can be much larger than the sample size. It is reported that two typical tests based on, respectively, the biggest off-diagonal entry and the largest eigenvalue of the sample correlation matrix lose their control of type I error in such high-dimensional scenarios, and exhibit distinct behaviours in type II error under different types of alternative hypothesis. Given these facts, we propose a permutation test procedure by synthesizing these two extreme statistics. Simulation results show that for finite dimension and sample size the proposed test outperforms the existing methods in various cases.     

Paired permutation testing in 2<Superscript><Emphasis Type="Italic">k</Emphasis></Superscript> unreplicated factorials

Exact permutation testing of effects in unreplicated two-level multifactorial designs is developed based on the notion of realigning observations and on paired permutations. This approach preserves the exchangeability of error components for testing up tok effects. Advantages and limitations of exact permutation procedures for unreplicated factorials are discussed and a simulation study on paired permutation testing is presented.     

A multivariate control median test

In this paper, we extend the univariate control median test to the multivariate case. We apply the permutation principle for the null distribution function of the test statistic and obtain a conditionally nonparametric test procedure. Because of the amount of computational work involved in implementing the test, we consider the normal approximation. We prove the consistency and derive the asymptotic efficiency of our control median test relative to Puri and Sen's median test. Finally, we compare the power of our control median test with those of Hotelling's T² test and Puri and Sen's median test through the simulations.     

On the equivalence of three estimators for dispersion effects in unreplicated two-level factorial designs

Box and Meyer [1986. Dispersion effects from fractional designs. Technometrics 28(1), 19–27] were the first to consider identifying both location and dispersion effects from unreplicated two-level fractional factorial designs. Since the publication of their paper a number of different procedures (both iterative and non-iterative) have been proposed for estimating the location and dispersion effects. An overview and a critical analysis of most of these procedures is given by Brenneman and Nair [2001. Methods for identifying dispersion effects in unreplicated factorial experiments: a critical analysis and proposed strategies. Technometrics 43(4), 388–405]. Under a linear structure for the dispersion effects, non-iterative estimation methods for the dispersion effects were proposed by Brenneman and Nair [2001. Methods for identifying dispersion effects in unreplicated factorial experiments: a critical analysis and proposed strategies. Technometrics 43(4), 388–405], Liao and Iyer [2000. Optimal 2^n-p$2^{n-p}$ fractional factorial designs for dispersion effects under a location-dispersion model. Comm. Statist. Theory Methods 29(4), 823–835] and Wiklander [1998. A comparison of two estimators of dispersion effects. Comm. Statist. Theory Methods 27(4), 905–923] (see also Wiklander and Holm [2003. Dispersion effects in unreplicated factorial designs. Appl. Stochastic. Models Bus. Ind. 19(1), 13–30]). We prove that for two-level factorial designs the proposed estimators are different representations of a single estimator. The proof uses the framework of Seely [1970a. Linear spaces and unbiased estimation. Ann. Math. Statist. 41, 1725–1734], in which quadratic estimators are expressed as inner products of symmetric matrices.     

Notes on Test Homogeneity of the Odds Ratio in Matched Pairs Under Stratified Sampling: A Monte Carlo Evaluation

Using Monte Carlo simulation, we compare the performance of five asymptotic test procedures and a randomized permutation test procedure for testing the homogeneity of odds ratio under the stratified matched-pair design. We note that the weighted-least-square test procedure is liberal, while Pearson's goodness-of-fit (PGF) test procedure with the continuity correction is conservative. We note that PGF without the continuity correction, the conditional likelihood ratio test procedure, and the randomized permutation test procedure can generally perform well with respect to Type I error. We use the data taken from a case–control study regarding the endometrial cancer incidence published elsewhere to illustrate the use of these test procedures.     

A modified Mack–Wolfe test for the umbrella alternative problem

ABSTRACT

The Mack–Wolfe test is the most frequently used non parametric procedure for the umbrella alternative problem. In this paper, modifications of the Mack–Wolfe test are proposed for both known peak and unknown peak umbrellas. The exact mean and variance of the proposed tests in the null hypothesis are also derived. We compare these tests with some of the existing tests in terms of the type I error rate and power. In addition, a real data example is presented.     

Nonparametric test for the homogeneity of the overall variability

In this paper, we propose a nonparametric test for homogeneity of overall variabilities for two multi-dimensional populations. Comparisons between the proposed nonparametric procedure and the asymptotic parametric procedure and a permutation test based on standardized generalized variances are made when the underlying populations are multivariate normal. We also study the performance of these test procedures when the underlying populations are non-normal. We observe that the nonparametric procedure and the permutation test based on standardized generalized variances are not as powerful as the asymptotic parametric test under normality. However, they are reliable and powerful tests for comparing overall variability under other multivariate distributions such as the multivariate Cauchy, the multivariate Pareto and the multivariate exponential distributions, even with small sample sizes. A Monte Carlo simulation study is used to evaluate the performance of the proposed procedures. An example from an educational study is used to illustrate the proposed nonparametric test.     

Optimal partially replicated parallel-flats designs for 2×3 mixed factorial experiments

Augmenting additional repeated runs to an unreplicated factorial design provides an economical scheme of obtaining an unbiased estimate for the error variance based on pure replicates. The augmented partially replicated design usually performs satisfactorily in identifying truly active effects regardless of whether the effect sparsity principle holds. Liao and Chai (2009) proposed a set of sufficient conditions for a partially replicated two-level design to be D-optimal over the class of parallel-flats designs. In this article, we generalize their result to the 2^n₁×3^n₂ mixed factorial under D-, A- and E-optimality, and include the 2ⁿ and 3ⁿ symmetric factorials as special cases. In addition, some examples are given to illustrate the main results.     

A Nonparametric Test Procedure Based on a Group of Quantile Tests

In this article, we consider nonparametric test procedures based on a group of quantile test statistics. We consider the quadratic form for the two-sided test and the maximal and summing types of statistics for the one-sided alternatives. Then we derive the null limiting distributions of the proposed test statistics using the large sample approximation theory. Also, we consider applying the permutation principle to obtain the null distribution. In this vein, we may consider the supremum type, which should use the permutation principle for obtaining the null distribution. Then we illustrate our procedure with an example and compare the proposed tests with other existing tests including the individual quantile tests by obtaining empirical powers through simulation study. Also, we comment on the related discussions to this testing procedure as concluding remarks. Finally we prove the lemmas and theorems in the appendices.     

A non-parametric maximum test for the Behrens–Fisher problem

Non-normality and heteroscedasticity are common in applications. For the comparison of two samples in the non-parametric Behrens–Fisher problem, different tests have been proposed, but no single test can be recommended for all situations. Here, we propose combining two tests, the Welch t test based on ranks and the Brunner–Munzel test, within a maximum test. Simulation studies indicate that this maximum test, performed as a permutation test, controls the type I error rate and stabilizes the power. That is, it has good power characteristics for a variety of distributions, and also for unbalanced sample sizes. Compared to the single tests, the maximum test shows acceptable type I error control.     

Variable Bandwidths for Nonparametric Hazard Rate Estimation

A smoothing parameter inversely proportional to the square root of the true density is known to produce kernel estimates of the density having faster bias rate of convergence. We show that in the case of kernel-based nonparametric hazard rate estimation, a smoothing parameter inversely proportional to the square root of the true hazard rate leads to a mean square error rate of order n ^?8/9, an improvement over the standard second order kernel. An adaptive version of such a procedure is considered and analyzed.     

A nonparametric coherent confidence procedure

ABSTRACT

Holm's step-down testing procedure starts with the smallest p-value and sequentially screens larger p-values without any information on confidence intervals. This article changes the conventional step-down testing framework by presenting a nonparametric procedure that starts with the largest p-value and sequentially screens smaller p-values in a step-by-step manner to construct a set of simultaneous confidence sets. We use a partitioning approach to prove that the new procedure controls the simultaneous confidence level (thus strongly controlling the familywise error rate). Discernible features of the new stepwise procedure include consistency with individual inference, coherence, and confidence estimations for follow-up investigations. In a simple simulation study, the proposed procedure (treated as a testing procedure), is more powerful than Holm's procedure when the correlation coefficient is large, and vice versa when it is small. In the data analysis of a medical study, the new procedure is able to detect the efficacy of Aspirin as a cardiovascular prophylaxis in a nonparametric setting.     

Jackknife empirical likelihood method for testing the equality of two variances

In this paper, we propose a nonparametric method based on jackknife empirical likelihood ratio to test the equality of two variances. The asymptotic distribution of the test statistic has been shown to follow χ² distribution with the degree of freedom 1. Simulations have been conducted to show the type I error and the power compared to Levene's test and F test under different distribution settings. The proposed method has been applied to a real data set to illustrate the testing procedure.     

A NONPARAMETRIC TEST OF CHANGING CONDITIONAL VARIANCES IN AUTOREGRESSIVE TIME SERIES

A nonparametric test for detecting changing conditional variances in stationary AR(p) time series is proposed in this paper. For AR(1) models, the test statistic is a Kolmogorov-Smirnov type statistic and the asymptotic theory is developed under both the null and the alternative hypotheses. For AR(p) models (p ≥ 2), an approximate test procedure is proposed. The empirical upper percentage points for our test are tabulated for both p = 1 and p = 2 cases and a bootstrap procedure is suggested for the p ≥ 3 case. Monte Carlo simulations demonstrate that the test has very good powers for finite samples under both normal and non-normal errors.     

Multivariate two‐sample permutation tests for trials with multiple time‐to‐event outcomes

Clinical trials involving multiple time‐to‐event outcomes are increasingly common. In this paper, permutation tests for testing for group differences in multivariate time‐to‐event data are proposed. Unlike other two‐sample tests for multivariate survival data, the proposed tests attain the nominal type I error rate. A simulation study shows that the proposed tests outperform their competitors when the degree of censored observations is sufficiently high. When the degree of censoring is low, it is seen that naive tests such as Hotelling's T² outperform tests tailored to survival data. Computational and practical aspects of the proposed tests are discussed, and their use is illustrated by analyses of three publicly available datasets. Implementations of the proposed tests are available in an accompanying R package.     

Permutation tests of scale using deviances

Robust tests for comparing scale parameters, based on deviances—absolute deviations from the median—are examined. Higgins (2004) proposed a permutation test for comparing two treatments based on the ratio of deviances, but the performance of this procedure has not been investigated. A simulation study examines the performance of Higgins’ test relative to other tests of scale utilizing deviances that have been shown in the literature to have good properties. An extension of Higgins’ procedure to three or more treatments is proposed, and a second simulation study compares its performance to other omnibus tests for comparing scale. While no procedure emerged as a preferred choice in every scenario, Higgins’ tests are found to perform well overall with respect to Type I error rate and power.     

Nonparametric multiple comparison procedures for unbalanced one-way factorial designs

In this paper, we present several nonparametric multiple comparison (MC) procedures for unbalanced one-way factorial designs. The nonparametric hypotheses are formulated by using normalized distribution functions and the comparisons are carried out on the basis of the relative treatment effects. The proposed test statistics take the form of linear pseudo rank statistics and the asymptotic joint distribution of the pseudo rank statistics for testing treatments versus control satisfies the multivariate totally positive of order two condition irrespective of the correlations among the rank statistics. Therefore, in the context of MCs of treatments versus control, the nonparametric Simes test is validated for the global testing of the intersection hypothesis. For simultaneous testing of individual hypotheses, the nonparametric Hochberg stepup procedure strongly controls the familywise type I error rate asymptotically. With regard to all pairwise comparisons, we generalize various single-step and stagewise procedures to perform comparisons on the relative treatment effects. To further compare with normal theory counterparts, the asymptotic relative efficiencies of the nonparametric MC procedures with respect to the parametric MC procedures are derived under a sequence of Pitman alternatives in a nonparametric location shift model for unbalanced one-way layouts. Monte Carlo simulations are conducted to demonstrate the validity and power of the proposed nonparametric MC procedures.