A Monte Carlo study of REML and robust rank-based analyses for the random intercept mixed model

Restricted maximum likelihood (REML) methods are traditionally used for analyzing mixed models. Based on a multivariate normal likelihood, these analyses are sensitive to outliers. Recently developed robust rank-based procedures offer a complete analysis of mixed model: estimation of fixed effects, standard errors, and estimation of variance components. The results of a large Monte Carlo study are presented, comparing these two analyses for many situations over multivariate normal and contaminated normal distributions. The rank-based analyses are much more powerful and efficient than the REML analyses over all non-normal situations, while losing little power for normal errors.     

A CONTINUOUSLY ADAPTIVE RANK TEST FOR SHIFT IN LOCATION

This paper considers the problem of testing for shift in location when the symmetry of the underlying distribution is in doubt. Various adaptive test procedures have been suggested in the literature; they are mainly based on a preliminary test or measure of asymmetry, and then choosing between the sign or the Wilcoxon tests accordingly. However, as this paper demonstrates, there are some disadvantages with such procedures. This paper develops a test that does not suffer from such disadvantages. The proposed test is based on modifying the Wilcoxon scores according to the evidence of asymmetry of the distribution present in the data as indicated by the magnitude of the P‐value from a preliminary test of symmetry. A simulation study investigates and compares the performance of the proposed test and other known adaptive procedures in terms of power and attainment of the nominal size. The performance of a suitable bootstrap procedure for the situation under consideration is also studied. In most cases under consideration, the proposed test is found to be superior to the other tests.     

An Improved Method on Wilcoxon Rank Sum Test for Gene Selection from Microarray Experiments

Selecting a small subset out of the thousands of genes in microarray data is important for accurate classification of phenotypes. In this paper, we propose a flexible rank-based nonparametric procedure for gene selection from microarray data. In the method we propose a statistic for testing whether area under receiver operating characteristic curve (AUC) for each gene is equal to 0.5 allowing different variance for each gene. The contribution to this “single gene” statistic is the studentization of the empirical AUC, which takes into account the variances associated with each gene in the experiment. Delong et al. proposed a nonparametric procedure for calculating a consistent variance estimator of the AUC. We use their variance estimation technique to get a test statistic, and we focus on the primary step in the gene selection process, namely, the ranking of genes with respect to a statistical measure of differential expression. Two real datasets are analyzed to illustrate the methods and a simulation study is carried out to assess the relative performance of different statistical gene ranking measures. The work includes how to use the variance information to produce a list of significant targets and assess differential gene expressions under two conditions. The proposed method does not involve complicated formulas and does not require advanced programming skills. We conclude that the proposed methods offer useful analytical tools for identifying differentially expressed genes for further biological and clinical analysis.     

Controlling Type-I Error Rate in Monitoring Structural Changes Using Partially Sequential Procedures

In the present article, we develop some asymptotically power on partially sequential nonparametric tests for monitoring structural changes. Our test procedures are based on Wilcoxon score. We use the idea of curved stopping boundaries. We derive some exact results and perform simulation studies to provide various properties of the tests. We see that one of the proposed procedures significantly controls the Type I error rate. This procedure may be very effective for fluctuation monitoring. We illustrate the procedures by using real life data from the stock market.     

Critical Values for the Robust Rank-Order Test

ABSTRACT

The nonparametric Wilcoxon–Mann–Whitney test is commonly used by practitioners for detecting differences in location (mean, median) between two samples. Earlier work has shown this test to have a number of disadvantages, most of which are remedied by use of the alternative robust rank-order test. Use of the robust rank-order test has been limited, perhaps partly because exact critical values have up to now been available for only a small number of sample-size values, and not for all of the commonly used levels of significance. This article expands what is known about the distribution of the robust rank-order test statistic; critical values are given for more sample sizes and for more levels of significance.     

A new method for the comparison of survival distributions

The assessment of overall homogeneity of time‐to‐event curves is a key element in survival analysis in biomedical research. The currently commonly used testing methods, e.g. log‐rank test, Wilcoxon test, and Kolmogorov–Smirnov test, may have a significant loss of statistical testing power under certain circumstances. In this paper we propose a new testing method that is robust for the comparison of the overall homogeneity of survival curves based on the absolute difference of the area under the survival curves using normal approximation by Greenwood's formula. Monte Carlo simulations are conducted to investigate the performance of the new testing method compared against the log‐rank, Wilcoxon, and Kolmogorov–Smirnov tests under a variety of circumstances. The proposed new method has robust performance with greater power to detect the overall differences than the log‐rank, Wilcoxon, and Kolmogorov–Smirnov tests in many scenarios in the simulations. Furthermore, the applicability of the new testing approach is illustrated in a real data example from a kidney dialysis trial. Copyright © 2009 John Wiley & Sons, Ltd.     

Letters to the Editor

Although several authors have indicated that the median test has low power in small samples, it continues to be presented in many statistical textbooks, included in a number of popular statistical software packages, and used in a variety of application areas. We present results of a power simulation study that shows that the median test has noticeably lower power, even for the double exponential distribution for which it is asymptotically most powerful, than other readily available rank tests. We suggest that the median test be “retired” from routine use and recommend alternative rank tests that have superior power over a relatively large family of symmetric distributions.     

One sample tests of location for nonnormal symmetric data

A score test of location is derived for data from a distorted normal distribution. A simulation study compares the performance of this test to the t-test and Wilcoxon test for symmetric data from such a distribution. For this type of data the score test can be considerably more powerful than both the t-test and Wilcoxon test. This suggests that such a score test may be useful in practice when variations from normality can be modeled by such a family of distributions.     

Adaptive Procedures for the Wilcoxon–Mann–Whitney Test: Seven Decades of Advances

The Wilcoxon–Mann–Whitney test has dominated non parametric analyses in behavioral sciences for the past seven decades. Its widespread use masks the fact that there exist simple “adaptive” procedures which use data-dependent statistical decision rules to select an optimal non parametric test. This paper discusses key adaptive approaches for testing differences in locations in two-sample environments. Our Monte Carlo analysis shows that adaptive procedures often perform substantially better than t-tests, even with moderately sized samples (80 observations). We illustrate adaptive approaches using data from Gneezy and Smorodinsky (2006 Gneezy, U., Smorodinsky, R. (2006). All-pay auctions: an experimental study. J. Economic Behav. Organizat. 61(2): 255275.[Crossref], [Web of Science ®] , [Google Scholar]), and offer a Stata package to researchers interested in taking advantage of these techniques.     

Simple Robust Tests for Autocorrelated Errors in Time Series Design Intervention Models

A simple, robust test for the autocorrelation parameter in an intervention time-series model (AB design) is proposed. It is analogous to the traditional tests and can easily be computed by using the freeware R. In the same way as traditional tests of autocorrelation are based on least squares (LS) fits of a linear model, our robust test is based on the highly efficient Wilcoxon fit of the linear model. We present the results of a Monte Carlo study which show that our robust test inherits the good efficiency properties of this Wilcoxon fit. Its empirical power is only slightly less than the empirical power of the least squares test over situations with normally distributed errors while it exhibited much more power over situations with error distributions having tails heavier than those of a normal distribution. It also showed robustness of validity over all null situations simulated. We also present the results of the application of our test to a real data set which illustrates the robustness of our test.