A permutation test for umbrella alternatives

There is a wide variety of stochastic ordering problems where K groups (typically ordered with respect to time) are observed along with a (continuous) response. The interest of the study may be on finding the change-point group, i.e. the group where an inversion of trend of the variable under study is observed. A change point is not merely a maximum (or a minimum) of the time-series function, but a further requirement is that the trend of the time-series is monotonically increasing before that point, and monotonically decreasing afterwards. A suitable solution can be provided within a conditional approach, i.e. by considering some suitable nonparametric combination of dependent tests for simple stochastic ordering problems. The proposed procedure is very flexible and can be extended to trend and/or repeated measure problems. Some comparisons through simulations and examples with the well known Mack & Wolfe test for umbrella alternative and with Page’s test for trend problems with correlated data are investigated.     

The one-way analysis of variance with ordered alternatives: A modification of bartholomew's Ē2 Test

Tests of homogeneity of normal means with the alternative restricted by an ordering on the means are considered. The simply ordered case, μ₁ ≤ μ₂ ≤ ··· ≤ μ_k, and the simple tree ordering, μ₁ ≤ μ_j, for; j= 2, 3,…, k, are emphasized. A modification of the likelihood-ratio test is proposed which is asymptotically equivalent to it but is more robust to violations of the hypothesized orderings. The new test has power at the points satisfying the hypothesized ordering which is similar to that of the likelihood-ratio test provided the degrees of freedom are not too small. The modified test is shown to be unbiased and consistent.     

A modified chi-square test for testing equality of two multinomial populations against an order restricted alternative

A modified chi-square test for testing the equality of two multinomial populations against an order restricted alternative in one sample and two sample cases is constructed. The relation between the concepts of dependence by cM-square and stochastic ordering is established, The asymptotic distribution of the test statistic is the chi-bar-square type discussed by Robertson, Wright and Dykstra (1988). Simulations are used to compare the power of this test with the power of the likelihood ratio test of stochastic ordering of the two multinomial populations.     

A modified Mack–Wolfe test for the umbrella alternative problem

ABSTRACT

The Mack–Wolfe test is the most frequently used non parametric procedure for the umbrella alternative problem. In this paper, modifications of the Mack–Wolfe test are proposed for both known peak and unknown peak umbrellas. The exact mean and variance of the proposed tests in the null hypothesis are also derived. We compare these tests with some of the existing tests in terms of the type I error rate and power. In addition, a real data example is presented.     

DISTRIBUTION-FREE CONFIDENCE PROCEDURE FOR UMBRELLA ORDERINGS

Responses in a one-factor experiment with A; ordered treatments follow an umbrella, ordering if they consist of two piecewise monotone segments, i.e. increasing and then decreasing, or the converse. This paper proposes a non-parametric distribution-free confidence procedure for umbrella orderings, the aim being to identify the treatments that correspond to the optimal effects. It uses a method that joins the seemingly unrelated theories of U-statistics and isotonic regression. A random confidence subset of the ordered treatments is constructed, such that it contains all the unknown peaks (optimal treatments) of an umbrella ordering with any prespecified confidence level. The paper demonstrates that the proposed confidence procedure is nonparametric distribution-free and, further, that the proposed procedure naturally implies a test for umbrella alternatives. Since the proposed confidence procedure is always more informative than tests for umbrella alternatives, it should be used in their place in practice. An example illustrates the proposed procedure.     

An optimal sign test for one-sample bivariate location model using an alternative bivariate ranked-set sample

The aim of this paper is to find an optimal alternative bivariate ranked-set sample for one-sample location model bivariate sign test. Our numerical and theoretical results indicated that the optimal designs for the bivariate sign test are the alternative designs with quantifying order statistics with labels {((r+1)/2, (r+1)/2)}, when the set size r is odd and {(r/2+1, r/2), (r/2, r/2+1)} when the set size r is even. The asymptotic distribution and Pitman efficiencies of these designs are derived. A simulation study is conducted to investigate the power of the proposed optimal designs. Illustration using real data with the Bootstrap algorithm for P-value estimation is used.     

EXACT P‐VALUES FOR DISCRETE MODELS OBTAINED BY ESTIMATION AND MAXIMIZATION

In constructing exact tests from discrete data, one must deal with the possible dependence of the P‐value on nuisance parameter(s) ψ as well as the discreteness of the sample space. A classical but heavy‐handed approach is to maximize over ψ. We prove what has previously been understood informally, namely that maximization produces the unique and smallest possible P‐value subject to the ordering induced by the underlying test statistic and test validity. On the other hand, allowing for the worst case will be more attractive when the P‐value is less dependent on ψ. We investigate the extent to which estimating ψ under the null reduces this dependence. An approach somewhere between full maximization and estimation is partial maximization, with appropriate penalty, as introduced by Berger & Boos (1994, P values maximized over a confidence set for the nuisance parameter. J. Amer. Statist. Assoc. 89 , 1012–1016). It is argued that estimation followed by maximization is an attractive, but computationally more demanding, alternative to partial maximization. We illustrate the ideas on a range of low‐dimensional but important examples for which the alternative methods can be investigated completely numerically.     

A robust modification of the ordered-heterogeneity test

An ordered heterogeneity (OH) test is a test for a trend that combines a non-directional heterogeneity test with the rank-order information specified under the alternative. We propose two modifications of the OH test procedure: (1) to use the mean ranks of the groups rather than the sample means to determine the observed ordering of the groups, and (2) to use the maximum correlation out of the 2^k???1 – 1 possibilities under the alternative rather than the single ordering (1, 2, … , k), where k is the number of independent groups. A simulation study indicates that these two changes increase the power of the ordered heterogeneity test when, as common in practice, the underlying distribution may deviate from a normal distribution and the trend pattern is a priori unknown. In contrast to the original OH test, the modified OH test can detect all possible patterns under the alternative with a relatively high power.     

Maximum studentized score tests for the detection of outliers in time series regression models

Efficient score tests exist among others, for testing the presence of additive and/or innovative outliers that are the result of the shifted mean of the error process under the regression model. A sample influence function of autocorrelation-based diagnostic technique also exists for the detection of outliers that are the result of the shifted autocorrelations. The later diagnostic technique is however not useful if the outlying observation does not affect the autocorrelation structure but is generated due to an inflation in the variance of the error process under the regression model. In this paper, we develop a unified maximum studentized type test which is applicable for testing the additive and innovative outliers as well as variance shifted outliers that may or may not affect the autocorrelation structure of the outlier free time series observations. Since the computation of the p-values for the maximum studentized type test is not easy in general, we propose a Satterthwaite type approximation based on suitable doubly non-central F-distributions for finding such p-values [F.E. Satterthwaite, An approximate distribution of estimates of variance components, Biometrics 2 (1946), pp. 110–114]. The approximations are evaluated through a simulation study, for example, for the detection of additive and innovative outliers as well as variance shifted outliers that do not affect the autocorrelation structure of the outlier free time series observations. Some simulation results on model misspecification effects on outlier detection are also provided.     

A Method for Designing Three-Hypothesis Test Problems and Sequential Schemes

In applications, a two-sided hypothesis test problem sometimes needs to be changed to a three-hypothesis one with the two alternative hypotheses properly selected. In this article, we obtain the hypothesis design and the three-hypothesis sequential test scheme under the Koopman–Darmois distribution by solving a system of equations that meet requirements on the error rates and average sample number. This method provides a useful guide for practitioners to design hypotheses in multihypothesis test problems with controlled error rates and sampling cost. Formulas of the scheme's error rates and average sample number are obtained using numerical quadrature for the discrete-time situation.     

Testing linear hypotheses in high-dimensional regressions

For a multivariate linear model, Wilk's likelihood ratio test (LRT) constitutes one of the cornerstone tools. However, the computation of its quantiles under the null or the alternative hypothesis requires complex analytic approximations, and more importantly, these distributional approximations are feasible only for moderate dimension of the dependent variable, say p≤20. On the other hand, assuming that the data dimension p as well as the number q of regression variables are fixed while the sample size n grows, several asymptotic approximations are proposed in the literature for Wilk's Λ including the widely used chi-square approximation. In this paper, we consider necessary modifications to Wilk's test in a high-dimensional context, specifically assuming a high data dimension p and a large sample size n. Based on recent random matrix theory, the correction we propose to Wilk's test is asymptotically Gaussian under the null hypothesis and simulations demonstrate that the corrected LRT has very satisfactory size and power, surely in the large p and large n context, but also for moderately large data dimensions such as p=30 or p=50. As a byproduct, we give a reason explaining why the standard chi-square approximation fails for high-dimensional data. We also introduce a new procedure for the classical multiple sample significance test in multivariate analysis of variance which is valid for high-dimensional data.     

On the Comparison of Two Ordinal Responses

Responses of two groups, measured on the same ordinal scale, are compared through the column effect association model, applied on the corresponding 2 × J contingency table. Monotonic or umbrella shaped ordering for the scores of the model are related to stochastic or umbrella ordering of the underlying response distributions, respectively. An algorithm for testing all possible hypotheses of stochastic ordering and deciding on an appropriate one is proposed.     

Cancer immunotherapy trial design with delayed treatment effect

A challenge arising in cancer immunotherapy trial design is the presence of a delayed treatment effect wherein the proportional hazard assumption no longer holds true. As a result, a traditional survival trial design based on the standard log‐rank test, which ignores the delayed treatment effect, will lead to substantial loss of statistical power. Recently, a piecewise weighted log‐rank test is proposed to incorporate the delayed treatment effect into consideration of the trial design. However, because the sample size formula was derived under a sequence of local alternative hypotheses, it results in an underestimated sample size when the hazard ratio is relatively small for a balanced trial design and an inaccurate sample size estimation for an unbalanced design. In this article, we derived a new sample size formula under a fixed alternative hypothesis for the delayed treatment effect model. Simulation results show that the new formula provides accurate sample size estimation for both balanced and unbalanced designs.     

Heterogeneity of variance and biased hypothesis tests

This study examined the influence of heterogeneity of variance on Type I error rates and power of the independent-samples Student's t-test of equality of means on samples of scores from normal and 10 non-normal distributions. The same test of equality of means was performed on corresponding rank-transformed scores. For many non-normal distributions, both versions produced anomalous power functions, resulting partly from the fact that the hypothesis test was biased, so that under some conditions, the probability of rejecting H ₀ decreased as the difference between means increased. In all cases where bias occurred, the t-test on ranks exhibited substantially greater bias than the t-test on scores. This anomalous result was independent of the more familiar changes in Type I error rates and power attributable to unequal sample sizes combined with unequal variances.     

Book Reviews

The Levene test is a widely used test for detecting differences in dispersion. The modified Levene transformation using sample medians is considered in this article. After Levene's transformation the data are not normally distributed, hence, nonparametric tests may be useful. As the Wilcoxon rank sum test applied to the transformed data cannot control the type I error rate for asymmetric distributions, a permutation test based on reallocations of the original observations rather than the absolute deviations was investigated. Levene's transformation is then only an intermediate step to compute the test statistic. Such a Levene test, however, cannot control the type I error rate when the Wilcoxon statistic is used; with the Fisher–Pitman permutation test it can be extremely conservative. The Fisher–Pitman test based on reallocations of the transformed data seems to be the only acceptable nonparametric test. Simulation results indicate that this test is on average more powerful than applying the t test after Levene's transformation, even when the t test is improved by the deletion of structural zeros.     

DETERMINATION OF DOMAINS OF ATTRACTION BASED ON A SEQUENCE OF MAXIMA

Suppose that the maximum of a random sample from a distribution F(x) may be obtained in each of k equally spaced observation periods. This paper proposes a test to determine the domain of attraction of F(x), and investigates the properties when the sample size is very large and perhaps unknown and k is fixed and small. The test statistic is a function of the spacings between the order statistics based on the sequence of maxima and is suggested by reference to one studied previously when inference was based on the largest k observations of a random sample. A Monte Carlo study shows that the proposed test is more powerful than its main competitor. The test is illustrated by two examples.     

A Discussion of Permutation Tests Conditional to Observed Responses in Unreplicated 2 M Full Factorial Designs

ABSTRACT

In this article we present a new solution to test for effects in unreplicated two-level factorial designs. The proposed test statistic, in case the error components are normally distributed, follows an F random variable, though our attention is on its nonparametric permutation version. The proposed procedure does not require any transformation of data such as residualization and it is exact for each effect and distribution-free. Our main aim is to discuss a permutation solution conditional to the original vector of responses. We give two versions of the same nonparametric testing procedure in order to control both the individual error rate and the experiment-wise error rate. A power comparison with Loughin and Noble's test is provided in the case of a unreplicated 2⁴ full factorial design.     

Rank test statistics for umbrella alternatives

This paper proposes an optimal rank test procedure for testing an umbrella alternative when the peak of the umbrella is known. It is referred to as maximin efficient linear rank test. Also when the peak of the umbrella is unknown, a test procedure is proposed and its performance is discussed.     

A new aging concept derived from the increasing convex ordering

In this paper, a comparison between the life distribution of a new unit with that of a used unit in the increasing convex order is made leading to a new class of life distributions which we call “new better than used in convex ordering of second order”. This class includes as subclasses the NBU and the NBUC and is a subclass of the NBUCA class. Preservation properties under convolution, random maxima, mixing and formation of coherent structures are established. Stochastic comparisons of the excess lifetime when the inter-arrival times belong to the NBUC(2) class are developed. Some applications of Poisson shock models and a test of exponentiality against NBUC(2) alternative are presented.     

Sample size calculation for the one‐sample log‐rank test

In this paper, an exact variance of the one‐sample log‐rank test statistic is derived under the alternative hypothesis, and a sample size formula is proposed based on the derived exact variance. Simulation results showed that the proposed sample size formula provides adequate power to design a study to compare the survival of a single sample with that of a standard population. Copyright © 2014 John Wiley & Sons, Ltd.