Multi-sample inference for simple-tree alternatives with ranked-set samples

This paper develops a non‐parametric multi‐sample inference for simple‐tree alternatives for ranked‐set samples. The multi‐sample inference provides simultaneous one‐sample sign confidence intervals for the population medians. The decision rule compares these intervals to achieve the desired type I error. For the specified upper bounds on the experiment‐wise error rates, corresponding individual confidence coefficients are presented. It is shown that the testing procedure is distribution‐free. To achieve the desired confidence coefficients for multi‐sample inference, a nonparametric confidence interval is constructed by interpolating the adjacent order statistics. Interpolation coefficients and coverage probabilities are provided, along with the nominal levels.     

Conditional Score Tests for Heteroscedasticity in the Two-Way Error Components Model

This paper extends the one-way heteroskedasticity score test of Holly and Gardiol (2000, In: Krishnakumar, J, Ronchetti, E (Eds.), Panel Data Econometrics: Future Directions, North-Holland, Amsterdam, pp. 199–211) to two conditional Lagrange Multiplier (LM) tests of heteroskedasticity under contiguous alternatives within the two-way error components model framework. In each case, the derivation of Rao's efficient score statistics for testing heteroskedasticity is first obtained. Then, based on a specific set of assumptions, the asymptotic distribution of the score under contiguous alternatives is established. Finally, the expression for the score test statistic in the presence of heteroskedasticity and related asymptotic local powers of these score test statistics are derived and discussed.     

Robust confidence regions for multinomial probabilities

Generally, confidence regions for the probabilities of a multinomial population are constructed based on the Pearson χ² statistic. Morales et al. (Bootstrap confidence regions in multinomial sampling. Appl Math Comput. 2004;155:295–315) considered the bootstrap and asymptotic confidence regions based on a broader family of test statistics known as power-divergence test statistics. In this study, we extend their work and propose penalized power-divergence test statistics-based confidence regions. We only consider small sample sizes where asymptotic properties fail and alternative methods are needed. Both bootstrap and asymptotic confidence regions are constructed. We consider the percentile and the bias corrected and accelerated bootstrap confidence regions. The latter confidence region has not been studied previously for the power-divergence statistics much less for the penalized ones. Designed simulation studies are carried out to calculate average coverage probabilities. Mean absolute deviation between actual and nominal coverage probabilities is used to compare the proposed confidence regions.     

Variance Components Testing in ANOVA‐Type Mixed Models

The purpose of this article is threefold. First, variance components testing for ANOVA ‐type mixed models is considered, in which response may not be divided into independent sub‐vectors, whereas most of existing methods are for models where response can be divided into independent sub‐vectors. Second, testing that a certain subset of variance components is zero. Third, as normality is often violated in practice, it is desirable to construct tests under very mild assumptions. To achieve these goals, an adaptive difference‐based test and an adaptive trace‐based test are constructed. The test statistics are asymptotically normal under the null hypothesis, are consistent against all global alternatives and can detect local alternatives distinct from the null at a rate as close to n ^{? 1 ∕ 2} as possible with n being the sample size. Moreover, when the dimensions of variance components in different sets are bounded, we develop a test with chi‐square as its limiting null distribution. The finite sample performance of the tests is examined via simulations, and a real data set is analysed for illustration.     

On the Exact Size of Tests of Treatment Effects in Multi‐Arm Clinical Trials

When testing treatment effects in multi‐arm clinical trials, the Bonferroni method or the method of Simes 1986) is used to adjust for the multiple comparisons. When control of the family‐wise error rate is required, these methods are combined with the close testing principle of Marcus et al. (1976). Under weak assumptions, the resulting p‐values all give rise to valid tests provided that the basic test used for each treatment is valid. However, standard tests can be far from valid, especially when the endpoint is binary and when sample sizes are unbalanced, as is common in multi‐arm clinical trials. This paper looks at the relationship between size deviations of the component test and size deviations of the multiple comparison test. The conclusion is that multiple comparison tests are as imperfect as the basic tests at nominal size α/m where m is the number of treatments. This, admittedly not unexpected, conclusion implies that these methods should only be used when the component test is very accurate at small nominal sizes. For binary end‐points, this suggests use of the parametric bootstrap test. All these conclusions are supported by a detailed numerical study.     

Location‐invariant Multi‐sample U‐tests for Covariance Matrices with Large Dimension

For two or more multivariate distributions with common covariance matrix, test statistics for certain special structures of the common covariance matrix are presented when the dimension of the multivariate vectors may exceed the number of such vectors. The test statistics are constructed as functions of location‐invariant estimators defined as U‐statistics, and the corresponding asymptotic theory is used to derive the limiting distributions of the proposed tests. The properties of the test statistics are established under mild and practical assumptions, and the same are numerically demonstrated using simulation results with small or moderate sample sizes and large dimensions.     

On testing for independence between the innovations of several time series

Test statistics for checking the independence between the innovations of several time series are developed. The time series models considered allow for general specifications for the conditional mean and variance functions that could depend on common explanatory variables. In testing for independence between more than two time series, checking pairwise independence does not lead to consistent procedures. Thus a finite family of empirical processes relying on multivariate lagged residuals are constructed, and we derive their asymptotic distributions. In order to obtain simple asymptotic covariance structures, Möbius transformations of the empirical processes are studied, and simplifications occur. Under the null hypothesis of independence, we show that these transformed processes are asymptotically Gaussian, independent, and with tractable covariance functions not depending on the estimated parameters. Various procedures are discussed, including Cramér–von Mises test statistics and tests based on non‐parametric measures. The ranks of the residuals are considered in the new methods, giving test statistics which are asymptotically margin‐free. Generalized cross‐correlations are introduced, extending the concept of cross‐correlation to an arbitrary number of time series; portmanteau procedures based on them are discussed. In order to detect the dependence visually, graphical devices are proposed. Simulations are conducted to explore the finite sample properties of the methodology, which is found to be powerful against various types of alternatives when the independence is tested between two and three time series. An application is considered, using the daily log‐returns of Apple, Intel and Hewlett‐Packard traded on the Nasdaq financial market. The Canadian Journal of Statistics 40: 447–479; 2012 © 2012 Statistical Society of Canada     

Some tests for uniformity of circular distributions powerful against multimodal alternatives

The author introduces new statistics suited for testing uniformity of circular distributions and powerful against multimodal alternatives. One of them has a simple expression in terms of the geometric mean of the sample of chord lengths. The others belong to a family indexed by a continuous parameter. The asymptotic distributions under the null hypothesis are derived. We compare the power of the new tests against Stephens's alternatives with those of Ajne, Watson, and Hermans‐Rasson's tests. Some of the new tests are the most powerful when the alternative has three or four modes. A heuristic justification of this feature is given. An application to the analysis of archaeological data is provided. The Canadian Journal of Statistics 38:80–96; 2010 © 2010 Statistical Society of Canada     

A Joint Score Test for Heteroscedasticity in the Two Way Error Components Model

This article extends the work by Holly and Gardiol (2000) (A score test for individual heteroscedasticity in a one-way error component model. In: Krishnakumar, J., Ronchetti, E., Eds. Panel Data Econometrics: Future Directions. Elsevier, North-Holland, Amsterdam, pp. 199–211, Ch. 10) to the two-way error components model. It deals exclusively with a joint heteroscedasticity test by first deriving Rao's efficient score statistics. Then, based on appropriate set of assumptions, we deduce the asymptotic distribution of the score under contiguous alternatives. Finally, we provide the expression for the score test statistic in the presence of heteroscedasticity and discuss its asymptotic local power.     

Adaptive graph‐based multiple testing procedures

Multiple testing procedures defined by directed, weighted graphs have recently been proposed as an intuitive visual tool for constructing multiple testing strategies that reflect the often complex contextual relations between hypotheses in clinical trials. Many well‐known sequentially rejective tests, such as (parallel) gatekeeping tests or hierarchical testing procedures are special cases of the graph based tests. We generalize these graph‐based multiple testing procedures to adaptive trial designs with an interim analysis. These designs permit mid‐trial design modifications based on unblinded interim data as well as external information, while providing strong family wise error rate control. To maintain the familywise error rate, it is not required to prespecify the adaption rule in detail. Because the adaptive test does not require knowledge of the multivariate distribution of test statistics, it is applicable in a wide range of scenarios including trials with multiple treatment comparisons, endpoints or subgroups, or combinations thereof. Examples of adaptations are dropping of treatment arms, selection of subpopulations, and sample size reassessment. If, in the interim analysis, it is decided to continue the trial as planned, the adaptive test reduces to the originally planned multiple testing procedure. Only if adaptations are actually implemented, an adjusted test needs to be applied. The procedure is illustrated with a case study and its operating characteristics are investigated by simulations. Copyright © 2014 John Wiley & Sons, Ltd.     

Nested combination tests with a time‐to‐event endpoint using a short‐term endpoint for design adaptations

Adaptive trial methodology for multiarmed trials and enrichment designs has been extensively discussed in the past. A general principle to construct test procedures that control the family‐wise Type I error rate in the strong sense is based on combination tests within a closed test. Using survival data, a problem arises when using information of patients for adaptive decision making, which are under risk at interim. With the currently available testing procedures, either no testing of hypotheses in interim analyses is possible or there are restrictions on the interim data that can be used in the adaptation decisions as, essentially, only the interim test statistics of the primary endpoint may be used. We propose a general adaptive testing procedure, covering multiarmed and enrichment designs, which does not have these restrictions. An important application are clinical trials, where short‐term surrogate endpoints are used as basis for trial adaptations, and we illustrate how such trials can be designed. We propose statistical models to assess the impact of effect sizes, the correlation structure between the short‐term and the primary endpoint, the sample size, the timing of interim analyses, and the selection rule on the operating characteristics.     

Combining Multivariate Bioassays: Accurate Inference Using Small Sample Asymptotics

For several independent multivariate bioassays performed at different laboratories or locations, the problem of testing the homogeneity of the relative potencies is addressed, assuming the usual slope‐ratio or parallel line assay model. When the homogeneity hypothesis holds, interval estimation of the common relative potency is also addressed. These problems have been investigated in the literature using likelihood‐based methods, under the assumption of a common covariance matrix across the different studies. This assumption is relaxed in this investigation. Numerical results show that the usual likelihood‐based procedures are inaccurate for both of the above problems, in terms of providing inflated type I error probabilities for the homogeneity test, and providing coverage probabilities below the nominal level for the interval estimation of the common relative potency, unless the sample sizes are large, as expected. Correction based on small sample asymptotics is investigated in this article, and this provides significantly more accurate results in the small sample scenario. The results are also illustrated with examples.     

Testing circular symmetry

The author addresses the problem of testing circular data for reflective symmetry about an unknown central direction and proposes a simple omnibus test based on the sample second sine moment about an estimation of this direction. Under quite general conditions, for an underlying distribution which is reflectively symmetric, the large‐sample asymptotic distribution of the test statistic is standard normal. Randomization and bootstrap variants of the test are also introduced, and the operating characteristics of different versions of the test are investigated in a Monte Carlo study. The large‐sample and bootstrap versions of the test are applied in the analysis of two illustrative examples drawn from the circular statistics literature.     

IDENTIFYING TREATMENT EFFECTS IN MULTI-CHANNEL MEASUREMENTS IN ELECTROENCEPHALOGRAPHIC STUDIES: MULTIVARIATE PERMUTATION TESTS AND MULTIPLE COMPARISONS

A versatile procedure is described comprising an application of statistical techniques to the analysis of the large, multi‐dimensional data arrays produced by electroencephalographic (EEG) measurements of human brain function. Previous analytical methods have been unable to identify objectively the precise times at which statistically significant experimental effects occur, owing to the large number of variables (electrodes) and small number of subjects, or have been restricted to two‐treatment experimental designs. Many time‐points are sampled in each experimental trial, making adjustment for multiple comparisons mandatory. Given the typically large number of comparisons and the clear dependence structure among time‐points, simple Bonferroni‐type adjustments are far too conservative. A three‐step approach is proposed: (i) summing univariate statistics across variables; (ii) using permutation tests for treatment effects at each time‐point; and (iii) adjusting for multiple comparisons using permutation distributions to control family‐wise error across the whole set of time‐points. Our approach provides an exact test of the individual hypotheses while asymptotically controlling family‐wise error in the strong sense, and can provide tests of interaction and main effects in factorial designs. An application to two experimental data sets from EEG studies is described, but the approach has application to the analysis of spatio‐temporal multivariate data gathered in many other contexts.     

A FULLY NONPARAMETRIC TEST FOR ONE-WAY LAYOUTS

The use of a vector of sign statistics as the basis of a nonparametric test for equality of distributions in one‐way layouts is considered. An important feature of this test is its ability to detect a broad range of alternatives, including scale and shape differences. In this scenario, the data consist of several independent measurements on each treatment or subject. Presented here are a finite sample and asymptotic distribution theory for the test statistics and a discussion of a follow‐up clustering procedure based on a mixture model approximation. Finally, the methods are illustrated using two examples from the literature.     

A resampling‐based test for two crossing survival curves

The area between two survival curves is an intuitive test statistic for the classical two‐sample testing problem. We propose a bootstrap version of it for assessing the overall homogeneity of these curves. Our approach allows ties in the data as well as independent right censoring, which may differ between the groups. The asymptotic distribution of the test statistic as well as of its bootstrap counterpart are derived under the null hypothesis, and their consistency is proven for general alternatives. We demonstrate the finite sample superiority of the proposed test over some existing methods in a simulation study and illustrate its application by a real‐data example.     

Exact unconditional testing procedures for comparing two independent Poisson rates

We consider seven exact unconditional testing procedures for comparing adjusted incidence rates between two groups from a Poisson process. Exact tests are always preferable due to the guarantee of test size in small to medium sample settings. Han [Comparing two independent incidence rates using conditional and unconditional exact tests. Pharm Stat. 2008;7(3):195–201] compared the performance of partial maximization p-values based on the Wald test statistic, the likelihood ratio test statistic, the score test statistic, and the conditional p-value. These four testing procedures do not perform consistently, as the results depend on the choice of test statistics for general alternatives. We consider the approach based on estimation and partial maximization, and compare these to the ones studied by Han (2008) for testing superiority. The procedures are compared with regard to the actual type I error rate and power under various conditions. An example from a biomedical research study is provided to illustrate the testing procedures. The approach based on partial maximization using the score test is recommended due to the comparable performance and computational advantage in large sample settings. Additionally, the approach based on estimation and partial maximization performs consistently for all the three test statistics, and is also recommended for use in practice.     

CHANGE‐POINT DETECTION WITH RANK STATISTICS IN LONG‐MEMORY TIME‐SERIES MODELS

Wilcoxon‐type rank statistics are considered for testing a long‐memory time‐series model with a common distribution against the alternatives involving a change in the distribution at an unknown time point. The asymptotic properties of the test statistics and the change‐point estimators are studied. Finite‐sample behaviours are investigated in a small Monte Carlo simulation study. Data examples from hydrology and telecommunications illustrate the method.     

A permutation‐based trend test for the analysis of a mechanistic animal migraine assay with a nonstandard design

The effect of a test compound on neurogenically induced vasodilation in marmosets was studied using a non‐standard experimental design with overlapping dosage groups and repeated measurements. In this study, the assumption that the data were normally distributed seemed inappropriate, so no traditional data analyses could be used. As an alternative, a new permutation trend test was designed based on the Jonckheere–Terpstra test statistic. This test protects the type I error without any further assumptions. Statistically significant differences in trend between treatment groups were detected. The effect of the compound was then shown across doses using subsequent Wilcoxon rank‐sum tests against ordered alternatives. In all, the permutation test proved quite useful in this context. This nonparametric approach to the analysis may easily be adapted to other applications. Copyright © 2005 John Wiley & Sons, Ltd.     

Nonparametric Tests for Comparing Several Coefficients of Variation

We consider the problem of comparing (k + 1) coefficients of variation. We are interested in testing the null hypothesis that the coefficients of variation are equal against each of the alternatives: (a) some populations have different coefficients of variation and (b) the coefficients of variation are ordered. Three nonparametric test statistics are proposed and their asymptotic theory is developed. We compared the proposed tests together with another parametric test using two Monte Carlo studies to estimate their probabilities of Type I error and powers. An illustration of the proposed tests using a real data set is given.