Exact Multivariate Permutation Tests for Fixed Effects in Mixed-Models

A test for the fixed effect in mixed-models is proposed. It is based on permutation strategy and is exact. The testing approach presented is very general and the class of models covered is very broad.

Multivariate responses with different type of variables (e.g., continuous, categorical, and ranks) are usually tested with separated models and the overall test are usually reached through Bonferroni-like combinations, i.e., without taking into account the joint distribution of the test statistics. On the contrary, in this approach the joint distribution is immediately obtained and the dependence among tests is taken into account in the overall test. The methods are implemented in the R package flip, freely available on CRAN.     

Schätzungen in Stochastischen Differenzen-und Differentialgleiehungssystemen 2

Some ways of Studentizing the parametric c-sample tests (c≧2) for location are examined and their asymptotic properties established. A way of Studentizing the c-sample Puni test based on the ranks of the observations is proposed. The resulting test is shown to be asymptotically valid and consistent for a reasonable class of alternatives     

Analysis of ranked data in randomized blocks when there are missing values

Data consisting of ranks within blocks are considered for randomized block designs when there are missing values. Tied ranks are possible. Such data can be analysed using the Skillings–Mack test. Here we suggest a new approach based on carrying out an ANOVA on the ranks using the general linear model platform available in many statistical packages. Such a platform allows an ANOVA to be calculated when there are missing values. Indicative sizes and powers show the ANOVA approach performs better than the Skillings–Mack test.     

Exact monte carlo tests using several statistics

Concepts of ranking and boundary of multivariate statistics are discussed and applied to the simultaneous use of several test statistics calculated for data and simulated replicates. An example of residual analysis in regression is given using layer ranks and supplementary simulation with a stopping rule.     

Most powerful tests for use in matched pair experiments when data may be censored

Four distribution-free tests are developed for use in matched pair experiments when data may be censored: a bootstrap based on estimates of the median difference, and three rerandomization tests. The latter include a globally almost most powerful (GAMP) test which uses the original data and two modified Gilbert-Gehan tests which use the ranks. Computation time is reduced by using a binary count to generate subsamples and by restricting subsampling to the uncensored pairs. In Monte Carlo simulations against normal alternatives, mixed normal alternatives, and exponential alternatives, the GAMP test is most powerful with light censoring, the rank test is most powerful with heavy censoring. The bootstrap degenerates to the sign test and is least powerful.     

Overview of Friedman’s Test and Post-hoc Analysis

When the null hypothesis of Friedman’s test is rejected, there is a wide variety of multiple comparisons that can be used to determine which treatments differ from each other. We will discuss the contexts where different multiple comparisons should be applied, when the population follows some discrete distributions commonly used to model count data in biological and ecological fields. Our simulation study shows that sign test is very conservative. Fisher’s LSD and Tukey’s HSD tests computed with ranks are the most liberal. Theoretical considerations are illustrated with data of the Azores Buzzard (Buteo buteo rothschildi) population from Azores, Portugal.     

Semi-Sequential One-Shot Monitoring of Small Disorders With Controlled Type I Error Rate

We propose a simple two-stage monitoring rule for detecting small disorders in a two-sample location problem. The proposed rule is based on ranks and hence is nonparametric in nature. In the first stage, we use a sequential monitoring scheme to decide the necessity of employing a location test at some point of time. If there is urgency, we simply use a two-sample Wilcoxon rank sum test in the second stage. This leads to a semi sequential one-shot monitoring procedure. We study some asymptotic performance of the proposed rule. We also present some numerical findings obtained through Monte Carlo studies. The proposed rule meets the challenge of controlling type I error rate in sequential monitoring of an incoming series of observations.     

Some partially sequential nonparametric tests for detecting linear trend

In the present study, we develop two nonparametric partially sequential tests for detecting possible presence of linear trend among the incoming series of observations. We assume that a sample of fixed size is available a priori from some unknown univariate continuous population and there is no sign of trend among these historical observations. Our proposed tests can be viewed as the sequential type tests for monitoring structural changes. We use partial sequential sampling schemes based on usual ranks as well as on sequential ranks. We provide detailed discussion on asymptotic studies related to the proposed tests. We compare the two tests under various situations. We also present some numerical results based on simulation studies. Proposed tests are extremely important in profit making in volatile market through Margin Trading. We illustrate the mechanism with a detailed analysis of a stock price data.     

A Diagnostic Test for Normality Within the Power Exponential Family

This article develops the locally uniformly most powerful unbiased Lagrange multiplier test of normality of regression disturbances within the family of power exponential distributions. The small sample power properties of the test are compared in a Monte Carlo study with 6 well-known tests across 12 alternative nonnormal distributions. In addition, the finite sample power properties for nonnormal alternatives within the power exponential family are summarized by estimating response surfaces. The results suggest that the proposed text is computationally convenient and possesses relatively attractive power properties even against alternatives outside the power exponential family.     

Smoothed ranks for two or multi-sample location problems

Smoothed ranks are proposed for two or multi-sample location problems. The regular ranks in Wilcoxon's two sample test are replaced with smoothed ranks, and the shift parameter is estimated. Asymptotic properties of the smoothed rank estimator are shown and a hypothesis test is proposed. Moreover, the smoothed ranks are applied in the Kruskal–Wallis's r-sample test and the power of the test is computed using regular and smoothed ranks. Examples and Monte Carlo simulations show that the smoothed ranks perform similarly to the traditional rank based estimators under contaminated normal or non-normal populations.     

A robust modification of the ordered-heterogeneity test

An ordered heterogeneity (OH) test is a test for a trend that combines a non-directional heterogeneity test with the rank-order information specified under the alternative. We propose two modifications of the OH test procedure: (1) to use the mean ranks of the groups rather than the sample means to determine the observed ordering of the groups, and (2) to use the maximum correlation out of the 2^k???1 – 1 possibilities under the alternative rather than the single ordering (1, 2, … , k), where k is the number of independent groups. A simulation study indicates that these two changes increase the power of the ordered heterogeneity test when, as common in practice, the underlying distribution may deviate from a normal distribution and the trend pattern is a priori unknown. In contrast to the original OH test, the modified OH test can detect all possible patterns under the alternative with a relatively high power.     

Tests of hypotheses based on ranks in the general linear model

A unified approach is developed for testing hypotheses in the general linear model based on the ranks of the residuals. It complements the nonparametric estimation procedures recently reported in the literature. The testing and estimation procedures together provide a robust alternative to least squares. The methods are similar in spirit to least squares so that results are simple to interpret. Hypotheses concerning a subset of specified parameters can be tested, while the remaining parameters are treated as nuisance parameters. Asymptotically, the test statistic is shown to have a chi-square distribution under the null hypothesis. This result is then extended to cover a sequence of contiguous alternatives from which the Pitman efficacy is derived. The general application of the test requires the consistent estimation of a functional of the underlying distribution and one such estimate is furnished.     

Basic concepts of group sequential and adaptive group sequential test procedures

Based on the concept of repeated significance tests, an empirical study may be planned in subsequent stages. Group sequential test procedures offer the possibility of performing the study with a fixed number of observations per stage. At least, the number of observations must be chosen independently of the observed data. In adaptive group sequential test procedures, the number of observations can be changed during the course of the study using all results observed so far. In this article, the basic concepts of these two designs are reviewed. Recent developments in adaptive designs are outlined and potential fields of application are given.     

A Bayesian Approach to Modeling Time-Varying Cointegration and Cointegrating Rank

A multivariate model that allows for both a time-varying cointegrating matrix and time-varying cointegrating rank is presented. The model addresses the issue that, in real data, the validity of a constant cointegrating relationship may be questionable. The model nests the submodels implied by alternative cointegrating matrix ranks and allows for transitions between stationarity and nonstationarity, and cointegrating and noncointegrating relationships in accordance with the observed behavior of the data. A Bayesian test of cointegration is also developed. The model is used to assess the validity of the Fisher effect and is also applied to equity market data.     

Group sequential x2 statistic for testing the difference of two mean vectors in clinical trials

In this study we discuss the group sequential procedures for comparing two treatments based on multivariate observations in clinical trials. Also we suppose that a response vector on each of two treatments has a multivariate normal distribution with unknown covariance matrix. Then we propose a group sequential x² statistic in order to carry out repeated significance test for hypothesis of no difference between two population mean vectors. In order to realize the group sequential test where average sample number is reduced, we propose another modified group sequential x² statistic by extension of Jennison and Turnbull ( 1991 ). After construction of repeated confidence boundaries for making the repeated significance test, we compare two group sequential procedures based on two statistics regarding the average sample number and the power of the test in the simulations.     

Nonparametric multiple testing procedures

Assume that we have n_i independent observations from each of k independent populations. Each population has the same distribution except for a translation parameter. We are interested in specific pairwise differences of the parameters in various settings, such as treatment vs. control, change point or all pairwise differences. We propose new multiple testing procedures for the pairwise differences. The new procedures are based on ranks and they have desirable practical properties not shared by existing procedures. These include tests that satisfy the interval property. Furthermore, the test method provides an interval that serves as an estimate of the difference in the parameters of interest.     

The Performance of Randomization Tests that Use Permutations of Independent Variables

ABSTRACT

In this article we evaluate the performance of a randomization test for a subset of regression coefficients in a linear model. This randomization test is based on random permutations of the independent variables. It is shown that the method maintains its level of significance, except for extreme situations, and has power that approximates the power of another randomization test, which is based on the permutation of residuals from the reduced model. We also show, via an example, that the method of permuting independent variables is more valuable than other randomization methods because it can be used in connection with the downweighting of outliers.     

On the asymptotic distribution of a class of aligned rank order test statistics in randomized block designs

In the present investigation, the unconditional asymptotic distribution of a class of aligned rank order test statistics for randomized block designs is derived under the null hypothesis and for nearby alternatives, as the number of blocks tends to infinity. The proofs of these results are based on the asymptotic equivalence in quadratic mean between aligned observations and their ranks and thus are quite similar to the Hájek and SKidák (1967) approach.     

Asyhptotic efficiency of sequential and non-sequential procedures based on fisher's method of combining tests

In this paper we propose test statistics based on Fisher's method of combining tests for hypotheses involving two or more parameters simultaneously, It Is shown that these tests are asymptotically efficient In the sense of Bahadur, It is then shown how these tests can be modified to give sequential test procedures which are efficient in the sense of Berk and Brown (1978).

The results in section 3 generalize the work of Perng (1977) and Durairajan (1980).     

Comment

We propose a sequential test for predictive ability for recursively assessing whether some economic variables have explanatory content for another variable. In the forecasting literature it is common to assess predictive ability by using “one-shot” tests at each estimation period. We show that this practice leads to size distortions, selects overfitted models and provides spurious evidence of in-sample predictive ability, and may lower the forecast accuracy of the model selected by the test. The usefulness of the proposed test is shown in well-known empirical applications to the real-time predictive content of money for output and the selection between linear and nonlinear models.