A Diagnostic Test for Normality Within the Power Exponential Family

This article develops the locally uniformly most powerful unbiased Lagrange multiplier test of normality of regression disturbances within the family of power exponential distributions. The small sample power properties of the test are compared in a Monte Carlo study with 6 well-known tests across 12 alternative nonnormal distributions. In addition, the finite sample power properties for nonnormal alternatives within the power exponential family are summarized by estimating response surfaces. The results suggest that the proposed text is computationally convenient and possesses relatively attractive power properties even against alternatives outside the power exponential family.     

A method for constructing exact tests from test statistics that have unknown null distributions

A randomized procedure is described for constructing an exact test from a test statistic F for which the null distribution is unknown. The procedure is restricted to cases where F is a function of a random element U that has a known distribution under the null hypothesis. The power of the exact randomized test is shown to be greater in some cases than the power of the exact nonrandomized test that could be constructed if the null distribution of Fwere known.     

THE POWER OF STUDENT'S t TEST: CAN A NON-SIMILAR TEST DO BETTER?

Lehmann & Stein (1948) proved the existence of non-similar tests which can be more powerful than best similar tests. They used Student's problem of testing for a non-zero mean given a random sample from the normal distribution with unknown variance as an example. This raises the question: should we use a non-similar test instead of Student's t test? Questions like this can be answered by comparing the power of the test with the power envelope. This paper discusses the difficulties involved in computing power envelopes. It reports an empirical comparison of the power of the t test and the power envelope and finds that the two are almost identical especially for sample sizes greater than 20. These findings suggest that, as well as being uniformly most powerful (UMP) within the class of similar tests, Student's t test is approximately UMP within the class of all tests. For practical purposes it might also be regarded as UMP when moderate or large sample sizes are involved.     

On the Relationship between Directional and Omnibus Statistical Tests

Abstract.  A common statistical problem involves the testing of a K -dimensional parameter vector. In both parametric and semiparametric settings, two types of directional tests – linear combination and constrained tests – are frequently used instead of omnibus tests in hopes of achieving greater power for specific alternatives. In this paper, we consider the relationship between these directional tests, as well as their relationship to omnibus tests. Every constrained directional test is shown to be asymptotically equivalent to a specific linear combination test under a sequence of contiguous alternatives and vice versa. Even when the direction of the alternative is known, the constrained test in general will not be optimal unless the objective function used to derive it is efficient. For an arbitrary alternative, insight into the power characteristics of directional tests in comparison to omnibus tests can be gained by a chi-square partition of the omnibus test.     

The Performance of Randomization Tests that Use Permutations of Independent Variables

ABSTRACT

In this article we evaluate the performance of a randomization test for a subset of regression coefficients in a linear model. This randomization test is based on random permutations of the independent variables. It is shown that the method maintains its level of significance, except for extreme situations, and has power that approximates the power of another randomization test, which is based on the permutation of residuals from the reduced model. We also show, via an example, that the method of permuting independent variables is more valuable than other randomization methods because it can be used in connection with the downweighting of outliers.     

More powerful permutation test based on multistage ranked set sampling

Many researches have used ranked set sampling (RSS) method instead of simple random sampling (SRS) to improve power of some nonparametric tests. In this study, the two-sample permutation test within multistage ranked set sampling (MSRSS) is proposed and investigated. The power of this test is compared with the SRS permutation test for some symmetric and asymmetric distributions through Monte Carlo simulations. It has been found that this test is more powerful than the SRS permutation test; its power increased by set size and/or number of cycles and/or number of stages. Symmetric distributions power increased better than asymmetric distributions power.     

Adaptive choice of scale tests in flexible two-stage designs with applications in experimental ecology and clinical trials

In this paper, the two-sample scale problem is addressed within the rank framework which does not require to specify the underlying continuous distribution. However, since the power of a rank test depends on the underlying distribution, it would be very useful for the researcher to have some information on it in order to use the possibly most suitable test. A two-stage adaptive design is used with adaptive tests where the data from the first stage are used to compute a selector statistic to select the test statistic for stage 2. More precisely, an adaptive scale test due to Hall and Padmanabhan and its components are considered in one-stage and several adaptive and non-adaptive two-stage procedures. A simulation study shows that the two-stage test with the adaptive choice in the second stage and with Liptak combination, when it is not more powerful than the corresponding one-stage test, shows, however, a quite similar power behavior. The test procedures are illustrated using two ecological applications and a clinical trial.     

On Tests for Group Variation With a Small to Moderate Number of Groups

This paper considers a family of penalized likelihood score tests for group variation. The tests can be indexed by a measure of degrees of freedom. At one extreme, with degrees of freedom one less than the number of groups, is the usual score test for a fixed effects alternative using indicator variables for the groups, while at the other extreme, in the limit as the degrees of freedom 0, is a test closely related to a score test based on a random effects alternative. Asymptotic power comparisons are made for the tests in the family. As would be expected, different members of the family are more efficient for different alternatives. Generally the tests with smaller degrees of freedom appear to have better power than the standard test for alternatives focusing on differences among the larger groups, and lower power for alternatives focusing on differences among the smaller groups. Simulations indicate the asymptotic approximation to the distribution performs better for the tests with small degrees of freedom.     

Assessing the fit of finite mixture distributions

Mixture distributions have become a very flexible and common class of distributions, used in many different applications, but hardly any literature can be found on tests for assessing their goodness of fit. We propose two types of smooth tests of goodness of fit for mixture distributions. The first test is a genuine smooth test, and the second test makes explicit use of the mixture structure. In a simulation study the tests are compared to some traditional goodness of fit tests that, however, are not customised for mixture distributions. The first smooth test has overall good power and generally outperforms the other tests. The second smooth test is particularly suitable for assessing the fit of each component distribution separately. The tests are applicable to both continuous and discrete distributions and they are illustrated on three medical data sets.     

Likelihood ratio tests based on subglobal optimization: A power comparison in exponential mixture models

The paper compares several versions of the likelihood ratio test for exponential homogeneity against mixtures of two exponentials. They are based on different implementations of the likelihood maximization algorithm. We show that global maximization of the likelihood is not appropriate to obtain a good power of the LR test. A simple starting strategy for the EM algorithm, which under the null hypothesis often fails to find the global maximum, results in a rather powerful test. On the other hand, a multiple starting strategy that comes close to global maximization under both the null and the alternative hypotheses leads to inferior power.     

Evaluation of the statistical power for multiple tests: a case study

It is challenging to estimate the statistical power when a complicated testing strategy is used to adjust for the type-I error for multiple comparisons in a clinical trial. In this paper, we use the Bonferroni Inequality to estimate the lower bound of the statistical power assuming that test statistics are approximately normally distributed and the correlation structure among test statistics is unknown or only partially known. The method was applied to the design of a clinical study for sample size and statistical power estimation.     

Union-Intersection testing for outliers in multivariate normal data

The union-intersection approach to multivariate test construction is used to develop an alternative to Wilks' likelihood ratio test statistic for testing for two or more outliers in multivariate normal data. It is shown that critical values of both statistics are poorly approximated by Bonferroni bounds. Simulated critical values are presented for both statistics for significance levels 1% and 5%, for sample sizes 10(5)30, 40, 50, 75 and 100 for 2, 3, 4 and 5 dimensions. A power comparison of the two tests in the slippage of the mean model for generating outliers indicates that the union-intersection test is the more powerful when the slippages are close to collinear. Although Wilks' test remains the preference for general use, the union-intersection test could be valuable when such special structure in the data is suspected.     

The Asymptotic Power Of Jonckheere-Type Tests For Ordered Alternatives

For the c -sample location problem with ordered alternatives, the test proposed by Barlow et al . (1972 p. 184) is an appropriate one under the model of normality. For non-normal data, however, there are rank tests which have higher power than the test of Barlow et al ., e.g. the Jonckheere test or so-called Jonckheere-type tests recently introduced and studied by Büning & Kössler (1996). In this paper the asymptotic power of the Jonckheere-type tests is computed by using results of Hájek (1968) which may be considered as extensions of the theorem of Chernoff & Savage (1958). Power studies via Monte Carlo simulation show that the asymptotic power values provide a good approximation to the finite ones even for moderate sample sizes.     

Locally optimal test for simultaneously testing the mean and variance of a normal distribution

A generalization of the locally most powerful unbiased (LMPU) test for the single parameter case to the k-parameter case was proposed by SenGupta and Vermeire (1986). In particular we defined a locally most mean power unbiased (LMMPU) test based on the mean curvature of the power hypersurface. Compared to the type C tests of Neyman and Pearson and the type D tests (Isaacson, 1951), LMMPU tests possess better theoretical properties and enjoy ease of construction of critical regions. In this paper we present an interesting example of a two-parameter univariate normal population for which Isaacson (1951, p. 233) was unsuccessful in finding a type D test. For the case of one observation, we prove that no Type D region exists but the LMMPU test is obtained - it is an example of a test with singular Hessian matrix for its power but is nevertheless a strictly locally unbiased (LU) test.     

Nonparametric tests for multivariate multi-sample locations based on data depth

Several nonparametric tests for multivariate multi-sample location problem are proposed in this paper. These tests are based on the notion of data depth, which is used to measure the centrality/outlyingness of a given point with respect to a given distribution or a data cloud. Proposed tests are completely nonparametric and implemented through the idea of permutation tests. Performance of the proposed tests is compared with existing parametric test and nonparametric test based on data depth. An extensive simulation study reveals that proposed tests are superior to the existing tests based on data depth with regard to power. Illustrations with real data are provided.     

Weighted Logrank Permutation Tests for Randomly Right Censored Life Science Data

In biomedical research, weighted logrank tests are frequently applied to compare two samples of randomly right censored survival times. We address the question how to combine a number of weighted logrank statistics to achieve good power of the corresponding survival test for a whole linear space or cone of alternatives, which are given by hazard rates. This leads to a new class of semiparametric projection tests that are motivated by likelihood ratio tests for an asymptotic model. We show that these tests can be carried out as permutation tests and discuss their asymptotic properties. A simulation study together with the analysis of a classical data set illustrates the advantages.     

On optimal tests for separate hypotheses and conditional probability integral transformations

Consider the problem of testing the composite null hypothesis that a random sample X₁,…,X_n is from a parent which is a member of a particular continuous parametric family of distributions against an alternative that it is from a separate family of distributions. It is shown here that in many cases a uniformly most powerful similar (UMPS) test exists for this problem, and, moreover, that this test is equivalent to a uniformly most powerful invariant (UMPI) test. It is also seen in the method of proof used that the UMPS test statistic Is a function of the statistics U₁,…,U_n?k obtained by the conditional probability integral transformations (CPIT), and thus that no Information Is lost by these transformations, It is also shown that these optimal tests have power that is a nonotone function of the null hypothesis class of distributions, so that, for example, if one additional parameter for the distribution is assumed known, then the power of the test can not lecrease. It Is shown that the statistics U₁, …, U_n?k are independent of the complete sufficient statistic, and that these statistics have important invariance properties. Two examples at given. The UMPS tests for testing the two-parameter uniform family against the two-parameter exponential family, and for testing one truncation parameter distribution against another one are derived.     

New invariant and consistent chi-squared type goodness-of-fit tests for multivariate normality and a related comparative simulation study

ABSTRACT

New invariant and consistent goodness-of-fit tests for multivariate normality are introduced. Tests are based on the Karhunen–Loève transformation of a multidimensional sample from a population. A comparison of simulated powers of tests and other well-known tests with respect to some alternatives is given. The simulation study demonstrates that power of the proposed McCull test almost does not depend on the number of grouping cells. The test shows an advantage over other chi-squared type tests. However, averaged over all of the simulated conditions examined in this article, the Anderson–Darling type and the Cramer–von Mises type tests seem to be the best.     

A comparison of several adaptive tests for paired data

In the last few years, two adaptive tests for paired data have been proposed. One test proposed by Freidlin et al. [On the use of the Shapiro–Wilk test in two-stage adaptive inference for paired data from moderate to very heavy tailed distributions, Biom. J. 45 (2003), pp. 887–900] is a two-stage procedure that uses a selection statistic to determine which of three rank scores to use in the computation of the test statistic. Another statistic, proposed by O'Gorman [Applied Adaptive Statistical Methods: Tests of Significance and Confidence Intervals, Society for Industrial and Applied Mathematics, Philadelphia, 2004], uses a weighted t-test with the weights determined by the data. These two methods, and an earlier rank-based adaptive test proposed by Randles and Hogg [Adaptive Distribution-free Tests, Commun. Stat. 2 (1973), pp. 337–356], are compared with the t-test and to Wilcoxon's signed-rank test. For sample sizes between 15 and 50, the results show that the adaptive test proposed by Freidlin et al. and the adaptive test proposed by O'Gorman have higher power than the other tests over a range of moderate to long-tailed symmetric distributions. The results also show that the test proposed by O'Gorman has greater power than the other tests for short-tailed distributions. For sample sizes greater than 50 and for small sample sizes the adaptive test proposed by O'Gorman has the highest power for most distributions.     

Testing Normality Using Transformed Data

In this article, we first present a characterization of the normal distribution and then we introduce an exact goodness of fit test for normal distribution. The power of the proposed test under various alternatives is compared with the existing tests, by simulation.