On Testing the Mean Equivalence of Treatments from Correlated Normal Populations

Let there be k equally correlated treatment populations under consideration, a Studentized range test is proposed to test the hypothesis of average mean equivalence against the alternative hypothesis of inequivalence. The maximum level and minimum power at some least favorable configurations of means are used to calculate the critical value and the required sample size simultaneously when testing a null against an alternative hypothesis. The range test is applied to a real world problem to find out if the stress levels among children at four time periods due to a newly built nearby airport are equivalent.     

On equivalence of two variances of a bivariate normal vector

A test for assessing the equivalence of two variances of a bivariate normal vector is constructed. It is uniformly more powerful than the two one-sided tests procedure and the power improvement is substantial. Numerical studies show that it has a type I error close to the test level at most boundary points of the null hypothesis space. One can apply this test to paired difference experiments or 2×2 crossover designs to compare the variances of two populations with two correlated samples. The application of this test on bioequivalence in variability is presented. We point out that bioequivalence in intra-variability implies bioequivalence in variability, however, the latter has a larger power.     

Bootstrap tests for multivariate directional alternatives

Tests on multivariate means that are hypothesized to be in a specified direction have received attention from both theoretical and applied points of view. One of the most common procedures used to test this cone alternative is the likelihood ratio test (LRT) assuming a multivariate normal model for the data. However, the resulting test for an ordered alternative is biased in that the only usable critical values are bounds on the null distribution. The present paper provides empirical evidence that bootstrapping the null distribution of the likelihood ratio statistic results in a bootstrap test (BT) with comparable power properties without the additional burden of assuming multivariate normality. Additionally, the tests based on the LRT statistic can reject the null hypothesis in favor of the alternative even though the true means are far from the alternative region. The BT also has similar properties for normal and nonnormal data. This anomalous behavior is due to the formulation of the null hypothesis and a possible remedy is to reformulate the null to be the complement of the alternative hypothesis. We discuss properties of a BT for the modified set of hypotheses (MBT) based on a simulation study. The resulting test is conservative in general and in some specific cases has power estimates comparable to those for existing methods. The BT has higher sensitivity but relatively lower specificity, whereas the MBT has higher specificity but relatively lower sensitivity.     

An empirical likelihood ratio based goodness-of-fit test for skew normality

In this paper, an empirical likelihood ratio based goodness-of-fit test for the skew normality is proposed. The asymptotic results of the test statistic under the null hypothesis and the alternative hypothesis are derived. Simulations indicate that the Type I error of the proposed test can be well controlled for a given nominal level. The power comparison with other available tests shows that the proposed test is competitive. The test is applied to IQ scores data set and Australian Institute of Sport data set to illustrate the testing procedure.     

Hypotheses testing for a multidimensional parameter of inhomogeneous Poisson processes

We observe a realization of an inhomogeneous Poisson process whose intensity function depends on an unknown multidimensional parameter. We consider the asymptotic behaviour of the Rao score test for a simple null hypothesis against the multilateral alternative. By using the Edgeworth type expansion (under the null hypothesis) for a vector of stochastic integrals with respect to the Poisson process, we refine the (classic) threshold of the test (obtained by the central limit theorem), which improves the first type probability of error. The expansion allows us to describe the power of the test under the local alternative, i.e. a sequence of alternatives, which converge to the null hypothesis with a certain rate. The rates can be different for components of the parameter.     

Multiple comparison procedures for finding non-maximum normal means

Abstract

In this study, we discuss multiple comparison procedures for finding normal means which are not maximum among several normal means. Specifically, we propose the single step procedure, the sequentially rejective step down procedure and the step up procedure. For the single step procedure we determine the critical value for a specified significance level. For the sequentially rejective step down procedure and the step up procedure we determine the critical value at each step of the test for a specified significance level. For three procedures we formulate the power of the test under a specified alternative hypothesis. We give some numerical examples regarding critical values and power of the test intended to compare three procedures.     

On nonparametric test for the residual probability order

Residual probability order is a partial ordering analog of the total order stochastic precedence which can be fruitfully applied in many reliability problems. We introduce a U-statistic test for the null hypothesis that two random variables are equally distributed versus the alternative that one strictly dominates the other in residual probability order. The critical value is obtained by normal approximation and bootstrap procedures. The performance of the test statistic is evaluated using a simulation study. Finally, a numerical example illustrating the theory is also given.     

The power functions of the likelihood ratio tests for a simply ordered trend in normal means

Likelihood ratio tests for the homogeneity of k normal means with the alternative restricted by an increasing trend are considered as well as the likelihood ratio tests of the null hypothesis that the means satisfy the trend. While the work is primarily a survey of results concerning the power functions of these tests, the extensions of some results to the case of not necessarily equal sample sizes are presented. For the case of known or unknown population variances, exact expressions are given for the power functions for k=3,4, and approximations are discussed for larger k. The topics of consistency, bias and monotonicity of the power functions are included. Also, Bartholomew's conjectures concerning minimal and maximal powers are investigated, with results of a new numerical study given.     

From statistical power to statistical assurance: It's time for a paradigm change in clinical trial design

A well-designed clinical trial requires an appropriate sample size with adequate statistical power to address trial objectives. The statistical power is traditionally defined as the probability of rejecting the null hypothesis with a pre-specified true clinical treatment effect. This power is a conditional probability conditioned on the true but actually unknown effect. In practice, however, this true effect is never a fixed value. Thus, we discuss a newly proposed alternative to this conventional statistical power: statistical assurance, defined as the unconditional probability of rejecting the null hypothesis. This kind of assurance can then be obtained as an expected power where the expectation is based on the prior probability distribution of the unknown treatment effect, which leads to the Bayesian paradigm. In this article, we outline the transition from conventional statistical power to the newly developed assurance and discuss the computations of assurance using Monte Carlo simulation-based approach.     

On group sequential tests for data in unequally sized groups and with unknown variance

We present a method to generalise the scope of application of group sequential tests designed for equally sized groups of normal observations with known variance. Preserving the significance levels against which standardised statistics are compared leads to tests for unequally grouped data which maintain Type I error probabilities to a high degree of accuracy. The same approach can be followed when observations have unknown variance by setting critical values for Studentised statistics at percentiles of the appropriate t-distributions. This significance level approach is equally applicable to group sequential one-sided tests and two-sided tests, possibly with early stopping permitted to accept the null hypothesis. In applications to equivalence testing, tests are required to maintain a specified power, rather than Type I error rate: such tests can be constructed by defining the standardised test statistics used in the significance level approach with respect to appropriately chosen hypotheses.     

On the level probabilities for useful partially ordered alternatives in the analysis of variance

In the analysis of variance, we often encounter situations in which we want to test the null hypothesis of homogeneity of the normal means against various partially ordered alternative hypotheses. We study likelihood ratio tests for three useful types of alternatives: d-star, bipartite and broom tree. Especially, we give computational formulas for the level probabilities of the alternative types. The results permit us to obtain critical values for practical use.     

Robust inference from multiple test statistics via permutations: a better alternative to the single test statistic approach for randomized trials

Formal inference in randomized clinical trials is based on controlling the type I error rate associated with a single pre‐specified statistic. The deficiency of using just one method of analysis is that it depends on assumptions that may not be met. For robust inference, we propose pre‐specifying multiple test statistics and relying on the minimum p‐value for testing the null hypothesis of no treatment effect. The null hypothesis associated with the various test statistics is that the treatment groups are indistinguishable. The critical value for hypothesis testing comes from permutation distributions. Rejection of the null hypothesis when the smallest p‐value is less than the critical value controls the type I error rate at its designated value. Even if one of the candidate test statistics has low power, the adverse effect on the power of the minimum p‐value statistic is not much. Its use is illustrated with examples. We conclude that it is better to rely on the minimum p‐value rather than a single statistic particularly when that single statistic is the logrank test, because of the cost and complexity of many survival trials. Copyright © 2013 John Wiley & Sons, Ltd.     

A generalization of the Wilcoxon signed-rank test and its applications

This paper extends the Wilcoxon signed-rank test to the case where the available observations are imprecise quantities, rather than crisp. To do this, the associated test statistic is extended, using the α-cuts approach. In addition, the concept of critical value is generalized to the case when the significance level is given by a fuzzy number. Finally, to accept or reject the null hypothesis of interest, a preference degree between two fuzzy sets is employed for comparing the observed fuzzy test statistic and fuzzy critical value.     

Goodness‐of‐Fit Test for Monotone Functions

Abstract. In this article, we develop a test for the null hypothesis that a real‐valued function belongs to a given parametric set against the non‐parametric alternative that it is monotone, say decreasing. The method is described in a general model that covers the monotone density model, the monotone regression and the right‐censoring model with monotone hazard rate. The criterion for testing is an ‐distance between a Grenander‐type non‐parametric estimator and a parametric estimator computed under the null hypothesis. A normalized version of this distance is shown to have an asymptotic normal distribution under the null, whence a test can be developed. Moreover, a bootstrap procedure is shown to be consistent to calibrate the test.     

Model Checks in Inverse Regression Models with Convolution‐Type Operators

Abstract. We consider the problem of testing parametric assumptions in an inverse regression model with a convolution‐type operator. An L ₂ ‐type goodness‐of‐fit test is proposed which compares the distance between a parametric and a non‐parametric estimate of the regression function. Asymptotic normality of the corresponding test statistic is shown under the null hypothesis and under a general non‐parametric alternative with different rates of convergence in both cases. The feasibility of the proposed test is demonstrated by means of a small simulation study. In particular, the power of the test against certain types of alternative is investigated. Finally, an empirical example is provided, in which the proposed methods are applied to the determination of the shape of the luminosity profile of the elliptical galaxy NGC 5017.     

Nonparametric tests of hypotheses for umbrella alternatives

The author proposes a general method for constructing nonparametric tests of hypotheses for umbrella alternatives. Such alternatives are relevant when the treatment effect changes in direction after reaching a peak. The author's class of tests is based on the ranks of the observations. His general approach consists of defining two sets of rankings: the first is induced by the alternative and the other by the data itself. His test statistic measures the distance between the two sets. The author determines the asymptotic distribution for some special cases of distances under both the null and the alternative hypothesis when the location of the peak is known or unknown. He shows the good power of his tests through a limited simulation study     

Changepoint Estimation in a Segmented Linear Regression via Empirical Likelihood

For a segmented regression system with an unknown changepoint over two domains of a predictor, a new empirical likelihood ratio statistic is proposed to test the null hypothesis of no change. Under the null hypothesis of no change, the proposed test statistic is shown empirically to be Gumbel distributed with robust location and scale estimators against various parameter settings and error distributions. A power analysis is conducted to illustrate the performance of the test. Under the alternative hypothesis with a changepoint, the test statistic is utilized to estimate the changepoint between the two domains. A comparison of the frequency distributions between the proposed estimator and two parametric methods indicates that the proposed method is effective in capturing the true changepoint.     

The power functions of the likelihood ratio tests for a simple tree ordering in normal means: unequal weights

Likelihood ratio tests are considered for two testing situations; testing for the homogeneity of k normal means against the alternative restricted by a simple tree ordering trend and testing the null hypothesis that the means satisfy the trend against all alternatives. Exact expressions are given for the power functions for k = 3 and 4 and unequal sample sizes, both for the case of known and unknown population variances, and approximations are discussed for larger k. Also, Bartholomew’s conjectures concerning minimal and maximal powers are investigated for the case of equal and unequal sample sizes. The power formulas are used to compute powers for a numerical example.     

A Five-Decision Testing Procedure to Infer the Value of a Unidimensional Parameter

ABSTRACT

A statistical test can be seen as a procedure to produce a decision based on observed data, where some decisions consist of rejecting a hypothesis (yielding a significant result) and some do not, and where one controls the probability to make a wrong rejection at some prespecified significance level. Whereas traditional hypothesis testing involves only two possible decisions (to reject or not a null hypothesis), Kaiser’s directional two-sided test as well as the more recently introduced testing procedure of Jones and Tukey, each equivalent to running two one-sided tests, involve three possible decisions to infer the value of a unidimensional parameter. The latter procedure assumes that a point null hypothesis is impossible (e.g., that two treatments cannot have exactly the same effect), allowing a gain of statistical power. There are, however, situations where a point hypothesis is indeed plausible, for example, when considering hypotheses derived from Einstein’s theories. In this article, we introduce a five-decision rule testing procedure, equivalent to running a traditional two-sided test in addition to two one-sided tests, which combines the advantages of the testing procedures of Kaiser (no assumption on a point hypothesis being impossible) and Jones and Tukey (higher power), allowing for a nonnegligible (typically 20%) reduction of the sample size needed to reach a given statistical power to get a significant result, compared to the traditional approach.     

Towards a theory of point optimal testing

This paper puts the case for the inclusion of point optimal tests in the econometrician's repertoire. They do not suit every testing situation but the current evidence, which is reviewed here, indicates that they can have extremely useful Small-sample power properties. As well as being most powerful at a nominated point in the alternative hypothesis parameter space, they may also have optimum power at a number of other points and indeed be uniformly most powerful when such a test exists. Point optimal tests can also be used to trace out the maxemum attainable power envelope for a given testing problem, thus providing a benchmark against which test procedures can be evaluated. In some cases, point optimal tests can be constructed from tests of simple null hypothesis against a simple alternative. For a wide range of models of interst to econometricians, this paper shows how one can check whether a point optimal test can be constructed in this way. When it cannot, one may wish to consider approximately point optimal tests. As an illustration, the approach is applied to the non-nested problem of testing for AR(1) distrubances against MA(1) distrubances in the linear regression model.