Multiple comparisons with a control for exponential location parameters under heteroscedasticity

In this paper, a new design-oriented two-stage two-sided simultaneous confidence intervals, for comparing several exponential populations with control population in terms of location parameters under heteroscedasticity, are proposed. If there is a prior information that the location parameter of k exponential populations are not less than the location parameter of control population, one-sided simultaneous confidence intervals provide more inferential sensitivity than two-sided simultaneous confidence intervals. But the two-sided simultaneous confidence intervals have advantages over the one-sided simultaneous confidence intervals as they provide both lower and upper bounds for the parameters of interest. The proposed design-oriented two-stage two-sided simultaneous confidence intervals provide the benefits of both the two-stage one-sided and two-sided simultaneous confidence intervals. When the additional sample at the second stage may not be available due to the experimental budget shortage or other factors in an experiment, one-stage two-sided confidence intervals are proposed, which combine the advantages of one-stage one-sided and two-sided simultaneous confidence intervals. The critical constants are obtained using the techniques given in Lam [9,10]. These critical constant are compared with the critical constants obtained by Bonferroni inequality techniques and found that critical constant obtained by Lam [9,10] are less conservative than critical constants computed from the Bonferroni inequality technique. Implementation of the proposed simultaneous confidence intervals is demonstrated by a numerical example.     

Multiple comparisons of several populations with more than one control with respectto scale parameter

In this paper, one-sided and two-sided test procedures for comparing several treatments with more than one control with respect to scale parameter are proposed. The proposed test procedures are inverted to obtain the associated simultaneous confidence intervals. The multiple comparisons of test treatments with the best control are also developed. The computation of the critical points, required to implement the proposed procedures, is discussed by taking the normal probability model. Applications of the proposed test procedures to two-parameter exponential probability model are also demonstrated.     

Two stage multiple comparison procedures based on the studentized range

Stein’s (1945) two sample approach and Tukey’s T-Method of multiple comparisons (see e.g. Miller, 1966, Ch. 2) are combined to obtain fixed width simultaneous confidence intervals and simultaneous test procedures of predetermined Type I and Type II error levels, for all contrasts, in a one way layout. The necessary constants for implementing the two stage procedure are obtained under a least favorable configuration of the parameters. This provides the required protection of the null and alternative hypotheses under any configuration of parameters. A table is provided for some selected designs and error levels and an example is given to illustrate certain features of the new procedure.     

A ratio-to-control Williams-type test for trend

Under certain conditions, many multiple contrast tests based on the difference of treatment means can also be conveniently expressed in terms of ratios. In this paper, a Williams test for trend is defined as ratios-to-control for ease of interpretation and to obtain directly comparable confidence intervals. Simultaneous confidence intervals for percentages are particularly helpful for interpretations in the case of multiple endpoints. Methods for constructing simultaneous confidence intervals are discussed under both homogeneous and heterogeneous error variances. This approach is available in the R extension package mratios. The proposed method is used to test for trend in an immunotoxicity study with several endpoints as an example.     

A method of unconstrained multiple comparisons with the best

There are three types of multiple comparisons: all-pairwise multiple comparisons (MCA), multiple comparisons with the best (MCB), and multiple comparisons with a control (MCC). There are also three levels of multiple comparisons inference: confidence sets, subset comparisons, test of homogeneity. In current practice, MCA procedures dominate. In correct attempts at more efficient comparisons, in the form of employing lower level MCA procedures for higher level inference, account for the most frequent abuses in multiple comparisons. A better strategy is to choose the correct type of inference at the level of inference desired. In particular, very often the simulataneous comparisons of each treatment with the best of the other treatments (MCB) suffice. Hsu (1984b) gave simultaneous confidence intervals for θ_i ? max_j≠iθ_j having the simple form [? (Y_i ?max_j≠i Y_j ? C) (Y_i?max_j≠i Y_j + C)⁺]. Those intervals were constrained, sothat even if a treatment is inferred to be the best, no positive bound on how much it is better thatn the rest is given, a somewhat undesirable property. In this article it is shown that by employing a slightly larger critical value, the nonpositivity constraint on the lower bound is removed.     

Multiple comparison procedures for finding non-maximum normal means

Abstract

In this study, we discuss multiple comparison procedures for finding normal means which are not maximum among several normal means. Specifically, we propose the single step procedure, the sequentially rejective step down procedure and the step up procedure. For the single step procedure we determine the critical value for a specified significance level. For the sequentially rejective step down procedure and the step up procedure we determine the critical value at each step of the test for a specified significance level. For three procedures we formulate the power of the test under a specified alternative hypothesis. We give some numerical examples regarding critical values and power of the test intended to compare three procedures.     

Simultaneous confidence intervals for pairwise multiple comparisons in a two-way unbalanced design with unequal variances

In this research, we propose simultaneous confidence intervals for all pairwise multiple comparisons in a two-way unbalanced design with unequal variances, using a parametric bootstrap approach. Simulation results show that Type 1 error of the multiple comparison test is close to the nominal level even for small samples. They also show that the proposed method outperforms Tukey–Kramer procedure when variances are heteroscedastic and group sizes are unequal.     

Multi-sample inference for simple-tree alternatives with ranked-set samples

This paper develops a non‐parametric multi‐sample inference for simple‐tree alternatives for ranked‐set samples. The multi‐sample inference provides simultaneous one‐sample sign confidence intervals for the population medians. The decision rule compares these intervals to achieve the desired type I error. For the specified upper bounds on the experiment‐wise error rates, corresponding individual confidence coefficients are presented. It is shown that the testing procedure is distribution‐free. To achieve the desired confidence coefficients for multi‐sample inference, a nonparametric confidence interval is constructed by interpolating the adjacent order statistics. Interpolation coefficients and coverage probabilities are provided, along with the nominal levels.     

A revision of the tukey multiple comparisons procedure to control the probability of committing at most one type i error

Halperin et al. (1988) suggested an approach which allows for k Type I errors while using Scheffe's method of multiple comparisons for linear combinations of p means. In this paper we apply the same type of error control to Tukey's method of multiple pairwise comparisons. In fact, the variant of the Tukey (1953) approach discussed here defines the error control objective as assuring with a specified probability that at most one out of the p(p-l)/2 comparisons between all pairs of the treatment means is significant in two-sided tests when an overall null hypothesis (all p means are equal) is true or, from a confidence interval point of view, that at most one of a set of simultaneous confidence intervals for all of the pairwise differences of the treatment means is incorrect. The formulae which yield the critical values needed to carry out this new procedure are derived and the critical values are tabulated. A Monte Carlo study was conducted and several tables are presented to demonstrate the experimentwise Type I error rates and the gains in power furnished by the proposed procedure     

Controlling the familywise error rate with plug-in estimator for the proportion of true null hypotheses

Summary.  Estimation of the number or proportion of true null hypotheses in multiple-testing problems has become an interesting area of research. The first important work in this field was performed by Schweder and Spjøtvoll. Among others, they proposed to use plug-in estimates for the proportion of true null hypotheses in multiple-test procedures to improve the power. We investigate the problem of controlling the familywise error rate FWER when such estimators are used as plug-in estimators in single-step or step-down multiple-test procedures. First we investigate the case of independent p -values under the null hypotheses and show that a suitable choice of plug-in estimates leads to control of FWER in single-step procedures. We also investigate the power and study the asymptotic behaviour of the number of false rejections. Although step-down procedures are more difficult to handle we briefly consider a possible solution to this problem. Anyhow, plug-in step-down procedures are not recommended here. For dependent p -values we derive a condition for asymptotic control of FWER and provide some simulations with respect to FWER and power for various models and hypotheses.     

Multiple Comparison Procedures: The Practical Solution

A practicing statistician looks at the multiple comparison controversy and related issues through the eyes of the users. The concept of consistency is introduced and discussed in relation to five of the more common multiple comparison procedures. All of the procedures are found to be inconsistent except the simplest procedure, the unrestricted least significant difference (LSD) procedure (or multiple t test). For this and other reasons the unrestricted LSD procedure is recommended for general use, with the proviso that it should be viewed as a hypothesis generator rather than as a method for simultaneous hypothesis generation and testing. The implications for Scheffé's test for general contrasts are also discussed, and a new recommendation is made.     

Modifications of the Bonferroni-Holm procedure for a multi-way ANOVA

We present step-wise test procedures based on the Bonferroni-Holm principle for multi-way ANOVA-type models. It is shown for two plausible modifications that the multiple level α is preserved. These theoretical results are supplemented by a simulation study, in a two-way ANOVA setting, to compare the multiple procedures with respect to their simultaneous power and the relative frequency of correctly rejected false hypotheses. Financial support of the Deutsche Forschungsgemeinschaft is gratefully acknowledged.     

Simultaneous Confidence Intervals for the Population Cell Means,for Two-by-Two Factorial Data,that Utilize Uncertain Prior Information

Consider a two-by-two factorial experiment with more than one replicate. Suppose that we have uncertain prior information that the two-factor interaction is zero. We describe new simultaneous frequentist confidence intervals for the four population cell means, with simultaneous confidence coefficient 1 ? α, that utilize this prior information in the following sense. These simultaneous confidence intervals define a cube with expected volume that (a) is relatively small when the two-factor interaction is zero and (b) has maximum value that is not too large. Also, these intervals coincide with the standard simultaneous confidence intervals obtained by Tukey’s method, with simultaneous confidence coefficient 1 ? α, when the data strongly contradict the prior information that the two-factor interaction is zero. We illustrate the application of these new simultaneous confidence intervals to a real data set.     

A comparative study of confidence intervals for negative binomial proportion

In this paper, we investigate four existing and three new confidence interval estimators for the negative binomial proportion (i.e., proportion under inverse/negative binomial sampling). An extensive and systematic comparative study among these confidence interval estimators through Monte Carlo simulations is presented. The performance of these confidence intervals are evaluated in terms of their coverage probabilities and expected interval widths. Our simulation studies suggest that the confidence interval estimator based on saddlepoint approximation is more appealing for large coverage levels (e.g., nominal level≤1% ) whereas the score confidence interval estimator is more desirable for those commonly used coverage levels (e.g., nominal level>1% ). We illustrate these confidence interval construction methods with a real data set from a maternal congenital heart disease study.     

CONDITIONAL INFERENCE PROCEDURES FOR THE PARETO AND POWER FUNCTION DISTRIBUTIONS BASED ON TYPE-II RIGHT CENSORED SAMPLES

In this paper we consider conditional inference procedures for the Pareto and power function distributions. We develop procedures for obtaining confidence intervals for the location and scale parameters as well as upper and lower n probability tolerance intervals for a proportion g, given a Type-II right censored sample from the corresponding distribution. The intervals are exact, and are obtained by conditioning on the observed values of the ancillary statistics. Since, for each distribution, the procedures assume that a shape parameter x is known, a sensitivity analysis is also carried out to see how the procedures are affected by changes in x.     

Multiple comparisons with the average for exponential location parameters based on doubly censored sample under heteroscedasticity

In this paper, a one-stage multiple comparison procedures with the average for exponential location parameters based on the doubly censored sample under heteroscedasticity is proposed. These intervals can be used to identify a subset which includes all no-worse-than-the-average treatments in an experimental design and to identify better-than-the-average, worse-than-the-average and not-much-different-from-the-average products in agriculture, emerging market, pharmaceutical industries. The critical values are tabulated in a table for practical use. A simulation study on the confidence length and coverage probabilities is done. At last, an example of comparing four drugs in the treatment of leukemia is given to demonstrate the proposed procedures.     

New one-stage multiple comparison procedures with the average for exponential location parameters under heteroscedasticity

ABSTRACT

In this paper, we present new one-stage multiple comparison procedures with the average for location parameters of two-parameter exponential distributions under heteroscedasticity by modifying the existing one proposed by Wu [One stage multiple comparisons with the average for exponential location parameters under heteroscedasticity. Comput Stat Data Anal. 2013;68:352–360] with unequal sample sizes. A simulation study is done and the results show that the proposed procedures have shorter confidence length with coverage probabilities closer to the nominal ones. At last, an example of comparing the survival days of patients for four categories of lung cancer is given to demonstrate the proposed procedures.     

On the conservative simultaneous confidence procedures for multiple comparisons among mean vectors

In this paper, conservative simultaneous confidence intervals for multiple comparisons among mean vectors in multivariate normal distributions are considered. Some properties of the multivariate Tukey–Kramer procedure for pairwise comparisons and the conservative simultaneous confidence procedure for comparisons with a control are presented. Particularly, the upper bound for the conservativeness of the simultaneous confidence procedure for comparisons with a control is obtained. Finally, numerical results by Monte Carlo simulations and an example to illustrate the procedure are given.     

Extension of two-sided test to multiple treatment trials

In a two-treatment trial, a two-sided test is often used to reach a conclusion, Usually we are interested in doing a two-sided test because of no prior preference between the two treatments and we want a three-decision framework. When a standard control is just as good as the new experimental treatment (which has the same toxicity and cost), then we will accept both treatments. Only when the standard control is clearly worse or better than the new experimental treatment, then we choose only one treatment. In this paper, we extend the concept of a two-sided test to the multiple treatment trial where three or more treatments are involved. The procedure turns out to be a subset selection procedure; however, the theoretical framework and performance requirement are different from the existing subset selection procedures. Two procedures (exclusion or inclusion) are developed here for the case of normal data with equal known variance. If the sample size is large, they can be applied with unknown variance and with the binomial data or survival data with random censoring.     

Simultaneous confidence sets and confidence intervals for multiple ratios

This paper deals with the problem of simultaneously estimating multiple ratios. In the simplest case of only one ratio parameter, Fieller's theorem (J. Roy. Statist. Soc. Ser. B 16 (1954) 175) provides a confidence interval for the single ratio. For multiple ratios, there is no method available to construct simultaneous confidence intervals that exactly satisfy a given familywise confidence level. Many of the methods in use are conservative since they are based on probability inequalities. In this paper, first we consider exact simultaneous confidence sets based on the multivariate t-distribution. Two approaches of determining the exact simultaneous confidence sets are outlined. Second, approximate simultaneous confidence intervals based on the multivariate t-distribution with estimated correlation matrix and a resampling approach are discussed. The methods are applied to ratios of linear combinations of the means in the one-way layout and ratios of parameter combinations in the general linear model. Extensive Monte Carlo simulation is carried out to compare the performance of the various methods with respect to the stability of the estimated critical points and of the coverage probabilities.