Simultaneous confidence intervals by iteratively adjusted alpha for relative effects in the one-way layout

A bootstrap based method to construct 1−α simultaneous confidence intervals for relative effects in the one-way layout is presented. This procedure takes the stochastic correlation between the test statistics into account and results in narrower simultaneous confidence intervals than the application of the Bonferroni correction. Instead of using the bootstrap distribution of a maximum statistic, the coverage of the confidence intervals for the individual comparisons are adjusted iteratively until the overall confidence level is reached. Empirical coverage and power estimates of the introduced procedure for many-to-one comparisons are presented and compared with asymptotic procedures based on the multivariate normal distribution.     

Simultaneous confidence sets and confidence intervals for multiple ratios

This paper deals with the problem of simultaneously estimating multiple ratios. In the simplest case of only one ratio parameter, Fieller's theorem (J. Roy. Statist. Soc. Ser. B 16 (1954) 175) provides a confidence interval for the single ratio. For multiple ratios, there is no method available to construct simultaneous confidence intervals that exactly satisfy a given familywise confidence level. Many of the methods in use are conservative since they are based on probability inequalities. In this paper, first we consider exact simultaneous confidence sets based on the multivariate t-distribution. Two approaches of determining the exact simultaneous confidence sets are outlined. Second, approximate simultaneous confidence intervals based on the multivariate t-distribution with estimated correlation matrix and a resampling approach are discussed. The methods are applied to ratios of linear combinations of the means in the one-way layout and ratios of parameter combinations in the general linear model. Extensive Monte Carlo simulation is carried out to compare the performance of the various methods with respect to the stability of the estimated critical points and of the coverage probabilities.     

Simultaneous confidence bands for nonlinear regression models

The maximization and minimization procedure for constructing confidence bands about general regression models is explained. Then, using an existing confidence region about the parameters of a nonlinear regression model and the maximization and minimization procedure, a generally conservative simultaneous confidence band is constructed about the model. Two examples are given, and some problems with the procedure are discussed     

Max-min multiple comparison procedure for comparing several dose levels with a zero dose control

The comparison of increasing doses of a compound to a zero dose control is of interest in medical and toxicological studies. Assume that the mean dose effects are non-decreasing among the non-zero doses of the compound. A simple procedure that modifies Dunnett's procedure is proposed to construct simultaneous confidence intervals for pairwise comparisons of each dose group with the zero dose control by utilizing the ordering of the means. The simultaneous lower bounds and upper bounds by the new procedure are monotone, which is not the case with Dunnett's procedure. This is useful to categorize dose levels. The expected gains of the new procedure over Dunnett's procedure are studied. The procedure is shown by real data to compare well with its predecessor.     

Nonparametric multiple comparison procedures for unbalanced two-way layouts

In this paper, we consider nonparametric multiple comparison procedures for unbalanced two-way factorial designs under a pure nonparametric framework. For multiple comparisons of treatments versus a control concerning the main effects or the simple factor effects, the limiting distribution of the associated rank statistics is proven to satisfy the multivariate totally positive of order two condition. Hence, asymptotically the proposed Hochberg procedure strongly controls the familywise type I error rate for the simultaneous testing of the individual hypotheses. In addition, we propose to employ Shaffer's modified version of Holm's stepdown procedure to perform simultaneous tests on all pairwise comparisons regarding the main or simple factor effects and to perform simultaneous tests on all interaction effects. The logical constraints in the corresponding hypothesis families are utilized to sharpen the rejective thresholds and improve the power of the tests.     

Critical point and power calculations for the studentized range test for generally correlated means

The studentized range test is a widely applied statistical procedure to compare several normal means within the analysis of variance. However, up to now no general methodology is available to perform the all-pair comparisons precisely, such as the computation of p-values or quantiles in the simple unbalanced one-way layout. Instead, a variety of approximations have been proposed in the past. This article focuses on exact computations of simultaneous confidence intervals and exact sample size determinations for all-pair comparisons in the analysis of variance involving arbitrary variance-covariance matrices. General power expressions in closed form are developed and numerical issues concerning the arising multivariate central and noncentral t-distributions are discussed. An application to the usual fixed effects analysis of covariance illustrates the use of the obtained results.     

Improved simultaneous confidence intervals for linear contrasts and regression parameters

A well known method for obtaining conservative simultaneous confidence intervals for the K parameters in a linear regression model, or for K linear contrasts, is based on the percentage points of the Studentized maximum modulus distribution. From an inequality due to Sidak, conservative yet uniformly shorter confidence intervals would be possible if the percentage points of a particular form of the multivariate t distribution were available. The purpose of this paper is to provide the required percentage points. For K<8 the resulting confidence intervals can be substantially shorter.     

A revision of the tukey multiple comparisons procedure to control the probability of committing at most one type i error

Halperin et al. (1988) suggested an approach which allows for k Type I errors while using Scheffe's method of multiple comparisons for linear combinations of p means. In this paper we apply the same type of error control to Tukey's method of multiple pairwise comparisons. In fact, the variant of the Tukey (1953) approach discussed here defines the error control objective as assuring with a specified probability that at most one out of the p(p-l)/2 comparisons between all pairs of the treatment means is significant in two-sided tests when an overall null hypothesis (all p means are equal) is true or, from a confidence interval point of view, that at most one of a set of simultaneous confidence intervals for all of the pairwise differences of the treatment means is incorrect. The formulae which yield the critical values needed to carry out this new procedure are derived and the critical values are tabulated. A Monte Carlo study was conducted and several tables are presented to demonstrate the experimentwise Type I error rates and the gains in power furnished by the proposed procedure     

Simultaneous Inferences on the Cumulative Distribution Function of a Normal Distribution

This paper addresses the problem of constructing simultaneous confidence intervals for the cumulative distribution function of a normal distribution at several specified points. The procedure is based upon the observation of a random sample of independent observations from a normal distribution with an unknown mean and variance. A new methodology is proposed for obtaining confidence intervals with a specified overall simultaneous confidence level through the inversion of acceptance sets. Both one-sided and two-sided confidence intervals are considered. Some illustrations of the new method are provided, and comparisons are made with other approaches to the problem.     

Multiple comparisons with a control for exponential location parameters under heteroscedasticity

In this paper, a new design-oriented two-stage two-sided simultaneous confidence intervals, for comparing several exponential populations with control population in terms of location parameters under heteroscedasticity, are proposed. If there is a prior information that the location parameter of k exponential populations are not less than the location parameter of control population, one-sided simultaneous confidence intervals provide more inferential sensitivity than two-sided simultaneous confidence intervals. But the two-sided simultaneous confidence intervals have advantages over the one-sided simultaneous confidence intervals as they provide both lower and upper bounds for the parameters of interest. The proposed design-oriented two-stage two-sided simultaneous confidence intervals provide the benefits of both the two-stage one-sided and two-sided simultaneous confidence intervals. When the additional sample at the second stage may not be available due to the experimental budget shortage or other factors in an experiment, one-stage two-sided confidence intervals are proposed, which combine the advantages of one-stage one-sided and two-sided simultaneous confidence intervals. The critical constants are obtained using the techniques given in Lam [9,10]. These critical constant are compared with the critical constants obtained by Bonferroni inequality techniques and found that critical constant obtained by Lam [9,10] are less conservative than critical constants computed from the Bonferroni inequality technique. Implementation of the proposed simultaneous confidence intervals is demonstrated by a numerical example.     

Simultaneous Confidence Intervals for Ratios of Fixed Effect Parameters in Linear Mixed Models

In multiple comparisons of fixed effect parameters in linear mixed models, treatment effects can be reported as relative changes or ratios. Simultaneous confidence intervals for such ratios had been previously proposed based on Bonferroni adjustments or multivariate normal quantiles accounting for the correlation among the multiple contrasts. We propose Fieller-type intervals using multivariate t quantiles and the application of Markov chain Monte Carlo techniques to sample from the joint posterior distribution and construct percentile-based simultaneous intervals. The methods are compared in a simulation study including bioassay problems with random intercepts and slopes, repeated measurements designs, and multicenter clinical trials.     

Automatic selection of the proper family for simultaneous confidence intervals

Statisticians often employ simultaneous confidence intervals to reduce the likelihood of their drawing false conclusions when they must make a number of comparisons. To do this properly, it is necessary to consider the family of comparisons over which simultaneous confidence must be assured. Sometimes it is not clear what family of comparisons is appropriate. We describe how computer software can monitor the types of contrasts a user examines, and select the smallest family of contrasts that is likely to be of interest. We also describe how to calculate simultaneous confidence intervals for these families using a hybrid of the Bonferroni and Scheffé methods. Our method is especially suitable for problems with discrete and continuous predictors.     

Simultaneous confidence intervals for pairwise multiple comparisons in a two-way unbalanced design with unequal variances

In this research, we propose simultaneous confidence intervals for all pairwise multiple comparisons in a two-way unbalanced design with unequal variances, using a parametric bootstrap approach. Simulation results show that Type 1 error of the multiple comparison test is close to the nominal level even for small samples. They also show that the proposed method outperforms Tukey–Kramer procedure when variances are heteroscedastic and group sizes are unequal.     

Two stage multiple comparison procedures based on the studentized range

Stein’s (1945) two sample approach and Tukey’s T-Method of multiple comparisons (see e.g. Miller, 1966, Ch. 2) are combined to obtain fixed width simultaneous confidence intervals and simultaneous test procedures of predetermined Type I and Type II error levels, for all contrasts, in a one way layout. The necessary constants for implementing the two stage procedure are obtained under a least favorable configuration of the parameters. This provides the required protection of the null and alternative hypotheses under any configuration of parameters. A table is provided for some selected designs and error levels and an example is given to illustrate certain features of the new procedure.     

Multiple comparisons of matched proportions

It is well known (see, e.g., Scheffé (1959)) that if confidence intervals are desired for several treatment comparisons of interest, especially after a preliminary test of significance, then the appropriate technique is to consider simultaneous confidence intervals with a certain joint confidence coefficient. Goodman (1964) derived such simultaneous confidence intervals for contrasts among several multinomial populations, each with the same number, say J, of classes. The special case involving simultaneous confidence intervals for contrasts among several binomial populations on the basis of independent samples follows simply by taking J=2. This paper now deals with the problem of construction of simultaneous confidence intervals among probabilities of ‘success’ on the basis of matched samples.     

Nonparametric multiple comparison procedures for unbalanced one-way factorial designs

In this paper, we present several nonparametric multiple comparison (MC) procedures for unbalanced one-way factorial designs. The nonparametric hypotheses are formulated by using normalized distribution functions and the comparisons are carried out on the basis of the relative treatment effects. The proposed test statistics take the form of linear pseudo rank statistics and the asymptotic joint distribution of the pseudo rank statistics for testing treatments versus control satisfies the multivariate totally positive of order two condition irrespective of the correlations among the rank statistics. Therefore, in the context of MCs of treatments versus control, the nonparametric Simes test is validated for the global testing of the intersection hypothesis. For simultaneous testing of individual hypotheses, the nonparametric Hochberg stepup procedure strongly controls the familywise type I error rate asymptotically. With regard to all pairwise comparisons, we generalize various single-step and stagewise procedures to perform comparisons on the relative treatment effects. To further compare with normal theory counterparts, the asymptotic relative efficiencies of the nonparametric MC procedures with respect to the parametric MC procedures are derived under a sequence of Pitman alternatives in a nonparametric location shift model for unbalanced one-way layouts. Monte Carlo simulations are conducted to demonstrate the validity and power of the proposed nonparametric MC procedures.     

Single use conservative confidence regions in multivariate controlled calibration

We consider a multivariate linear model for multivariate controlled calibration, and construct some conservative confidence regions, which are nonempty and invariant under nonsingular transformations. The computation of our confidence region is easier compared to some of the existing procedures. We illustrate the results using two examples. The simulation results show the closeness of the coverage probability of our confidence regions to the assumed confidence level.     

Multiple comparisons of exponential location parameters with a control based on doubly censored sample under heteroscedasticity

In this article, a one-sample procedure for multiple comparisons of exponential location parameters with a control under heteroscedasticity is proposed. The observations are obtained by doubly censored samples. A one-sided and two-sided confidence intervals are used to perform such multiple comparisons. Statistical tables of critical values and an example of comparing four drugs in treating leukemia are provided.     

Simultaneous Tolerance Limits and a Unified Approach to some Nonparametric Theory

In this paper nonparametric simultaneous tolerance limits are developed using rectangle probabilities for uniform order statistics. Consideration is given to the handling of censored data, and some comparisons are made with the parametric normal theory. The nonparametric regional estimation techniques of (i) confidence bands for a distribution function, (ii) simultaneous confidence intervals for quantiles and (iii) simultaneous tolerance limits are unified. A Bayesian approach is also discussed.     

Statistics in the High School Curriculum

Recent work, spearheaded by Charles Dunnett (1980a), leads to the conclusion that the Tukey-Kramer (TK) method (popularly known as “Kramer's Method”) is the recommended multiple comparisons procedure for the simultaneous estimation of all pairwise differences of means in an imbalanced one-way ANOVA design with homogeneous variances. Nine other multiple comparisons methods are compared to each other and to the TK method using the criteria of conservativeness, narrowness of confidence intervals, robustness, and ease of use. The degree of superiority of the TK method over these methods, especially over the popular Bonferroni method, is sufficient to warrant recommending its use. Because of the lack of robustness of the TK method in heterogeneous variance cases, other methods are recommended.