On the conservative simultaneous confidence procedures for multiple comparisons among mean vectors

In this paper, conservative simultaneous confidence intervals for multiple comparisons among mean vectors in multivariate normal distributions are considered. Some properties of the multivariate Tukey–Kramer procedure for pairwise comparisons and the conservative simultaneous confidence procedure for comparisons with a control are presented. Particularly, the upper bound for the conservativeness of the simultaneous confidence procedure for comparisons with a control is obtained. Finally, numerical results by Monte Carlo simulations and an example to illustrate the procedure are given.     

Joint estimation for the parameters of Weibull distribution

This paper discusses exact joint confidence region for the shape parameter β and scale parameter η of the two-parameter Weibull distribution. As an application, the joint confidence region is used to obtain a conservative lower confidence bound for the reliability function. The method can be used for both complete and censored samples.     

Some Bayesian Methods for Two Auditing Problems

Two problems of interest to auditors are: (i) finding an upper bound for the total amount of overstatement of assets in a set of accounts; and (ii) estimating the amount of sales tax owed on a collection of transactions. For the first problem, the Stringer bound has often been used despite the fact that in many cases it is known to be much too large. Here we will introduce a family of stepwise Bayes models that yields bounds that are closely related to the Stringer bound but are less conservative. Then we will show how this approach can also be used for solving the second problem. This will allow practitioners with modest amounts of prior information to select inference procedures with good frequentist properties.     

Deriving a lower bound for the proportion of perceivers in replicated difference tests by means of multiple test theory

Analyzing repeated difference tests aims in significance testing for differences as well as in estimating the mean discrimination ability of the consumers. In addition to the average success probability, the proportion of consumers that may detect the difference between two products and therefore account for any increase of this probability is of interest. While some authors address the first two goals, for the latter one only an estimator directly linked to the average probability seems to be used. However, this may lead to unreasonable results. Therefore we propose a new approach based on multiple test theory. We define a suitable set of hypotheses that is closed under intersection. From this, we derive a series of hypotheses that may be sequentially tested while the overall significance level will not be violated. By means of this procedure we may determine a minimal number of assessors that must have perceived the difference between the products at least once in a while. From this, we can find a conservative lower bound for the proportion of perceivers within the consumers. In several examples, we give some insight into the properties of this new method and show that the knowledge about this lower bound might indeed be valuable for the investigator. Finally, an adaption of this approach for similarity tests will be proposed.     

Bounding sample size projections for the area under a ROC curve

Studies of diagnostic tests are often designed with the goal of estimating the area under the receiver operating characteristic curve (AUC) because the AUC is a natural summary of a test's overall diagnostic ability. However, sample size projections dealing with AUCs are very sensitive to assumptions about the variance of the empirical AUC estimator, which depends on two correlation parameters. While these correlation parameters can be estimated from the available data, in practice it is hard to find reliable estimates before the study is conducted. Here we derive achievable bounds on the projected sample size that are free of these two correlation parameters. The lower bound is the smallest sample size that would yield the desired level of precision for some model, while the upper bound is the smallest sample size that would yield the desired level of precision for all models. These bounds are important reference points when designing a single or multi-arm study; they are the absolute minimum and maximum sample size that would ever be required. When the study design includes multiple readers or interpreters of the test, we derive bounds pertaining to the average reader AUC and the ‘pooled’ or overall AUC for the population of readers. These upper bounds for multireader studies are not too conservative when several readers are involved.     

Confidence Intervals for Intraclass Correlation in Inter-Rater Reliability

Abstract Calculation of a confidence interval for intraclass correlation to assess inter‐rater reliability is problematic when the number of raters is small and the rater effect is not negligible. Intervals produced by existing methods are uninformative: the lower bound is often close to zero, even in cases where the reliability is good and the sample size is large. In this paper, we show that this problem is unavoidable without extra assumptions and we propose two new approaches. The first approach assumes that the raters are sufficiently trained and is related to a sensitivity analysis. The second approach is based on a model with fixed rater effect. Using either approach, we obtain conservative and informative confidence intervals even from samples with only two raters. We illustrate our point with data on the development of neuromotor functions in children and adolescents.     

Exact testing in multivariate regression

An F statistic due to Rao (1951,1973) tests uniform mixed linear restrictions in the multivariateregression model. In combination with a generalization of the Bera-Evans-Savin exact functional relationship between the W, LR, and LM statistics, Rao's F serves to unify a number of exact test procedures commonly applied in disparate empirical literatures. Examples in demand analysis and asset pricing are provided. The availability of exact tests of restrictions in certain nonlinear models when the model is linear under the null, originally explored by Milliken-Graybill (1970), is extended to multivariate regression. Generalized RESET, J-, and Hausman-Wu tests are resented. As an extension of Dufour (1989), bounds tests exist for nonlinear and inequality restrictions. Applications include conservative bound tests for symmetry or negativity of the substitution matrix in demand systems.     

Inferences on the lognormal mean for complete samples

In many engineering problems it is necessary to draw statistical inferences on the mean of a lognormal distribution based on a complete sample of observations. Statistical demonstration of mean time to repair (MTTR) is one example. Although optimum confidence intervals and hypothesis tests for the lognormal mean have been developed, they are difficult to use, requiring extensive tables and/or a computer. In this paper, simplified conservative methods for calculating confidence intervals or hypothesis tests for the lognormal mean are presented. In this paper, “conservative” refers to confidence intervals (hypothesis tests) whose infimum coverage probability (supremum probability of rejecting the null hypothesis taken over parameter values under the null hypothesis) equals the nominal level. The term “conservative” has obvious implications to confidence intervals (they are “wider” in some sense than their optimum or exact counterparts). Applying the term “conservative” to hypothesis tests should not be confusing if it is remembered that this implies that their equivalent confidence intervals are conservative. No implication of optimality is intended for these conservative procedures. It is emphasized that these are direct statistical inference methods for the lognormal mean, as opposed to the already well-known methods for the parameters of the underlying normal distribution. The method currently employed in MIL-STD-471A for statistical demonstration of MTTR is analyzed and compared to the new method in terms of asymptotic relative efficiency. The new methods are also compared to the optimum methods derived by Land (1971, 1973).     

On the minimum expected quantity for the validity of the chi-squared test in 2 2 2 tables

A 2 2 2 contingency table can often be analysed in an exact fashion by using Fisher's exact test and in an approximate fashion by using the chi-squared test with Yates' continuity correction, and it is traditionally held that the approximation is valid when the minimum expected quantity E is E S 5. Unfortunately, little research has been carried out into this belief, other than that it is necessary to establish a bound E>E*, that the condition E S 5 may not be the most appropriate (Martín Andrés et al., 1992) and that E* is not a constant, but usually increasing with the growth of the sample size (Martín Andrés & Herranz Tejedor, 1997). In this paper, the authors conduct a theoretical experimental study from which they ascertain that E* value (which is very variable and frequently quite a lot greater than 5) is strongly related to the magnitude of the skewness of the underlying hypergeometric distribution, and that bounding the skewness is equivalent to bounding E (which is the best control procedure). The study enables estimating the expression for the above-mentioned E* (which in turn depends on the number of tails in the test, the alpha error used, the total sample size, and the minimum marginal imbalance) to be estimated. Also the authors show that E* increases generally with the sample size and with the marginal imbalance, although it does reach a maximum. Some general and very conservative validity conditions are E S 35.53 (one-tailed test) and E S 7.45 (two-tailed test) for alpha nominal errors in 1% h f h 10%. The traditional condition E S 5 is only valid when the samples are small and one of the marginals is very balanced; alternatively, the condition E S 5.5 is valid for small samples or a very balanced marginal. Finally, it is proved that the chi-squared test is always valid in tables where both marginals are balanced, and that the maximum skewness permitted is related to the maximum value of the bound E*, to its value for tables with at least one balanced marginal and to the minimum value that those marginals must have (in non-balanced tables) for the chi-squared test to be valid.     

A method of choosing multiway partitions for classification and decision trees

A method is given of choosing k-way partitions (where 2 ≤ k ≤ (number of categories of predictor variable)) in classification or decision tree analyses. The method, like that proposed by Kass, chooses the best partition on the basis of statistical significanceand uses the Bonferroni inequality to calculate the significance. Unlike Kass's algorithm, the algorithm does not favour simple partitions (low values of k) nor does it discriminate against free-type (no restriction on order of values) predictor variables with many categories. A method of adjusting the significance for the number of predictor variables and of using multiple comparisons to put an upper bound on the significance is given. Monte Carlo tests show that the algorithm gives slightly conservative tests of significance for both small and large samples and does not favour one type of predictor variable over another. The algorithm is incoroporated in a PC software program, Knowledgeseeker,which is briefly described.     

Testing Variability in the Two-Sample Case

A number of robust methods for testing variability have been reported in previous literature. An examination of these procedures for a wide variety of populations confirms their general robustness. Shoemaker's improvement of the F test extends that test use to a realistic variety of population shapes. However, a combination of the Brown–Forsythe and O'Brien methods based on testing kurtosis is shown to be conservative for a wide range of sample sizes and population distributions. The composite test is also shown to be more powerful in most conditions than other conservative procedures.     

On improving the min test for the analysis of combination drug trials

In the analysis of clinical trials of combination therapies, the min test is often used to demonstrate a combination therapy's superiority to its components. Although uniformly most powerful within a class of monotone tests, this test is excessively conservative with low power at certain alternatives. This paperdemonstrates that more powerful tests may be found outside of this class. Some such alternative tests are suggested and compared with the min tests on the basis of their actual significance levels and powers. The proposed tests are observed to be less conservative and uniformly more powerful than the min test.     

An exact upper limit for the variance bias in a carry-over model with correlated errors

The analysis of crossover designs assuming i.i.d. errors leads to biased variance estimates whenever the true covariance structure is not spherical. As a result, the OLS F-test for the equality of the direct effects of the treatments is not valid. Bellavance et al. [1996. Biometrics 52, 607–612] use simulations to show that a modified F-test based on an estimate of the within subjects covariance matrix allows for nearly unbiased tests. Kunert and Utzig [1993. JRSS B 55, 919–927] propose an alternative test that does not need an estimate of the covariance matrix. Instead, they correct the F-statistic by multiplying by a constant based on the worst-case scenario. However, for designs with more than three observations per subject, Kunert and Utzig (1993) only give a rough upper bound for the worst-case variance bias. This may lead to overly conservative tests. In this paper we derive an exact upper limit for the variance bias due to carry-over for an arbitrary number of observations per subject. The result holds for a certain class of highly efficient balanced crossover designs.     

Bias bound for the minimax estimator

The bias bound function of an estimator is an important quantity in order to perform globally robust inference. We show how to evaluate the exact bias bound for the minimax estimator of the location parameter for a wide class of unimodal symmetric location and scale family. We show, by an example, how to obtain an upper bound of the bias bound for a unimodal asymmetric location and scale family. We provide the exact bias bound of the minimum distance/disparity estimators under a contamination neighborhood generated from the same distance.     

On the block structure of proper block designs

In this paper we consider proper block designs and derive an upper bound for the number of blocks which can have a fixed number of symbols common with a given block of the design. To arrive at the desired bound, a generalization of an integer programming theorem due to Bush (1976) is first obtained. The integer programming theorem is then used to derive the main result of this paper. The bound given here is then compared with a similar bound obtained by Kageyama and Tsuji (1977).     

Uncertainty Quantification in Case of Imperfect Models: A Non‐Bayesian Approach

The starting point in uncertainty quantification is a stochastic model, which is fitted to a technical system in a suitable way, and prediction of uncertainty is carried out within this stochastic model. In any application, such a model will not be perfect, so any uncertainty quantification from such a model has to take into account the inadequacy of the model. In this paper, we rigorously show how the observed data of the technical system can be used to build a conservative non‐asymptotic confidence interval on quantiles related to experiments with the technical system. The construction of this confidence interval is based on concentration inequalities and order statistics. An asymptotic bound on the length of this confidence interval is presented. Here we assume that engineers use more and more of their knowledge to build models with order of errors bounded by . The results are illustrated by applying the newly proposed approach to real and simulated data.     

On the choice of the prior distribution in hypergeometric sampling

Information in a statistical procedure arising from sources other than sampling is called prior information, and its incorporation into the procedure forms the basis of the Bayesian approach to statistics. Under hypergeometric sampling, methodology is developed which quantifies the amount of information provided by the sample data relative to that provided by the prior distribution and allows for a ranking of prior distributions with respect to conservativeness, where conservatism refers to restraint of extraneous information embedded in any prior distribution. The most conservative prior distribution from a specified class (each member of which carries the available prior information) is that prior distribution within the class over which the likelihood function has the greatest average domination. Four different families of prior distributions are developed by considering a Bayesian approach to the formation of lots. The most conservative prior distribution from each of the four families of prior distributions is determined and compared for the situation when no prior information is available. The results of the comparison advocate the use of the Polya (beta-binomial) prior distribution in hypergeometric sampling.     

Subset selection of the t best populations

Selection of the “best” t out of k populations has been considered in the indifferece zone formulation by Bachhofer (1954) and in the subset selection formulation by Carroll, Gupta and Huang (1975). The latter approach is used here to obtain conservative solutions for the goals of selecting (i) all the “good” or (ii) only “good” populations, where “good” means having a location parameter among the largest t. For the case of normal distributions, with common unknown variance, tables are produced for implementing these procedures. Also, for this case, simulation results suggest that the procedure may not be too conservative.     

Optimum spring balance weighing designs for estimating the total weight

The problem of estimation of the total weight or objects using a spring balance weighing design has been deait with in this paper Based on a theorem by Dey and Gupta (1977) giving a lower bound for the variance of the estimated total weight, a necessary and sufficient condition for this lower bound to be attained is obtained. A few special cases where the lower bound is attained are enumerated.     

Test procedures in coyariamce analysis assuming a general correlation pattern

The analysis of covariance procedure is considered when the observations in each cell are equicorrelated. A correction procedure is given, A computationally easier conservative test statistic is also given. The conservative test statistic allows one to more readily determine the consequences of ignoring correlations, even slight correlations, in the analysis of covariance procedure. The difference of the corrected test and the conservative test is shown to converge in probability to zero. This conservative test is easy to implement on statistical computer packages, It is shown, that for the general correlation pattern, any test involving the regression coefficients of the covariables is an exact test. An example illustrates the procedure