Analysis of short-term systematic measurement error variance for the difference of paired data without repetition of measurement

The variance of short-term systematic measurement errors for the difference of paired data is estimated. The difference of paired data is determined by subtracting the measurement results of two methods, which measure the same item only once without measurement repetition. The unbiased estimators for short-term systematic measurement error variances based on the one-way random effects model are not fit for practical purpose because they can be negative. The estimators, which are derived for balanced data as well as for unbalanced data, are always positive but biased. The basis of these positive estimators is the one-way random effects model. The biases, variances, and the mean squared errors of the positive estimators are derived as well as their estimators. The positive estimators are fit for practical purpose.     

A combination multiple comparisons and subset selection procedure to identify treatments that are strictly inferior to the best

This paper considers the problem of identifying which treatments are strictly worse than the best treatment or treatments in a one-way layout, which has many important applications in screening trials for new product development. A procedure is proposed that selects a subset of the treatments containing only treatments that are known to be strictly worse than the best treatment or treatments. In addition, simultaneous confidence intervals are obtained which provide upper bounds on how inferior the treatments are compared with these best treatments. In this way, the new procedure shares the characteristics of both subset selection procedures and multiple comparison procedures. Some tables of critical points are provided for implementing the new procedure, and some examples of its use are given.     

Optimal design for the Bradley–Terry paired comparison model

Paired comparisons are a popular tool for questionnaires in psychological marketing research. The quality of the statistical analysis of the responses heavily depends on the design, i.e. the choice of the alternatives in the comparisons. In this paper we show that the structure of locally optimal designs changes substantially with the parameters in the underlying utility. This fact is illustrated by elementary examples, where the optimal designs can be completely characterized. As an alternative maximin efficient designs are proposed which perform well for all parameter settings. Research supported by grant Ho 1286 of the German Research Council (Deutsche Forschungsgemeinschaft).     

Avoiding 'data snooping' in multilevel and mixed effects models

Summary.  Multilevel or mixed effects models are commonly applied to hierarchical data. The level 2 residuals, which are otherwise known as random effects, are often of both substantive and diagnostic interest. Substantively, they are frequently used for institutional comparisons or rankings. Diagnostically, they are used to assess the model assumptions at the group level. Inference on the level 2 residuals, however, typically does not account for 'data snooping', i.e. for the harmful effects of carrying out a multitude of hypothesis tests at the same time. We provide a very general framework that encompasses both of the following inference problems: inference on the 'absolute' level 2 residuals to determine which are significantly different from 0, and inference on any prespecified number of pairwise comparisons. Thus, the user has the choice of testing the comparisons of interest. As our methods are flexible with respect to the estimation method that is invoked, the user may choose the desired estimation method accordingly. We demonstrate the methods with the London education authority data, the wafer data and the National Educational Longitudinal Study data.     

Nonparametric approaches to testing and multiple comparisons in a one-way anova

Two questions of interest involving nonparametric multiple comparisons are considered. The first question concerns whether it is appropriate to use a multiple comparison procedure as a test of the equality of k treatments, and if it is, which procedure performs best as a test. Our results show that for smaller k values some multiple comparison procedures perform well as tests. The second question concerns whether a joint ranking or a separate ranking multiple comparison procedure performs better as a test and as a device for treatment separation. We find that the joint ranking procedure does slightly better as a test, but for treatment separation the answer depends on the situation.     

Testing equality of two normal means using combined samples of paired and unpaired data

A test for equality of two normal means when the data consist of both paired and unpaired observations is proposed. The proposed test is compared with two other standard methods known in the literature with respect to the type I error rate and power using simulation results.     

Theory of nonparametric statistics for rounded-off data with applications

This article gives a unified account of nonparametric statistics, covering testing, estimating, multiple comparisons, analysis of variance and regression, for rounded-off data, with ties handled by the average scores method. The theory is illustrated by means of numerous applications to the Biomedical, Engineering and Behavioral Sciences.     

Use of tail areas for testing goodness-of-fit

Characterizing a set of data as a random sample from a specified distribution is often a precursor to statistical inference or hypothesis testing involving the extremes of the distribution -precisely the regions of greatest uncertainty. It seems reasonable then to exploit as best we can our limited knowledge of this region. Toward this end we investigate here the areas in the tails of the distribution as determined by the extreme order statistics as a criterion for testing goodness-of-fit.     

Nonparametric multiple comparison procedures for unbalanced one-way factorial designs

In this paper, we present several nonparametric multiple comparison (MC) procedures for unbalanced one-way factorial designs. The nonparametric hypotheses are formulated by using normalized distribution functions and the comparisons are carried out on the basis of the relative treatment effects. The proposed test statistics take the form of linear pseudo rank statistics and the asymptotic joint distribution of the pseudo rank statistics for testing treatments versus control satisfies the multivariate totally positive of order two condition irrespective of the correlations among the rank statistics. Therefore, in the context of MCs of treatments versus control, the nonparametric Simes test is validated for the global testing of the intersection hypothesis. For simultaneous testing of individual hypotheses, the nonparametric Hochberg stepup procedure strongly controls the familywise type I error rate asymptotically. With regard to all pairwise comparisons, we generalize various single-step and stagewise procedures to perform comparisons on the relative treatment effects. To further compare with normal theory counterparts, the asymptotic relative efficiencies of the nonparametric MC procedures with respect to the parametric MC procedures are derived under a sequence of Pitman alternatives in a nonparametric location shift model for unbalanced one-way layouts. Monte Carlo simulations are conducted to demonstrate the validity and power of the proposed nonparametric MC procedures.