Optimal design results for 2n factorial paired comparison experiments

Four general classes of partially balanced designs for 2ⁿ factorials, corresponding to four different forms of a general null hypothesis H on factorial effects, are presented. For the typical design in each class, the simplified form of the non-centrality parameter λ² of the asymptotic chi-square distribution of the likelihood ratio statistic for testing the corresponding form of H₀ is derived under defined local alternatives. Optimal designs d₁ maximizing λ² in the i-th class and minimizing the trace, determinant and largest eigenvalue of a defined covariance matrix, i =1,…,4, are determined.     

D-optimal weighted paired comparison designs

As a generalization of the paired comparison designs, the experimental design which considers the weighted difference between responses is studied. D-optimal designs are constructed for a model with main effects and first-order interactions. The experimental region is a hypercube or a hypersphere.     

Dynamic paired comparison models with stochastic variances

In paired comparison experiments, the worth or merit of a unit is measured through comparisons against other units. When paired comparison outcomes are collected over time and the merits of the units may be changing, it is often convenient to assume the data follow a non-linear state-space model. Typical paired comparison state-space models that assume a fixed (unknown) autoregressive variance do not account for the possibility of sudden changes in the merits. This is a particular concern, for example, in modeling cognitive ability in human development; cognitive ability not only changes over time, but also can change abruptly. We explore a particular extension of conventional state-space models for paired comparison data that allows the state variance to vary stochastically. Models of this type have recently been developed and applied to modeling financial data, but can be seen to have applicability in modeling paired comparison data. A filtering algorithm is also derived that can be used in place of likelihood-based computations when the number of objects being compared is large. Applications to National Football League game outcomes and chess game outcomes are presented.     

Optimal paired comparison designs for first-order interactions

In many fields of applications paired comparisons are used in which either full or partial profiles of the alternatives are presented. For this situation we introduce an appropriate model and derive optimal designs in the presence of interactions when all attributes have the same number of levels.     

Optimal designs for asymmetrical factorial paired comparison experiments

Three forms of a general null hypothesis Ho on the factorial parameters of a general asymmetrical factorial paired comparison experiment are considered. A class of partially balanced designscorresponding to each form of H₀ is constructed and the A,D and ioptimal design, minimizing the trace, determinant and largest eigenvalue of a defined covariance matrix of related maximumlikelihoodestimators, in that class is determined. Moreover, the optimal design in each class maximizes the noncentrality parameter λ² of the asymptotic noncentral chi-square distribution of the likelihood ratiostatistic -2 log λ for testing H_o under defined local alternatives. These results apply directly to symmetrical factorial paired comparison experiments as special casesExamples are given forillustrating applications of the developed results     

Design and analysis of paired comparison experiments involving mixtures

In applications involving subjective judgements in the form of paired comparison experiments, the treatments to be compared may be a resulting mixture of several components in which the proportion, and not the actual amount of a given component is recorded. Springall's result relating classical response surface designs with designs for paired comparison experiments is used to construct rotatable and minimum bias designs for paired comparison experiments with mixtures.     

A comparison of several adaptive tests for paired data

In the last few years, two adaptive tests for paired data have been proposed. One test proposed by Freidlin et al. [On the use of the Shapiro–Wilk test in two-stage adaptive inference for paired data from moderate to very heavy tailed distributions, Biom. J. 45 (2003), pp. 887–900] is a two-stage procedure that uses a selection statistic to determine which of three rank scores to use in the computation of the test statistic. Another statistic, proposed by O'Gorman [Applied Adaptive Statistical Methods: Tests of Significance and Confidence Intervals, Society for Industrial and Applied Mathematics, Philadelphia, 2004], uses a weighted t-test with the weights determined by the data. These two methods, and an earlier rank-based adaptive test proposed by Randles and Hogg [Adaptive Distribution-free Tests, Commun. Stat. 2 (1973), pp. 337–356], are compared with the t-test and to Wilcoxon's signed-rank test. For sample sizes between 15 and 50, the results show that the adaptive test proposed by Freidlin et al. and the adaptive test proposed by O'Gorman have higher power than the other tests over a range of moderate to long-tailed symmetric distributions. The results also show that the test proposed by O'Gorman has greater power than the other tests for short-tailed distributions. For sample sizes greater than 50 and for small sample sizes the adaptive test proposed by O'Gorman has the highest power for most distributions.     

Decision-making for paired comparison using the extended amended Davidson model

For decision purpose, one of the commonly used statistical applications is the comparison of two or more objects or characteristics. Sometimes, it is not possible to compare the objects at a time or when the number of objects under study is large and the differences between the objects become small, then a useful way is to compare them in pairwise manner. Because of its practical nature, the fields in which paired comparison techniques are being used are numerous. Many Bayesian statisticians have focused their attention on the practical and usable paired comparison technique and have successfully performed the Bayesian study of many of the paired comparison models. In the current study, analysis of the amended Davidson model (ADM) which has been extended after incorporating the order effect parameter is narrated. For this intention, both the informative and non informative priors are used. The said model is studied for the case of four treatments which are compared pairwise.     

Log linear models for multivariate paired comparison experiments with ties

A log linear multivariate paired comparison model for ties is proposed in which the cell probabilities under independence are those given by Davidson (1970). Altham's (1970) generalized measure of association (iv) is used to compare the association structure between two models, one having full, the other having reduced association structure. Based on the model with reduced association structure, the analysis of data from a consumer preference experiment is presented.     

Asymptotic relative efficiency of designs for factorial paired comparison experiments

A general approach for comparing designs of paired comparison experiments on the basis of the asymptotic relative efficiencies, in the Bahadur sense, of their respective likelihood ratio tests is discussed and extended to factorials. Explicit results for comparing five designs of 2^q factorial paired comparison experiments are obtained. These results indicate that some of the designs which require comparison of fewer distinct pairs of treatments than does the completely balanced design are, generally, more efficient for detecting main effects and/or certain interactions. The developments of this paper generalize the work of Littell and Boyett (1977) for comparing two designs of R x C factorial paired comparison experiments.     

A Bayes-type estimator for the Bradley-Terry model for paired comparison

A Bayes-type estimator is proposed for the worth parameter π_i and for the treatment effect parameter ln π_i in the Bradley-Terry Model for paired comparison. In contrast to current Bayes estimators which require iterative numberical calculations, this estimator has a closed form expression. This estimation technique is also extended to obtain estimators for the Luce Multiple Comparison Model. An application of this technique to a 2³ factorial experiment with paired comparisons is presented.     

Optimal designs for main effects in linear paired comparison models

In psychology, marketing research and sensory analysis paired comparisons which demand judges to evaluate the trade-off between two alternatives constitute a popular method of data collection. For this situation we present optimal designs in a discrete setting when the alternatives are specified by an analysis of variance model with main effects only. We employ combinatorial tools to achieve optimal designs which have sufficiently small sample sizes. Moreover, optimal designs are constructed when the number of factors presented is restricted for each pair of alternatives.     

Designs for first-order interactions in paired comparison experiments with two-level factors

For paired comparison experiments involving options described by a common set of two-level factors a new method for generating exact designs is presented. These designs allow the efficient estimation of main effects and first-order interactions and perform better than alternative designs available in the literature.     

Semiparametric and parametric transformation models for comparing diagnostic markers with paired design

We develop semiparametric and parametric transformation models for estimation and comparison of ROC curves derived from measurements from two diagnostic tests on the same subjects. We assume the existence of transformed measurement scales, one for each test, on which the paired measurements have bivariate normal distributions. The resulting pair of ROC curves are estimated by maximum likelihood algorithms, using joint rank data in the semiparametric model with unspecified transformations and using Box-Cox transformations in the parametric transformation case. Several hypothesis tests for comparing the two ROC curves, or characteristics of them, are developed. Two clinical examples are presented and simulation results are provided.     

Adaptive sequential design for regression on multi-resolution bases

This work investigates the problem of construction of designs for estimation and discrimination between competing linear models. In our framework, the unknown signal is observed with the addition of a noise and only a few evaluations of the noisy signal are available. The model selection is performed in a multi-resolution setting. In this setting, the locations of discrete sequential D and A designs are precisely constraint in a small number of explicit points. Hence, an efficient stochastic algorithm can be constructed that alternately improves the design and the model. Several numerical experiments illustrate the efficiency of our method for regression. One can also use this algorithm as a preliminary step to build response surfaces for sensitivity analysis.     

Bayesian analysis of the amended Davidson model for paired comparison using noninformative and informative priors

In recent years, numerous statisticians have focused their attention on the Bayesian analysis of different paired comparison models. While studying paired comparison techniques, the Davidson model is considered to be one of the famous paired comparison models in the available literature. In this article, we have introduced an amendment in the Davidson model which has been commenced to accommodate the option of not distinguishing the effects of two treatments when they are compared pairwise. Having made this amendment, the Bayesian analysis of the Amended Davidson model is performed using the noninformative (uniform and Jeffreys’) and informative (Dirichlet–gamma–gamma) priors. To study the model and to perform the Bayesian analysis with the help of an example, we have obtained the joint and marginal posterior distributions of the parameters, their posterior estimates, graphical presentations of the marginal densities, preference and predictive probabilities and the posterior probabilities to compare the treatment parameters.     

Response surface design evaluation and comparison

Designing an experiment to fit a response surface model typically involves selecting among several candidate designs. There are often many competing criteria that could be considered in selecting the design, and practitioners are typically forced to make trade-offs between these objectives when choosing the final design. Traditional alphabetic optimality criteria are often used in evaluating and comparing competing designs. These optimality criteria are single-number summaries for quality properties of the design such as the precision with which the model parameters are estimated or the uncertainty associated with prediction. Other important considerations include the robustness of the design to model misspecification and potential problems arising from spurious or missing data. Several qualitative and quantitative properties of good response surface designs are discussed, and some of their important trade-offs are considered. Graphical methods for evaluating design performance for several important response surface problems are discussed and we show how these techniques can be used to compare competing designs. These graphical methods are generally superior to the simplistic summaries of alphabetic optimality criteria. Several special cases are considered, including robust parameter designs, split-plot designs, mixture experiment designs, and designs for generalized linear models.     

Bayesian longitudinal paired comparison model and its application to sports data using weighted likelihood bootstrap

This article describes a procedure for Bayesian longitudinal paired comparison data analysis to rank stimuli. The proposed model is developed by combining the Bradley–Terry model and a nonlinear model that utilizes an exponential distribution to describe longitudinal changes in scale values. The weighted likelihood bootstrap method (WLB) is used to obtain samples from posterior distributions of parameters. WLB is an effective tool because neither diagnosing parameter convergence nor specifying proposal distributions is required, which decreases both the preparation necessary and the time involved. The proposed model is a simple one with few parameters, so WLB can be effectively accommodated. An actual example using sports data from sumo wrestling is presented to verify the efficacy of the proposed method.