Analysis of large sets of ranking data

Various procedures, mainly graphical are presented for analyzing large sets of ranking data in which the permutations are not equally likely. One method is based on box plots, the others are motivated by a model originally proposed by Mallows. The model is characterised by two parameters corresponding to location and dispersion. Graphical methods based on Q-Q plots are also discussed for comparing two groups of judges. The proposed methods are illustrated on an empirical data set.     

A 2-dimensional extension of the Bradley–Terry model for paired comparisons

The Bradley–Terry model is widely and often beneficially used to rank objects from paired comparisons. The underlying assumption that makes ranking possible is the existence of a latent linear scale of merit or equivalently of a kind of transitiveness of the preference. However, in some situations such as sensory comparisons of products, this assumption can be unrealistic. In these contexts, although the Bradley–Terry model appears to be significantly interesting, the linear ranking does not make sense. Our aim is to propose a 2-dimensional extension of the Bradley–Terry model that accounts for interactions between the compared objects. From a methodological point of view, this proposition can be seen as a multidimensional scaling approach in the context of a logistic model for binomial data. Maximum likelihood is investigated and asymptotic properties are derived in order to construct confidence ellipses on the diagram of the 2-dimensional scores. It is shown by an illustrative example based on real sensory data on how to use the 2-dimensional model to inspect the lack-of-fit of the Bradley–Terry model.     

Detection of concordance for extreme ranks

When analysing ranking data from one or more groups of judges one may wish to allow for the possibility that the judges have paid more attention to the allocation of the extreme ranks, rather than to the intermediate ranks. In some cases they may have only worried about assigning the top ranks (1 and 2, say) while randomly allocating the remaining ones.

In another context, the analystmay wish to only take account of the agreement among judges with respect to extreme ranks (top or bottom, or both),

In such situations an analysis of concordance within, and between groups, if appropriate, should be able to deal with extreme ranks specifically. We propose a data analyticapproach, related to an analysis of diversity,which actyally permits an analysis of concordance for each rank separately.     

Optimal designs for main effects in linear paired comparison models

In psychology, marketing research and sensory analysis paired comparisons which demand judges to evaluate the trade-off between two alternatives constitute a popular method of data collection. For this situation we present optimal designs in a discrete setting when the alternatives are specified by an analysis of variance model with main effects only. We employ combinatorial tools to achieve optimal designs which have sufficiently small sample sizes. Moreover, optimal designs are constructed when the number of factors presented is restricted for each pair of alternatives.     

Random Effect Threshold Models for Dose–Response Relationships with Repeated Measurements

A random threshold model for dose--response designs with repeated measurements is introduced. Inference procedures for this model are discussed. The framework of generalized linear models is used to propose a quasi-likelihood inference procedure. The feasibility of this approach is illustrated with the analysis of food science data concerning a forced choice sensory experiment.     

Analysis of mutual funds’ management styles: a modeling,ranking and visualizing approach

A method to rank mutual funds according to their investment style measured with respect to the returns of a reference portfolio (benchmark) is introduced. It is based on a style analysis model estimating a mutual fund portfolio composition as well as the benchmark one. Starting from such compositions, it computes a proximity measure based on the L ₁ or L ₂ norm to assess the similarity between each mutual fund portfolio returns and the benchmark returns as well as between the returns of each benchmark constituent and that of the corresponding mutual fund constituent. To this purpose the mean integrated absolute error and the mean integrated squared error are computed to derive both a global ranking of mutual fund management styles and partial rankings expressing the over- (under-) weighting of each portfolio constituent. A visual inspection of the results emphasizing main differences in management styles is provided, using a parallel coordinates plot. Since a modeling, a ranking and a visualizing approach are integrated, the method is named MoRaViA. From the practitioners’ point of view, it allows the identification of a specific management style for each mutual fund, discriminating active management funds from passive management ones. To evaluate the effectiveness of MoRaViA, many sets of artificial portfolios are generated and an application on a set of equity funds operating in the European market is presented.     

Extending the Bradley–Terry model for paired comparisons to accommodate weights

In the method of paired comparisons (PCs), treatments are compared on the basis of qualitative characteristics they possess, in the light of their sensory evaluations made by judges. However, there may emerge the situations where in addition to qualitative merits/worths, judges may assign quantitative weights to reflect/specify the relative importance of the treatments. In this study, an attempt is made to reconcile the qualitative and the quantitative PCs through assigning quantitative weights to treatments having qualitative merits using/extending the Bradley–Terry (BT) model. Behaviors of the existing BT model and the proposed weighted BT model are studied through the test of goodness-of-fit. Experimental and simulated data sets are used for illustration.     

Concordance of Complete or Right-Censored Rankings Based on Spearman's Footrule

A right-censored ranking is what results when a judge ranks only the “top K” of M objects. Complete uncensored rankings constitute a special case. We present two measures of concordance among the rankings of N ≥ 2 such judges, both based on Spearman's footrule. One measure is unweighted, while the other gives greatest weight to the first rank, less to the second, and so on. We consider methods for calculating or estimating the P-values of the corresponding tests of the hypothesis of random ranking.     

New imperfect rankings models for ranked set sampling

Ranked set sampling is a sampling approach that leads to improved statistical inference in situations where the units to be sampled can be ranked relative to each other prior to formal measurement. This ranking may be done either by subjective judgment or according to an auxiliary variable, and it need not be completely accurate. In fact, results in the literature have shown that no matter how poor the quality of the ranking, procedures based on ranked set sampling tend to be at least as efficient as procedures based on simple random sampling. However, efforts to quantify the gains in efficiency for ranked set sampling procedures have been hampered by a shortage of available models for imperfect rankings. In this paper, we introduce a new class of models for imperfect rankings, and we provide a rigorous proof that essentially any reasonable model for imperfect rankings is a limit of models in this class. We then describe a specific, easily applied method for selecting an appropriate imperfect rankings model from the class.     

Calculation of Scores for a Wilcoxon Generalization Applicable to Data Subject to Arbitrary Right Censorship

For data subject to right censoring it is suggested that the Wilcoxon ranking procedure can be generalized by scoring observations according to the expected values of order statistics from the uniform distribution subject to the same right censoring. This parallels the logrank scoring procedure in which scores correspond to the expected values of order statistics from the exponential distribution that have been subject to right censoring. A caveat is given that, in situations where the mechanism of censoring has been affected by treatment, the usual permutational analysis of ranking scores would be inappropriate. But a jackknife approach could be remedial.     

GMM nonparametric correction methods for logistic regression with error‐contaminated covariates and partially observed instrumental variables

We consider logistic regression with covariate measurement error. Most existing approaches require certain replicates of the error‐contaminated covariates, which may not be available in the data. We propose generalized method of moments (GMM) nonparametric correction approaches that use instrumental variables observed in a calibration subsample. The instrumental variable is related to the underlying true covariates through a general nonparametric model, and the probability of being in the calibration subsample may depend on the observed variables. We first take a simple approach adopting the inverse selection probability weighting technique using the calibration subsample. We then improve the approach based on the GMM using the whole sample. The asymptotic properties are derived, and the finite sample performance is evaluated through simulation studies and an application to a real data set.     

Count Data Models with Correlated Unobserved Heterogeneity

Abstract. As previously argued, the correlation between included and omitted regressors generally causes inconsistency of standard estimators for count data models. Non‐linear instrumental variables estimation of an exponential model under conditional moment restrictions is one of the proposed remedies. This approach is extended here by fully exploiting the model assumptions and thereby improving efficiency of the resulting estimator. Empirical likelihood in particular has favourable properties in this setting compared with the two‐step generalized method of moments, as demonstrated in a Monte Carlo experiment. The proposed method is applied to the estimation of a cigarette demand function.     

Robust Inference for Inverse Stochastic Dominance

The notion of inverse stochastic dominance is gaining increasing support in risk, inequality, and welfare analysis as a relevant criterion for ranking distributions, which is alternative to the standard stochastic dominance approach. Its implementation rests on comparisons of two distributions’ quantile functions, or of their multiple partial integrals, at fixed population proportions. This article develops a novel statistical inference model for inverse stochastic dominance that is based on the influence function approach. The proposed method allows model-free evaluations that are limitedly affected by contamination in the data. Asymptotic normality of the estimators allows to derive tests for the restrictions implied by various forms of inverse stochastic dominance. Monte Carlo experiments and an application promote the qualities of the influence function estimator when compared with alternative dominance criteria.     

The correlation structure of longitudinal measurements of vision in patients with macular degeneration

Background: In age‐related macular degeneration (ARMD) trials, the FDA‐approved endpoint is the loss (or gain) of at least three lines of vision as compared to baseline. The use of such a response endpoint entails a potentially severe loss of information. A more efficient strategy could be obtained by using longitudinal measures of the change in visual acuity. In this paper we investigate, by using data from two randomized clinical trials, the mean and variance–covariance structures of the longitudinal measurements of the change in visual acuity. Methods: Individual patient data were collected in 234 patients in a randomized trial comparing interferon‐ α with placebo and in 1181 patients in a randomized trial comparing three active doses of pegaptanib with sham. A linear model for longitudinal data was used to analyze the repeated measurements of the change in visual acuity. Results: For both trials, the data were adequately summarized by a model that assumed a quadratic trend for the mean change in visual acuity over time, a power variance function, and an antedependence correlation structure. The power variance function was remarkably similar for the two datasets and involved the square root of the measurement time. Conclusions: The similarity of the estimated variance functions and correlation structures for both datasets indicates that these aspects may be a genuine feature of the measurements of changes in visual acuity in patients with ARMD. The feature can be used in the planning and analysis of trials that use visual acuity as the clinical endpoint of interest. Copyright © 2010 John Wiley & Sons, Ltd.     

Reducing sample size needed for cox-proportional hazards model analysis using more efficient sampling method

Abstract

In general, survival data are time-to-event data, such as time to death, time to appearance of a tumor, or time to recurrence of a disease. Models for survival data have frequently been based on the proportional hazards model, proposed by Cox. The Cox model has intensive application in the field of social, medical, behavioral and public health sciences. In this paper we propose a more efficient sampling method of recruiting subjects for survival analysis. We propose using a Moving Extreme Ranked Set Sampling (MERSS) scheme with ranking based on an easy-to-evaluate baseline auxiliary variable known to be associated with survival time. This paper demonstrates that this approach provides a more powerful testing procedure as well as a more efficient estimate of hazard ratio than that based on simple random sampling (SRS). Theoretical derivation and simulation studies are provided. The Iowa 65+ Rural study data are used to illustrate the methods developed in this paper.     

Parametric estimation of location and scale parameters in ranked set sampling

This paper develops parametric inference for the parameters of location-scale family of distributions based on a ranked set sample. Likelihood function incorporates within-set ranking errors into the model through a missing data mechanism. The maximum likelihood estimators of the location-scale and missing data model parameters are constructed and an EM-algorithm is provided. It is shown that the proposed estimator is robust against imperfect ranking error and provides higher efficiency over its competitors.     

Anisotropy of Hölder Gaussian random fields: characterization,estimation, and application to image textures

The characterization and estimation of the Hölder regularity of random fields has long been an important topic of Probability theory and Statistics. This notion of regularity has also been widely used in image analysis to measure the roughness of textures. However, such a measure is rarely sufficient to characterize textures as it does not account for their directional properties (e.g., isotropy and anisotropy). In this paper, we present an approach to further characterize directional properties associated with the Hölder regularity of random fields. Using the spectral density, we define a notion of asymptotic topothesy which quantifies directional contributions of field high-frequencies to the Hölder regularity. This notion is related to the topothesy function of the so-called anisotropic fractional Brownian fields, but is defined in a more generic framework of intrinsic random fields. We then propose a method based on multi-oriented quadratic variations to estimate this asymptotic topothesy. Eventually, we evaluate this method on synthetic data and apply it for the characterization of historical photographic papers.     

Finite sample performance of sequential designs for model identification

Classical regression analysis is usually performed in two steps. In the first step, an appropriate model is identified to describe the data generating process and in the second step, statistical inference is performed in the identified model. An intuitively appealing approach to the design of experiment for these different purposes are sequential strategies, which use parts of the sample for model identification and adapt the design according to the outcome of the identification steps. In this article, we investigate the finite sample properties of two sequential design strategies, which were recently proposed in the literature. A detailed comparison of sequential designs for model discrimination in several regression models is given by means of a simulation study. Some non-sequential designs are also included in the study.     

Bayesian interim analysis of lifetime data

In hypothesis testing involving censored lifetime data that are independently distributed according to an accelerated-failure-time model, it is often of interest to predict whether continuation of the experiment will significantly alter the inferences drawn at an interim point. Approaching the problem from a Bayesian viewpoint, we suggest a possible solution based on Laplace approximations to the posterior distribution of the parameters of interest and on Markov-chain Monte Carlo. We apply our results to Weibull data from a carcinogenesis experiment on mice.     

Accounting for clinical covariates and interactions in ranking genomic markers using ROC

In biomedical research, profiling is now commonly conducted, generating high-dimensional genomic measurements (without loss of generality, say genes). An important analysis objective is to rank genes according to their marginal associations with a disease outcome/phenotype. Clinical-covariates, including for example clinical risk factors and environmental exposures, usually exist and need to be properly accounted for. In this study, we propose conducting marginal ranking of genes using a receiver operating characteristic (ROC) based method. This method can accommodate categorical, censored survival, and continuous outcome variables in a very similar manner. Unlike logistic-model-based methods, it does not make very specific assumptions on model, making it robust. In ranking genes, we account for both the main effects of clinical-covariates and their interactions with genes, and develop multiple diagnostic accuracy improvement measurements. Using simulation studies, we show that the proposed method is effective in that genes associated with or gene–covariate interactions associated with the outcome receive high rankings. In data analysis, we observe some differences between the rankings using the proposed method and the logistic-model-based method.