Concordance of Complete or Right-Censored Rankings Based on Spearman's Footrule

A right-censored ranking is what results when a judge ranks only the “top K” of M objects. Complete uncensored rankings constitute a special case. We present two measures of concordance among the rankings of N ≥ 2 such judges, both based on Spearman's footrule. One measure is unweighted, while the other gives greatest weight to the first rank, less to the second, and so on. We consider methods for calculating or estimating the P-values of the corresponding tests of the hypothesis of random ranking.     

Clustering ranking data in market segmentation: a case study on the Italian McDonald's customers’ preferences†

Cluster analysis is often used for market segmentation. When the inputs in the clustering algorithm are ranking data, the intersubject (dis)similarities must be measured by matching-type measures, able to take account of the ordinal nature of the data. Among them, we used a Weighted Spearman's rho, suitably transformed into a (dis)similarity measure, in order to emphasize the concordance on the top ranks. This allows creating clusters grouping customers that place the same items (products, services, etc.) higher in their rankings. Also the statistical instruments used to interpret the clusters must be conceived to deal with ordinal data. The median and other location measures are appropriate but not always able to clearly differentiate groups. The so-called bipolar mean, with its related variability measure, may reveal some additional features. A case study on real data from a survey carried out in the Italian McDonald's restaurants is presented.     

Concordance coefficients to measure the agreement among several sets of ranks

In this paper, two measures of agreement among several sets of ranks, Kendall's concordance coefficient and top-down concordance coefficient, are reviewed. In order to illustrate the utility of these measures, two examples, in the fields of health and sports, are presented. A Monte Carlo simulation study was carried out to compare the performance of Kendall's and top-down concordance coefficients in detecting several types and magnitudes of agreements. The data generation scheme was developed in order to induce an agreement with different intensities among m (m>2) sets of ranks in non-directional and directional rank agreement scenarios. The performance of each coefficient was estimated by the proportion of rejected null hypotheses, assessed at 5% significance level, when testing whether the underlying population concordance coefficient is sufficiently greater than zero. For the directional rank agreement scenario, the top-down concordance coefficient allowed to achieve a percentage of significant concordances that was higher than the one achieved by Kendall's concordance coefficient. Mainly, when the degree of agreement was small, the results of the simulation study pointed to the advantage of using a weighted rank concordance, namely the top-down concordance coefficient, simultaneously with Kendall's concordance coefficient, enabling the detection of agreement (in a top-down sense) in situations not detected by Kendall's concordance coefficient.     

Detection of concordance for extreme ranks

When analysing ranking data from one or more groups of judges one may wish to allow for the possibility that the judges have paid more attention to the allocation of the extreme ranks, rather than to the intermediate ranks. In some cases they may have only worried about assigning the top ranks (1 and 2, say) while randomly allocating the remaining ones.

In another context, the analystmay wish to only take account of the agreement among judges with respect to extreme ranks (top or bottom, or both),

In such situations an analysis of concordance within, and between groups, if appropriate, should be able to deal with extreme ranks specifically. We propose a data analyticapproach, related to an analysis of diversity,which actyally permits an analysis of concordance for each rank separately.     

Modeling the Factors Influencing the Evaluations of Items Through Mixture Models for Preference Datasets

In numerous situations, we use ranks dataset to exhibit preferences of a group of respondents towards a set of items. While assigning ranks, judges may consider several factors contributing to overall ranks of items. In this study, an attempt is made to model factors influencing the judges’ evaluations of items through mixture models for preference datasets. Both the probabilistic features of the mixture distribution and inferential as well as computational issues emerging out of the maximum likelihood estimation are addressed. Moreover, empirical evidences from observed dataset confirming the plausibility of the proposed model to preference dataset are provided.     

General scores statistics on ranks in the analysis of unbalanced designs

The authors consider the situation of incomplete rankings in which n judges independently rank k_i ∈ {2, …, t} objects. They wish to test the null hypothesis that each judge picks the ranking at random from the space of k_i! permutations of the integers 1, …, k_i. The statistic considered is a generalization of the Friedman test in which the ranks assigned by each judge are replaced by real‐valued functions a(j, k_i), 1 ≤ j ≤ k_i ≤ t of the ranks. The authors define a measure of pairwise similarity between complete rankings based on such functions, and use averages of such similarities to construct measures of the level of concordance of the judges' rankings. In the complete ranking case, the resulting statistics coincide with those defined by Hájek & ?idák (1967, p. 118), and Sen (1968). These measures of similarity are extended to the situation of incomplete rankings. A statistic is derived in this more general situation and its properties are investigated.     

A WEIGHTED RANK MEASURE OF CORRELATION

Spearman's rank correlation coefficient is not entirely suitable for measuring the correlation between two rankings in some applications because it treats all ranks equally. In 2000, Blest proposed an alternative measure of correlation that gives more importance to higher ranks but has some drawbacks. This paper proposes a weighted rank measure of correlation that weights the distance between two ranks using a linear function of those ranks, giving more importance to higher ranks than lower ones. It analyses its distribution and provides a table of critical values to test whether a given value of the coefficient is significantly different from zero. The paper also summarizes a number of applications for which the new measure is more suitable than Spearman's.     

Smoothed ranks for two or multi-sample location problems

Smoothed ranks are proposed for two or multi-sample location problems. The regular ranks in Wilcoxon's two sample test are replaced with smoothed ranks, and the shift parameter is estimated. Asymptotic properties of the smoothed rank estimator are shown and a hypothesis test is proposed. Moreover, the smoothed ranks are applied in the Kruskal–Wallis's r-sample test and the power of the test is computed using regular and smoothed ranks. Examples and Monte Carlo simulations show that the smoothed ranks perform similarly to the traditional rank based estimators under contaminated normal or non-normal populations.     

A statistical test for detecting discordance in rankings between k groups

In several research areas such as psychology, social science, and medicine, studies are conducted in which objects should be ranked by different judges/raters and the concordance of the different rankings is then analyzed. In such studies, it is also frequently of interest to compare the rankings between different groups of judges, e.g. female vs. male judges or judges from different professions. In the two-group case, the two-group concordance test of Schucany & Frawley can be employed for such a comparison. In this article, we propose an extension of this test enabling the comparison of rankings from more than two groups of judges. This test aims to detect disagreement in the average rankings of the objects between k groups with an at least moderate intra-group concordance. We evaluate this test in an extensive simulation study and in an application to data from an aesthetics study. This simulation study shows that the proposed test is able to detect differences between average rankings and performs well even in situations in which the disagreement is comparably small or the intra-group concordance is inhomogeneous.     

A test of concordance based on Gini’s mean difference

A new rank correlation index, which can be used to measure the extent of concordance or discordance between two rankings, is proposed. This index is based on Gini’s mean difference computed on the totals ranks corresponding to each unit and it turns out to be a special case of a more general measure of the agreement of m rankings. The proposed index can be used in a test for the independence of two criteria used to rank the units of a sample, against their concordance/discordance. It can then be regarded as a competitor of other classical methods, such as Kendall’s tau. The exact distribution of the proposed test-statistic under the null hypothesis of independence is studied and its expectation and variance are determined; moreover, the asymptotic distribution of the test-statistic is derived. Finally, the implementation of the proposed test and its performance are discussed. Both the authors contributed equally to this work; however, the actual writing of the paper was as follows: Sects. 2 and 3 are due to C. G. Borroni, Sects. 1 and 4 are due to M. Zenga.     

Importance of Components for a System

Which component is most important for a system's survival? We answer this question by ranking the information relationship between a system and its components. The mutual information (M) measures dependence between the operational states of the system and a component for a mission time as well as between their life lengths. This measure ranks each component in terms of its expected utility for predicting the system's survival. We explore some relationships between the ordering of importance of components by M and by Zellner's Maximal Data Information (MDIP) criterion. For many systems the bivariate distribution of the component and system lifetimes does not have a density with respect to the two-dimensional Lebesgue measure. For these systems, M is not defined, so we use a modification of a mutual information index to cover such situations. Our results for ordering dependence are general in terms of binary structures, sum of random variables, and order statistics.     

Nonparametric tests of hypotheses for umbrella alternatives

The author proposes a general method for constructing nonparametric tests of hypotheses for umbrella alternatives. Such alternatives are relevant when the treatment effect changes in direction after reaching a peak. The author's class of tests is based on the ranks of the observations. His general approach consists of defining two sets of rankings: the first is induced by the alternative and the other by the data itself. His test statistic measures the distance between the two sets. The author determines the asymptotic distribution for some special cases of distances under both the null and the alternative hypothesis when the location of the peak is known or unknown. He shows the good power of his tests through a limited simulation study     

Criteria for Linear Model Selection Based on Kullback's Symmetric Divergence

Model selection criteria are frequently developed by constructing estimators of discrepancy measures that assess the disparity between the 'true' model and a fitted approximating model. The Akaike information criterion (AIC) and its variants result from utilizing Kullback's directed divergence as the targeted discrepancy. The directed divergence is an asymmetric measure of separation between two statistical models, meaning that an alternative directed divergence can be obtained by reversing the roles of the two models in the definition of the measure. The sum of the two directed divergences is Kullback's symmetric divergence. In the framework of linear models, a comparison of the two directed divergences reveals an important distinction between the measures. When used to evaluate fitted approximating models that are improperly specified, the directed divergence which serves as the basis for AIC is more sensitive towards detecting overfitted models, whereas its counterpart is more sensitive towards detecting underfitted models. Since the symmetric divergence combines the information in both measures, it functions as a gauge of model disparity which is arguably more balanced than either of its individual components. With this motivation, the paper proposes a new class of criteria for linear model selection based on targeting the symmetric divergence. The criteria can be regarded as analogues of AIC and two of its variants: 'corrected' AIC or AICc and 'modified' AIC or MAIC. The paper examines the selection tendencies of the new criteria in a simulation study and the results indicate that they perform favourably when compared to their AIC analogues.     

Asymptotic inference on a general measure of monotone dependence

Summary In this paper a class of measures of monotone dependence (concordance/discordance) for arbitrary (not necessarily continuous) bivariate distributions is considered. It is shown that the corresponding sampling index of concordance/discordance (which is the most natural estimator of the population index) converges in law to a normal distribution. A Berry-Esséen bound for its rate of convergence is given. Finally, a consistent estimator of the asymptotic variance of the sampling concordance/ discordance index is proposed. This last result is essential for constructing confidence intervals and testing hypotheses on the population measure of monotone dependence.     

On inference for Kendall's τ within a longitudinal data setting

Kendall's τ is a non-parametric measure of correlation based on ranks and is used in a wide range of research disciplines. Although methods are available for making inference about Kendall's τ, none has been extended to modeling multiple Kendall's τs arising in longitudinal data analysis. Compounding this problem is the pervasive issue of missing data in such study designs. In this article, we develop a novel approach to provide inference about Kendall's τ within a longitudinal study setting under both complete and missing data. The proposed approach is illustrated with simulated data and applied to an HIV prevention study.     

On blest's measure of rank correlation

Blest (2000) proposed a new nonparametric measure of correlation between two random variables. His coefficient, which is dissymmetric in its arguments, emphasizes discrepancies observed among the first ranks in the orderings induced by the variables. The authors derive the limiting distribution of Blest's index and suggest symmetric variants whose merits as statistics for testing independence are explored using asymptotic relative efficiency calculations and Monte Carlo simulations.     

Average Spearman's Rho,Concordance, and the Matching Problem: Some Relationships

Relationships between concordance measures and the number of matches are established when there are n objects to be ranked by each of k judges under the hypothesis of independent and random ordering. These relationships generalize earlier results of Barton and David, who dealt with the case k = 2.     

Rank Correlation — an Alternative Measure

Within the bounds of a general theory of rank correlation two particular measures have been adopted widely: Spearman7apos;s rank correlation coefficient, ρ in which ranks replace variates in Pearson's product-moment correlation calculation; and Kendall's τ in which the disarray of x -ordered data due to a y -ordering is measured by counting the minimum number, s ; of transpositions (interchanges between adjacent ranks) of the y -ordering sufficient to recover the x-ordering. Based on insights from the calculation of Kendall's coefficient, this paper develops a graphical approach which leads to a new rank correlation coefficient akin to that of Spearman. This measure appears to stand outside general theorybut has greater power of discrimination amongst differing reorderings of the data whilst simultaneously being strongly correlated with both ρ and τ. The development is focused on situations where agreement over ordering is more important for top place getters than for those lower down the order as, for example, in subjectively judged Olympic events such as ice skating. The basic properties of the proposed coefficient are identified.     

Functions of Concordance and Dependence with Related Measures

Some functions that serve as building blocks for construction of a wider range of modes of concordance and dependence are pointed. We probe into interplays of such modes. From the standpoint of their conformity to stochastic dominance ordering of distributions within a Fréchet class, all such derived modes display some parallelism under certain conditions. We finally suggest a novel numeric measure of dependence that covers similar existing measures in literature.     

Testing for concordance between several criteria

The problem of whether the rankings of some objects given by a set of criteria (or judges) show any agreement or are more or less independent is addressed. The most familiar measure for concordance is the Kendall W coefficient. Classical tests for concordance are the Friedman test and the F test. Legendre [Species associations: the Kendall coefficient of concordance revisited. J. Agric. Biol. Environ. Stat. 2005;10(2):226–245] compared via simulation the Friedman test and its permutation version. Unfortunately, the simulation study of Legendre was very limited because it considered neither the copula aspect nor the F test. Kendall W is a rank-based correlation measure, and therefore it is not affected by the marginal distributions of the underlying variables, but only by the copula of the multivariate distribution. In this article, the simulation study of Legendre is deeply extended by considering the copula aspect as well as the F test. It is shown that the Friedman test is too conservative and less powerful than both the F test and the permutation test for concordance which always have a correct size and behave alike. The F test should be preferred because it is computationally much easier. Surprisingly, the power function of the tests is not much affected by the type of copula.