Optimal transitive procedures for comparing large numbers of parameters

Independent random samples are selected from each of a set of N independent populations, P₁,…,P_n. Interest centers around comparing N (unknown) scalar parameters θ₁,…,θ_N associated respectively with the N populations P₁,…,P_n. Procedures are constructed for estimating the magnitude of each of the differences δ_t,j = θ_i ? θ_j (1 ≤ i,j ≤ N) between pairs of populations. A loss function which adopts appropriate penalties for magnitude errors in estimation of differences is constructed. Magnitude estimators of differences are called transitive if they give rise to a transitive (i.e., consistent) relationship between pairwise differences of parameters. We show how to construct optimal effcient transitive magnitude–estimation procedures and demonstrate their usefulness through an example involving estimating the magnitude of the differences between disease incidence in paired towns for different pairs. Optimal transitive pairwise–comparison procedures are optimum (i.e., have the smallest posterior Bayes risks) in the class of all transitive pairwise–comparison procedures; as such they replace classical Bayes procedures which are usually not transitive when the number N of parameters compared is large. The posterior Bayes risk of optimal transitive pairwise comparison procedures are compared with that for alternative ‘adapted’ procedures, constructed from optimal simultaneous estimators and adapted for the purpose of pairwise comparisons. It is shown that the optimal transitive pairwise comparison procedures dominated the adapted procedures (in posterior Bayes risk) and typically represent only a small increase in posterior risk over the classical Bayes procedures which generally fail to be consistent. Optimal Bayes procedures are shown, for large numbers of parameters to be reasonably easy to construct using the algorithms outlined in this paper