An empirical bayes approach to estimating the probability of correct selection

In the problem of selecting the best of k populations, Olkin, Sobel, and Tong (1976) have introduced the idea of estimating the probability of correct selection. In an attempt to improve on their estimator we consider anempirical Bayes approach. We compare the two estimators via analytic results and a simulation study.     

Conditions under which F. {N } = for tong's adaptive solution to ranking and selection problems

Tong ‘1978’ proposed an adaptive approach as an alternative to the classical indifference-zone formulation of the problems of ranking and selection. With a fixed pre-selected y*‘1/k < y* < 1’ his procedure calls for the termination of vector-at-a-time sampling when the estimated probability of a correct selection exceeds Y* for the first time. The purpose of this note is to show that for the case of two normal populations with common known variance, the expected number of vector-observations required by Tong's procedure to terminate sampling approaches infinity as the two population means approach equality for Y* ≥ 0.8413.It is conjectured that this phenomenon also persists if the two largest of K ≥3 population means approach equality. Since in the typical ranking and selection setting it usually is assumed that the experimenter has no knowledge concerning the differences between the population means, the experimenter who uses Tong's procedure clearly does so at his own risk.     

Selection and ranking procedures: a brief introduction

This paper presents a brief introduction to selection and ranking methodology. Both indifference zone and subset selection approaches are discussed along with some modifications and generalizations. Two examples are provided to illustate the use of subset selection and the indifference zone approaches. The paper concludes with the remark that selection and ranking methodology is a realistic approach in statistical analyses involving comparisons among two or more treatments.     

Equal probability of correct selection for bernoulli selection procedures

The problem of selecting the Bernoulli population which has the highest "success" probability is considered. It has been noted in several articles that the probability of a correct selection is the same, uniformly in the Bernoulli p-vector (P1,P2,….,Pk), for two or more different selection procedures. We give a general theorem which explains this phenomenon.

An application of particular interest arises when "strong" curtailment of a single-stage procedure (as introduced by Bechhofer and Kulkarni (1982a) )is employed; the corresponding result for "weak" curtailment of a single-stage procedure needs no proof. The use of strong curtailment in place of weak curtailment requires no more (and usually many less) observations to achieve the same.     

Bayesian subset selection approach to ranking normal means

In this, article we consider a Bayesian approach to the problem of ranking the means of normal distributed populations, which is a common problem in the biological sciences. We use a decision-theoretic approach with a straightforward loss function to determine a set of candidate rankings. This loss function allows the researcher to balance the risk of not including the correct ranking with the risk of increasing the number of rankings selected. We apply our new procedure to an example regarding the effect of zinc on the diversity of diatom species.     

On two-stage selection procedures and related probability-inequalities

In this paper we discuss a modification of the Dudewicz-Dalal procedure for the problem of selecting the population with the largest mean from k normal populations with unknown variances. We derive some inequalities and use them to lower-bound the probability of correct selection. These bounds are applied to the determination of the second-stage sample size which is required in order to achieve a prescribed probability of correct selection. We discuss the resulting procedure and compare it to that of Dudewicz and Dalai (1975).     

On selecting the treatment with the largest probability of survival

Suppose there are k(>= 2) treatments and each treatment is a Bernoulli process with binomial sampling. The problem of selecting a random-sized subset which contains the treatment with the largest survival probability (reliability or probability of success) is considered. Based on the ideas from both classical approaches and general Bayesian statistical decision approach, a new subset selection procedure is proposed to solve this kind of problem in both balanced and unbalanced designs. Comparing with the classical procedures, the proposed procedure has a significantly smaller selected subset. The optimal properties and performance of it were examined. The methods of selecting and fitting the priors and the results of Monte Carlo simulations on selected important cases are also studied.     

Inequalities for the partial sums of elliptical order statistics related to genetic selection

Let X₁,…,X_n be exchangeable normal variables with a common correlation p, and let X₍₁₎ > … > X_(n) denote their order statistics. The random variable σⁿ_i=_n—_k+1x_i, called the selection differential by geneticists, is of particular interest in genetic selection and related areas. In this paper we give results concerning a conjecture of Tong (1982) on the distribution of this random variable as a function of ρ. The same technique used can be applied to yield more general results for linear combinations of order statistics from elliptical distributions.     

A predictive approach for the selection of a fixed number of good treatments

This paper offers a predictive approach for the selection of a fixed number (= t) of treatments from k treatments with the goal of controlling for predictive losses. For the ith treatment, independent observations X _ij (j = 1,2,…,n) can be observed where X _ij ’s are normally distributed N(θ _i ; σ ²). The ranked values of θ _i ’s and X _i ’s are θ ₍₁₎ ≤ … ≤ θ _(k) and X _[1] ≤ … ≤ X _[k] and the selected subset S = {[k], [k? 1], … , [k ? t+1]} will be considered. This paper distinguishes between two types of loss functions. A type I loss function associated with a selected subset S is the loss in utility from the selector’s view point and is a function of θ _i with i ? S. A type II loss function associated with S measures the unfairness in the selection from candidates’ viewpoint and is a function of θ _i with i ? S. This paper shows that under mild assumptions on the loss functions S is optimal and provides the necessary formulae for choosing n so that the two types of loss can be controlled individually or simultaneously with a high probability. Predictive bounds for the losses are provided, Numerical examples support the usefulness of the predictive approach over the design of experiment approach.     

Distribution-free subset selection for incompletely ranked data

In market research and some other areas, it is common that a sample of n judges (consumers, evaluators, etc.) are asked to independently rank a series of k objects or candidates. It is usually difficult to obtain the judges' full cooperation to completely rank all k objects. A practical way to overcome this difficulty is to give each judge the freedom to choose the number of top candidates he is willing to rank. A frequently encountered question in this type of survey is how to select the best object or candidate from the incompletely ranked data. This paper proposes a subset selection procedure which constructs a random subset of all the k objects involved in the survey such that the best object is included in the subset with a prespecified confidence. It is shown that the proposed subset selection procedure is distribution-free over a very broad class of underlying distributions. An example from a market research study is used to illustrate the proposed procedure.     

A restricted subset selection procedure for Weibull populations

Consider k(k ≥ 2) two-parameter Weibull populations. We want to select a subset of the populations not exceeding m in size such that the subset contains at least ? of the t best populations. We have proposed a procedure which uses either the maximum likelihood estimators or ‘simplified’ linear estimators of the parameters. The estimators are based on type II censored data. The ranking of the populations is done by comparing their reliabilities at a certain fixed time. In selected cases the constants for the procedure are tabulated using Monte Carlo methods.     

Two new goals for selection based on proportions

Procedures are derived for selecting, with controlled probability of error, (1) a subset of populations which contains all populations better than a dual probability/proportion standard and (2) a subset of populations which both contains all populations better than an upper probability/proportion standard and also contains no populations worse than a lower probability/proportion standard. The procedures are motivated by current investigations in the area of computer performance evaluation.     

Bootstrap method in ranking and slippage problems

In this paper, the bootstrap method of Efron (1979) is given for a ranking and a slippage problem, where the ranking (or slippage) is with respect to the mean of the distributions. The method is also applied to obtain a confidence interval for the largest mean.     

Comments on ‘Application of an adaptive design to a randomized phase II selection trial in gastric cancer: a report of the study design’ by Satoshi Morita and Junichi Sakamoto. Pharmaceutical Statistics

In this commentary, we show that the treatment selection probabilities in Morita and Sakamoto [1] could be different if safety information is considered. Copyright © 2012 John Wiley & Sons, Ltd.     

Classifying weibull populations with respect to a control

This paper is concerned with classifying k Weibull populations by their reliabilities with respect to a control population. He have proposed procedures which can be used for maximum likelihood estimators or simplified linear estimators of the parameters. Estimators are based on type II censored data. The cases considered include unknown shape parameters being equal or unequal. In selected cases, the constants needed for the procedures are tabulated using Monte Carlo methods.     

On the estimation of the true probability of a correct selection

For ranking and selection problems, the true probabiIity of a correct selection P(CS) is unknown even if a selection is made under the indifference-zone approach. Thus to estimate the true P(CS) some Bayes estimators and a bootstrap estimator are proposed for two normcal populations with common known variance. Also a bootstrap estimator and a bootstrap confidence interval are proposed for normal populations with common unknown variance. Some comparisons between proposed estimators and some other known estimators are made via Monte Carlo simulations.     

A bayesian approach to the comparison of two means

A hierarchical Bayesian approach to the problem of comparison of two means is considered. Hypothesis testing, ranking and selection, and estimation (after selection) are treated. Under the hypothesis that two means are different, it is desired to select the population which has the larger mean. Expressions for the ranking probability of each mean being the larger and the corresponding estimate of each mean are given. For certain priors, it is possible to express the quantities of interest in closed form. A simulation study has been done to compare mean square errors of a hierarchical Bayesian estimator and some of the existing estimators of the selected mean. The case of comparing two means in the presence of block effects has also been considered and an example is presented to illustrate the methodology.     

Indifference-zone ranking and selection: confidence intervals for true achieved P(CD)

In this paper we present procedures which attempt to allow experimenters to take at least partial advantage of more-favorable configurations of the population parameters (without, in the process, sacrificing precise probability statements about the inferences made) by obtaining confidence intervals for the true probability of a correct decision, regarded as a function of the true unknown underlying parameter values.     

Truncation of the Bechhofer-Kiefer-Sobel sequential procedure for selecting the multinomial event which has the largest probability

In this article we study the effect of truncation on the performance of an open vector-at-a-time sequential sampling procedure (P^* _B) proposed by Bechhofer, Kiefer and Sobel , for selecting the multinomial event which has the largest probability. The performance of the truncated version (P^{* B} _T) is compared to that of the original basic procedure (P^* _B). The performance characteristics studied include the probability of a correct selection, the expected number of vector-observations (n) to terminate sampling, and the variance of n. Both procedures guarantee the specified probability of a correct selection. Exact results and Monte Carlo sampling results are obtained. It is shown that P^* _{B T}is far superior to P^* _B in terms of E{n} and Var{n}, particularly when the event probabilities are equal.The performance of P^* _{B T} is also compared to that of a closed vector-at-a-time sequential sampling procedure proposed for the same problem by Ramey and Alam; this procedure has here to fore been claimed to be the best one for this problem. It is shown that p^* _{B T} is superior to the Ramey-Alam procedure for most of the specifications of practical interest.