On two-stage selection procedures and related probability-inequalities

In this paper we discuss a modification of the Dudewicz-Dalal procedure for the problem of selecting the population with the largest mean from k normal populations with unknown variances. We derive some inequalities and use them to lower-bound the probability of correct selection. These bounds are applied to the determination of the second-stage sample size which is required in order to achieve a prescribed probability of correct selection. We discuss the resulting procedure and compare it to that of Dudewicz and Dalai (1975).     

On selecting a subset which contains all populations better than a control

Let π₁…, π_k denote k(≥ 2) populations with unknown means μ₁ , …, μ_k and variances σ₁ ² , …, σ_k ² , respectively and let π_o denote the control population having mean μ_o and variance σ_o ² . It is assumed that these populations are normally distributed with correlation matrix {ρ_ij}. The goal is to select a subset, of populations of π₁ , …, π_k which contains all the populations with means larger than or equal to the mean of the control one. Procedures are given for selecting such a subset so that the probability that all the populations with means larger than or equal to the mean of the control one are included in the selected subset is at least equal to a predetermined value P?(l/k < P? < 1). The goal treated here is a first step screening procedure that allows the experimenter to choose a subset and withhold judgement about which one has the largest mean. Then, if the one with the largest mean is desired it can be chosen from the selected subset on the basis of cost and other considerations. Percentage points are also included.     

Selecting the Best Exponential Population When the Scale Parameters are Bounded

Consider k (≥ 2) independent exponential populations with different location and scale parameters. Call a population associated with largest of unknown location parameters as the best population. For the goal of selecting the best population, it is established that if the scale parameters are completely unknown, then the indifference-zone probability requirement can not be guaranteed by any single sample decision rule which is just and translation invariant. Under the assumption that the scale parameters are bounded above by a known constant, a single sample selection procedure is proposed for which the indifference-zone probability requirement can be guaranteed. Under the same assumption, 100P*% simultaneous upper confidence intervals for all distances from the largest location parameter are also obtained.     

Least significant spacing for ‘one versus the rest’ normal populations

Consider sample means from k(≥2) normal populations where the variances and sample sizes are equal. The problem is to find the ‘least significant difference’ or ‘spacing’ (LSS) between the two largest means, so that if an observed spacing is larger we have confidence 1 - α that the population with largest sample mean also has the largest population mean.

When the variance is known it is shown that the maximum LSS occurs when k = 2, provided a < .2723. In other words, for any value of k we may use the usual (one-tailed) least significant difference to demonstrate that one population has a population mean greater than (or equal to) the rest.

When the variance is estimated bounds are obtained for the confidence which indicate that this last result is approximately correct.     

Complete ranking procedures with appropriate loss functions

This paper treats the problem of comparing different evaluations of procedures which rank the variances of k normal populations. Procedures are evaluated on the basis of appropriate loss functions for a particular goal. The goal considered involves ranking the variances of k independent normal populations when the corresponding population means are unknown. The variances are ranked by selecting samples of size n from each population and using the sample variances to obtain the ranking. Our results extend those of various authors who looked at the narrower problem of evaluating the standard proceduv 3 associated with selecting the smallest of the population variances (see e.g.,P. Somerville (1975)).

Different loss functions (both parametric and non-parametric) appropriate to the particular goal under consideration are proposed. Procedures are evaluated by the performance of their risk over a particular preference zone. The sample size n, the least favorable parametric configuration, and the maximum value of the risk are three quantities studied for each procedure. When k is small these quantities, calculated by numerical simulation, show which loss functions respond better and which respond worse to increases in sample size. Loss functions are compared with one another according to the extent of this response. Theoretical results are given for the case of asymptotically large k. It is shown that for certain cases the error incurred by using these asymptotic results is small when k is only moderately large.

This work is an outgrowth of and extends that of J. Reeves and M.J. Sobel (1987) by comparing procedures on the basis of the sample size (perpopulation) required to obtain various bounds on the associated risk functions. New methodologies are developed to evaluate complete ranking procedures in different settings.     

SELECTING THE m POPULATIONS WITH LARGEST MEANS FROM k NORMAL POPULATIONS WITH UNKNOWN VARIANCES

This paper gives a two-sample procedure for selecting the m populations with the largest means from k normal populations with unknown variances. The method is a generalization of a recent work by Ofosu [1973] and hence should find wider practical applications. The experimenter takes an initial sample of preset size N₀ from each population and computes an unbiased estimate of its variance. From this estimate he determines the second sample size for the population according to a table presented for this purpose. The populations associated with the m largest overall sample means will be selected. The procedure is shown to satisfy a confidence requirement similar to that of Ofosu.     

On rules based on sample medians for selection of the largest location parameter

The problem of selection of a subset containing the largest of several location parameters is considered, and a Gupta-type selection rule based on sample medians is investigated for normal and double exponential populations. Numerical comparisons between rules based on medians and means of small samples are made for normal and contaminated normal populations, assuming the popula-tion means to be equally spaced. It appears that the rule based on sample means loses its superiority over the rule based on sample medians in case the samples are heavily contaminated. The asymptotic relative efficiency (ARE) of the medians procedure relative to the means procedure is also computed, assuming the normal means to be in a slippage configuration. The means proce-dure is found to be superior to the median procedure in the sense of ARE. As in the small sample case, the situation is reversed if the normal populations are highly contaminate.     

Simultaneous prediction intervals for all patrwise differences among several future sample means

Hahn (1977) suggested a procedure for constructing prediction intervals for the difference between the means of two future samples from normal populations having equal variance, based on past samples selected from both populations. In this paper, we extend Hahn's work by constructing simultaneous prediction intervals for all pairwise differences among the means of k ≥ 2 future samples from normal populations with equal variances, using past samples taken from each of the k populations. For K = 2, this generalization reduces to Hahn's special case. These prediction intervals may be used when one has sampled the performance of several products and wishes to simultaneously as- sess the differences in future sample mean performance of these products with a predetermined overall coverage probability. The use of the new procedure is demonstrated with a numerical example.     

A Two-stage minimax procedure with screening for selecting the largest normal mean

The problem of selecting the normal population with the largest population mean when the populations have a common known variance is considered. A two-stage procedure is proposed which guarantees the same probability requirement using the indifference-zone approach as does the single-stage procedure of Bechhofer (1954). The two-stage procedure has the highly desirable property that the expected total number of observations required by the procedure is always less than the total number of observations required by the corresponding single-stage procedure, regardless of the configuration of the population means. The saving in expected total number of observations can be substantial, particularly when the configuration of the population means is favorable to the experimenter. The saving is accomplished by screening out “non-contending” populations in the first stage, and concentrating sampling only on “contending” populations in the second stage.

The two-stage procedure can be regarded as a composite one which uses a screening subset-type approach (Gupta (1956), (1965)) in the first stage, and an indifference-zone approach (Bechhofer (1954)) applied to all populations retained in the selected sub-set in the second stage. Constants to implement the procedure for various k and P? are provided, as are calculations giving the saving in expected total sample size if the two-stage procedure is used in place of the corresponding single-stage procedure.     

A comparison of selection procedures for selecting the best normal population under heterogeneity of variance

This study examines the comparative probabilities of making a correct selection when using the means procedure (M), the medians procedure (D) and the rank-sum procedure (S) to correctly select the normal population with the largest mean under heterogeneity of variance. The comparison is conducted by using Monte-Carlo simulation techniques for 3, 4, and 5 normal populations under the condition that equal sample sizes are taken from each population. The population means and standard deviations are assumed to be equally-spaced. Two types of heterogeneity of variance are considered: (1) associating larger means with larger variances, and (2) associating larger means with smaller variances.     

On a conjecture concerning the least favorable configuration of a two-stage selection procedure

A two-stage procedure 𝓅with screening in the first stage to find the population with the largest mean out of k ≧ 2 normal populations with unknown means and a common variance is under concern. It was proposed and previousiy studied by Cohen (1959), Alam (1970) and Tamhane and Bechhofer (1977, 1979) using the indifference-zone approach. The conjecture that the least favourable parameter configuration for the probability of a correct selection is of the slippage type remained unproved for k ≧ 3. Miescke and Sehr (1980) proved the conjecture for k=3. The problem was further discussed by Gupta and Miescke (1982). A general proof for rhe conjecture will be given in this paper.     

On estimating the mean of the selected population with unknown variance

This paper compares four estimators of the mean of the selected population from two normal populations with unknown means and common but unknown variance. The selection procedure is that the population yielding the largest sample mean is selected. The four estimators considered are invariant under both location and scale transformations. The bias and mean square errors of the four estimators are computed and compared. The conclusions are close to those reported by Dahiya ‘1974’, even for small sample sizes     

Subset selection of the t best populations

Selection of the “best” t out of k populations has been considered in the indifferece zone formulation by Bachhofer (1954) and in the subset selection formulation by Carroll, Gupta and Huang (1975). The latter approach is used here to obtain conservative solutions for the goals of selecting (i) all the “good” or (ii) only “good” populations, where “good” means having a location parameter among the largest t. For the case of normal distributions, with common unknown variance, tables are produced for implementing these procedures. Also, for this case, simulation results suggest that the procedure may not be too conservative.     

Interval estimation of the largest reliability of k weibull populations

A procedure is given for obtaining a random width confidence interval for the largest reliability of k Weibull populations. The procedure does not identify the populations for which the reliability would be a maximum. The maximum likelihood estimators or the simplified linear estimators of the reliability based on type II censored data are used. The cases considered include unknown shape parameters being equal or unequal. Simultaneous confidence intervals for the k reliabilities are also obtained. Tables for the lower and upper limits in selected cases are constructed using Monte Carlo methods.     

A two-stage procedure with accelerated test for selecting the best exponential population

In this article, we discuss a two-stage procedure for selecting the largest location parameter among k(k≥2) two-parameter exponential populations(or products) from an accelerated test. The accelerated test will be conducted at a higher stress level than that of normal in the second stage. under certain assumptions between parameter and stress leveL, the two-stage selection procedure, which guarantees that the probability of correct selection is at least p^*, is proposed. At the end of the paper , we present some useful tables that serve as a guide for the needed sample size in the second stage.     

Designing selection experiments with bernoulli populations

This paper is concerned with a fixed size subset selection problem for Bernoulli populations in the framework of the indifference zone approach. The goal is to select s populationswhich contain at least c of those with the t largest success probabilities. In order to control the probability of correct selection over the preference zone extensive tables of exact minimum sample sizes have been prepared to implement the single-stage procedure generalized from the well-known Sobel-Huyett procedure. It is shown how the tables can also be employed to design certain closedsequential procedures. These procedures curtail the sampling process of the single-stage procedureand may differ in their sampling rules. Two procedures working with play-the-winner rules are described in detail     

Conditions under which F. {N } = for tong's adaptive solution to ranking and selection problems

Tong ‘1978’ proposed an adaptive approach as an alternative to the classical indifference-zone formulation of the problems of ranking and selection. With a fixed pre-selected y*‘1/k < y* < 1’ his procedure calls for the termination of vector-at-a-time sampling when the estimated probability of a correct selection exceeds Y* for the first time. The purpose of this note is to show that for the case of two normal populations with common known variance, the expected number of vector-observations required by Tong's procedure to terminate sampling approaches infinity as the two population means approach equality for Y* ≥ 0.8413.It is conjectured that this phenomenon also persists if the two largest of K ≥3 population means approach equality. Since in the typical ranking and selection setting it usually is assumed that the experimenter has no knowledge concerning the differences between the population means, the experimenter who uses Tong's procedure clearly does so at his own risk.     

Some comments on two-stage selection procedures

In this paper we study the procedures of Dudewicz and Dalal ( 1975 ), and the modifications suggested by Rinott ( 1978 ), for selecting the largest mean from k normal populations with unknown variances. We look at the case k = 2 in detail, because there is an optimal allocation scheme here. We do not really allocate the total number of samples into two groups, but we estimate this optimal sample size, as well, so as to guarantee the probability of correct selection (written as P(CS)) at least P^?, 1/2 < P^? < 1 . We prove that the procedure of Rinott is “asymptotically in-efficient” (to be defined below) in the sense of Chow and Robbins ( 1965 ) for any k  2. Next, we propose two-stage procedures having all the properties of Rinott's procedure, together with the property of “asymptotic efficiency” - which is highly desirable.     

On a conjecture concerning the least favorable configuration of certain two-stage selection procedures

Given k normal populations with unknown means and a common known variance a two-stage procedure p₁ with screening in the first stage to find the population with the largest mean using the indifference-zone approach is under concern. It was proposed and studied previously by Cohen (1959), Alam (1970) and Tamhane and Bechhofer (1977, 1979). But up to now a conjecture concerning the least favorable parameter configuration of p₁remained unproved for k ≥ 3. In this paper we give a non-standard proof of the conjecture in case of k = 3 for p₁. which (under minor changes) works also for a simplified version of p₁,. Besides, a counterexample is provided to show that another (more intuitive) method of proof fails to work.     

Multivariate analysis of variance with additional data from an unknown subset of the populations

In this paper we consider the problem of testing the means of k multivariate normal populations with additional data from an unknown subset of the k populations. The purpose of this research is to offer test procedures utilizing all the available data for the multivariate analysis of variance problem because the additional data may contain valuable information about the parameters of the k populations. The standard procedure uses only the data from identified populations. We provide a test using all available data based upon Hotelling' s generalized T²statistic. The power of this test is computed using Betz's approximation of Hotelling' s generalized T²statistic by an F-distribution. A comparison of the power of the test and the standard test procedure is also given.