The optimal group size using inverse binomial group testing considering misclassification

ABSTRACT

Inverse binomial sampling is preferred for quick report. It is also recommended when the population proportion is really small to ensure a positive sample is contained. Group testing has been discussed extensively under binomial model, but not so much under negative binomial model. In this study, we investigate the problem of how to determine the group size using inverse binomial group testing. We propose to choose the optimal group size by minimizing asymptotic variance of the estimator or the cost relative to Fisher information. We show the good performance of our estimator by applying to the data of Chlamydia.     

The inverse binomial distribution as a statistical model

A particular case of Jain and Consul's (1971) generalized neg-ative binomial distribution is studied. The name inverse binomial is suggested because of its close relation with the inverse Gaussian distribution. We develop statistical properties including conditional inference of a parameter. An application using real data is given.     

Confidence regions for two proportions from independent negative binomial distributions

The negative binomial distribution offers an alternative view to the binomial distribution for modeling count data. This alternative view is particularly useful when the probability of success is very small, because, unlike the fixed sampling scheme of the binomial distribution, the inverse sampling approach allows one to collect enough data in order to adequately estimate the proportion of success. However, despite work that has been done on the joint estimation of two binomial proportions from independent samples, there is little, if any, similar work for negative binomial proportions. In this paper, we construct and investigate three confidence regions for two negative binomial proportions based on three statistics: the Wald (W), score (S) and likelihood ratio (LR) statistics. For large-to-moderate sample sizes, this paper finds that all three regions have good coverage properties, with comparable average areas for large sample sizes but with the S method producing the smaller regions for moderate sample sizes. In the small sample case, the LR method has good coverage properties, but often at the expense of comparatively larger areas. Finally, we apply these three regions to some real data for the joint estimation of liver damage rates in patients taking one of two drugs.     

Estimation of proportions by group testing with retesting of positive groups

Abstract

When estimating a proportion p by group testing, and it is desired to increase precision, it is sometimes impractical to obtain additional individuals but it is possible to retest groups formed from the individuals within the groups that test positive at the first stage. Hepworth and Watson assessed four methods of retesting, and recommended a random regrouping of individuals from the first stage. They developed an estimator of p for their proposed method, and, because of the analytic complexity, used simulation to examine its variance properties. We now provide an analytical solution to the variance of the estimator, and compare its performance with the earlier simulated results. We show that our solution gives an acceptable approximation in a reasonable range of circumstances.     

Confidence interval estimation for negative binomial group distribution

Negative binomial group distribution was proposed in the literature which was motivated by inverse sampling when considering group inspection: products are inspected group by group, and the number of non-conforming items of a group is recorded only until the inspection of the whole group is finished. The non-conforming probability p of the population is thus the parameter of interest. In this paper, the confidence interval construction for this parameter is investigated. The common normal approximation and exact method are applied. To overcome the drawbacks of these commonly used methods, a composite method that is based on the confidence intervals of the negative binomial distribution is proposed, which benefits from the relationship between negative binomial distribution and negative binomial group distribution. Simulation studies are carried out to examine the performances of our methods. A real data example is also presented to illustrate the application of our method.     

Revisiting retesting in the estimation of proportions by group testing

In the estimation of a proportion p by group testing (pooled testing), retesting of units within positive groups has received little attention due to the minimal gain in precision compared to testing additional units. If acquisition of additional units is impractical or too expensive, and testing is not destructive, we show that retesting can be a useful option. We propose the retesting of a random grouping of units from positive groups, and compare it with nested halving procedures suggested by others. We develop an estimator of p for our proposed method, and examine its variance properties. Using simulation we compare retesting methods across a range of group testing situations, and show that for most realistic scenarios, our method is more efficient.     

One-way analysis of proportions for misclassified binomial data

We consider data with a nominal grouping variable and a binary response variable. The grouping variable is measured without error, but the response variable is measured using a fallible device subject to misclassification. To achieve model identifiability, we use the double-sampling scheme which requires obtaining a subsample of the original data or another independent sample. This sample is then classified by both the fallible device and another infallible device regarding the response variable. We propose two Wald tests for testing the association between the two variables and illustrate the test using traffic data. The Type-I error rate and power of the tests are examined using simulations and a modified Wald test is recommended.     

Sequential risk-efficient estimation for the ratio of two binomial proportions

A risk-efficient sequential point estimator is considered for the ratio of two independent binomial proportions based on maximum likelihood estimation under squared error loss and cost proportional to the observations. It is assumed that the cost per observation is constant. First-order asymptotic expansions are obtained for large-sample properties of the proposed procedure. Performance of the procedure is studied through the criteria of risk efficiency and regret analysis. Monte Carlo simulation is carried out to obtain the expected sample size that minimizes the risk and to examine its finite sample behavior. An example is provided to illustrate its use.     

Estimating the proportions of two populations in a mixture using linear maps

We address the problem of estimating the proportions of two statistical populations in a given mixture on the basis of an unlabeled sample of n–dimensional observations on the mixture. Assuming that the expected values of observations on the two populations are known, we show that almost any linear map from Rⁿ to R¹ yields an unbiased consistent estimate of the proportion of one population in a very easy way. We then find that linear map for which the resulting proportion estimate has minimum variance among all estimates so obtained. After deriving a simple expression for the minimum-variance estimate, we discuss practical aspects of obtaining this and related estimates.     

An empirical comparison of several methods for testing the equality of dependent proportions

Three methods for testing the equality of nonindependent proportions were compared with, the use of Monte Carlo techniques. The three methods included Cochran's test, an ANOVA F test, and Hotelling's T² test. With respect to empirical significance levels, the ANOVA F test is recommended as the preferred method of analysis.

Oftentimes an experimenter is interested in testing the equality of several proportions. When the proportions are independent Kemp and Butcher (1972) and Butcher and Kemp (1974) compared several methods for analysing large sample binomial data for the case of a 3 x 3 factorial design without replication. In addition, Levy and Narula (1977) compared many of the same methods for analyzing binomial data; however, Levy and Narula investigated the relative utility of the methods for small sample sizes.     

Asymptotically optimum estimation of a probability in inverse binomial sampling under general loss functions

The optimum quality that can be asymptotically achieved in the estimation of a probability p using inverse binomial sampling is addressed. A general definition of quality is used in terms of the risk associated with a loss function that satisfies certain assumptions. It is shown that the limit superior of the risk for p asymptotically small has a minimum over all (possibly randomized) estimators. This minimum is achieved by certain non-randomized estimators. The model includes commonly used quality criteria as particular cases. Applications to the non-asymptotic regime are discussed considering specific loss functions, for which minimax estimators are derived.     

Improved approximations for the inverse moments of the positive binomial distribution

Several alternatives to the most common approximation to the inverse moments of the positive binomial distribution are obtained. The method is based on equating moments and gives considerably better approximations for some values of the parameters.     

Analysis of hypoglycemic events using negative binomial models

Negative binomial regression is a standard model to analyze hypoglycemic events in diabetes clinical trials. Adjusting for baseline covariates could potentially increase the estimation efficiency of negative binomial regression. However, adjusting for covariates raises concerns about model misspecification, in which the negative binomial regression is not robust because of its requirement for strong model assumptions. In some literature, it was suggested to correct the standard error of the maximum likelihood estimator through introducing overdispersion, which can be estimated by the Deviance or Pearson Chi‐square. We proposed to conduct the negative binomial regression using Sandwich estimation to calculate the covariance matrix of the parameter estimates together with Pearson overdispersion correction (denoted by NBSP). In this research, we compared several commonly used negative binomial model options with our proposed NBSP. Simulations and real data analyses showed that NBSP is the most robust to model misspecification, and the estimation efficiency will be improved by adjusting for baseline hypoglycemia. Copyright © 2013 John Wiley & Sons, Ltd.     

Mid-P confidence intervals based on the likelihood ratio for proportions estimated by group testing

Group testing has been used in many fields of study to estimate proportions. When groups are of different size, the derivation of exact confidence intervals is complicated by the lack of a unique ordering of the event space. An exact interval estimation method is described here, in which outcomes are ordered according to a likelihood ratio statistic. The method is compared with another exact method, in which outcomes are ordered by their associated MLE. Plots of the P‐value against the proportion are useful in examining the properties of the methods. Coverage provided by the intervals is assessed using several realistic grouptesting procedures. The method based on the likelihood ratio, with a mid‐P correction, is shown to give very good coverage in terms of closeness to the nominal level, and is recommended for this type of problem.     

On optimality of a two-stage sawpling method for binomial populations

We consider a family of two-stage sampling methods for a binomial parameter that guarantee a certain precision. It is shown that, among all such methods, one due to Birnbaum and Healy minimizes the average expected second stage sample size with respect to a certain density on the parameter space. It does not, however, minimize the average expected second stage sample size with respect to the uniform density.     

A unified sequential test procedure for simultaneous testing the equality of several binomial proportions to a specified standard

In this article, we propose a unified sequentially rejective test procedure for testing simultaneously the equality of several independent binomial proportions to a specified standard. The proposed test procedure is general enough to include some well-known multiple testing procedures such as the Ordinary Bonferroni procedure, Hochberg procedure and Rom procedure. It involves multiple tests of significance based on the simple binomial tests (exact or approximate) which can be easily found in many elementary standard statistics textbooks. Unlike the traditional Chi-square test of the overall hypothesis, the procedure can identify the subset of the binomial proportions, which are different from the prespecified standard with the control of the familywise type I error rate. Moreover, the power computation of the procedure is provided and the procedure is illustrated by two real examples from an ecological study and a carcinogenicity study.     

Nearly optimal truncated group sequential test on binomial proportions

In this article, we systematically study the optimal truncated group sequential test on binomial proportions. Through analysis of the cost structure, average test cost is introduced as a new optimality criterion. According to the new criterion, the optimal tests on different design parameters including the boundaries, success discriminant value, stage sample vector, stage size, and the maximum sample size are defined. Since the computation time in finding optimal designs by exhaustive search is intolerably long, group sequential sample space sorting method and procedures are developed to find the near-optimal ones. In comparison with the international standard ISO2859-1, the truncated group sequential designs proposed in this article can reduce the average test costs around 20%.     

基于梯度统计量的逆抽样下风险差的置信区间构建

通过逆抽样过程获得的分布又称为负二项分布,在流行病学研究和二分类变量分布的研究中应用极为广泛。因此,提出两种基于梯度统计量的逆抽样下风险差的置信区间的构建方法,分别依据风险差的极大似然估计(MLE)和方差最小无偏一致估计量(UMVUE)。与现有的WALD方法和得分方法相比,该方法所构建置信区间的优点在于:置信区间构建方法既不需要计算Fisher信息阵也不需要计算其逆矩阵,可使计算得以大大简化;对所提出的基于梯度统计量的置信区间构建方法进行蒙特卡洛模拟研究,模拟结果表明提出的构建方法可以得到很好的覆盖概率和较短的区间宽度。     

Mixture formulations of a bivariate negative binomial distribution with applications

This paper considers further mixture formulations of the bivariate negative binomial (BNB) distribution of Edwards and Gurland (1961) and Subrahmaniam (1966). These formulations and some known ones are applied (1) to obtain a bivariate generalized negative binomial (BGNB) distribution of Bhattacharya (1966), (2) to establish a connection between the accident-proneness models given by the BNB, BGNB and Bhattacharya's bivariate distributions, and (3) to compute the grade correlation and distribution function of the Wicksell-Kibble bivariate gamma distribution.     

Estimation of the binomial parameter,using an apriori hypothesis about its value

We study estimation of the parameter p of a r.v. x ～ Bin(p,n) using the prior hypothesis that p equals a prepecified value P_o when we entertain the possibility that P_o is not the right value of p, which then could be any value in (0.1). We apply notions of Hodges and Lehmann (1952), Bickel (1984) and Berger (1982) to obtain (biased) estimators which do well under the hypothesis that p = p_o at a small price in maximum risk. A number of examples and comparisons are discussed at the end of the paper.