Estimating a sensitive proportion through randomized response procedures based on auxiliary information

Randomized response techniques are widely employed in surveys dealing with sensitive questions to ensure interviewee anonymity and reduce nonrespondents rates and biased responses. Since Warner’s (J Am Stat Assoc 60:63–69, 1965) pioneering work, many ingenious devices have been suggested to increase respondent’s privacy protection and to better estimate the proportion of people, π _A , bearing a sensitive attribute. In spite of the massive use of auxiliary information in the estimation of non-sensitive parameters, very few attempts have been made to improve randomization strategy performance when auxiliary variables are available. Moving from Zaizai’s (Model Assist Stat Appl 1:125–130, 2006) recent work, in this paper we provide a class of estimators for π _A , for a generic randomization scheme, when the mean of a supplementary non-sensitive variable is known. The minimum attainable variance bound of the class is obtained and the best estimator is also identified. We prove that the best estimator acts as a regression-type estimator which is at least as efficient as the corresponding estimator evaluated without allowing for the auxiliary variable. The general results are then applied to Warner and Simmons’ model.     

Estimating a distribution for each category of a sensitive variate

The use of a Randomized Response (RR) design makes it possible to estimate the distribution of a sensitive variate. In this paper, the estimation of the distribution of a non-sensitive variate for each category of a sensitive variate is considered for the case where data on the sensitive variate is obtained by use of an RR procedure. Simple estimators are developed without making any distributional assumptions about the non-sensitive variate. However, if distributional assumptions are made, it is shown that the EM algorithm may be used to compute Maximum Likelihood estimates. Computational comparisons of the estimators, using simulation, indicate that the simple estimators perform well, particularly for large sample sizes.     

An optional randomized response model for estimating a rare sensitive attribute using Poisson distribution

The crux of this article is to estimate the mean of the number of persons possessing a rare sensitive attribute based on the Mangat (1991 Mangat, N.S. (1991). An optional randomized response sampling technique using non–stigmatized attribute. Statistica. 51(4):595–602. [Google Scholar]) randomization device by utilizing the Poisson distribution in simple random sampling and stratified sampling. Properties of the proposed randomized response (RR) model have been studied along with recommendations. It is also shown that the proposed model is more efficient than that of Land et al. (2011 Land, M., Singh, S., Sedory, S.A. (2011). Estimation of a rare attribute using Poisson distribution. Statistics. 46(3):351–360.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) in simple random sampling and that of Lee et al. (2013 Lee, G.S., Uhm, D., Kim, J.M. (2013). Estimation of a rare sensitive attribute in stratified sampling using Poisson distribution. Statistics. 47(3):575–589.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) in stratified random sampling when the proportion of persons possessing a rare unrelated attribute is known. Numerical illustrations are also given in support of the present study.     

A stratified randomized response model for sensitive characteristics using the negative hypergeometric distribution

Taking clue from the pioneer work of Singh and Sedory (2013 Singh, S., Sedory, S.A. (2013). A new randomized response device for sensitive characteristics: an application of the negative hypergeometric distribution. Metron 71:3–8.[Crossref] , [Google Scholar]), we have suggested a new stratified randomized response (RR) model. The properties of the suggested stratified RR model have been studied under proportional and “Neyman” allocations. The study has been also carried out in the presence of crude prior estimates. Numerical illustrations are also given in support of the present study.     

A regression estimator for finite population mean of a sensitive variable using an optional randomized response model

Kalucha et al. (Kalucha G., Gupta S., Dass B. K. (accepted). Ratio estimation of finite population mean using optional randomized response models. Journal of Statistical Theory and Practice) introduced an additive ratio estimator for finite population mean of a sensitive variable in simple random sampling without replacement and showed that this estimator performs better than the ordinary mean estimator based on an optional randomized response technique (RRT). In this paper, we introduce a regression estimator that performs better than the ratio estimator even for the modest correlation between the study and the auxiliary variables. A comparison of the proposed estimator with the corresponding ratio estimator and the ordinary RRT mean estimator is carried out theoretically, and is also illustrated with a simulation study.     

On the comparison of Warner's and unrelated question randomized response plans for estimating sensitive finite population proportions

We consider the problem of estimation of a finite population proportion (P) related to a sensitive attribute under Warner's (1965 Warner, S.L. (1965). Randomized response: A survey technique for eliminating evasive answer bias. J. Am. Stat. Assoc. 60:63–69.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) randomized response plan and the unrelated question plan due to Horvitz et al. (1967 Warner, S.L. (1965). Randomized response: A survey technique for eliminating evasive answer bias. J. Am. Stat. Assoc. 60:63–69.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) and prove that for a given probability sampling design, given any linear unbiased estimator (LUE) of P based on Warner's (1965 Warner, S.L. (1965). Randomized response: A survey technique for eliminating evasive answer bias. J. Am. Stat. Assoc. 60:63–69.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) plan with any given value of the plan parameter, there exists an LUE of P based on the unrelated question plan with a uniformly smaller variance for suitable choices of the plan parameters. Assuming that only the attribute is sensitive but its complement is innocuous, the same is also shown to be true when the plan parameters for the two plans are so chosen so that both offer the same specified level of privacy.     

A new stratified three-stage unrelated randomized response model for estimating a rare sensitive attribute based on the Poisson distribution

This article suggests an efficient method of estimating a rare sensitive attribute which is assumed following Poisson distribution by using three-stage unrelated randomized response model instead of the Land et al. model (2011 Land, M., S. Singh, and S. A. Sedory. 2011. Estimation of a rare sensitive attribute using poisson distribution. Statistics 46 (3):351–60. doi:10.1080/02331888.2010.524300.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) when the population consists of some different sized clusters and clusters selected by probability proportional to size(:pps) sampling. A rare sensitive parameter is estimated by using pps sampling and equal probability two-stage sampling when the parameter of a rare unrelated attribute is assumed to be known and unknown.

We extend this method to the case of stratified population by applying stratified pps sampling and stratified equal probability two-stage sampling. An empirical study is carried out to show the efficiency of the two proposed methods when the parameter of a rare unrelated attribute is assumed to be known and unknown.     

Estimating the causal effects in randomized trials for survival data with a cure fraction and non compliance

We consider causal inference in randomized studies for survival data with a cure fraction and all-or-none treatment non compliance. To describe the causal effects, we consider the complier average causal effect (CACE) and the complier effect on survival probability beyond time t (CESP), where CACE and CESP are defined as the difference of cure rate and non cured subjects’ survival probability between treatment and control groups within the complier class. These estimands depend on the distributions of survival times in treatment and control groups. Given covariates and latent compliance type, we model these distributions with transformation promotion time cure model whose parameters are estimated by maximum likelihood. Both the infinite dimensional parameter in the model and the mixture structure of the problem create some computational difficulties which are overcome by an expectation-maximization (EM) algorithm. We show the estimators are consistent and asymptotically normal. Some simulation studies are conducted to assess the finite-sample performance of the proposed approach. We also illustrate our method by analyzing a real data from the Healthy Insurance Plan of Greater New York.     

Estimating efficacy in a proposed randomized trial with initial and later non-compliance

Summary.  A controversial topic in obstetrics is the effect of walking on the probability of Caesarean section among women in labour. A major reason for the controversy is the presence of non-compliance that complicates the estimation of efficacy, the effect of treatment received on outcome. The intent-to-treat method does not estimate efficacy, and estimates of efficacy that are based directly on treatment received may be biased because they are not protected by randomization. However, when non-compliance occurs immediately after randomization, the use of a potential outcomes model with reasonable assumptions has made it possible to estimate efficacy and still to retain the benefits of randomization to avoid selection bias. In this obstetrics application, non-compliance occurs initially and later in one arm. Consequently some parameters cannot be uniquely estimated without making strong assumptions. This difficulty is circumvented by a new study design involving an additional randomization group and a novel potential outcomes model (principal stratification).     

A validation of a computer-assisted randomized response survey to estimate the prevalence of fraud in social security

Summary.  In the Netherlands, there is a research tradition that measures fraud against regulations by interviewing eligible individuals using a survey. In these studies the sensitive questions about fraud are posed by using a randomized response method. The paper describes the results of a Dutch study into the consequences of replacing home interviews by trained interviewers with Internet-delivered interviews in a survey on fraud in the area of disability benefits. Both surveys used computer-assisted self-interviews with randomized response questions. This study has three goals: first to present the research tradition that makes use of randomized response, second to compare the results of home interviews and the Internet survey and finally to introduce an adapted weighted logistic regression method to test the relationship between the probability of fraud and explanatory variables. The results show that there are no systematic differences between modes of interview, either for estimates of the prevalence of fraud or for the identification of associated variables. These outcomes result in the conclusion that the Internet survey is a useful and cost-effective instrument for measuring fraud in a population, and that it is unlikely that replacing home interviews with the Internet survey will result in a significant break with tradition.     

On comutativity of design and model expectations in randomized response surveys

Interchangability of the order of design expectation ( E_p ) and model expectation ( E_R ) under randomized response ( RR ) surveys for finding expectation and mean-square error of a linear estimator e found to be permissible for a non-informative sampling design. The non-comutative property established by Chaudhuri & Adhikary ( 1990 ) under probability proportional to size with replacement ( PPSWR ) sampling is disproved.     

Revisit of a randomized response model for estimating a rare sensitive attribute under probability proportional to size sampling using Poisson probability distribution

The present article deals with the estimation of mean number of individuals possess a rare sensitive attribute using Poisson probability distribution, when the population consists of clusters. Unbiased estimation procedures for the mean number of individuals have been suggested and their properties are discussed when the parameter of a rare non-sensitive unrelated attribute is assumed to be known as well as unknown. The suggested estimation procedure is further discussed for situation of stratified cluster population. Empirical studies are carried out to show the dominance of proposed method and resultant estimators over a well-known contemporary estimator.     

Robust analysis of variance for a randomized block design

In this paper we study the asymptotic theory of M-estimates and their associated tests for a one-factor experiment in a randomized block design. In this case one natural asymptotic theory corresponds to leaving the number of treatments fixed and letting the number of blocks tend to infinity. The classic asymptotic theory of M-estimates does not apply here, because the number of parameters and the number of observations are of the same order. In this paper we prove the consistency and asymptotic normality of the estimators of the treatment effects. It turns out that the asymptotic covariance matrix of the treatment effects estimators differs from the one derived from the classic theory of M-estimates for the linear model with a fixed number of parameters. We also study a test for treatment effects derived from M-estimates and we compare by Monte Carlo simulation the efficiency of this test with respect to the F-test, the Friedman test and the test based on aligned ranks.     

Estimation of a rare sensitive attribute in a stratified two-stage unrelated randomized response model by using Poisson probability distribution

The present article deals with the estimation of mean number of respondents who possess a rare sensitive character in presence of known and unknown proportion of a rare unrelated non-sensitive attribute by using the Poisson probability distribution in stratified random sampling as well as in stratified random double sampling. The variance of rare sensitive character is also derived under proportional and optimal allocation methods in stratified random sampling when stratum sizes are known and unknown. The properties of the suggested estimation procedures have been deeply examined. The proposed model is found to be dominant over Lee et al. [Estimation of a rare sensitive attribute in a stratified sample using Poisson distribution. Statistics. 2013;47:575–589] model. Numerical illustrations are presented to support the theoretical results. Results are analysed and suitable recommendations are put forward to the survey practitioners.     

Estimation of a rare sensitive attribute for two-stage randomized response model in probability proportional to size sampling using Poisson probability distribution

This paper addresses the estimation of the mean number of individuals in the population who possess a rare sensitive attribute using Poisson distribution for the situations of (i) clustered population and (ii) stratified population with clusters are strata units. Properties of the proposed estimation procedures have been discussed when the proportion of a rare unrelated non-sensitive attribute is assumed to be known as well as unknown. Empirical studies are carried out to support the theoretical results which showed dominance over Lee et al. [Estimation of a rare sensitive attribute in probability proportional to size measures using Poisson distribution. Statistics (Ber). 2014;48(3):685–709] estimation procedures.     

New scrambled response models for estimating the mean of a sensitive quantitative character

Moving from the scrambling mechanism recently suggested by Saha [25 Saha, A. 2007. A simple randomized response technique in complex surveys. Metron, LXV: 59–66.  [Google Scholar]], three scrambled randomized response (SRR) models are introduced with the intent to realize a right trade-off between efficiency and privacy protection. The models perturb the true response on the sensitive variable by resorting to the multiplicative and additive approaches in different ways. Some analytical and numerical comparisons of efficiency are performed to set up the conditions under which improvements upon Saha's model can be obtained and to quantify the efficiency gain. The use of auxiliary information is also discussed in a class of estimators for the sensitive mean under a generic randomization scheme. The class includes also the three proposed SRR models. Finally, some graphical comparisons are carried out from the double perspective of the accuracy in the estimates and respondents’ privacy protection.     

A two-stage unrelated randomized response model for estimating a rare sensitive attribute in probability proportional to size sampling using Poisson distribution

This paper describes the estimating procedures of mean number of entities that possess a rare sensitive attribute using the Mangat (1992) randomized device, when the population consists of some clusters and the population is again stratified with some clusters in each stratum. Unbiased estimation procedures for the mean number of individuals have been discussed and their properties are described when the parameter of a rare unrelated attribute is assumed to be known and unknown. An empirical study is carried out to show the dominance of the proposed estimator over Lee et al. (2013) estimator.     

Estimating the prevalence of male clients of prostitute women in Vancouver with a simple capture–recapture method

Summary.  Capture–recapture techniques are widely used to estimate the size of difficult-to-count human populations. Applications often focus on the overlap between two or more samples, but another type of data that is encountered in human studies involves only the number of times that particular individuals were encountered in the study period. We present a method for estimating the population size in this situation. This method is simple and technically accessible and allows for entries and exits by individuals and for a difference between probabilities of initial and subsequent contacts. We apply the method to arrest data on male clients of prostitute women in Vancouver.