Combining information from multiple surveys by using regression for efficient small domain estimation

Summary.  In sample surveys of finite populations, subpopulations for which the sample size is too small for estimation of adequate precision are referred to as small domains. Demand for small domain estimates has been growing in recent years among users of survey data. We explore the possibility of enhancing the precision of domain estimators by combining comparable information collected in multiple surveys of the same population. For this, we propose a regression method of estimation that is essentially an extended calibration procedure whereby comparable domain estimates from the various surveys are calibrated to each other. We show through analytic results and an empirical study that this method may greatly improve the precision of domain estimators for the variables that are common to these surveys, as these estimators make effective use of increased sample size for the common survey items. The design-based direct estimators proposed involve only domain-specific data on the variables of interest. This is in contrast with small domain (mostly small area) indirect estimators, based on a single survey, which incorporate through modelling data that are external to the targeted small domains. The approach proposed is also highly effective in handling the closely related problem of estimation for rare population characteristics.     

Improvement in Estimating the Population Median in Simple Random Sampling and Stratified Random Sampling Using Auxiliary Information

This paper deals with estimation of population median in simple and stratified random samplings by using auxiliary information. Auxiliary information is rarely used in estimating population median, although there have been many studies to estimate population mean using auxiliary information. In this study, we suggest some estimators using auxiliary information such as mode and range of an auxiliary variable and correlation coefficient. We also expand these estimators to stratified random sampling for combined and separate estimators. We obtain mean square error equations for all proposed estimators and find theoretical conditions. These conditions are also supported by using numerical examples.     

Estimating the Size of a Subdomain: An Application in Auditing

This article suggests an alternative to the ratio estimator for estimating the total size of a subdomain of a population. The application that served as the genesis for this work is from auditing. The problem is to estimate the total of sales transactions that are not tax exempt from an audit sample of the population of nontaxed sales transactions. A superpopulation approach, which models the unit's probability of belonging to the subdomain as a function of its size, leads to a family of estimators. The simplest member of this famiiy is one in which that function is specified to be a constant. The optimal estimator for this model performs markedly better than the ratio estimator when the assumption is true and often performs better when it is not, though in that case it is biased. Stratification is shown to reduce this bias and at the same time make the ratio estimator more similar to the optimal estimator. A simulation experiment shows that the theoretical advantages hold in a real audit population.     

Estimation of a finite population total in two-stage and stratified sampling under superpopulation models

Optimal sampling strategies which minimise the expected mean square error for a linear design as well as model-design unbiased estimators for a finite population total for two-stage and stratified sampling are obtained under different superpopu1ation models     

Recursive computation of inclusion probabilities in ranked-set sampling

We derive recursive algorithms for computing first-order and second-order inclusion probabilities for ranked-set sampling from a finite population. These algorithms make it practical to compute inclusion probabilities even for relatively large sample and population sizes. As an application, we use the inclusion probabilities to examine the performance of Horvitz-Thompson estimators under different varieties of balanced ranked-set sampling. We find that it is only for balanced Level 2 sampling that the Horvitz-Thompson estimator can be relied upon to outperform the simple random sampling mean estimator.     

Estimating the variance of a normal population by utilizing the information in a sample from a second related normal population

A class of estimators of the variance σ₁ ² of a normal population is introduced, by utilization the information in a sample from a second normal population with different mean and variance σ₂ ², under the restriction that σ₁ ²?≤?σ₂ ². Simulation results indicate that some members of this class are more efficient than the usual minimum variance unbiased estimator (MVUE) of σ₁ ², Stein estimator and Mehta and Gurland estimator. The case of known and unknown means are considered.     

Unbiased Estimation of the Distribution Function of an Exponential Population Using Order Statistics with Application in Ranked Set Sampling

In this paper we consider the problem of unbiased estimation of the distribution function of an exponential population using order statistics based on a random sample. We present a (unique) unbiased estimator based on a single, say ith, order statistic and study some properties of the estimator for i = 2. We also indicate how this estimator can be utilized to obtain unbiased estimators when a few selected order statistics are available as well as when the sample is selected following an alternative sampling procedure known as ranked set sampling. It is further proved that for a ranked set sample of size two, the proposed estimator is uniformly better than the conventional nonparametric unbiased estimator, further, for a general sample size, a modified ranked set sampling procedure provides an unbiased estimator uniformly better than the conventional nonparametric unbiased estimator based on the usual ranked set sampling procedure.     

On optimality of the horvitz-thompson estimator under a markov process model

For any varying probability sampling design the Horvitz-Thompson (1952) estimator is shown to be optimal within the class of all unbiased estimators of a finite population total under a Markov process model     

Estimating variances of strata in ranked set sampling

In RSS, the variance of observations in each ranked set plays an important role in finding an optimal design for unbalanced RSS and in inferring the population mean. The empirical estimator (i.e., the sample variance in a given ranked set) is most commonly used for estimating the variance in the literature. However, the empirical estimator does not use the information in the entire data over different ranked sets. Further, it is highly variable when the sample size is not large enough, as is typical in RSS applications. In this paper, we propose a plug-in estimator for the variance of each set, which is more efficient than the empirical one. The estimator uses a result in order statistics which characterizes the cumulative distribution function (CDF) of the rth order statistics as a function of the population CDF. We analytically prove the asymptotic normality of the proposed estimator. We further apply it to estimate the standard error of the RSS mean estimator. Both our simulation and empirical study show that our estimators consistently outperform existing methods.     

A Model Selection Criterion for Discriminant Analysis of Several Groups When the Dimension is Larger than the Total Sample Size

This article deals with a criterion for selection of variables for the multiple group discriminant analysis in high-dimensional data. The variable selection models considered for discriminant analysis in Fujikoshi (1985 Fujikoshi , Y. ( 1985 ). Selection of variables in discriminant analysis and canonical correlation analysis . In: Krishnaiah , P. R. , ed. Multivariate Analysis . Vol. VI. Amsterdam : North-Holland , pp. 219 – 236 . [Google Scholar], 2002 Fujikoshi , Y. ( 2002 ). Selection of variables for discriminant analysis in a high-dimensional case . Sankhya Ser. A 64 : 256 – 257 . [Google Scholar]) are the ones based on additional information due to Rao (1948 Rao , C. R. ( 1948 ). Tests of significance in multivariate analysis . Biometrika 35 : 58 – 79 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar], 1970 Rao , C. R. ( 1970 ). Inference on discriminant function coefficients . In: Bose , R. C. , ed. Essays in Probability and Statistics . Chapel Hill , NC : University of North Carolina Press , pp. 537 – 602 . [Google Scholar]). Our criterion is based on Akaike information criterion (AIC) for this model. The AIC has been successfully used in the literature in model selection when the dimension p is smaller than the sample size N. However, the case when p > N has not been considered in the literature, because MLE can not be estimated corresponding to singularity of the within-group covariance matrix. A popular method used to address the singularity problem in high-dimensional classification is the regularized method, which replaces the within-group sample covariance matrix with a ridge-type covariance estimate to stabilize the estimate. In this article, we propose AIC-type criterion by replacing MLE of the within-group covariance matrix with ridge-type estimator. This idea follows Srivastava and Kubokawa (2008 Srivastava , M. S. , Kubokawa , T. ( 2008 ). Akaike information criterion for selecting components of the mean vector in high dimensional data with fewer observations . J. Japan Statist. Soc. 38 : 259 – 283 . [Google Scholar]). Simulations revealed that our proposed criterion performs well.     

On the consistency between model-and design-based estimators in survey sampling

In finite population sampling, often a distinction is made between model-and design-based estimators of the parameters of interest (like the population total, population variance, etc.). The model-based estimators depend on the (known) parameters of the model, while the design-based estimators depend on the (known) selection probabilities of the different units in the population. It is shown in this paper that the two approaches are not necessarily incompatible, and indeed can often lead to the same estimator. Our ideas are illustrated with the Horvitz-Thompson, and the generalized Horvitz-Thompson estimator. These estimators are identified as hierarchical Bays estimators. Also, certain “stepwise-Bayes” estimators of Vardeman and Meeden (J. Stat. Inf. (1983), V7, pp 329-341) are unified from a hierarchical Bayes point of view.     

Coverage-adjusted estimators for mark-recapture in heterogeneous populations

Consideration of coverage yields a new class of estimators of population size for the standard mark-recapture model which permits heterogeneity of capture probabilities. Real data and simulation studies are used to assess these coverage-adjusted estimators. The simulations highlight the need for estimators that perform well for a wide range of values of the mean and coefficient of variation of the capture probabilities. When judged for this type of robustness, the simulations provide good grounds for preferring the new estimators to earlier ones for this model, except when the number of sampling occasions is large. A bootstrapping approach is used to estimate the standard errors of the new estimators, and to obtain confidence intervals for the population size.     

Estimating Percentiles of Time-to-Failure Distribution Obtained from a Linear Degradation Model Using Kernel Density Method

In this article, we propose a nonparametric estimator for percentiles of the time-to-failure distribution obtained from a linear degradation model using the kernel density method. The properties of the proposed kernel estimator are investigated and compared with well-known maximum likelihood and ordinary least squares estimators via a simulation technique. The mean squared error and the length of the bootstrap confidence interval are used as the basis criteria of the comparisons. The simulation study shows that the performance of the kernel estimator is acceptable as a general estimator. When the distribution of the data is assumed to be known, the maximum likelihood and ordinary least squares estimators perform better than the kernel estimator, while the kernel estimator is superior when the assumption of our knowledge of the data distribution is violated. A comparison among different estimators is achieved using a real data set.     

Ratio-Cum-Product Type Exponential Estimator of Finite Population Mean in Stratified Random Sampling

This article addresses the problem of estimating the finite population mean in stratified random sampling using auxiliary information. Motivated by Singh (1967 Singh , M. P. ( 1967 ). Ratio cum product method of estimation . Metrika 12 : 34 – 42 .[Crossref] , [Google Scholar]) and Bahl and Tuteja (1991 Bahl , S. , Tuteja , R. K. ( 1991 ). Ratio and product type exponential estimator . Inform. Optimiz. Sci. 12 ( 1 ): 159 – 163 .[Taylor &; Francis Online] , [Google Scholar]) a ratio-cum-product type exponential estimator has been suggested and its bias and mean squared error have been derived under large sample approximation. Suggested estimator has been compared with usual unbiased estimator of population mean in stratified random sampling, combined ratio estimator, combined product estimator, ratio and product type exponential estimator of Singh et al. (2008 Singh , R. , Kumar , M. , Singh , R. D. , Chaudhary , M. K. ( 2008 ). Exponential ratio type estimators in stratified random sampling. Presented in International Symposium on Optimisation and Statistics (I.S.O.S) at A.M.U., Aligarh, India, during 29–31 Dec . [Google Scholar]). Conditions under which suggested estimator is more efficient than other considered estimators have been obtained. A numerical illustration is given in support of the theoretical findings.     

Admissible estimators in finite population sampling employing various types of prior information

We consider some estimators of the total and variance of a finite population from Bayesian and pseudo-Bayesian perspectives. Recently, Meeden and Ghosh (1982a, 1982b) have provided quite simple but powerful tools for proving admissibility of estimators and estimator-design pairs is finite population sampling problems. We consider what these techniques yield in the way of admissibility results for the estimators discussed.     

An Improved Class of Estimators in Two-Phase Sampling Using Two Auxiliary Variables

This article suggests an improved class of estimators under the general framework of two-phase sampling scheme in presence of two auxiliary variables. This class includes a large number of estimators (Chand, 1975 Chand , L. ( 1975 ). Some Ratio-Type Estimator Based on Two or More Auxiliary Variables. Unpublished Ph.D. dissertation, Iowa State University, Iowa . [Google Scholar]; Kiregyera, 1980 Kiregyera , B. ( 1980 ). A chain ratio-type estimator in finite population double sampling using two auxiliary variables . Metrika 27 : 217 – 223 .[Crossref] , [Google Scholar], 3; Mukharjee et al., 1987 Mukharjee , R. , Rao , T. J. , Vijayan , K. ( 1987 ). Regression-type estimators using multiple auxiliary information . Aust. J. Statist. 29 : 244 – 254 . [Google Scholar]) and also the class of estimators suggested by Sahoo et al. (1993 Sahoo , J. , Sahoo , L. N. , Mohanty , S. ( 1993 ). A regression approach to estimation in two phase sampling using two auxiliary variables . Curr. Sci. 65 ( 1 ): 73 – 75 . [Google Scholar]).     

Systematic and nonrandom sampling in the presence of linear trends

In the case of a finite population with a linear trend, improvements in estimation procedures are suggested for several well-known systematic samplingschemes. The use of the least squares regression estimator is examined and a sampling scheme which reduces its expected mean squared error is proposed.     

Estimation of Finite Population Variance Using Scrambled Responses in the Presence of Auxiliary Information

In this article, a new estimator for estimating the finite population variance of a sensitive variable based on scrambled responses collected using a randomization device is introduced. The estimator is then improved by using known auxiliary information. The estimators due to Das and Tripathi (1978: Sankhya) and Isaki (1983: JASA) are shown to be special cases of the proposed estimator. Numerical simulations are performed to study the magnitude of the gain in efficiency when using the estimator with auxiliary information with respect to the estimator based only on the scrambled responses. An idea to extend the present work from SRSWOR design to more complex design is also given.     

Estimation of the Change Point in Monitoring the Process Mean and Variance

Knowing the time of a process change could lead to quicker identification of the special cause and less process down time, as well as help to reduce the probability of incorrectly identifying the special cause. In this article, we propose the maximum likelihood estimator (MLE) for the process change point when a control chart with the fixed sampling rate (FSR) scheme or the variable sampling rate (VSR) scheme is used in monitoring a process to detect changes in the process mean and/or variance of a normal quality variable. We investigate the performance of this estimator when it is used in various types of control charts.     

Family of Estimators of Population Mean Using Two Auxiliary Variables in Stratified Random Sampling

A general family of estimators, which use the information of two auxiliary variables in the stratified random sampling, is proposed to estimate the population mean of the variable under study. Under stratified random sampling without replacement scheme, the expressions of bias and mean square error (MSE) up to the first- and second-order approximations are derived. The family of estimators in its optimum case is discussed. Also, an empirical study is carried out to show the properties of the proposed estimators.