Robust Inference in Two‐phase Sampling Designs with Application to Unit Nonresponse

Influential units occur frequently in surveys, especially in business surveys that collect economic variables whose distributions are highly skewed. A unit is said to be influential when its inclusion or exclusion from the sample has an important impact on the sampling error of estimates. We extend the concept of conditional bias attached to a unit and propose a robust version of the double expansion estimator, which depends on a tuning constant. We determine the tuning constant that minimizes the maximum estimated conditional bias. Our results can be naturally extended to the case of unit nonresponse, the set of respondents often being viewed as a second‐phase sample. A robust version of calibration estimators, based on auxiliary information available at both phases, is also constructed.     

Variance estimation using auxiliary information under a one unit per stratum sample design

Several variance estimators using auxiliary information were compared for estimating the variance of the total or ratio under a one unit per stratum sample design. The auxiliary information used consisted of data from the 1977 and 1982 Economic Census. One thousand probability proportional to size one primary sampling unit per stratum samples were selected for the Monte Carlo study of characteristics of interest in a content evaluation survey as part of the 1982 Economic Census program. Six variance estimators were applied to each sample and their bias and mean square errors were evaluated. The results are strikingly different between the variance estimators of the estimated total and ratio.     

MULTISTAGE SAMPLING FOR RAW WOOL CHARACTERISTICS

The problem of evaluating the sampling variance of a mean when units are subsampled from a multistage sample is discussed. In particular, a specific problem arising in the sampling of wool where information on the identity of subsampled units is not available is dealt with by introducing a simple model to account for the variability in the unobserved numbers of observations within the multistage categories. Estimation aspects of the wool example are also dealt with.     

Designing stratified sampling in economic and business surveys

In most economic and business surveys, the target variables (e.g. turnover of enterprises, income of households, etc.) commonly resemble skewed distributions with many small and few large units. In such surveys, if a stratified sampling technique is used as a method of sampling and estimation, the convenient way of stratification such as the use of demographical variables (e.g. gender, socioeconomic class, geographical region, religion, ethnicity, etc.) or other natural criteria, which is widely practiced in economic surveys, may fail to form homogeneous strata and is not much useful in order to increase the precision of the estimates of variables of interest. In this paper, a stratified sampling design for economic surveys based on auxiliary information has been developed, which can be used for constructing optimum stratification and determining optimum sample allocation to maximize the precision in estimate.     

VARIANCE ESTIMATION IN TWO-PHASE SAMPLING

Two‐phase sampling is often used for estimating a population total or mean when the cost per unit of collecting auxiliary variables, x, is much smaller than the cost per unit of measuring a characteristic of interest, y. In the first phase, a large sample s₁ is drawn according to a specific sampling design p(s₁) , and auxiliary data x are observed for the units i∈s₁ . Given the first‐phase sample s₁ , a second‐phase sample s₂ is selected from s₁ according to a specified sampling design {p(s₂∣s₁) } , and (y, x) is observed for the units i∈s₂ . In some cases, the population totals of some components of x may also be known. Two‐phase sampling is used for stratification at the second phase or both phases and for regression estimation. Horvitz–Thompson‐type variance estimators are used for variance estimation. However, the Horvitz–Thompson ( Horvitz & Thompson, J. Amer. Statist. Assoc. 1952 ) variance estimator in uni‐phase sampling is known to be highly unstable and may take negative values when the units are selected with unequal probabilities. On the other hand, the Sen–Yates–Grundy variance estimator is relatively stable and non‐negative for several unequal probability sampling designs with fixed sample sizes. In this paper, we extend the Sen–Yates–Grundy ( Sen , J. Ind. Soc. Agric. Statist. 1953; Yates & Grundy , J. Roy. Statist. Soc. Ser. B 1953) variance estimator to two‐phase sampling, assuming fixed first‐phase sample size and fixed second‐phase sample size given the first‐phase sample. We apply the new variance estimators to two‐phase sampling designs with stratification at the second phase or both phases. We also develop Sen–Yates–Grundy‐type variance estimators of the two‐phase regression estimators that make use of the first‐phase auxiliary data and known population totals of some of the auxiliary variables.     

How to Select Representative Samples

We give a formal definition of a representative sample, but roughly speaking, it is a scaled‐down version of the population, capturing its characteristics. New methods for selecting representative probability samples in the presence of auxiliary variables are introduced. Representative samples are needed for multipurpose surveys, when several target variables are of interest. Such samples also enable estimation of parameters in subspaces and improved estimation of target variable distributions. We describe how two recently proposed sampling designs can be used to produce representative samples. Both designs use distance between population units when producing a sample. We propose a distance function that can calculate distances between units in general auxiliary spaces. We also propose a variance estimator for the commonly used Horvitz–Thompson estimator. Real data as well as illustrative examples show that representative samples are obtained and that the variance of the Horvitz–Thompson estimator is reduced compared with simple random sampling.     

Optimal PPS Sampling with Vanishing Auxiliary Variables – with Applications in Microscopy

Recently, non‐uniform sampling has been suggested in microscopy to increase efficiency. More precisely, proportional to size (PPS) sampling has been introduced, where the probability of sampling a unit in the population is proportional to the value of an auxiliary variable. In the microscopy application, the sampling units are fields of view, and the auxiliary variables are easily observed approximations to the variables of interest. Unfortunately, often some auxiliary variables vanish, that is, are zero‐valued. Consequently, part of the population is inaccessible in PPS sampling. We propose a modification of the design based on a stratification idea, for which an optimal solution can be found, using a model‐assisted approach. The new optimal design also applies to the case where ‘vanish’ refers to missing auxiliary variables and has independent interest in sampling theory. We verify robustness of the new approach by numerical results, and we use real data to illustrate the applicability.     

Unconditional empirical likelihood approach for analytic use of public survey data

Modeling survey data often requires having the knowledge of design and weighting variables. With public-use survey data, some of these variables may not be available for confidentiality reasons. The proposed approach can be used in this situation, as long as calibrated weights and variables specifying the strata and primary sampling units are available. It gives consistent point estimation and a pivotal statistics for testing and confidence intervals. The proposed approach does not rely on with-replacement sampling, single-stage, negligible sampling fractions, or noninformative sampling. Adjustments based on design effects, eigenvalues, joint-inclusion probabilities or bootstrap, are not needed. The inclusion probabilities and auxiliary variables do not have to be known. Multistage designs with unequal selection of primary sampling units are considered. Nonresponse can be easily accommodated if the calibrated weights include reweighting adjustment for nonresponse. We use an unconditional approach, where the variables and sample are random variables. The design can be informative.     

TWO-DIMENSIONAL BALANCED SAMPLING PLANS EXCLUDING CONTIGUOUS UNITS

ABSTRACT

A balanced sampling plan excluding contiguous units (or BSEC for short) was first introduced by Hedayat, Rao and Stufken in 1988. These designs can be used for survey sampling when the units are arranged in one-dimensional ordering and the contiguous units in this ordering provide similar information. In this paper, we generalize the concept of a BSEC to the two-dimensional situation and give constructions of two-dimensional BSECs with block size 3. The existence problem is completely solved in the case where λ = 1.     

Probability proportional to size (πps) sampling using ranks

There can be gains in estimation efficiency over equal probability samplin methods when one makes use of auxiliary information for probability proporti onal to size with replacement (πpswr) sampling methods. The usual method is simple to execute, but might lead to more than one appearance in the sampl e for any particular unit. When a suitable variable x is not available, one may know how to rank units reasonably well relative to the unknown y values before sample selection. When such ranking is possible, we introduce a simple and efficient sampling plan using the ranks as the unknown x measures of size. The proposed sampling plan is similar to, has the simplicity of, and has no greater sampling variance than with replacement sampling, but is without replacement.     

Improvement over variance estimation using auxiliary information in sample surveys

This paper addresses the problem of estimating the population variance S²_y of the study variable y using auxiliary information in sample surveys. We have suggested a class of estimators of the population variance S²_y of the study variable y when the population variance S²_x of the auxiliary variable x is known. Asymptotic expressions of bias and mean squared error (MSE) of the proposed class of estimators have been obtained. Asymptotic optimum estimators in the proposed class of estimators have also been identified along with its MSE formula. A comparison has been provided. We have further provided the double sampling version of the proposed class of estimators. The properties of the double sampling version have been provided under large sample approximation. In addition, we support the present study with aid of a numerical illustration.     

METHOD OF ESTIMATION FOR SAMPLING FROM INCOMPLETE FRAMES

The planning of any sample survey or census requires the existence of a sampling frame comprising a list of all the sampling units. But unfortunately there is hardly a situation in practice where the frame is available in the form the sampler desires to use. Most commonly some units of the target population are not listed in the frame, and the frame may contain units which do not belong to the target population. In this investigation a suitable method of estimation is proposed when sampling is done from such imperfect frames and a geographical ordering of the units can be established.     

Using multiparametric auxiliary information at the estimation stage

Difference type estimators use auxiliary information based on an auxiliary parameter (specifically the parameter of interest), associated with the auxiliary variable. In practice, however, several parameters for auxiliary variables are available. This paper discusses how such estimators can be modified to improve the usual methods if information related to other parameters associated with an auxiliary variable or variables is available. Some applications estimating several such parameters are described. A proper set of simulation-based comparisons is made. Research partially supported by MCYT (Spain) contract n. BFM2001-3190     

Efficient M-estimators with auxiliary information

This paper introduces a new class of M-estimators based on generalised empirical likelihood (GEL) estimation with some auxiliary information available in the sample. The resulting class of estimators is efficient in the sense that it achieves the same asymptotic lower bound as that of the efficient generalised method of moment (GMM) estimator with the same auxiliary information. The paper also shows that in case of smooth estimating equations the proposed estimators enjoy a small second order bias property compared to both efficient GMM and full GEL estimators. Analytical formulae to obtain bias corrected estimators are also provided. Simulations show that with correctly specified auxiliary information the proposed estimators and in particular those based on empirical likelihood outperform standard M and efficient GMM estimators both in terms of finite sample bias and efficiency. On the other hand with moderately misspecified auxiliary information estimators based on the nonparametric tilting method are typically characterised by the best finite sample properties.     

基于回归组合技术的连续性抽样估计方法研究

在使用样本轮换的连续性抽样调查中,不仅可以利用前期调查的研究变量的信息,还可使用现期调查的辅助变量信息来建立回归模型进行回归估计,进而构造回归组合估计量,并在此基础上确定最优样本轮换率和最优权重系数,使得回归组合估计量的方差最小,从而更大程度地提高连续性抽样调查的估计精度。     

Estimation of a Parameter of Bivariate Pareto Distribution by Ranked Set Sampling

Ranked set sampling is applicable whenever ranking of a set of sampling units can be done easily by a judgement method or based on the measurement of an auxiliary variable on the units selected. In this work, we derive different estimators of a parameter associated with the distribution of the study variate Y, based on a ranked-set sample obtained by using an auxiliary variable X correlated with Y for ranking the sample units, when (X, Y) follows a bivariate Pareto distribution. Efficiency comparisons among these estimators are also made. Real-life data have been used to illustrate the application of the results obtained.     

ON TWO-STAGE SUCCESSIVE SAMPLING

In repeated sampling enquiries application of method of successive sampling with partial replacement of units is advantageous. In this paper use of successive sampling technique when the sampling design is multi-stage has been studied. Estimates of population mean and its variance have been obtained (a) on the second occasion, and (b) on the h-th occasion under two systems of replacement, namely (i) by retaining only a fraction p of psu's along with their sample of ssu's, and (ii) by retaining all the psu's on the second occasion, but from each psu only a fraction p of the ssu's within them is retained. A cost function suitable to the design has been illustrated, with the help of data collected from a sample survey conducted by the Indian Council of Agricultural Research.     

CONTROLLED SAMPLING WITH VARYING PROBABILITIES WITH AND WITHOUT REPLACEMENT

Goodman and Kish (1950) introduced the problem of controlled selection in the sense of decreasing the selection probability of nonpreferred combinations, such as, for example, combinations which present organisational difficulties involving additional cost, etc. The authors (Avadhani and Sukhatme (1965), Sukhatme and Avadhani (1965)) have evolved certain techniques of controlled selection which eliminate altogether some non-preferred combinations and reduce the probability of selection of the remaining combinations, if any, to the minimum possible extent without deviating from the fundamental principles of random sampling. However, it is often felt convenient in practice to draw sampling units one after another from the population rather than combinations of units. But, at present no technique by which one can select the units one after another and at the same time reduce the probability of selection of non-preferred units is available in literature.
In this paper we have suggested a solution to this problem which not only minimizes the selection probability of non-preferred units (and of samples containing predominantly large numbers of nonpreferred units) but also provides more efficient estimators than the the usual probability proportional to size (P.P.S) sampling scheme.     

Weighting for unequal selection probabilities in multilevel models

When multilevel models are estimated from survey data derived using multistage sampling, unequal selection probabilities at any stage of sampling may induce bias in standard estimators, unless the sources of the unequal probabilities are fully controlled for in the covariates. This paper proposes alternative ways of weighting the estimation of a two-level model by using the reciprocals of the selection probabilities at each stage of sampling. Consistent estimators are obtained when both the sample number of level 2 units and the sample number of level 1 units within sampled level 2 units increase. Scaling of the weights is proposed to improve the properties of the estimators and to simplify computation. Variance estimators are also proposed. In a limited simulation study the scaled weighted estimators are found to perform well, although non-negligible bias starts to arise for informative designs when the sample number of level 1 units becomes small. The variance estimators perform extremely well. The procedures are illustrated using data from the survey of psychiatric morbidity.     

Design effect of randomized systematic sampling

In statistical practice, systematic sampling (SYS) is used in many modifications due to its simple handling. In addition, SYS may provide efficiency gains if it is well adjusted to the structure of the population under study. However, if SYS is based on an inappropriate picture of the population a high decrease of efficiency, i.e. a high increase in variance may result by changing from simple random sampling to SYS. In the context of two-stage designs SYS so far seems often in use for subsampling within the primary units. As an alternative to this practice, we propose to randomize the order of the primary units, then to select systematically a number of primary units and, thereafter, to draw secondary units by simple random sampling without replacement within the primary units selected. This procedure is more efficient than simple random sampling with replacement from the whole population of all secondary units, i.e. the variance of an adequate estimator for a total is never increased by changing from simple random sampling to randomized SYS whatever be the values associated by a characteristic with the secondary units, while there are values for which the variance decreases for the change mentioned. This result should hold generally, even if our proof, so far, is not complete for general sample sizes.