Invited Discussion Paper Resampling Methods in Sample Surveys

This article reviews the applications of three resampling methods, the jackknife, the balanced repeated replication, and the bootstrap, in sample surveys. The sampling design under consideration is a stratified multistage sampling design. We discuss the implementation of the resampling methods; for example, the construction of balanced repeated replications and approximated balanced repeated replication estimators; four modified bootstrap algorithms to generate bootstrap samples; and three different ways of applying the resampling methods in the presence of imputed missing values. Asymptotic properties of the resampling estimators are discussed for two types of important survey estimators, functions of weighted averages and sample quantiles.     

基于超总体模型的设计效应分解

本文基于超总体模型研究抽样调查中设计效应的计算问题。首先以随机效应模型为基础，明确了简单随机、二阶段、不等概率和分层抽样对应的超总体模型，进而通过所给模型推导出分层、类集、加权单因素设计效应的计算公式和多因素组合的设计效应计算公式并给出了对应估计量，公式表明：多因素同时存在的组合设计效应等于对应单因素设计效应的乘积。最后，对设计效应的理论值、估计值和真实值之间的关系进行了蒙特卡洛仿真，并利用相对偏倚、相对均方误进行了评价。本文的研究，对复杂抽样设计中正确计算、使用设计效应具有指导意义。     

基于多重抽样框的校准估计方法研究

在现代抽样调查中,校准估计方法能够通过有效利用辅助信息来提高估计量的精度,多重抽样框抽样调查则不仅可以解决单一抽样框覆盖不全的问题,还可以节约抽样设计阶段的成本。本文将这两种现代抽样估计与设计方法进行结合,将校准估计方法引入到基于多重抽样框的抽样调查体系中,在实现节约调查成本的同时,还能够提高估计量的精度。文章首先按照分离抽样框与组合抽样框估计方法的分类思路,对传统多重抽样框估计方法进行系统梳理;然后在最短距离法校准估计的分析框架下,按照调查时所能掌握辅助信息的具体情况,给出了两类多重抽样框估计情形下的各种不同形式的校准估计量;随后数值分析的比较结果也表明在多重抽样框中校准估计量的估计效率明显优于传统估计量;最后对本文研究进行总结的基础上,给出了我国抽样实践中应用这套先进抽样估计方法体系的展望。     

COMBINING HOUSEHOLD SURVEYS USING MASS IMPUTATION TO ESTIMATE POPULATION TOTALS

Pressure is often placed on statistical analysts to improve the accuracy of their population estimates. In response to this pressure, analysts have long exploited the potential to combine surveys in various ways. This paper develops a framework for combining surveys when data items from one of the surveys is mass imputed. The estimates from the surveys are combined using a composite estimator (CE). The CE accounts for the variability due to the imputation model and the surveys’ sampling schemes. Diagnostics for the validity of the imputation model are also discussed. We describe an application of combining the Australian Labour Force Survey and the National Aboriginal and Torres Strait Islander Health Survey to estimate employment characteristics about the Indigenous population. The findings suggest that combining these surveys is beneficial.     

规模以下工业抽样设计研究

为推动规模以下工业抽样调查工作以及解决当前调查面临的有关问题,本文对抽样设计进行了改进研究。首先,本文对规模以下工业抽样设计演变过程进行系统梳理,总结了现行抽样设计充分利用双重抽样框设计和综合运用三种抽样方法的特点。其次,针对园区层企业密度高的特点,探索结合园区因素改进地域抽样设计,对园区层和非园区层分别抽样,解决调查中面临的非抽样误差问题,并调整辅助变量使其与核心指标相关性均较高,确保抽样推断精度,有效提高抽样调查效率。并以我国东 部某省为例进行实证模拟得到结合园区因素抽样设计对调查工作改进的结论。再次,针对我国各级政府管理需要以及局队业务分工优化调整情况,介绍了规模以下工业样本追加理论和实证应用的主要研究成果。最后,在大数据时代数据来源广泛的背景下,本文在多重抽样框设计以及利用辅助变量提升样本轮换推断精度方面提出了进一步改进抽样设计的思路。     

我国住户调查一体化设计研究

住户调查一体化设计包括对各项住户调查的通盘考虑和与普查、行政记录的有机衔接。首先,在借鉴国际经验和考虑我国实际的基础上,提出我国住户调查一体化设计的两个基本要求;其次,构造出我国住户调查一体化设计的基础框架;最后,充分利用现行国家调查制度的渠道和机制,对住户调查项目按其调查内容特征和内在逻辑关系进行精简、整合,形成以劳动力调查和住户收支与生活状况调查为核心的住户调查体系,并给出以主样本为主体的我国住户调查的一体化设计思路。     

Gap-based inverse sampling

We present a new inverse sampling design for surveys of rare events, Gap-Based Inverse Sampling. In the design, sampling stops if after a predetermined interval, or gap, no new rare events are found. The length of the gap that follows after finding a rare event is used as a way of limiting sample effort. We present stopping rules using decisions based on the gap length, the total number of rare events found, and a fixed upper limit of survey effort. We illustrate the use of the design with stratified sampling of two biological populations. The design uses the intuitive behavior of a field biologist in stratified sampling, where if in a stratum nothing is found after a long search, the field surveyor would like to consider the stratum is empty and stop searching. Our design has appeal for surveying rare events (for example, a rare species) with stratified sampling where there are likely to be some completely empty strata.     

Designing stratified sampling in economic and business surveys

In most economic and business surveys, the target variables (e.g. turnover of enterprises, income of households, etc.) commonly resemble skewed distributions with many small and few large units. In such surveys, if a stratified sampling technique is used as a method of sampling and estimation, the convenient way of stratification such as the use of demographical variables (e.g. gender, socioeconomic class, geographical region, religion, ethnicity, etc.) or other natural criteria, which is widely practiced in economic surveys, may fail to form homogeneous strata and is not much useful in order to increase the precision of the estimates of variables of interest. In this paper, a stratified sampling design for economic surveys based on auxiliary information has been developed, which can be used for constructing optimum stratification and determining optimum sample allocation to maximize the precision in estimate.     

A jackknife variance estimator for unequal probability sampling

Summary.  The jackknife method is often used for variance estimation in sample surveys but has only been developed for a limited class of sampling designs. We propose a jackknife variance estimator which is defined for any without-replacement unequal probability sampling design. We demonstrate design consistency of this estimator for a broad class of point estimators. A Monte Carlo study shows how the proposed estimator may improve on existing estimators.     

Random sampling from databases: a survey

This paper reviews recent literature on techniques for obtaining random samples from databases. We begin with a discussion of why one would want to include sampling facilities in database management systems. We then review basic sampling techniques used in constructing DBMS sampling algorithms, e.g. acceptance/rejection and reservoir sampling. A discussion of sampling from various data structures follows: B ⁺ trees, hash files, spatial data structures (including R-trees and quadtrees). Algorithms for sampling from simple relational queries, e.g. single relational operators such as selection, intersection, union, set difference, projection, and join are then described. We then describe sampling for estimation of aggregates (e.g. the size of query results). Here we discuss both clustered sampling, and sequential sampling approaches. Decision-theoretic approaches to sampling for query optimization are reviewed.     

Upper Bounds on the True Coverage of Bootstrap Percentile Type Confidence Intervals

A simple derivation of expected mean squares is given for the randomized (complete) block design, showing that “experimental error,” the error term for testing treatments, is comprised of three sources of variability: block by treatment interaction, within block plot-to-plot variability, and within experimental plot sampling variation. The approach could readily be extended to incorporate measurement error as a fourth component of experimental error.     

Estimation bias of different design and analytical strategies in dual-frame telephone surveys: an empirical evaluation

Dual-frame survey designs have become increasingly popular in large-scale telephone surveys. This is due to the lack of coverage of the traditional landline survey design and the escalating use of cell phones in recent years. Several estimation strategies have been proposed and their properties have been discussed under ideal scenarios, including pseudo-maximum-likelihood estimation, single-frame estimation, and simple composite estimation [C.J. Skinner and J.N.K. Rao, Estimation in dual frame surveys with complex designs, J. Am. Statist. Assoc. 91 (1996), pp. 349–356; S.L. Lohr and J.N.K. Rao, Inference from dual frame surveys, J. Am. Statist. Assoc. 95 (2000), pp. 271–280]. In practice, estimation in dual-frame telephone surveys is vulnerable to biases and errors (e.g. inaccessibility, topic/mode salience, and measurement error). The investigation of the performance of popular dual-frame estimation methods is scarce in real and less ideal scenarios. Through an innovatively designed simulation study, we compare the estimation bias under different sampling designs with various estimation strategies. To reduce bias, different raking strategies are compared. Simulated scenarios incorporating sampling costs are examined for practical considerations. Overall, the cell phone-only design yields results with the least bias and variance. When accurate covariate information is available for post-stratification, raking estimates from the cell phone-any design also perform very well. We also provide SAS macros for this simulation evaluation upon request. Survey practitioners can fine-tune the parameters based on their prior knowledge of the target population and run the simulation under different scenarios to gain more insights into how to optimally design and analyse telephone surveys.     

An algorithm for the design of factorial experiments when the data are correlated

Since the development of methods for the analysis of experiments with dependent data, see for example Gleeson and Cullis (1987), the design of such experiments has been an area of active research. We investigate the design of factorial experiments, complete and fractional, for various dependency structures. An algorithm for generating optimal or near optimal designs is presented and shown to be useful across a wide range of dependency structures.     

Response improvement in complex experiments by co-information composite likelihood optimization

We propose an adaptive procedure for improving the response outcomes of complex combinatorial experiments. New experiment batches are chosen by minimizing the co-information composite likelihood (COIL) objective function, which is derived by coupling importance sampling and composite likelihood principles. We show convergence of the best experiment within each batch to the globally optimal experiment in finite time, and carry out simulations to assess the convergence behavior as the design space size increases. The procedure is tested as a new enzyme engineering protocol in an experiment with a design space size of order 10⁷.     

On comutativity of design and model expectations in randomized response surveys

Interchangability of the order of design expectation ( E_p ) and model expectation ( E_R ) under randomized response ( RR ) surveys for finding expectation and mean-square error of a linear estimator e found to be permissible for a non-informative sampling design. The non-comutative property established by Chaudhuri & Adhikary ( 1990 ) under probability proportional to size with replacement ( PPSWR ) sampling is disproved.     

Corrigendum

The articles presents results concerningthe significances of the sample lead and illustrates their uses. They apply to the sample lead of one party over another in political polls, one productover another in market research surveys, share of the market of one company over another in industrial studies, one class over another in social investigations, one programme over another in TV viewing surveys, etc. They enable calculation of confidence intervals and required sample sizes, testing of hypotheses, etc. They deal with sampling from finite and infinite populations, with and without replacement, sampling from population with overlapping classifications, stratified sampling, optimum allocation to strata, etc. Derivation of the results is given in the appendices. Some of the proofs are rather complicated, but the final results are quite simple and easy to use.     

Best Invariant and Minimax Estimation of Quantiles in Finite Populations

The theoretical literature on quantile and distribution function estimation in infinite populations is very rich, and invariance plays an important role in these studies. This is not the case for the commonly occurring problem of estimation of quantiles in finite populations. The latter is more complicated and interesting because an optimal strategy consists not only of an estimator, but also of a sampling design, and the estimator may depend on the design and on the labels of sampled individuals, whereas in iid sampling, design issues and labels do not exist.We study the estimation of finite population quantiles, with emphasis on estimators that are invariant under the group of monotone transformations of the data, and suitable invariant loss functions. Invariance under the finite group of permutation of the sample is also considered. We discuss nonrandomized and randomized estimators, best invariant and minimax estimators, and sampling strategies relative to different classes. Invariant loss functions and estimators in finite population sampling have a nonparametric flavor, and various natural combinatorial questions and tools arise as a result.     

Model‐Based Non‐parametric Variance Estimation for Systematic Sampling

Abstract. Systematic sampling is frequently used in surveys, because of its ease of implementation and its design efficiency. An important drawback of systematic sampling, however, is that no direct estimator of the design variance is available. We describe a new estimator of the model‐based expectation of the design variance, under a non‐parametric model for the population. The non‐parametric model is sufficiently flexible that it can be expected to hold at least approximately in many situations with continuous auxiliary variables observed at the population level. We prove the model consistency of the estimator for both the anticipated variance and the design variance under a non‐parametric model with a univariate covariate. The broad applicability of the approach is demonstrated on a dataset from a forestry survey.     

Simple random sampling with over-replacement

There are several ways to select units with replacement and an equal inclusion expectation. We present a new sampling design called simple random sampling with over-replacement. Its interest lies in the high variance produced for the Horvitz-Thompson estimator. This characteristic could be useful for resampling methods.     

Projection array based designs for computer experiments

In this paper we define a new class of designs for computer experiments. A projection array based design defines sets of simulation runs with properties that extend the conceptual properties of orthogonal array based Latin hypercube sampling, particularly to underlying design structures other than orthogonal arrays. Additionally, we illustrate how these designs can be sequentially augmented to improve the overall projection properties of the initial design or focus on interesting regions of the design space that need further exploration to improve the overall fit of the underlying response surface. We also illustrate how an initial Latin hypercube sample can be expressed as a projection array based design and show how one can augment these designs to improve higher dimensional space filling properties.