On robust causality nonresponse testing in duration studies under the Cox model

High survey nonresponse in unemployment duration studies may have a strong effect on inference if the so called causal mechanism is present. A robust method of testing the causal nonresponse is proposed for data sets where survey information can be combined with complete administrative records. It is assumed that population distribution follows approximately the Cox regression model. Formal justification of the method and a comparative simulation study are included.     

The Use of Sample Weights in Hot Deck Imputation

A common strategy for handling item nonresponse in survey sampling is hot deck imputation, where each missing value is replaced with an observed response from a "similar" unit. We discuss here the use of sampling weights in the hot deck. The naive approach is to ignore sample weights in creation of adjustment cells, which effectively imputes the unweighted sample distribution of respondents in an adjustment cell, potentially causing bias. Alternative approaches have been proposed that use weights in the imputation by incorporating them into the probabilities of selection for each donor. We show by simulation that these weighted hot decks do not correct for bias when the outcome is related to the sampling weight and the response propensity. The correct approach is to use the sampling weight as a stratifying variable alongside additional adjustment variables when forming adjustment cells.     

Modeling Nonignorable Nonresponse in Categorical Panel Data With an Example in Estimating Gross Labor-Force Flows

Many large-scale sample surveys use panel designs under which sampled individuals are interviewed several times before being dropped from the sample. The longitudinal data bases available from such surveys could be used to provide estimates of gross change over time. One problem in using these data to estimate gross change is how to handle the period-to-period nonresponse. This nonresponse is typically nonrandom and, furthermore, may be nonignorable in that it cannot be accounted for by other observed quantities in the data. Under the models proposed in this article, which are appropriate for the analysis of categorical data, the probability of nonresponse may be taken to be a function of the missing variable of interest. The proposed models are fit using maximum likelihood estimation. As an example, the method is applied to the problem of estimating gross flows in labor-force participation using data from the Current Population Survey and the Canadian Labour Force Survey.     

Robust quasi-randomization-based estimation with ensemble learning for missing data

Missing data analysis requires assumptions about an outcome model or a response probability model to adjust for potential bias due to nonresponse. Doubly robust (DR) estimators are consistent if at least one of the models is correctly specified. Multiply robust (MR) estimators extend DR estimators by allowing for multiple models for both the outcome and/or response probability models and are consistent if at least one of the multiple models is correctly specified. We propose a robust quasi-randomization-based model approach to bring more protection against model misspecification than the existing DR and MR estimators, where any multiple semiparametric, nonparametric or machine learning models can be used for the outcome variable. The proposed estimator achieves unbiasedness by using a subsampling Rao–Blackwell method, given cell-homogenous response, regardless of any working models for the outcome. An unbiased variance estimation formula is proposed, which does not use any replicate jackknife or bootstrap methods. A simulation study shows that our proposed method outperforms the existing multiply robust estimators.     

Estimation of finite population kurtosis under two-phase sampling for nonresponse

In this paper an estimator of finite population kurtosis computed under the two-phase sampling for nonresponse is proposed. The formulas characterizing its asymptotic properties are derived using Taylor linearization technique for the general situation of arbitrary sampling designs in both phases and stochastic nonresponse represented by arbitrary response distribution. An important special case of simple random sampling without replacement and deterministic nonresponse is also considered.     

Balanced k-nearest neighbour imputation

Random imputation is an interesting class of imputation methods to handle item nonresponse because it tends to preserve the distribution of the imputed variable. However, such methods amplify the total variance of the estimators because values are imputed at random. This increase in variance is called imputation variance. In this paper, we propose a new random hot-deck imputation method that is based on the k-nearest neighbour methodology. It replaces the missing value of a unit with the observed value of a similar unit. Calibration and balanced sampling are applied to minimize the imputation variance. Moreover, our proposed method provides triple protection against nonresponse bias. This means that if at least one out of three specified models holds, then the resulting total estimator is unbiased. Finally, our approach allows the user to perform consistency edits and to impute simultaneously.     

Estimation of population mean on the most recent occasion under non response in h-occasion successive sampling using several auxiliary variables

In this article, general estimation procedures of population mean on the most recent occasion in the presence of non response on all occasions have been deduced in h-occasion successive sampling. In the estimation procedures, regression type estimators have been suggested with the aid of stable and mutually independent several auxiliary variables which are readily available only on the most recent occasion. To check the efficiency of the proposed estimators, they have been compared with similar estimator in absence of non response. Properties of the suggested estimation procedures have been studied and their empirical studies are carried out to validate the theoretical results. Suitable recommendations have been made.     

Using Auxiliary Data for Binomial Parameter Estimation with Nonignorable Nonresponse

Nonignorable nonresponse is a nonresponse mechanism that depends on the values of the variable having nonresponse. When an observed data of a binomial distribution suffer missing values from a nonignorable nonresponse mechanism, the binomial distribution parameters become unidentifiable without any other auxiliary information or assumption. To address the problems of non identifiability, existing methods mostly based on the log-linear regression model. In this article, we focus on the model when the nonresponse is nonignorable and we consider to use the auxiliary data to improve identifiability; furthermore, we derive the maximum likelihood estimator (MLE) for the binomial proportion and its associated variance. We present results for an analysis of real-life data from the SARS study in China. Finally, the simulation study shows that the proposed method gives promising results.     

Estimation of an indicator of the representativeness of survey response

Nonresponse is a major source of estimation error in sample surveys. The response rate is widely used to measure survey quality associated with nonresponse, but is inadequate as an indicator because of its limited relation with nonresponse bias. Schouten et al. (2009) proposed an alternative indicator, which they refer to as an indicator of representativeness or R-indicator. This indicator measures the variability of the probabilities of response for units in the population. This paper develops methods for the estimation of this R-indicator assuming that values of a set of auxiliary variables are observed for both respondents and nonrespondents. We propose bias adjustments to the point estimator proposed by Schouten et al. (2009) and demonstrate the effectiveness of this adjustment in a simulation study where it is shown that the method is valid, especially for smaller sample sizes. We also propose linearization variance estimators which avoid the need for computer-intensive replication methods and show good coverage in the simulation study even when models are not fully specified. The use of the proposed procedures is also illustrated in an application to two business surveys at Statistics Netherlands.     

Nonresponse Assessment of a Consumer Price Index

A household budget survey often suffers from a high nonresponse rate and a selective response. The bias that may be introduced in the estimation of budget shares because of this nonresponse can affect the estimate of a consumer price index, which is a weighted sum of partial price index numbers (weighted with the estimated budget shares). The bias is especially important when related to the standard error of the estimate. Because of the impossibility of subsampling nonrespondents to the budget survey, no exact information on the bias can be obtained. To evaluate the nonresponse bias, bounds for this bias are calculated using linear programming methods for several assumptions. The impact on a price index of a high nonresponse rate among people with a high income can also be assessed by using the elasticity with respect to total expenditure. Attention is also given to the possible nonresponse bias in a time series of price index numbers. The possible nonresponse bias is much larger than the standard error of the estimate.     

Some effective combinations of available information under non response in two-occasion successive sampling

The present work suggests some effective linear combinations of exponential estimators to estimate the current population mean in two occasion successive sampling in presence of non response. Using the subsampling technique of non respondents, estimation procedures have been developed by utilizing information on an auxiliary variable, which is readily available on both occasions. Properties of the proposed estimation procedures have been examined and related optimum replacement strategies are suggested. Empirical studies are carried out to justify the preposition of estimators. Suitable recommendations have been made.     

A Case Study in Nonresponse: Plaintiff vs. California State Board of Equalization

In any sample survey, nonresponse bias is a potential issue. Even with a moderately high nonresponse rate, however, covariates can sometimes be used to show that the nonresponse bias is likely to be small. This note presents such an argument, which was used by the winning side in a tax case.     

Missing data methods in official statistics in the United Kingdom: Some recent developments

In recent years an increase in nonresponse rates in major government and social surveys has been observed. It is thought that decreasing response rates and changes in nonresponse bias may affect, potentially severely, the quality of survey data. This paper discusses the problem of unit and item nonresponse in government surveys from an applied perspective and highlights some newer developments in this field with a focus on official statistics in the United Kingdom (UK). The main focus of the paper is on post-survey adjustment methods, in particular adjustment for item nonresponse. The use of various imputation and weighting methods is discussed in an example. The application also illustrates the close relationship between missing data and measurement error. JEL classification C42, C81     

Missing-Data Adjustments in Large Surveys

Useful properties of a general-purpose imputation method for numerical data are suggested and discussed in the context of several large government surveys. Imputation based on predictive mean matching is proposed as a useful extension of methods in existing practice, and versions of the method are presented for unit nonresponse and item nonresponse with a general pattern of missingness. Extensions of the method to provide multiple imputations are also considered. Pros and cons of weighting adjustments are discussed, and weighting-based analogs to predictive mean matching are outlined.     

ESTIMATION PROCEDURES FOR CATEGORICAL SURVEY DATA WITH NONIGNORABLE NONRESPONSE

We consider surveys with one or more callbacks and use a series of logistic regressions to model the probabilities of nonresponse at first contact and subsequent callbacks. These probabilities are allowed to depend on covariates as well as the categorical variable of interest and so the nonresponse mechanism is nonignorable. Explicit formulae for the score functions and information matrices are given for some important special cases to facilitate implementation of the method of scoring for obtaining maximum likelihood estimates of the model parameters. For estimating finite population quantities, we suggest the imputation and prediction approaches as alternatives to weighting adjustment. Simulation results suggest that the proposed methods work well in reducing the bias due to nonresponse. In our study, the imputation and prediction approaches perform better than weighting adjustment and they continue to perform quite well in simulations involving misspecified response models.     

A composite class of estimators using scrambled response mechanism for sensitive population mean in successive sampling

This paper considers the problem of estimation of population mean of a sensitive characteristics using non-sensitive auxiliary variable at current move in two move successive sampling. The proposed estimator is studied under five different scrambled response models. Various estimators have been elaborated to be the member of the proposed class of estimators. The properties of the proposed estimators have been analysed. Many estimators belonging to the proposed class have been explored under five scrambled response models. In order to identify the scrambled model effect, the proposed composite class of estimators is compared to the direct methods. Respondents privacy protection have also been elaborated under different models. Theoretical results are supplemented with numerical demonstrations using real data. Simulation has been carried out to show the applicability of proposed estimators and hence suitable recommendations are forwarded.     

Bias-adjustment and calibration of jackknife variance estimator in the presence of non-response

In this paper, bias-adjustment in the jackknife estimator of variance accredited to Rao and Sitter (1995) has been considered. Then the bias-adjusted Rao and Sitter (1995) estimator has been calibrated such that its expected value under the imputing superpopulation model remains the same as the expected value of the mean squared error of the ratio estimator in the presence of non-response. A simulation study has been performed to compare the six different estimators of variance: out of them four estimators belong to Rao and Sitter (1995) and the other two proposed estimators are named as bias-adjusted and bias-adjusted-cum-calibrated estimators. The empirical relative bias and empirical relative efficiency of the two proposed estimators with respect to the four existing estimators accredited to Rao and Sitter (1995) have been investigated through simulations. The bias-adjusted-cum-calibrated estimator has been found to be an efficient estimator in the case of heteroscadastic populations. The present paper considers the situation of simple random and without replacement sampling. The possibility of obtaining a negative estimate of variance by the estimator due to Kim et al. (2006) has been pointed out.     

An improved alternative estimation procedure for current population mean in presence of positively and negatively correlated auxiliary variables in two-occasion rotation patterns

Abstract

The present study confirms the influential role of a positively and a negatively correlated auxiliary variables in enhancing the precision of estimates of current population mean in two occasion rotation (successive) sampling. Exponential-type estimators of current population mean have been proposed for three different situations: (i) the information on a positively correlated auxiliary variable is readily available on both occasions (ii) the information on a negatively correlated auxiliary variable is readily available on both occasions and (iii) the information on both positively and negatively correlated auxiliary variables are readily available on both the occasions. The characteristics of the proposed estimators have been explored and their efficacious performances are compared with the natural and recent contemporary estimators. Optimum replacement strategies of the proposed estimation procedures have been formulated. Simulation and empirical studies are carried out to justify the proposition of the proposed estimators and appropriate recommendations have been put forward to the survey practitioners.     

An effective estimation strategy for population mean under random non-response situations in two-phase successive sampling

This paper presents a modified exponential type estimation strategy for the current population mean in the presence of random non-response situations in two-occasion successive sampling under two-phase set-up. The properties of the proposed estimators have been examined with the assumption that numbers of sampling units follow a distribution due to random non-response. The performances of the proposed estimators are compared with the estimators designated for the complete response situations. Empirical studies are carried out to show the dominance nature of the proposed estimators over the estimator defined for complete response situations. Appropriate recommendations have been made to the survey practitioners/researchers for their real-life practical applications.     

Robust inference for estimating equations with nonignorably missing data based on SIR algorithm

Nonresponse is a very common phenomenon in survey sampling. Nonignorable nonresponse – that is, a response mechanism that depends on the values of the variable having nonresponse – is the most difficult type of nonresponse to handle. This article develops a robust estimation approach to estimating equations (EEs) by incorporating the modelling of nonignorably missing data, the generalized method of moments (GMM) method and the imputation of EEs via the observed data rather than the imputed missing values when some responses are subject to nonignorably missingness. Based on a particular semiparametric logistic model for nonignorable missing response, this paper proposes the modified EEs to calculate the conditional expectation under nonignorably missing data. We can apply the GMM to infer the parameters. The advantage of our method is that it replaces the non-parametric kernel-smoothing with a parametric sampling importance resampling (SIR) procedure to avoid nonparametric kernel-smoothing problems with high dimensional covariates. The proposed method is shown to be more robust than some current approaches by the simulations.