Second-order variance estimation in poststratified two-stage sampling

The linearization or Taylor series variance estimator and jackknife linearization variance estimator are popular for poststratified point estimators. In this note we propose a simple second-order linearization variance estimator for the poststratified estimator of the population total in two-stage sampling, using the second-order Taylor series expansion. We investigate the properties of the proposed variance estimator and its modified version and their empirical performance through some simulation studies in comparison to the standard and jackknife linearization variance estimators. Simulation studies are carried out on both artificially generated data and real data.     

Consistency of jackknife estimators of the variances of simple quantiles

Let σ² be the asymptotic variance of the sample p-quantile (0<p<1). Consistency of the delete-d jackknife estimators of σ² with d being a fraction of n is proved under very weak conditions. Some other results, such as the asymptotic orders of the moments of the jackknife histograms and an analog of the generalized Helly's theorem, are also established.     

Updating finite markov chains by using techniques of group matrix inversion

Several jackknife methods for the proportional hazards model are proposed. Instead of deleting observations in the calculation of the pseudovalues, we delete the conditional probabilities from the partial likelihood function. The parameter estimators and variance estimators for both the linear and weighted linear jackknife methods are strongly consistent. A limitted simulation study is conducted.     

On the stability of the jackknife variance estimator in ratio estimation

The stability of a slightly modified version of the usual jackknife variance estimator is evaluated exactly in small samples under a suitable linear regression model and compared with that of two different linearization variance estimators. Depending on the degree of heteroscedasticity of the error variance in the model, the stability of the jackknife variance estimator is found to be somewhat comparable to that of one or the other of the linearization variance estimators under conditions especially favorable to ratio estimation (i.e., regression approximately through the origin with a relatively small coefficient of variation in the x population). When these conditions do not hold, however, the jackknife variance estimator is found to be less stable than either of the linearization variance estimators.     

Imputation for missing values and corresponding variance estimation

Imputation is commonly used to compensate for missing data in surveys. We consider the general case where the responses on either the variable of interest y or the auxiliary variable x or both may be missing. We use ratio imputation for y when the associated x is observed and different imputations when x is not observed. We obtain design-consistent linearization and jackknife variance estimators under uniform response. We also report the results of a simulation study on the efficiencies of imputed estimators, and relative biases and efficiencies of associated variance estimators.     

Doubly robust point and variance estimation in the presence of imputed survey data

Imputation is often used in surveys to treat item nonresponse. It is well known that treating the imputed values as observed values may lead to substantial underestimation of the variance of the point estimators. To overcome the problem, a number of variance estimation methods have been proposed in the literature, including resampling methods such as the jackknife and the bootstrap. In this paper, we consider the problem of doubly robust inference in the presence of imputed survey data. In the doubly robust literature, point estimation has been the main focus. In this paper, using the reverse framework for variance estimation, we derive doubly robust linearization variance estimators in the case of deterministic and random regression imputation within imputation classes. Also, we study the properties of several jackknife variance estimators under both negligible and nonnegligible sampling fractions. A limited simulation study investigates the performance of various variance estimators in terms of relative bias and relative stability. Finally, the asymptotic normality of imputed estimators is established for stratified multistage designs under both deterministic and random regression imputation. The Canadian Journal of Statistics 40: 259–281; 2012 © 2012 Statistical Society of Canada     

Jackknife inference for heteroscedastic linear regression models

Inference on the regression parameters in a heteroscedastic linear regression model with replication is considered, using either the ordinary least-squares (OLS) or the weighted least-squares (WLS) estimator. A delete-group jackknife method is shown to produce consistent variance estimators irrespective of within-group correlations, unlike the delete-one jackknife variance estimators or those based on the customary δ-method assuming within-group independence. Finite-sample properties of the delete-group variance estimators and associated confidence intervals are also studied through simulation.     

A jackknife variance estimator for unequal probability sampling

Summary.  The jackknife method is often used for variance estimation in sample surveys but has only been developed for a limited class of sampling designs. We propose a jackknife variance estimator which is defined for any without-replacement unequal probability sampling design. We demonstrate design consistency of this estimator for a broad class of point estimators. A Monte Carlo study shows how the proposed estimator may improve on existing estimators.     

Estimating the variances of ratio estimates in complex sample surveys with two primary sampling units per stratum—a comparison of balanced replication and jackknife techniques

The balanced half-sample and jackknife variance estimation techniques are used to estimate the variance of the combined ratio estimate. An empirical sampling study is conducted using computer-generated populations to investigate the variance, bias and mean square error of these variance estimators and results are compared to theoretical results derived elsewhere for the linear case. Results indicate that either the balanced half-sample or jackknife method may be used effectively for estimating the variance of the combined ratio estimate.     

Jackknife Estimation for Smooth Functions of the Parametric Component in Partially Linear Regression Models

Abstract

It is known that due to the existence of the nonparametric component, the usual estimators for the parametric component or its function in partially linear regression models are biased. Sometimes this bias is severe. To reduce the bias, we propose two jackknife estimators and compare them with the naive estimator. All three estimators are shown to be asymptotically equivalent and asymptotically normally distributed under some regularity conditions. However, through simulation we demonstrate that the jackknife estimators perform better than the naive estimator in terms of bias when the sample size is small to moderate. To make our results more useful, we also construct consistent estimators of the asymptotic variance, which are robust against heterogeneity of the error variances.     

Evaluating the Effective Degrees of Freedom of the Delete-a-Group Jackknife

The delete-a-group jackknife is sometimes used when estimating the variances of statistics based on a large sample. We investigate heavily poststratified estimators for a population mean and a simple regression coefficient, where both full-sample and domain estimates are of interest. The delete-a-group (DAG) jackknife employing 30, 60, and 100 replicates is found to be highly unstable, even for large sample sizes. The empirical degrees of freedom of these DAG jackknives are usually much less than their nominal degrees of freedom. This analysis calls into question whether coverage intervals derived from replication-based variance estimators can be trusted for highly calibrated estimates.     

Comments on the paper “Bias-adjustment and calibration of jackknife variance estimator in the presence of non-response”

Singh and Arnab (2010) presented a bias adjustment to the jackknife variance estimator of Rao and Sitter (1995) in the presence of non-response. In their paper, they obtained a second-order approximation of the bias of the Rao-Sitter variance estimator and then proposed a bias-adjusted estimator based on this approximation. To compare their proposed variance estimator to various other variance estimators, they performed a simulation study and showed that their variance estimator is superior to the Rao-Sitter variance estimator. In fact they showed that the Rao-Sitter variance estimator suffers from severe underestimation. These results contradict those in the literature, which indicate that the Rao-Sitter variance estimator suffers from a positive bias if the sampling fractions are not negligible; see Rao and Sitter (1995), Lee et al. (1995) and Haziza and Picard (2011). Because of this contradiction, we felt that a further investigation was warranted. In this paper, we attempt to recreate the results of Singh and Arnab (2010) and, in fact, show that their second order approximation to the bias of the Rao-Sitter variance estimator is incorrect and that their simulation results are also questionable.     

A Comparison of Survival Function Estimators in the Koziol–Green Model

In this paper, three competing survival function estimators are compared under the assumptions of the so-called Koziol– Green model, which is a simple model of informative random censoring. It is shown that the model specific estimators of Ebrahimi and Abdushukurov, Cheng, and Lin are asymptotically equivalent. Further, exact expressions for the (noncentral) moments of these estimators are given, and their biases are analytically compared with the bias of the familiar Kaplan–Meier estimator. Finally, MSE comparisons of the three estimators are given for some selected rates of censoring.     

Efficient computation of the performance of bootstrap and jackknife estimators of the variance of L-statistics

Calculation of the bootstrap and the jackknife estimators of the variance of a statistic often relies on approximation techniques because the exact values are difficult if not impossible to obtain analytically. For the special case where the statistic is a linear combination of order statistics we propose to calculate the exact values combinatorically, thus completely eliminating the second-stage simulation error.     

Jackknife variances and confidence intervals of the Mantel-Haenszel estimator

In the situation of stratified 2×2 tables, consitency of two different jackknife variances of the Mantel-Haenszel estimator is discussed in the case of increasing sample sizes, but a fixed number of strata. Different principles for constructing confidence limits for the common odds ratio are investigated from a theoretical point of view with regard to the position and the length of the resulting intervals. Monte Carlo experiments compare the finite sample performance of the consistent jackknife variance with that of other noniterative variance estimators. In addition, the properties of these variance estimators are investigated when used for confidence interval estimation.     

The distribution of a moment estimator for a parameter of the generalized poisson distribution

The ratio of the sample variance to the sample mean estimates a simple function of the parameter which measures the departure of the Poisson-Poisson from the Poisson distribution. Moment series to order n?²⁴ are given for related estimators. In one case, exact integral formulations are given for the first two moments, enabling a comparison to be made between their asymptotic developments and a computer-oriented extended Taylor series (COETS) algorithm. The integral approach using generating functions is sketched out for the third and fourth moments. Levin's summation algorithm is used on the divergent series and comparative simulation assessments are given.     

Non–zero inflated modified power series distributions

In this paper, we study the class of inflated modified power series distributions (IMPSD) where inflation occurs at any of the support points. This class include among other the generalized Poisson, the generalized negative binomial, the generalized logarithmic series and the lost games distributions. We give expressions for the moments, factorial moments and central moments of the IMPSD. The maximum likelihood estimation of the parameters of the IMPSD and the variance – covariance matrix of the estimators is obtained. We derive these estimators and their information matrices for mentioned above particular members of IMPSD class. The second part of this paper deals with the distribution of sum of independent and identically distributed random variables taking values s, s+1. s + 2, …, s ≥ 0, with modified power series distributions inflated at the point s.     

Efficient Estimation of Parameters of the Negative Binomial Distribution

In this article we investigate a class of moment-based estimators, called power method estimators, which can be almost as efficient as maximum likelihood estimators and achieve a lower asymptotic variance than the standard zero term method and method of moments estimators. We investigate different methods of implementing the power method in practice and examine the robustness and efficiency of the power method estimators.     

Estimating the error variance in nonparametric regression by a covariate-matched u-statistic

For nonparametric regression models with fixed and random design, two classes of estimators for the error variance have been introduced: second sample moments based on residuals from a nonparametric fit, and difference-based estimators. The former are asymptotically optimal but require estimating the regression function; the latter are simple but have larger asymptotic variance. For nonparametric regression models with random covariates, we introduce a class of estimators for the error variance that are related to difference-based estimators: covariate-matched U-statistics. We give conditions on the random weights involved that lead to asymptotically optimal estimators of the error variance. Our explicit construction of the weights uses a kernel estimator for the covariate density.     

Unbiased Estimation of Central Moments by using U-statistics

We obtain an estimator of the r th central moment of a distribution, which is unbiased for all distributions for which the first r moments exist. We do this by finding the kernel which allows the r th central moment to be written as a regular statistical functional. The U-statistic associated with this kernel is the unique symmetric unbiased estimator of the r th central moment, and, for each distribution, it has minimum variance among all estimators which are unbiased for all these distributions.