A comparison of alternative variance estimation strategies for estimating the slope of a linear regression in sample surveys

The balanced half-sample, jackknife and linearization methods are used to estimate the variance of the slope of a linear regression under a variety of computer generated situations. The basic sampling design is one in which two PSU's are selected from each of a number of strata . The variance estimation techniques are compared with a Monte Carlo experiment. Results show that variance estimates may be highly biased and variable unless sizeable numbers of observations are available from each stratum. The jackknife and linearization estimates appear superior to the balanced half sample method - particularly when the number of strata or the number of available observations from each stratum is small.     

On using the jackknife to estimate quantile variance

We show that the jackknife technique fails badly when applied to the problem of estimating the variance of a sample quantile. When viewed as a point estimator, the jackknife estimator is known to be inconsistent. We show that the ratio of the jackknife variance estimate to the true variance has an asymptotic Weibull distribution with parameters 1 and 1/2. We also show that if the jackknife variance estimate is used to Studentize the sample quantile, the asymptotic distribution of the resulting Studentized statistic is markedly nonnormal, having infinite mean. This result is in stark contrast with that obtained in simpler problems, such as that of constructing confidence intervals for a mean, where the jackknife-Studentized statistic has an asymptotic standard normal distribution.     

Bootstrapping an Econometric Model: Some Empirical Results

The bootstrap, like the jackknife, is a technique for estimating standard errors. The idea is to use Monte Carlo simulation, based on a nonparametric estimate of the underlying error distribution. The bootstrap will be applied to an econometric model describing the demand for capital, labor, energy, and materials. The model is fitted by three-stage least squares. In sharp contrast with previous results, the coefficient estimates and the estimated standard errors perform very well. However, the model's forecasts show serious bias and large random errors, significantly understated by the conventional standard error of forecast.     

Consistency of jackknife estimators of the variances of simple quantiles

Let σ² be the asymptotic variance of the sample p-quantile (0<p<1). Consistency of the delete-d jackknife estimators of σ² with d being a fraction of n is proved under very weak conditions. Some other results, such as the asymptotic orders of the moments of the jackknife histograms and an analog of the generalized Helly's theorem, are also established.     

Estimating the variances of ratio estimates in complex sample surveys with two primary sampling units per stratum—a comparison of balanced replication and jackknife techniques

The balanced half-sample and jackknife variance estimation techniques are used to estimate the variance of the combined ratio estimate. An empirical sampling study is conducted using computer-generated populations to investigate the variance, bias and mean square error of these variance estimators and results are compared to theoretical results derived elsewhere for the linear case. Results indicate that either the balanced half-sample or jackknife method may be used effectively for estimating the variance of the combined ratio estimate.     

Comparative characteristics of estimators of the mean responding cell density in limiting dilution assays

The statistical problems associated with estimating the mean responding cell density in the limiting dilution assay (LDA) have largely been ignored. We evaluate techniques for analyzing LDA data from multiple biological samples, assumed to follow either a normal or gamma distribution. Simulated data is used to evaluate the performance of an unweighted mean, a log transform, and a weighted mean procedure described by Taswell (1987). In general, an unweighted mean with jackknife estimates will produce satisfactory results. In some cases, a log transform is more appropriate. Taswell's weighted mean algorithm is unable to estimate an accurate variance. We also show that methods which pool samples, or LDA data, are invalid. In addition, we show that optimization of the variance in multiple sample LDA's is dependent on the estimator, the between-organism variance, the replicate well size, and the numberof biological samples. However, this optimization is generally achieved by maximizing biological samples at the expense of well replicates.     

Jackknife Empirical Likelihood for the Accelerated Failure Time Model with Censored Data

Kendall and Gehan estimating functions are commonly used to estimate the regression parameter in accelerated failure time model with censored observations in survival analysis. In this paper, we apply the jackknife empirical likelihood method to overcome the computation difficulty about interval estimation. A Wilks’ theorem of jackknife empirical likelihood for U-statistic type estimating equations is established, which is used to construct the confidence intervals for the regression parameter. We carry out an extensive simulation study to compare the Wald-type procedure, the empirical likelihood method, and the jackknife empirical likelihood method. The proposed jackknife empirical likelihood method has a better performance than the existing methods. We also use a real data set to compare the proposed methods.     

On the stability of the jackknife variance estimator in ratio estimation

The stability of a slightly modified version of the usual jackknife variance estimator is evaluated exactly in small samples under a suitable linear regression model and compared with that of two different linearization variance estimators. Depending on the degree of heteroscedasticity of the error variance in the model, the stability of the jackknife variance estimator is found to be somewhat comparable to that of one or the other of the linearization variance estimators under conditions especially favorable to ratio estimation (i.e., regression approximately through the origin with a relatively small coefficient of variation in the x population). When these conditions do not hold, however, the jackknife variance estimator is found to be less stable than either of the linearization variance estimators.     

On estimating the dimensionality in discriminant analysis

In discriminant analysis, the dimension of the hyperplane which population mean vectors span is called the dimensionality. The procedures commonly used to estimate this dimension involve testing a sequence of dimensionality hypotheses as well as model fitting approaches based on (consistent) Akaike's method, (modified) Mallows' method and Schwarz's method. The marginal log-likelihood (MLL) method is developed and the asymptotic distribution of the dimensionality estimated by this method for normal populations is derived. Furthermore a modified marginal log-likelihood (MMLL) method is also considered. The MLL method is not consistent for large samples and two modified criteria are proposed which attain asymptotic consistency. Some comments are made with regard to the robustness of this method to departures from normality. The operating characteristics of the various methods proposed are examined and compared.     

Some General Comparative Points on Chao's and Zelterman's Estimators of the Population Size

Abstract. Two simple and frequently used capture–recapture estimates of the population size are compared: Chao's lower‐bound estimate and Zelterman's estimate allowing for contaminated distributions. In the Poisson case it is shown that if there are only counts of ones and twos, the estimator of Zelterman is always bounded above by Chao's estimator. If counts larger than two exist, the estimator of Zelterman is becoming larger than that of Chao's, if only the ratio of the frequencies of counts of twos and ones is small enough. A similar analysis is provided for the binomial case. For a two‐component mixture of Poisson distributions the asymptotic bias of both estimators is derived and it is shown that the Zelterman estimator can experience large overestimation bias. A modified Zelterman estimator is suggested and also the bias‐corrected version of Chao's estimator is considered. All four estimators are compared in a simulation study.     

VARIANCE ESTIMATION FOR SAMPLE AUTOCOVARIANCES: DIRECT AND RESAMPLING APPROACHES

The usual covariance estimates for data _n-1 from a stationary zero-mean stochastic process {X_t} are the sample covariances Both direct and resampling approaches are used to estimate the variance of the sample covariances. This paper compares the performance of these variance estimates. Using a direct approach, we show that a consistent windowed periodogram estimate for the spectrum is more effective than using the periodogram itself. A frequency domain bootstrap for time series is proposed and analyzed, and we introduce a frequency domain version of the jackknife that is shown to be asymptotically unbiased and consistent for Gaussian processes. Monte Carlo techniques show that the time domain jackknife and subseries method cannot be recommended. For a Gaussian underlying series a direct approach using a smoothed periodogram is best; for a non-Gaussian series the frequency domain bootstrap appears preferable. For small samples, the bootstraps are dangerous: both the direct approach and frequency domain jackknife are better.     

Bayesian estimation of renewal function for inverse Gaussian renewal process

Two approximation methods are used to obtain the Bayes estimate for the renewal function of inverse Gaussian renewal process. Both approximations use a gamma-type conditional prior for the location parameter, a non-informative marginal prior for the shape parameter, and a squared error loss function. Simulations compare the accuracy of the estimators and indicate that the Tieney and Kadane (T–K)-based estimator out performs Maximum Likelihood (ML)- and Lindley (L)-based estimator. Computations for the T–K-based Bayes estimate employ the generalized Newton's method as well as a recent modified Newton's method with cubic convergence to maximize modified likelihood functions. The program is available from the author.     

The effect of non-normality on estimating the variance of the combined ratio estimate in complex surveys

The performance of the balanced half-sample, jackknife and linearization methods for estimating the variance of the combined ratio estimate is studied by means of a computer simulation using artificially generated non-normally distributed populations.

The results of this investigation demonstrate that the variance estimates for the combined ratio estimate may be highly biased and unstable when the underlying distributions are non-normal. This is particularly true when the number of observations available from each stratum is small. The jack-     

概化理论方差分量及其变异量估计:Jackknife方法与Traditional方法比较

文章生成概化理论p×i、p×i×h、p×(i:h)三种不同设计下的正态数据、多项数据和二项数据,用Jackknife方法和Traditional方法估计数据的方差分量、标准误和置信区间,并比较这两种方法的性能。结果表明:(1)Jackknife方法在方差分量估计和标准误估计上都较为准确;(2)相较于Traditional方法,Jackknife方法在方差分量置信区间估计上略有不足。(3)相较于Traditional方法,Jackknife方法估计的准确性不随数据类型、研究设计和方差分量的不同而产生波动,具有更强的稳健性。     

Consistency of least-squares estimator and its jackknife variance estimator in nonlinear models

The purpose of this paper is twofold: (1) We establish the consistency of the least-squares estimator in a nonlinear modely_i = f(x_i,θ) +σ_ie_i where the range of the parameter θ is noncompact, the regression function is unbounded, and the σ_i,'s are not necessarily equal. This extends the results in Jennrich (1969) and Wu (1981). (2) Under the same model, the jackknife estimator of the asymptotic covariance matrix of the least-squares estimator is shown to be consistent, which provides a theoretical justification of the empirical results in Duncan (1978) and the use of the jackknife method in large-sample inferences.     

Jackknife empirical likelihood method for testing the equality of two variances

In this paper, we propose a nonparametric method based on jackknife empirical likelihood ratio to test the equality of two variances. The asymptotic distribution of the test statistic has been shown to follow χ² distribution with the degree of freedom 1. Simulations have been conducted to show the type I error and the power compared to Levene's test and F test under different distribution settings. The proposed method has been applied to a real data set to illustrate the testing procedure.     

Pseudo-empirical Bayes estimation of small area means under a nested error linear regression model with functional measurement errors

Small area estimation is studied under a nested error linear regression model with area level covariate subject to measurement error. Ghosh and Sinha (2007) obtained a pseudo-Bayes (PB) predictor of a small area mean and a corresponding pseudo-empirical Bayes (PEB) predictor, using the sample means of the observed covariate values to estimate the true covariate values. In this paper, we first derive an efficient PB predictor by using all the available data to estimate true covariate values. We then obtain a corresponding PEB predictor and show that it is asymptotically “optimal”. In addition, we employ a jackknife method to estimate the mean squared prediction error (MSPE) of the PEB predictor. Finally, we report the results of a simulation study on the performance of our PEB predictor and associated jackknife MSPE estimator. Our results show that the proposed PEB predictor can lead to significant gain in efficiency over the previously proposed PEB predictor. Area level models are also studied.     

Repeated measurement analysis for nonnormal data in small samples

The small sample performance of Zeger and Liang's extended generalized linear models for the analysis of longitudinal data (Biometrics, 42,121-130,1986) is investigated for correlated gamma data. Results show that the confidence intervals do not provide desirable coverage of the true parameter due to considerably biased point estimates. Improved estimates are proposed using the jackknife procedure. Simulations performed to evaluate the proposed estimates indicate superior properties to the previous estimates.     

Second-order and resampling approximation of finite population U-statistics based on stratified samples

We construct one-term Edgeworth expansions to distributions of U statistics and Studentized U-statistics, based on stratified samples drawn without replacement. Replacing the cumulants defining the expansions by consistent jackknife estimators, we obtain empirical Edgeworth expansions. The expansions provide second-order approximations that improve upon the normal approximation. Theoretical results are illustrated by a simulation study where we compare various approximations to the distribution of the commonly used Gini's mean difference estimator.