Small area estimation of mean price of habitation transaction using time-series and cross-sectional area-level models

In this paper, a new small domain estimator for area-level data is proposed. The proposed estimator is driven by a real problem of estimating the mean price of habitation transaction at a regional level in a European country, using data collected from a longitudinal survey conducted by a national statistical office. At the desired level of inference, it is not possible to provide accurate direct estimates because the sample sizes in these domains are very small. An area-level model with a heterogeneous covariance structure of random effects assists the proposed combined estimator. This model is an extension of a model due to Fay and Herriot [5], but it integrates information across domains and over several periods of time. In addition, a modified method of estimation of variance components for time-series and cross-sectional area-level models is proposed by including the design weights. A Monte Carlo simulation, based on real data, is conducted to investigate the performance of the proposed estimators in comparison with other estimators frequently used in small area estimation problems. In particular, we compare the performance of these estimators with the estimator based on the Rao–Yu model [23]. The simulation study also accesses the performance of the modified variance component estimators in comparison with the traditional ANOVA method. Simulation results show that the estimators proposed perform better than the other estimators in terms of both precision and bias.     

Jackknife Estimation for Smooth Functions of the Parametric Component in Partially Linear Regression Models

Abstract

It is known that due to the existence of the nonparametric component, the usual estimators for the parametric component or its function in partially linear regression models are biased. Sometimes this bias is severe. To reduce the bias, we propose two jackknife estimators and compare them with the naive estimator. All three estimators are shown to be asymptotically equivalent and asymptotically normally distributed under some regularity conditions. However, through simulation we demonstrate that the jackknife estimators perform better than the naive estimator in terms of bias when the sample size is small to moderate. To make our results more useful, we also construct consistent estimators of the asymptotic variance, which are robust against heterogeneity of the error variances.     

Simple heterogeneity variance estimation for meta-analysis

Summary.  A simple method of estimating the heterogeneity variance in a random-effects model for meta-analysis is proposed. The estimator that is presented is simple and easy to calculate and has improved bias compared with the most common estimator used in random-effects meta-analysis, particularly when the heterogeneity variance is moderate to large. In addition, it always yields a non-negative estimate of the heterogeneity variance, unlike some existing estimators. We find that random-effects inference about the overall effect based on this heterogeneity variance estimator is more reliable than inference using the common estimator, in terms of coverage probability for an interval estimate.     

A precise estimator for the log-normal mean

The log-normal distribution is frequently encountered in applications. The uniformly minimum variance unbiased (UMVU) estimator for the log-normal mean is given explicitly by a formula found by Finney in 1941. In contrast to this the most commonly used estimator for a log-normal mean is the sample mean. This is possibly due to the complexity of the formula given by Finney. A modified maximum likelihood estimator which approximates the UMVU estimator is derived here. It is sufficiently simple to be implemented in elementary spreadsheet applications. An elementary approximate formula for the root-mean-square error of the suggested estimator and the UMVU estimator is presented. The suggested estimator is compared with the sample mean, the maximum likelihood, and the UMVU estimators by Monte Carlo simulation in terms of root-mean-square error.     

Comments on the paper “Bias-adjustment and calibration of jackknife variance estimator in the presence of non-response”

Singh and Arnab (2010) presented a bias adjustment to the jackknife variance estimator of Rao and Sitter (1995) in the presence of non-response. In their paper, they obtained a second-order approximation of the bias of the Rao-Sitter variance estimator and then proposed a bias-adjusted estimator based on this approximation. To compare their proposed variance estimator to various other variance estimators, they performed a simulation study and showed that their variance estimator is superior to the Rao-Sitter variance estimator. In fact they showed that the Rao-Sitter variance estimator suffers from severe underestimation. These results contradict those in the literature, which indicate that the Rao-Sitter variance estimator suffers from a positive bias if the sampling fractions are not negligible; see Rao and Sitter (1995), Lee et al. (1995) and Haziza and Picard (2011). Because of this contradiction, we felt that a further investigation was warranted. In this paper, we attempt to recreate the results of Singh and Arnab (2010) and, in fact, show that their second order approximation to the bias of the Rao-Sitter variance estimator is incorrect and that their simulation results are also questionable.     

On difference-based variance estimation in nonparametric regression when the covariate is high dimensional

Summary.  We consider the problem of estimating the noise variance in homoscedastic nonparametric regression models. For low dimensional covariates t  ∈  R ^d ,  d =1, 2, difference-based estimators have been investigated in a series of papers. For a given length of such an estimator, difference schemes which minimize the asymptotic mean-squared error can be computed for d =1 and d =2. However, from numerical studies it is known that for finite sample sizes the performance of these estimators may be deficient owing to a large finite sample bias. We provide theoretical support for these findings. In particular, we show that with increasing dimension d this becomes more drastic. If d 4, these estimators even fail to be consistent. A different class of estimators is discussed which allow better control of the bias and remain consistent when d 4. These estimators are compared numerically with kernel-type estimators (which are asymptotically efficient), and some guidance is given about when their use becomes necessary.     

Estimating the variance in nonparametric regression—what is a reasonable choice?

The exact mean-squared error (MSE) of estimators of the variance in nonparametric regression based on quadratic forms is investigated. In particular, two classes of estimators are compared: Hall, Kay and Titterington's optimal difference-based estimators and a class of ordinary difference-based estimators which generalize methods proposed by Rice and Gasser, Sroka and Jennen-Steinmetz. For small sample sizes the MSE of the first estimator is essentially increased by the magnitude of the integrated first two squared derivatives of the regression function. It is shown that in many situations ordinary difference-based estimators are more appropriate for estimating the variance, because they control the bias much better and hence have a much better overall performance. It is also demonstrated that Rice's estimator does not always behave well. Data-driven guidelines are given to select the estimator with the smallest MSE.     

Estimating kurtosis and confidence intervals for the variance under nonnormality

Exact confidence intervals for variances rely on normal distribution assumptions. Alternatively, large-sample confidence intervals for the variance can be attained if one estimates the kurtosis of the underlying distribution. The method used to estimate the kurtosis has a direct impact on the performance of the interval and thus the quality of statistical inferences. In this paper the author considers a number of kurtosis estimators combined with large-sample theory to construct approximate confidence intervals for the variance. In addition, a nonparametric bootstrap resampling procedure is used to build bootstrap confidence intervals for the variance. Simulated coverage probabilities using different confidence interval methods are computed for a variety of sample sizes and distributions. A modification to a conventional estimator of the kurtosis, in conjunction with adjustments to the mean and variance of the asymptotic distribution of a function of the sample variance, improves the resulting coverage values for leptokurtically distributed populations.     

A comparative study of some bias correction techniques for kernel- based density estimators

Methods for obtaining kernel-based density estimators with lower bias and mean integrated squared error than an estimator based on a standard Normal kernel function are described and discussed. Three main approaches are considered which are: firstly by using 'optimal' polynomial kernels as described, for example, by Gasser er a1 (1985); secondly by employing generalised jackknifing as proposed by Jones nd Foster (1993) and thirdly by subtracting an estimator of the principal asymptotic bias term from the original estimator. The emphasis in this initial discussion is on their asymptotic properties. The finite sample performance of those that have the best asymptotic properties are compared with two adaptive estimators, as well as the fixed Normal kernel estimator, in a simulation study.     

Estimating the variance of the sample median

The small-sample bias and root mean squared error of several distribution-free estimators of the variance of the sample median are examined. A new estimator is proposed that is easy to compute and tends to have the smallest bias and root mean squared error.     

Estimation of the mean of the selected population

A new class of estimators is introduced for the problem of estimating the mean of the selected population. These estimators are found by subtracting from the largest sample mean an estimator of its bias. The new estimators are compared with those introduced by Cohen and Sackrowitz (1982) and in terms of frequentist risk they are found to perform quite similarly.     

Conditional inference in finite population sampling under a calibration model

Several estimators, including the classical and the regression estimators of finite population mean, are compared, both theoretically and empirically, under a calibration model, where the dependent variable(y), and not the independent variable(x), can be observed for all units of the finite population. It is shown asymptotically that when conditioned on x, the bias of the classical estimator may be much smaller than that of the regression estimators; whereas when conditioned on y, the regression estimator may have much smaller conditional bias than the classical estimator. Since all the y's(not x's) can be observed, it seems appropriate to make comparison under the conditional distribution of each estimator with y fixed. In this case, the regression estimator has smaller variance, smaller conditional bias, and the conditional coverage probability closer to its nominal level     

Bootstrap adaptive estimation: The trimmed-mean example

We consider the problem of choosing among a class of possible estimators by selecting the estimator with the smallest bootstrap estimate of finite sample variance. This is an alternative to using cross-validation to choose an estimator adaptively. The problem of a confidence interval based on such an adaptive estimator is considered. We illustrate the ideas by applying the method to the problem of choosing the trimming proportion of an adaptive trimmed mean. It is shown that a bootstrap adaptive trimmed mean is asymptotically normal with an asymptotic variance equal to the smallest among trimmed means. The asymptotic coverage probability of a bootstrap confidence interval based on such adaptive estimators is shown to have the nominal level. The intervals based on the asymptotic normality of the estimator share the same asymptotic result, but have poor small-sample properties compared to the bootstrap intervals. A small-sample simulation demonstrates that bootstrap adaptive trimmed means adapt themselves rather well even for samples of size 10.     

An Improved Generalized Difference-Cum-Ratio-Type Estimator for the Population Variance in Two-Phase Sampling Using Two Auxiliary Variables

In this paper, an improved generalized difference-cum-ratio-type estimator for the finite population variance under two-phase sampling design is proposed. The expressions for bias and mean square error (MSE) are derived to first order of approximation. The proposed estimator is more efficient than the usual sample variance estimator, traditional ratio estimator, traditional regression estimator, chain ratio type and chain ratio-product-type estimators, and Jhajj and Walia (2011) estimator. Four datasets are also used to illustrate the performances of different estimators.     

A modified bootstrap procedure for cluster sampling variance estimation of species richness

Variance estimators for probability sample-based predictions of species richness (S) are typically conditional on the sample (expected variance). In practical applications, sample sizes are typically small, and the variance of input parameters to a richness estimator should not be ignored. We propose a modified bootstrap variance estimator that attempts to capture the sampling variance by generating B replications of the richness prediction from stochastically resampled data of species incidence. The variance estimator is demonstrated for the observed richness (SO), five richness estimators, and with simulated cluster sampling (without replacement) in 11 finite populations of forest tree species. A key feature of the bootstrap procedure is a probabilistic augmentation of a species incidence matrix by the number of species expected to be ‘lost’ in a conventional bootstrap resampling scheme. In Monte-Carlo (MC) simulations, the modified bootstrap procedure performed well in terms of tracking the average MC estimates of richness and standard errors. Bootstrap-based estimates of standard errors were as a rule conservative. Extensions to other sampling designs, estimators of species richness and diversity, and estimates of change are possible.     

Small area estimation: the EBLUP estimator based on spatially correlated random area effects

This paper deals with small area indirect estimators under area level random effect models when only area level data are available and the random effects are correlated. The performance of the Spatial Empirical Best Linear Unbiased Predictor (SEBLUP) is explored with a Monte Carlo simulation study on lattice data and it is applied to the results of the sample survey on Life Conditions in Tuscany (Italy). The mean squared error (MSE) problem is discussed illustrating the MSE estimator in comparison with the MSE of the empirical sampling distribution of SEBLUP estimator. A clear tendency in our empirical findings is that the introduction of spatially correlated random area effects reduce both the variance and the bias of the EBLUP estimator. Despite some residual bias, the coverage rate of our confidence intervals comes close to a nominal 95%.     

Estimation of parameters for the truncated exponential distribution

We consider the right truncated exponential distribution where the truncation point is unknown and show that the ML equation has a unique solution over an extended parameter space. In the case of the estimation of the truncation point T we show that the asymptotic distribution of the MLE is not centered at T. A modified MLE is introduced which outperforms all other considered estimators including the minimum variance unbiased estimator. Asymptotic as well as small sample properties of different estimators are investigated and compared. The truncated exponential distribution has an increasing failure rate, ideally suited for use as a survival distribution for biological and industrial data.     

Bias-adjustment and calibration of jackknife variance estimator in the presence of non-response

In this paper, bias-adjustment in the jackknife estimator of variance accredited to Rao and Sitter (1995) has been considered. Then the bias-adjusted Rao and Sitter (1995) estimator has been calibrated such that its expected value under the imputing superpopulation model remains the same as the expected value of the mean squared error of the ratio estimator in the presence of non-response. A simulation study has been performed to compare the six different estimators of variance: out of them four estimators belong to Rao and Sitter (1995) and the other two proposed estimators are named as bias-adjusted and bias-adjusted-cum-calibrated estimators. The empirical relative bias and empirical relative efficiency of the two proposed estimators with respect to the four existing estimators accredited to Rao and Sitter (1995) have been investigated through simulations. The bias-adjusted-cum-calibrated estimator has been found to be an efficient estimator in the case of heteroscadastic populations. The present paper considers the situation of simple random and without replacement sampling. The possibility of obtaining a negative estimate of variance by the estimator due to Kim et al. (2006) has been pointed out.     

A simple bootstrap bandwidth selector for local polynomial fitting

A new, fully data-driven bandwidth selector with a double smoothing (DS) bias term and a data-driven variance estimator is developed following the bootstrap idea. The data-driven variance estimation does not involve any additional bandwidth selection. The proposed bandwidth selector convergences faster than a plug-in one due to the DS bias estimate, whereas the data-driven variance improves its finite sample performance clearly and makes it stable. Asymptotic results of the proposals are obtained. A comparative simulation study was done to show the overall gains and the gains obtained by improving either the bias term or the variance estimate, respectively. It is shown that the use of a good variance estimator is more important when the sample size is relatively small.     

Delete-m Jackknife for Unequal m

In this paper, the delete-mj jackknife estimator is proposed. This estimator is based on samples obtained from the original sample by successively removing mutually exclusive groups of unequal size. In a Monte Carlo simulation study, a hierarchical linear model was used to evaluate the role of nonnormal residuals and sample size on bias and efficiency of this estimator. It is shown that bias is reduced in exchange for a minor reduction in efficiency. The accompanying jackknife variance estimator even improves on both bias and efficiency, and, moreover, this estimator is mean-squared-error consistent, whereas the maximum likelihood equivalents are not.