On the stability of the jackknife variance estimator in ratio estimation

The stability of a slightly modified version of the usual jackknife variance estimator is evaluated exactly in small samples under a suitable linear regression model and compared with that of two different linearization variance estimators. Depending on the degree of heteroscedasticity of the error variance in the model, the stability of the jackknife variance estimator is found to be somewhat comparable to that of one or the other of the linearization variance estimators under conditions especially favorable to ratio estimation (i.e., regression approximately through the origin with a relatively small coefficient of variation in the x population). When these conditions do not hold, however, the jackknife variance estimator is found to be less stable than either of the linearization variance estimators.     

Efficient variance reduction approach based on the variation of the input importance

ABSTRACT

To reduce the output variance, the variance-based importance analysis can provide an efficient way by reducing the variance of the ‘important’ inputs. But with the reduction of the variance of those ‘important’ inputs, the input importance will change and it is no longer the most efficient way to reduce the variance of those ‘important’ inputs alone. Thus, analyst needs to consider reducing the variance of other inputs to obtain a more efficient way. This work provides a graphical solution for analyst to decide how to reduce the input variance to achieve the targeted reduction of the output variance efficiently. Furthermore, by the importance sampling-based approach, the graphical solution can be obtained with only a single group of samples, which can decrease the computational cost greatly.     

The effects of the proxy information on the iterative Stein-rule estimator of the disturbance variance

In a regression model with proxy variables, we consider the iterative estimator of the disturbance variance to obtain more precise estimates. In the formula of the estimator of the disturbance variance, the estimator is obtained by using Stein-rule (SR) estimator instead of OLS (ordinary least squares) estimator is called Iterative estimator of the disturbance variance. It is shown that, in a regression model with proxy variables the mean square error (MSE) of the iterative estimator of the disturbance variance is greater than the MSE of the disturbance variance related to the OLS estimator under certain conditions.     

Comments on the paper “Bias-adjustment and calibration of jackknife variance estimator in the presence of non-response”

Singh and Arnab (2010) presented a bias adjustment to the jackknife variance estimator of Rao and Sitter (1995) in the presence of non-response. In their paper, they obtained a second-order approximation of the bias of the Rao-Sitter variance estimator and then proposed a bias-adjusted estimator based on this approximation. To compare their proposed variance estimator to various other variance estimators, they performed a simulation study and showed that their variance estimator is superior to the Rao-Sitter variance estimator. In fact they showed that the Rao-Sitter variance estimator suffers from severe underestimation. These results contradict those in the literature, which indicate that the Rao-Sitter variance estimator suffers from a positive bias if the sampling fractions are not negligible; see Rao and Sitter (1995), Lee et al. (1995) and Haziza and Picard (2011). Because of this contradiction, we felt that a further investigation was warranted. In this paper, we attempt to recreate the results of Singh and Arnab (2010) and, in fact, show that their second order approximation to the bias of the Rao-Sitter variance estimator is incorrect and that their simulation results are also questionable.     

On the UMVU estimator for the generalized variance of the multinomial family

Abstract

The generalized variance is an important statistical indicator which appears in a number of statistical topics. It is a successful measure for multivariate data concentration. In this article, we established, in a closed form, the bias of the generalized variance maximum likelihood estimator of the Multinomial family. We also derived, with a complete proof, the uniformly minimum variance unbiased estimator (UMVU) for the generalized variance of this family. These results rely on explicit calculations, the completeness of the exponential family and the Lehmann–Scheffé theorem.     

Criteria for estimating the variance function used in the asymptotic quasi-likelihood approach

The estimation of the variance function of a linear regression model used in the asymptotic quasi-likelihood approach is considered. It is shown that the variance function used in the determination of the asymptotic quasi-likelihood estimates encompasses the variance functions commonly found in the literature. Selection criteria of the most appropriate estimate of the variance function for given data are established. These criteria are based on a graphical technique and a chi-squared test.     

Three modifications of the principle of the minque

Nonnegative estimators for the variance components of a linear model are obtained by ignoring the condition for unbiasedness in the principle of the MINQUE. An estimator is derived when the priori weights are proportional to the variance components. The ordinary sample variance is shown to be the nonnegative MINQUE. Efficiencies of the three estimators are examined for some special cases of the model.     

On the coefficient of determination for mixed regression models

For mixed regression models, we define a variance decomposition including three terms, explained individual variance, unexplained individual variance and noise variance. In contrast to traditional variance decomposition, it is thus the unexplained  , not the explained, variance that is split. It gives rise to a coefficient of individual determination (CID) defined as the estimated fraction of explained individual variance. We argue that in many applications CID is a valuable complement to R²$R^2$, since it excludes noise variance (which can never be explained) and thus has one as a natural upper bound.     

Generalizing the Welch Test To Non-Zero Hypotheses on the Variance Component in the One-Way Random Effects Model Under Variance Heterogeneity

In an unbalanced and heteroscedastic one-way random effects model of analysis of variance we consider hypotheses concerning the between group variance where in a classical set-up the hypothesis whether this variance component is zero is tested. We consider the still open problem of testing also extended hypotheses concerning this parameter and generalize the prominent Welch test to deal with these hypotheses, too.     

Comparison of designs for the three-fold nested random model

The quality of estimation of variance components depends on the design used as well as on the unknown values of the variance components. In this article, three designs are compared, namely, the balanced, staggered, and inverted nested designs for the three-fold nested random model. The comparison is based on the so-called quantile dispersion graphs using analysis of variance (ANOVA) and maximum likelihood (ML) estimates of the variance components. It is demonstrated that the staggered nested design gives more stable estimates of the variance component for the highest nesting factor than the balanced design. The reverse, however, is true in case of lower nested factors. A comparison between ANOVA and ML estimation of the variance components is also made using each of the aforementioned designs.     

Mixture model on the variance for the differential analysis of gene expression data

Summary.  In microarray experiments, accurate estimation of the gene variance is a key step in the identification of differentially expressed genes. Variance models go from the too stringent homoscedastic assumption to the overparameterized model assuming a specific variance for each gene. Between these two extremes there is some room for intermediate models. We propose a method that identifies clusters of genes with equal variance. We use a mixture model on the gene variance distribution. A test statistic for ranking and detecting differentially expressed genes is proposed. The method is illustrated with publicly available complementary deoxyribonucleic acid microarray experiments, an unpublished data set and further simulation studies.     

Disentangling the sources of variation in the survival of the European dipper

The population growth rate of the European dipper has been shown to decrease with winter temperature and population size. We examine here the demographic mechanism for this effect by analysing how these factors affect the survival rate. Using more than 20 years of capture-mark-recapture data (1974-1997) based on more than 4000 marked individuals, we perform analyses using open capture-mark-recapture models. This allowed us to estimate the annual apparent survival rates (probability of surviving and staying on the study site from one year to the next one) and the recapture probabilities. We partitioned the variance of the apparent survival rates into sampling variance and process variance using random effects models, and investigated which variables best accounted for temporal process variation. Adult males and females had similar apparent survival rates, with an average of 0.52 and a coefficient of variation of 40%. Chick apparent survival was lower, averaging 0.06 with a coefficient of variation of 42%. Eighty percent of the variance in apparent survival rates was explained by winter temperature and population size for adults and 48% by winter temperature for chicks. The process variance outweighed the sampling variance both for chick and adult survival rates, which explained that shrunk estimates obtained under random effects models were close to MLE estimates. A large proportion of the annual variation in the apparent survival rate of chicks appears to be explained by inter-year differences in dispersal rates.     

Disentangling the sources of variation in the survival of the European dipper

The population growth rate of the European dipper has been shown to decrease with winter temperature and population size. We examine here the demographic mechanism for this effect by analysing how these factors affect the survival rate. Using more than 20 years of capture-mark-recapture data (1974-1997) based on more than 4000 marked individuals, we perform analyses using open capture-mark-recapture models. This allowed us to estimate the annual apparent survival rates (probability of surviving and staying on the study site from one year to the next one) and the recapture probabilities. We partitioned the variance of the apparent survival rates into sampling variance and process variance using random effects models, and investigated which variables best accounted for temporal process variation. Adult males and females had similar apparent survival rates, with an average of 0.52 and a coefficient of variation of 40%. Chick apparent survival was lower, averaging 0.06 with a coefficient of variation of 42%. Eighty percent of the variance in apparent survival rates was explained by winter temperature and population size for adults and 48% by winter temperature for chicks. The process variance outweighed the sampling variance both for chick and adult survival rates, which explained that shrunk estimates obtained under random effects models were close to MLE estimates. A large proportion of the annual variation in the apparent survival rate of chicks appears to be explained by inter-year differences in dispersal rates.     

Confidence intervals for the between group variance in the unbalanced one-way random effects model of anaylsis of variance

A confidence interval for the between group variance is proposed which is deduced from Wald'sexact confidence interval for the rtio of the two variance components in the one-way random effects model and the exact confidence interval for the error variance resp.an unbiased estimator of the error variance. In a simulation study the confidence coeffecients for these two intervals are compared with the confidence coefficients of two other commonly used confidence intervals. There the confidence interval derived here yields confidence coefficiends which are always greater than the prescriped level.     

Inadmissibility of the uniformly minimum variance unbiased estimator of the inverse gaussian variance

The uniformly minimum variance unbiased estimator (UMVUE) of the variance of the inverse Gaussian distribution is shown to be inadmissible in terms of the mean squared error, and a dominating estimator is given. A dominating estimator to the maximum likelihood estimator (MLE) of the variance and estimators dominating the MLE's and the UMVUE's of other parameters are also given.     

Variance reduction in the study of a test concerning the behrens-fisher problem

A simulation case study illustrating the implementation of a variance reduction technique appropriate for dichotomous response variables is presented. In this simulation study, concerning the power of the Cochran and Cox test for the equality of means under possibly unequal variances, variance reductions of around 80% or more are obtained. More importantly, a known property of the Cochran and Cox, its conservative character, is detected thanks to the use of variance reduction.     

Optimal two-point designs for the michaelis-menten model with heteroscedastic errors

We construct D-optimal designs for the Michaelis-Menten model when the variance of the response depends on the independent variable. However, this dependence is only partially known. A Bayesian approacn is used to find an optimal design by incorporating the prior lnformation about the variance structure. We demonstrate the method for a class of error variance structures and present efficiencies of these optimal designs under prior mis-specifications. In particular, we show that an erroneous assumption on the variance structure for the Michaelis-Menten model can have serious consequences.     

Analysis of experiments using the asymptotic quasi-likelihood approach

Comparison of treatment effects in an experiment is usually done through analysis of variance under the assumption that the errors are normally and independently distributed with zero mean and constant variance. The traditional approach in dealing with non-constant variance is to apply a variance stabilizing transformation and then run the analysis on the transformed data. In this approach, the conclusions of analysis of variance apply only to the transformed population. In this paper, the asymptotic quasi-likelihood method is introduced to the analysis of experimental designs. The weak assumptions of the asymptotic quasi-likelihood method make it possible to draw conclusions on heterogeneous populations without transforming them. This paper demonstrates how to apply the asymptotic quasi-likelihood technique to three commonly used models. This gives a possible way to analyse data given a complex experimental design.     

Statistical properties of the Hadamard product of random vectors

The variance of the Hadamard product of two linear combinations of a random vector is presented in terms of the mean and the variance of the random vector when a normal distribution is assumed. The mean and variance of the Hadamard product are further given for any distribution.     

On the cramer-frechet-rao inequality for translation parameter in the case of finite support

In this paper we investigate the problem of deriving the C-F-R (CRAMER-FRECHET-RAO) bound for the variance of an unbiased estimator of the translation para¬meter for a class of distributions having as support an interval of fixed length. Starting with the general form of the O-F-R, inequality studied earlier by VINCZE (1979) for mixed

densities, we prove some inequalities related to the information quantity occurring in the C-F-R bound. The case when the variance of the unbiased estimator does not depend upon the translation parameter is investigated. The case when the variance depends upon the translation parameter is also briefly discussed. Finally some remarks will be given

concerning the attainability of the variance,bounds given in this paper