The effects of the proxy information on the iterative Stein-rule estimator of the disturbance variance

In a regression model with proxy variables, we consider the iterative estimator of the disturbance variance to obtain more precise estimates. In the formula of the estimator of the disturbance variance, the estimator is obtained by using Stein-rule (SR) estimator instead of OLS (ordinary least squares) estimator is called Iterative estimator of the disturbance variance. It is shown that, in a regression model with proxy variables the mean square error (MSE) of the iterative estimator of the disturbance variance is greater than the MSE of the disturbance variance related to the OLS estimator under certain conditions.     

Optimal two-point designs for the michaelis-menten model with heteroscedastic errors

We construct D-optimal designs for the Michaelis-Menten model when the variance of the response depends on the independent variable. However, this dependence is only partially known. A Bayesian approacn is used to find an optimal design by incorporating the prior lnformation about the variance structure. We demonstrate the method for a class of error variance structures and present efficiencies of these optimal designs under prior mis-specifications. In particular, we show that an erroneous assumption on the variance structure for the Michaelis-Menten model can have serious consequences.     

Mixture model on the variance for the differential analysis of gene expression data

Summary.  In microarray experiments, accurate estimation of the gene variance is a key step in the identification of differentially expressed genes. Variance models go from the too stringent homoscedastic assumption to the overparameterized model assuming a specific variance for each gene. Between these two extremes there is some room for intermediate models. We propose a method that identifies clusters of genes with equal variance. We use a mixture model on the gene variance distribution. A test statistic for ranking and detecting differentially expressed genes is proposed. The method is illustrated with publicly available complementary deoxyribonucleic acid microarray experiments, an unpublished data set and further simulation studies.     

Generalizing the Welch Test To Non-Zero Hypotheses on the Variance Component in the One-Way Random Effects Model Under Variance Heterogeneity

In an unbalanced and heteroscedastic one-way random effects model of analysis of variance we consider hypotheses concerning the between group variance where in a classical set-up the hypothesis whether this variance component is zero is tested. We consider the still open problem of testing also extended hypotheses concerning this parameter and generalize the prominent Welch test to deal with these hypotheses, too.     

On the difference between ML and REML estimators in the modelling of multivariate longitudinal data

A random effects model is examined in the multivariate setting where more than one characteristics are measured at each time point. ML and REML estimators are obtained under the restriction that estimates of variance matrices being at least p.s.d. It is shown that REML has greater probability of giving full rank estimates of variance components matrices but as regards the efficiency in the estimation of the location parameter, correct specification of the number of random effects is needed. In general, REML provides larger estimates of variance of model parameters than ML.     

Nonparametric regression in a statistical modified Helmholtz equation using the Fourier spectral regularization

In this paper, we deal with the Cauchy problem for the modified Helmholtz equation. We consider two models of data: the bounded variance model and the i.i.d. model. The trigonometric estimators of nonparametric regression is applied to solve the problem. In addition, the general forms of regularization parameter corresponding to the pointwise mean squared error and the mean integrated squared error are discussed in detail. The minimax rate convergence corresponding to the bounded variance model is also presented. In the i.i.d. model, we construct the asymptotic confidence interval for the solution of the problem. Finally, we give some numerical experiments and discuss the obtained results.     

On the stability of the jackknife variance estimator in ratio estimation

The stability of a slightly modified version of the usual jackknife variance estimator is evaluated exactly in small samples under a suitable linear regression model and compared with that of two different linearization variance estimators. Depending on the degree of heteroscedasticity of the error variance in the model, the stability of the jackknife variance estimator is found to be somewhat comparable to that of one or the other of the linearization variance estimators under conditions especially favorable to ratio estimation (i.e., regression approximately through the origin with a relatively small coefficient of variation in the x population). When these conditions do not hold, however, the jackknife variance estimator is found to be less stable than either of the linearization variance estimators.     

Model misspecification in parametric dual modeling

In typical normal theory regression, the assumption of homogeneity of variances is often not appropriate. Instead of treating the variances as a nuisance and transforming away the heterogeneity, the structure of the variances may be of interest and it is desirable to model the variances. Simultaneous modeling of the mean and variance of a response is known as dual modeling. When parametric models for the mean and variance are prescribed, estimation of the mean and variance parameters are interrelated. One commonly used dual model assumes a linear model for the mean and a log-linear variance model (Aitkin, 1987). This paper considers the impact of model misspecification (mean and variance) on the dual model estimation procedure. Asymptotic expressions for the mean and variance estimates, graphical illustrations of the impact of model misspecification, and simulation results are presented.     

Three modifications of the principle of the minque

Nonnegative estimators for the variance components of a linear model are obtained by ignoring the condition for unbiasedness in the principle of the MINQUE. An estimator is derived when the priori weights are proportional to the variance components. The ordinary sample variance is shown to be the nonnegative MINQUE. Efficiencies of the three estimators are examined for some special cases of the model.     

Confidence intervals for the between group variance in the unbalanced one-way random effects model of anaylsis of variance

A confidence interval for the between group variance is proposed which is deduced from Wald'sexact confidence interval for the rtio of the two variance components in the one-way random effects model and the exact confidence interval for the error variance resp.an unbiased estimator of the error variance. In a simulation study the confidence coeffecients for these two intervals are compared with the confidence coefficients of two other commonly used confidence intervals. There the confidence interval derived here yields confidence coefficiends which are always greater than the prescriped level.     

Comparison of designs for the three-fold nested random model

The quality of estimation of variance components depends on the design used as well as on the unknown values of the variance components. In this article, three designs are compared, namely, the balanced, staggered, and inverted nested designs for the three-fold nested random model. The comparison is based on the so-called quantile dispersion graphs using analysis of variance (ANOVA) and maximum likelihood (ML) estimates of the variance components. It is demonstrated that the staggered nested design gives more stable estimates of the variance component for the highest nesting factor than the balanced design. The reverse, however, is true in case of lower nested factors. A comparison between ANOVA and ML estimation of the variance components is also made using each of the aforementioned designs.     

A new class of unbiased estimators of the variance of the systematic sample mean

We propose a class of estimators of the variance of the systematic sample mean, which is unbiased under the assumption that the population follows a superpopulation model that satisfies some mild conditions. The approach is based on the separate estimation of the portion of the variance due to the systematic component of the model and that due to the stochastic component. In particular, we deal with two estimators belonging to the proposed class that are based on moving averages and local polynomials to estimate the systematic component of the model. The latter estimators are unbiased under the assumption that the population follows a linear trend and the errors are homoscedastic and uncorrelated. Through a simulation study we show that these estimators generally outperform, in terms of bias and mean square error, the usual estimator based on the first differences also when the superpopulation model departs significantly from linearity and the errors are heteroscedastic.     

Variance estimation when donor imputation is used to fill in missing values

Donor imputation is frequently used in surveys. However, very few variance estimation methods that take into account donor imputation have been developed in the literature. This is particularly true for surveys with high sampling fractions using nearest donor imputation, often called nearest‐neighbour imputation. In this paper, the authors develop a variance estimator for donor imputation based on the assumption that the imputed estimator of a domain total is approximately unbiased under an imputation model; that is, a model for the variable requiring imputation. Their variance estimator is valid, irrespective of the magnitude of the sampling fractions and the complexity of the donor imputation method, provided that the imputation model mean and variance are accurately estimated. They evaluate its performance in a simulation study and show that nonparametric estimation of the model mean and variance via smoothing splines brings robustness with respect to imputation model misspecifications. They also apply their variance estimator to real survey data when nearest‐neighbour imputation has been used to fill in the missing values. The Canadian Journal of Statistics 37: 400–416; 2009 © 2009 Statistical Society of Canada     

Graphical technique for comparing designs for random models

Methods for comparing designs for a random (or mixed) linear model have focused primarily on criteria based on single-valued functions. In general, these functions are difficult to use, because of their complex forms, in addition to their dependence on the model's unknown variance components. In this paper, a graphical approach is presented for comparing designs for random models. The one-way model is used for illustration. The proposed approach is based on using quantiles of an estimator of a function of the variance components. The dependence of these quantiles on the true values of the variance components is depicted by plotting the so-called quantile dispersion graphs (QDGs), which provide a comprehensive picture of the quality of estimation obtained with a given design. The QDGs can therefore be used to compare several candidate designs. Two methods of estimation of variance components are considered, namely analysis of variance and maximum-likelihood estimation.     

A note on testing the nullity of the between group variance in the one-way random effects model under variance heterogeneity

In an unbalanced and heteroscedastic one-way random effects model, we compare, by way of simulation, several test statistics for testing the null hypothesis that the variance of the random effects, also named the between group variance, is zero. These tests are the classical F-test, the test proposed by Jeyaratnam & Othman, the Welch test, and a modified version of Welch's test.     

A Comparison of Time-Varying Parameter and Multiprocess Mixture Models in the Case of Money-Supply Announcements

This study compares the performance of a recently proposed multiprocess mixture model and a random-walk time-varying parameter (TVP) model, using the interest rate–weekly money relationship for illustrative purposes. For the case of this relationship, which is subject to regime shifts and outliers, the mixture model performs well and the latter model performs poorly. This finding is of general interest, since investigators often adopt random-walk TVP models to accommodate potential regime shifts in regression relationships. The TVP estimation procedure is unlikely to find abrupt shifts, since the estimate of parameter variance is based on the entire data sample. In the face of rapid discontinuous shifts in the parameters, this variance estimate is unrepresentative of the variability during periods of abrupt shift or transient observations.     

Variance estimation based on blocked 3×2 cross-validation in high-dimensional linear regression

In high-dimensional linear regression, the dimension of variables is always greater than the sample size. In this situation, the traditional variance estimation technique based on ordinary least squares constantly exhibits a high bias even under sparsity assumption. One of the major reasons is the high spurious correlation between unobserved realized noise and several predictors. To alleviate this problem, a refitted cross-validation (RCV) method has been proposed in the literature. However, for a complicated model, the RCV exhibits a lower probability that the selected model includes the true model in case of finite samples. This phenomenon may easily result in a large bias of variance estimation. Thus, a model selection method based on the ranks of the frequency of occurrences in six votes from a blocked 3×2 cross-validation is proposed in this study. The proposed method has a considerably larger probability of including the true model in practice than the RCV method. The variance estimation obtained using the model selected by the proposed method also shows a lower bias and a smaller variance. Furthermore, theoretical analysis proves the asymptotic normality property of the proposed variance estimation.     

Outlier detection using difference-based variance estimators in multiple regression

In this article, we propose an outlier detection approach in a multiple regression model using the properties of a difference-based variance estimator. This type of a difference-based variance estimator was originally used to estimate error variance in a non parametric regression model without estimating a non parametric function. This article first employed a difference-based error variance estimator to study the outlier detection problem in a multiple regression model. Our approach uses the leave-one-out type method based on difference-based error variance. The existing outlier detection approaches using the leave-one-out approach are highly affected by other outliers, while ours is not because our approach does not use the regression coefficient estimator. We compared our approach with several existing methods using a simulation study, suggesting the outperformance of our approach. The advantages of our approach are demonstrated using a real data application. Our approach can be extended to the non parametric regression model for outlier detection.     

Quantile plots for mean effects in the presence of variance effects for 2k-p designs

In robust parameter design, variance effects and mean effects in a factorial experiment are modelled simultaneously. If variance effects are present in a model, correlations are induced among the naive estimators of the mean effects. A simple normal quantile plot of the mean effects may be misleading because the mean effects are no longer iid under the null hypothesis that they are zero. Adjusted quantiles are computed for the case when one variance effect is significant and examples of 8-run and 16-run fractional factorial designs are examined in detail. We find that the usual normal quantiles are similar to adjusted quantiles for all but the largest and smallest ordered effects for which they are conservative. Graphically, the qualitative difference between the two sets of quantiles is negligible (even in the presence of large variance effects) and we conclude that normal probability plots are robust in the presence of variance effects.