Minimum variance unbiased invariant estimation of variance components under normality

In a variance components model for normally distributed data, for a specified vector of linear combinations of the variance components, necessary and sufficient conditions are given under which the vector has a uniformly minimum variance unbiased translation-invariant estimator. The competing class of estimators is not restricted to those that are quadratic. For classification models, the conditions are translated into easy-to-check partial balance requirements on the incidence array.     

On geometry of the set of admissible invariant quadratic estimators in balanced two variance components model

Two variance components model for which each invariant quadratic admissible estimator of a linear function of variance components (under quadratic loss function) is a linear combination of two quadratic forms,Z ₁,Z ₂, say, is considered. A setD={(d ₁,d ₂)′:d ₁ Z ₁+d ₂ Z ₂ is admissible} is described by giving formulae on the boundary ofD. Different forms of the setD are presented on figures.     

Quadratic estimation in mixed linear models with two variance components

Explicit expressions for Bayes invariant quadratic estimates, biased and unbiased, are presented and proved to cover the entire class of admissible estimates in the considered classes. An unbalanced genetic model is studied for demonstration.     

Quadratic estimators of covariance components in a multivariate mixed linear model

It is known that the Henderson Method III (Biometrics 9:226–252, 1953) is of special interest for the mixed linear models because the estimators of the variance components are unaffected by the parameters of the fixed factor (or factors). This article deals with generalizations and minor extensions of the results obtained for the univariate linear models. A MANOVA mixed model is presented in a convenient form and the covariance components estimators are given on finite dimensional linear spaces. The results use both the usual parametric representations and the coordinate-free approach of Kruskal (Ann Math Statist 39:70–75, 1968) and Eaton (Ann Math Statist 41:528–538, 1970). The normal equations are generalized and it is given a necessary and sufficient condition for the existence of quadratic unbiased estimators for covariance components in the considered model.     

Improved robust Bayes estimators of the error variance in linear models

We consider the problem of estimating the error variance in a general linear model when the error distribution is assumed to be spherically symmetric, but not necessary Gaussian. In particular we study the case of a scale mixture of Gaussians including the particularly important case of the multivariate-t distribution. Under Stein's loss, we construct a class of estimators that improve on the usual best unbiased (and best equivariant) estimator. Our class has the interesting double robustness property of being simultaneously generalized Bayes (for the same generalized prior) and minimax over the entire class of scale mixture of Gaussian distributions.     

Bootstrap tests for variance components in generalized linear mixed models

In many applications of generalized linear mixed models to clustered correlated or longitudinal data, often we are interested in testing whether a random effects variance component is zero. The usual asymptotic mixture of chi‐square distributions of the score statistic for testing constrained variance components does not necessarily hold. In this article, the author proposes and explores a parametric bootstrap test that appears to be valid based on its estimated level of significance under the null hypothesis. Results from a simulation study indicate that the bootstrap test has a level much closer to the nominal one while the asymptotic test is conservative, and is more powerful than the usual asymptotic score test based on a mixture of chi‐squares. The proposed bootstrap test is illustrated using two sets of real‐life data obtained from clinical trials. The Canadian Journal of Statistics © 2009 Statistical Society of Canada     

Bayesian inference for the variance components in general mixed linear models

The general mixed linear model, containing both the fixed and random effects, is considered. Using gamma priors for the variance components, the conditional posterior distributions of the fixed effects and the variance components, conditional on the random effects, are obtained. Using the normal approximation for the multiple t distribution, approximations are obtained for the posterior distributions of the variance components in infinite series form. The same approximation Is used to obtain closed expressions for the moments of the variance components. An example is considered to illustrate the procedure and a numerical study examines the closeness of the approximations.     

Testing variance components in balanced linear growth curve models

It is well known that the testing of zero variance components is a non-standard problem since the null hypothesis is on the boundary of the parameter space. The usual asymptotic chi-square distribution of the likelihood ratio and score statistics under the null does not necessarily hold because of this null hypothesis. To circumvent this difficulty in balanced linear growth curve models, we introduce an appropriate test statistic and suggest a permutation procedure to approximate its finite-sample distribution. The proposed test alleviates the necessity of any distributional assumptions for the random effects and errors and can easily be applied for testing multiple variance components. Our simulation studies show that the proposed test has Type I error rate close to the nominal level. The power of the proposed test is also compared with the likelihood ratio test in the simulations. An application on data from an orthodontic study is presented and discussed.     

Likelihood ratio tests for variance components in linear mixed models

Although the asymptotic distributions of the likelihood ratio for testing hypotheses of null variance components in linear mixed models derived by Stram and Lee [1994. Variance components testing in longitudinal mixed effects model. Biometrics 50, 1171–1177] are valid, their proof is based on the work of Self and Liang [1987. Asymptotic properties of maximum likelihood estimators and likelihood tests under nonstandard conditions. J. Amer. Statist. Assoc. 82, 605–610] which requires identically distributed random variables, an assumption not always valid in longitudinal data problems. We use the less restrictive results of Vu and Zhou [1997. Generalization of likelihood ratio tests under nonstandard conditions. Ann. Statist. 25, 897–916] to prove that the proposed mixture of chi-squared distributions is the actual asymptotic distribution of such likelihood ratios used as test statistics for null variance components in models with one or two random effects. We also consider a limited simulation study to evaluate the appropriateness of the asymptotic distribution of such likelihood ratios in moderately sized samples.     

A comparison of mixed and minimax estimators of linear models

In this paper the stochastic properties of two estimators of linear models, mixed and minimax, based on different types of prior information, are compared using quadratic risk as the criterion for superiority. A necessary and sufficient condition for the minimax estimator to be superior to the comparable mixed estimator is derived as well as a simpler necessary but not sufficient condition.     

On invariant quadratic unbiased estimation of variance components

The present study deals with three different invarint quadratic unbiased estimators (IQUE) for variance components namely quadratic least squares estimators (QLSE), weighted quadratic least squares estimators (WQLSE) and Mitra type estimators (MTE). The variance and covariances of these three different estimators are presented for unbalanced one-way random model. The relative performances of these estimators are assessed based on different optimality criteria like, D-optimality, T-optimality and M-optimality together with variances of these estimators. As a result, it has been shown that MTE has optimal properties.     

On locally optimal invariant unbiased tests for the variance components ratio in mixed linear models

In the paper the problem of testing of two-sided hypotheses for variance components in mixed linear models is considered. When the uniformly most powerful invariant test does not exist (see e.g. Das and Sinha, in Proceedings of the second international Tampere conference in statistics, 1987; Gnot and Michalski, in Statistics 25:213–223, 1994; Michalski and Zmyślony, in Statistics 27:297–310, 1996) then to conduct the optimal statistical inference on model parameters a construction of a test with locally best properties is desirable, cf. Michalski (in Tatra Mountains Mathematical Publications 26:1–21, 2003). The main goal of this article is the construction of the locally best invariant unbiased test for a single variance component (or for a ratio of variance components). The result has been obtained utilizing Andersson’s and Wijsman’s approach connected with a representation of density function of maximal invariant (Andersson, in Ann Stat 10:955–961, 1982; Wijsman, in Proceedings of fifth Berk Symp Math Statist Prob 1:389–400, 1967; Wijsman, in Sankhyā A 48:1–42, 1986; Khuri et al., in Statistical tests for mixed linear models, 1998) and from generalized Neyman–Pearson Lemma (Dantzig and Wald, in Ann Math Stat 22:87–93, 1951; Rao, in Linear statistical inference and its applications, 1973). One selected real example of an unbalanced mixed linear model is given, for which the power functions of the LBIU test and Wald’s test (the F-test in ANOVA model) are computed, and compared with the attainable upper bound of power obtained by using Neyman–Pearson Lemma.     

Identification of the variance components in the general two-variance linear model

Bayesian analyses frequently employ two-stage hierarchical models involving two-variance parameters: one controlling measurement error and the other controlling the degree of smoothing implied by the model's higher level. These analyses can be hampered by poorly identified variances which may lead to difficulty in computing and in choosing reference priors for these parameters. In this paper, we introduce the class of two-variance hierarchical linear models and characterize the aspects of these models that lead to well-identified or poorly identified variances. These ideas are illustrated with a spatial analysis of a periodontal data set and examined in some generality for specific two-variance models including the conditionally autoregressive (CAR) and one-way random effect models. We also connect this theory with other constrained regression methods and suggest a diagnostic that can be used to search for missing spatially varying fixed effects in the CAR model.     

Asymptotic variance approximations for invariant estimators in uncertain asset-pricing models

This article derives explicit expressions for the asymptotic variances of the maximum likelihood and continuously-updated GMM estimators in models that may not satisfy the fundamental asset-pricing restrictions in population. The proposed misspecification-robust variance estimators allow the researcher to conduct valid inference on the model parameters even when the model is rejected by the data. While the results for the maximum likelihood estimator are only applicable to linear asset-pricing models, the asymptotic distribution of the continuously-updated GMM estimator is derived for general, possibly nonlinear, models. The large corrections in the asymptotic variances, that arise from explicitly incorporating model misspecification in the analysis, are illustrated using simulations and an empirical application.     

Bayes estimates in multivariate semiparametric linear models

Bayes estimates are derived in multivariate linear models with unknown distribution. The prior distribution is defined using a Dirichlet prior for the unknown error distribution and a normal-Wishart distribution for the parameters. The posterior distribution is determined and explicit expressions are given in the special cases of location-scale and two-sample models. The calculation of self-informative limits of Bayes estimates yields standard estimates.     

Estimation of variance components in linear mixed measurement error models

In this paper, we consider a linear mixed model with measurement errors in fixed effects. We find the corrected score function estimators for the variance components. An iterative algorithm is proposed for estimating the parameters. The computations on each iteration of this algorithm are those associated with computing estimates of fixed and random effects for given values of the variance components. We also derive the consistency of the estimators under regularity conditions. The simulation study shows that for relatively small sample size the corrected estimators perform very well. Finally, an example of real data is given for illustration.     

Estimation of variance components in the mixed effects models: A comparison between analysis of variance and spectral decomposition

The mixed effects models with two variance components are often used to analyze longitudinal data. For these models, we compare two approaches to estimating the variance components, the analysis of variance approach and the spectral decomposition approach. We establish a necessary and sufficient condition for the two approaches to yield identical estimates, and some sufficient conditions for the superiority of one approach over the other, under the mean squared error criterion. Applications of the methods to circular models and longitudinal data are discussed. Furthermore, simulation results indicate that better estimates of variance components do not necessarily imply higher power of the tests or shorter confidence intervals.     

Invariant methods for estimating variance components in mixed linear models 2

The subject of this contribution is to present a survey on new methods for variance component estimation, which appeared in the literature in recent years. Starting from mixed models treated in analysis of variance research work on this field turned over to a more general approach in which the covariance matrix of the vector of observations is assumed to be a unknown linear combination of known symmetric matrices. Much interest has been shown in developing some kinds op optimal estimators for the unknown parameters and most results were obtained for estimators being invariant with respect to a certain group of translations. Therefore we restrict attention to this class of estimates. We will deal with minimum variance unbiased estimators, least squared errors estimators, maximum likelihood estimators. Bayes quadratic estimators and show some relations to the mimimum norm quadratic unbiased estimation principle (MINQUE) introduced by C. R. Rao [20]. We do not mention the original motivation of MINQUE since the otion of minimum norm depends on a measure that is not accepted by all statisticians. Also we do‘nt deal with other approaches like the BAYEsian and fiducial methods which were successfully applied by S. Portnoy [18], P. Rusolph [22], G. C. Tiao, W. Y. Tan [28], M. J. K. Healy [9] and others, although in very special situations, only. Additionally we add some new results and also new insight in the properties of known estimators. We give a new characterization of MINQUE in the class of all estimators, extend explicite expressions for locally optimal quadratic estimators given by C. R. Rao [22] to a slightly more general situation and prove complete class theorems useful for the computation of BAYES quadratic estimators. We also investigate situations in which BAYES quadratic unbiased estimators do'nt change if the distribution of the error terms differ from the normal distribution.     

Simultaneous inferences for variance ratios of some mixed linear models

Earlier investigations used a one-sided inequality to consltuct confidence regions for the variance ratios or balanced randoiu models. In this study, confidence regions are based on a two-sided generalisation of this inequality and the results are illustrated by estimating the parameters of some elementary random models.