Bayesian inference for the variance components in general mixed linear models

The general mixed linear model, containing both the fixed and random effects, is considered. Using gamma priors for the variance components, the conditional posterior distributions of the fixed effects and the variance components, conditional on the random effects, are obtained. Using the normal approximation for the multiple t distribution, approximations are obtained for the posterior distributions of the variance components in infinite series form. The same approximation Is used to obtain closed expressions for the moments of the variance components. An example is considered to illustrate the procedure and a numerical study examines the closeness of the approximations.     

Minimum Variance Quadratic Unbiased Estimation for the Variance Components in Simple Linear Regression with Onefold Nested Error

The explicit forms of the minimum variance quadratic unbiased estimators (MIVQUEs) of the variance components are given for simple linear regression with onefold nested error. The resulting estimators are more efficient as the ratio of the initial variance components estimates increases and are asymptotically efficient as the ratio tends to infinity.     

Robust estimation of variance components

New robust estimates for variance components are introduced. Two simple models are considered: the balanced one-way classification model with a random factor and the balanced mixed model with one random factor and one fixed factor. However, the method of estimation proposed can be extended to more complex models. The new method of estimation we propose is based on the relationship between the variance components and the coefficients of the least-mean-squared-error predictor between two observations of the same group. This relationship enables us to transform the problem of estimating the variance components into the problem of estimating the coefficients of a simple linear regression model. The variance-component estimators derived from the least-squares regression estimates are shown to coincide with the maximum-likelihood estimates. Robust estimates of the variance components can be obtained by replacing the least-squares estimates by robust regression estimates. In particular, a Monte Carlo study shows that for outlier-contaminated normal samples, the estimates of variance components derived from GM regression estimates and the derived test outperform other robust procedures.     

The three-fold nested random effects model

Estimation of the variance components and the mean of the balanced and unbalanced threefold nested design is considered. The relative merits of the following procedures are evaluated: Analysis of variance (ANOVA), maximum likelihood (ML), restricted maximum likelihood (REML), and minimum variance quadratic unbiased estimator (MIVQUE). A new procedure called the weighted analysis of means (WAM) estimator which utilizes prior information on the variance components is proposed. It is found to have optimum properties similar to the REML and MIVQUE, and it is also computationally simpler. For the mean, the overall sample average, grand mean, unweighted mean, and generalized least-squares (GLS) estimator with its weights obtained from the above estimators for the variance components are considered. Comparisons of the above procedures for the variance components and the mean are made from exact expressions for the biases and mean square errors (MSEs) of the estimators and from empirical investigations.     

Comparison of designs for the three-fold nested random model

The quality of estimation of variance components depends on the design used as well as on the unknown values of the variance components. In this article, three designs are compared, namely, the balanced, staggered, and inverted nested designs for the three-fold nested random model. The comparison is based on the so-called quantile dispersion graphs using analysis of variance (ANOVA) and maximum likelihood (ML) estimates of the variance components. It is demonstrated that the staggered nested design gives more stable estimates of the variance component for the highest nesting factor than the balanced design. The reverse, however, is true in case of lower nested factors. A comparison between ANOVA and ML estimation of the variance components is also made using each of the aforementioned designs.     

Three modifications of the principle of the minque

Nonnegative estimators for the variance components of a linear model are obtained by ignoring the condition for unbiasedness in the principle of the MINQUE. An estimator is derived when the priori weights are proportional to the variance components. The ordinary sample variance is shown to be the nonnegative MINQUE. Efficiencies of the three estimators are examined for some special cases of the model.     

Unbiasedness of two-stage estimation and prediction procedures for mixed linear models

The traditional method for estimating or predicting linear combinations of the fixed effects and realized values of the random effects in mixed linear models is first to estimate the variance components and then to proceed as if the estimated values of the variance components were the true values. This two-stage procedure gives unbiased estimators or predictors of the linear combinations provided the data vector is symmetrically distributed about its expected value and provided the variance component estimators are translation-invariant and are even functions of the data vector. The standard procedures for estimating the variance components yield even, translation-invariant estimators.     

Estimation of variance components in the mixed effects models: A comparison between analysis of variance and spectral decomposition

The mixed effects models with two variance components are often used to analyze longitudinal data. For these models, we compare two approaches to estimating the variance components, the analysis of variance approach and the spectral decomposition approach. We establish a necessary and sufficient condition for the two approaches to yield identical estimates, and some sufficient conditions for the superiority of one approach over the other, under the mean squared error criterion. Applications of the methods to circular models and longitudinal data are discussed. Furthermore, simulation results indicate that better estimates of variance components do not necessarily imply higher power of the tests or shorter confidence intervals.     

Graphical technique for comparing designs for random models

Methods for comparing designs for a random (or mixed) linear model have focused primarily on criteria based on single-valued functions. In general, these functions are difficult to use, because of their complex forms, in addition to their dependence on the model's unknown variance components. In this paper, a graphical approach is presented for comparing designs for random models. The one-way model is used for illustration. The proposed approach is based on using quantiles of an estimator of a function of the variance components. The dependence of these quantiles on the true values of the variance components is depicted by plotting the so-called quantile dispersion graphs (QDGs), which provide a comprehensive picture of the quality of estimation obtained with a given design. The QDGs can therefore be used to compare several candidate designs. Two methods of estimation of variance components are considered, namely analysis of variance and maximum-likelihood estimation.     

Minimum variance unbiased invariant estimation of variance components under normality

In a variance components model for normally distributed data, for a specified vector of linear combinations of the variance components, necessary and sufficient conditions are given under which the vector has a uniformly minimum variance unbiased translation-invariant estimator. The competing class of estimators is not restricted to those that are quadratic. For classification models, the conditions are translated into easy-to-check partial balance requirements on the incidence array.     

On the unbiased estimation of fixed effects in a mixed model for growth curves

A mixed model for growth curves is introduced. A method of estimating the variance components is indicated. It is shown that the generalised least squares estimates of the fixed effects using estimates of variance components are unbiased and an expression is obtained for the increase in variance due to the substitution of the variances by their estimates. These results are directly applied to designs with two-way elimination of heterogeneity.     

Estimation using penalized quasilikelihood and quasi-pseudo-likelihood in Poisson mixed models

We consider two estimation schemes based on penalized quasilikelihood and quasi-pseudo-likelihood in Poisson mixed models. The asymptotic bias in regression coefficients and variance components estimated by penalized quasilikelihood (PQL) is studied for small values of the variance components. We show the PQL estimators of both regression coefficients and variance components in Poisson mixed models have a smaller order of bias compared to those for binomial data. Unbiased estimating equations based on quasi-pseudo-likelihood are proposed and are shown to yield consistent estimators under some regularity conditions. The finite sample performance of these two methods is compared through a simulation study.     

Confidence intervals and tests on the variance ratio in random models with two variance components

The LM test is modified to test any value of the ratio of two variance components in a mixed effects linear model with two variance components. The test is exact, so it can be used to construct exact confidence intervals on this ratio.Exact Neyman-Pearson (NP) tests on the variance ratio are described.Their powers provide attainable upper bounds on powers of tests on the variance ratio.Efficiencies of LM tests, which include ANOVA tests, and NP tests are compared for unbalanced, random, one-way ANOVA models.Confidence intervals corresponding to LM tests and NP tests are described.     

Variance least squares estimators for multivariate linear mixed model

Non-iterative, distribution-free, and unbiased estimators of variance components by least squares method are derived for multivariate linear mixed model. A general inter-cluster variance matrix, a same-member only general inter-response variance matrix, and an uncorrelated intra-cluster error structure for each response are assumed. Projection method is suggested when unbiased estimators of variance components are not nonnegative definite matrices. A simulation study is conducted to investigate the properties of the proposed estimators in terms of bias and mean square error with comparison to the Gaussian (restricted) maximum likelihood estimators. The proposed estimators are illustrated by an application of gene expression familial study.     

QUALITY IMPROVEMENT FROM DISASSEMBLY-REASSEMBLY EXPERIMENTS

The goal of achieving high quality products has led to an emphasis on reducing variation in performance characteristics. It may often happen that one of the product's components is responsible for much of the observed variation. This research is stimulated by the problem of detecting a component that impairs quality by systematically inflating the variance in a product that is assembled from “interchangeable components.” We consider the class of “disassembly-reassembly” experiments, in which components are swapped among assemblies. The specific units used in the experiment are sampled from a large population of units, so it is natural to measure the influence of each factor by its variance component. We present the model for these experiments as a special case of the mixed linear model, compare several estimators for the variance components and consider the problem of testing hypotheses to identify troublesome components.     

Variance components estimation for the balanced random effects model under mixed prior distributions

For the balanced random effects models, when the variance components are correlated either naturally or through common prior structures, by assuming a mixed prior distribution for the variance components, we propose some new Bayesian estimators. To contrast and compare the new estimators with the minimum variance unbiased (MVUE) and restricted maximum likelihood estimators (RMLE), some simulation studies are also carried out. It turns out that the proposed estimators have smaller mean squared errors than the MVUE and RMLE.     

Maximum likelihood estimation of variance components of heteroscedastic random anova model

the estimation of variance components of heteroscedastic random model is discussed in this paper. Maximum Likelihood (ML) is described for one-way heteroscedastic random models. The proportionality condition that cell variance is proportional to the cell sample size, is used to eliminate the efffect of heteroscedasticity. The algebraic expressions of the estimators are obtained for the model. It is seen that the algebraic expressions of the estimators depend mainly on the inverse of the variance-covariance matrix of the observation vector. So, the variance-covariance matrix is obtained and the formulae for the inversions are given. A Monte Carlo study is conducted. Five different variance patterns with different numbers of cells are considered in this study. For each variance pattern, 1000 Monte Carlo samples are drawn. Then the Monte Carlo biases and Monte Carlo MSE’s of the estimators of variance components are calculated. In respect of both bias and MSE, the Maximum Likelihood (ML) estimators of variance components are found to be sufficiently good.     

A theorem relating minque and unweighted means estimators of variance components in the one-way design

The unweighted means estimators of variance components in the one-way design are shown to equal the limit of the weighted MINQUE estimators as the ratio of the treatment variance weight to the error variance weight approaches infinity     

The present status of confidence interval estimation on variance components in balanced and unbalanced random models

Much research has been conducted to develop confidence Intervals on linear combinations and ratios of variance components in balanced and unbalanced random models.This paper first presents confidence intervals on functions of variance components in balanced designs.These results assume that classical analysis of variance sums of squares are independent and have exact scaled chi-squared distributions.In unbalanced designs, either one or both of these assumptions are violated, and modifications to the balanced model intervals are required.We report results of some recent work that examines various modifications for some particular unbalanced designs.     

The mixed model for survey regression estimation

Estimation of the population mean under the regression model with random components is considered. Conditions under which the random components regression estimator is design consistent are given. It is shown that consistency holds when incorrect values are used for the variance components. The regression estimator constructed with model parameters that differ considerably from the true parameters performed well in a Monte Carlo study. Variance estimators for the regression predictor are suggested. A variance estimator appropriate for estimators constructed with a biased estimator for the between-group variance component performed well in the Monte Carlo study.