Estimation of Variance Components for a Linear Toeplitz Model

The linear Toeplitz covariance structure model of order one is considered. We give some elegant explicit expressions of the Locally Minimum Variance Quadratic Unbiased Estimators of its covariance parameters. We deduce from a Monte Carlo method some properties of their Gaussian maximum likelihood estimators. Finally, for small sample sizes, these two types of estimators are compared with the intuitive empirical estimators and it is shown that the empirical biased estimators should be used.     

NONNEGATIVE ESTIMATORS FOR THE ONE-WAY RANDOM EFFECTS MODEL

The relative merits of ten estimators for the variance component of the balanced and unbalanced one-way random effects models are compared. Six of the estimators are nonnegative, two of which are obtained by modifying the Minimum Variance Quadratic Unbiased Estimator (MIVQUE) and the Weighted Least Square Estimator (WLS), and two more from the positive parts of these estimators. The Minimum Norm Quadratic Estimator (MINQE), which is nonnegative, is adjusted for reducing its bias. The nonnegative Minimum Mean Square Error Estimator (MIMSQE), the Analysis of Variance (ANOVA) and Unweighted Sums of Squares (USS) estimator are also included.     

The umvue and bayes estimate of reliability of mixed failure time distribution

We study the reliability estimates of the non-standard mixture of degenerate (degenerated at zero) and exponential distributions. The Uniformly Minimum Variance Unbiased Estimator (UMVUE) and Bayes estimator of the reliability for some selective prior when the mixing proportion is known and unknown are derived. The Bayes risk is computed for each Bayes estimator of the reliability. A simulated study is carried out to assess the performance of the estimators alongwith the true and Maximum Likelihood Estimate (MLE) of the reliability. An example from Vannman (1991) is also discussed at the end of the paper.     

Admissible linear estimation in singular linear models with respect to a restricted parameter set

The admissibility results of Hoffmann (1977), proved in the context of a nonsingular covariance matrix are extended to the situation where the covariance matrix is singular. Admissible linear estimators in the Gauss-Markoff model are characterised and admissibility of the Best Linear Unbiased Estimator is investigated.     

Are sufficient statistics sufficient

A gambling example is presented in which the players use the Minimum Variance Unbiased Estimator to estimate a parameter while you use another estimator. Your winnings are significant. The properties of your estimator are discussed and its derivation given.     

A test for variance-covarianch parameters in normal linear models

This paper derives a test statistic for the variance-covariance parameters which is a quadratic function of their MINQUE (Minimum Norm Quadratic Unbiased Estimation) estimates. The test is a Wald-type test, and its development closely parallels the theory used to derive a similar test for the coefficients in linear models. In fact, the derivation proceeds by first setting up the estimation problem in a derived linear model in which the dispersion parameters are the coefficients. The test statistic is shown to be the sum of the squares of independent standardized x² variables.     

Anova and minque type of estimators for the one-way random effects model

The one-way random effects model with unequal variances and unequal sample sizes is considered. Estimation of the variances, variance of a single observation (total variance), and the standard error of the unweighted mean are considered. Precision of the Analysis of Variance and Unweighted Sums of Squares type of estimators and the Minimum Norm Quadratic Unbiased Estimators with a priori weights are examined.     

Covariance Matrix Formula for Generalized Linear Models with Unknown Dispersion

In this paper, the existence of the Uniformly Minimum Risk Equivariant (UMRE) estimator of parameters in SURE model under some quadratic losses and matrix losses is studied. The necessary and sufficient conditions for existence of the UMRE estimator of linearly estimable function vectors of regression coefficients under an affine group of transformations are obtained. It is proved that no UMRE estimator of the covariance matrix under any one of two affine groups of transformations exists.     

A Jackknife Method for Estimation of Variance Components

This paper concerns a method of estimation of variance components in a random effect linear model. It is mainly a resampling method and relies on the Jackknife principle. The derived estimators are presented as least squares estimators in an appropriate linear model, and one of them appears as a MINQUE (Minimum Norm Quadratic Unbiased Estimation) estimator. Our resampling method is illustrated by an example given by C. R. Rao [7] and some optimal properties of our estimator are derived for this example. In the last part, this method is used to derive an estimation of variance components in a random effect linear model when one of the components is assumed to be known.     

Minque of variance components in generalized linear model with random effects

We consider the estimation of thc variance components in generalized Linear model with random effects. The Method of Minimum Norm Quadratic Unbiased Estimators extending the Rao's argument is outlined. The method is illustrated with an analysis of cell irradiation data and compared to the methods of estimation proposed by Schall (1991).     

A cautionary note on generalized linear models for covariance of unbalanced longitudinal data

Missing data in longitudinal studies can create enormous challenges in data analysis when coupled with the positive-definiteness constraint on a covariance matrix. For complete balanced data, the Cholesky decomposition of a covariance matrix makes it possible to remove the positive-definiteness constraint and use a generalized linear model setup to jointly model the mean and covariance using covariates (Pourahmadi, 2000). However, this approach may not be directly applicable when the longitudinal data are unbalanced, as coherent regression models for the dependence across all times and subjects may not exist. Within the existing generalized linear model framework, we show how to overcome this and other challenges by embedding the covariance matrix of the observed data for each subject in a larger covariance matrix and employing the familiar EM algorithm to compute the maximum likelihood estimates of the parameters and their standard errors. We illustrate and assess the methodology using real data sets and simulations.     

A useful property of order statistics and its application to UMVU estimation

Consider a random sample of sizen drawn from a continuous parent distributionF. A basic and useful known property associated with such sample is the following: the conditional distribution of thej ^th order statistic given a valuet of thei ^th order statistics, (j>i), coincides with the distribution of the(j?i) ^th order statistic in a sample of size (n?i) drawn from the parent distributionF truncated at the left att. In this article we mention some applications of this property, and provide a new application to the construction of an Uniformly Minimum Variance Unbiased (UMVU) estimator in the case of two-truncation parameters family of distributions.     

Bayesian Analysis of a Growth Curve Model with a General Autoregressive Covariance Structure

In this paper we consider from maximum likelihood and Bayesian points of view the generalized growth curve model when the covariance matrix has a Toeplitz structure. This covariance is a generalization of the AR(1) dependence structure. Inferences on the parameters as well as the future values are included. The results are illustrated with several real data sets.     

Best unbiased estimation of fixed effects in mixed ANOVA models

In a linear model with an arbitrary variance–covariance matrix, Zyskind (Ann. Math. Statist. 38 (1967) 1092) provided necessary and sufficient conditions for when a given linear function of the fixed-effect parameters has a best linear unbiased estimator (BLUE). If these conditions hold uniformly for all possible variance–covariance parameters (i.e., there is a UBLUE) and if the data are assumed to be normally distributed, these conditions are also necessary and sufficient for the parametric function to have a uniformly minimum variance unbiased estimator (UMVUE). For mixed-effects ANOVA models, we show how these conditions can be translated in terms of the incidence array, which facilitates verification of the UBLUE and UMVUE properties and facilitates construction of designs having such properties.     

Introduction of a new measure for detecting poor fit due to omitted nonlinear terms in SEM

The model chi-square that is used in linear structural equation modeling compares the fitted covariance matrix of a target model to an unstructured covariance matrix to assess global fit. For models with nonlinear terms, i.e., interaction or quadratic terms, this comparison is very problematic because these models are not nested within the saturated model that is represented by the unstructured covariance matrix. We propose a novel measure that quantifies the heteroscedasticity of residuals in structural equation models. It is based on a comparison of the likelihood for the residuals under the assumption of heteroscedasticity with the likelihood under the assumption of homoscedasticity. The measure is designed to respond to omitted nonlinear terms in the structural part of the model that result in heteroscedastic residual scores. In a small Monte Carlo study, we demonstrate that the measure appears to detect omitted nonlinear terms reliably when falsely a linear model is analyzed and the omitted nonlinear terms account for substantial nonlinear effects. The results also indicate that the measure did not respond when the correct model or an overparameterized model were used.     

Some properties of,and relationships among,several uncorrelated and homoscedastic residual vectors

In this paper we examine the properties of four types of residual vectors, arising from fitting a linear regression model to a set of data by least squares. The four types of residuals are (i) the Stepwise residuals (Hedayat and Robson, 1970), (ii) the Recursive residuals (Brown, Durbin, and Evans, 1975), (iii) the Sequentially Adjusted residuals (to be defined herein), and (iv) the BLUS residuals (Theil, 1965, 1971). We also study the relationships among the four residual vectors. It is found that, for any given sequence of observations, (i) the first three sets of residuals are identical, (ii) each of the first three sets, being identical, is a member of Thei’rs (1965, 1971) family of residuals; specifically, they are Linear Unbiased with a Scalar covariance matrix (LUS) but not Best Linear Unbiased with a Scalar covariance matrix (BLUS). We find the explicit form of the transformation matrix and show that the first three sets of residual vectors can be written as an orthogonal transformation of the BLUS residual vector. These and other properties may prove to be useful in the statistical analysis of residuals.     

The negative multinomial logit model

A polychotomous logit model is defined for negative multinomial frequency counts within independent populations. An efficient estimator of the model parameters and estimator covariance matrix is given in closed form. Minimum chi-square and Wald tests are presented.     

LEVERAGE ADJUSTMENTS FOR DISPERSION MODELLING IN GENERALIZED NONLINEAR MODELS

For normal linear models, it is generally accepted that residual maximum likelihood estimation is appropriate when covariance components require estimation. This paper considers generalized linear models in which both the mean and the dispersion are allowed to depend on unknown parameters and on covariates. For these models there is no closed form equivalent to residual maximum likelihood except in very special cases. Using a modified profile likelihood for the dispersion parameters, an adjusted score vector and adjusted information matrix are found under an asymptotic development that holds as the leverages in the mean model become small. Subsequently, the expectation of the fitted deviances is obtained directly to show that the adjusted score vector is unbiased at least to O(1/n) . Exact results are obtained in the single‐sample case. The results reduce to residual maximum likelihood estimation in the normal linear case.     

Checking identifiability of covariance parameters in linear mixed effects models

To build a linear mixed effects model, one needs to specify the random effects and often the associated parametrized covariance matrix structure. Inappropriate specification of the structures can result in the covariance parameters of the model not identifiable. Non-identifiability can result in extraordinary wide confidence intervals, and unreliable parameter inference. Sometimes software produces implication of model non-identifiability, but not always. In the simulation of fitting non-identifiable models we tried, about half of the times the software output did not look abnormal. We derive necessary and sufficient conditions of covariance parameters identifiability which does not require any prior model fitting. The results are easy to implement and are applicable to commonly used covariance matrix structures.     

COVARIANCE MODELS FOR LATTICE DATA

Given observations on an m × n lattice, approximate maximum likelihood estimates are derived for a family of models including direct covariance, spatial moving average, conditional autoregressive and simultaneous autoregressive models. The approach involves expressing the (approximate) covariance matrix of the observed variables in terms of a linear combination of neighbour relationship matrices, raised to a power. The structure is such that the eigenvectors of the covariance matrix are independent of the parameters of interest. This result leads to a simple Fisher scoring type algorithm for estimating the parameters. The ideas are illustrated by fitting models to some remotely sensed data.