Asymptotic efficiency of estimators in the multivariate linear model

Conditions are given under which the least squares estimator and a certain two-step estimator in the multivariate linear model are best asymptotically normal. Normality turns out to be necessary. Under normality the asymptotic efficiency in the sense of RAO of these two estimators is derived.     

Admissible linear estimators in the general Gauss-Markov model

This paper derives a complete characterization of estimators that are admissible for a given identifiable vector of parametric functions among the set of linear estimators under the general Gauss-Markov model with a dispersion matrix possibly singular. The characterization obtained implies some corollaries, which are then compared with the results known in the literature.     

Variance least squares estimators for multivariate linear mixed model

Non-iterative, distribution-free, and unbiased estimators of variance components by least squares method are derived for multivariate linear mixed model. A general inter-cluster variance matrix, a same-member only general inter-response variance matrix, and an uncorrelated intra-cluster error structure for each response are assumed. Projection method is suggested when unbiased estimators of variance components are not nonnegative definite matrices. A simulation study is conducted to investigate the properties of the proposed estimators in terms of bias and mean square error with comparison to the Gaussian (restricted) maximum likelihood estimators. The proposed estimators are illustrated by an application of gene expression familial study.     

Quadratic estimators of covariance components in a multivariate mixed linear model

It is known that the Henderson Method III (Biometrics 9:226–252, 1953) is of special interest for the mixed linear models because the estimators of the variance components are unaffected by the parameters of the fixed factor (or factors). This article deals with generalizations and minor extensions of the results obtained for the univariate linear models. A MANOVA mixed model is presented in a convenient form and the covariance components estimators are given on finite dimensional linear spaces. The results use both the usual parametric representations and the coordinate-free approach of Kruskal (Ann Math Statist 39:70–75, 1968) and Eaton (Ann Math Statist 41:528–538, 1970). The normal equations are generalized and it is given a necessary and sufficient condition for the existence of quadratic unbiased estimators for covariance components in the considered model.     

Admissibilities of matrix linear estimators multivariate linear models

This article respectively provides sufficient conditions and necessary conditions of matrix linear estimators of an estimable parameter matrix linear function in multivariate linear models with and without the assumption that the underlying distribution is a normal one with completely unknown covariance matrix. In the latter model, a necessary and sufficient condition is given for matrix linear estimators to be admissible in the space of all matrix linear estimators under each of three different kinds of quadratic matrix loss functions, respectively. In the former model, a sufficient condition is first provided for matrix linear estimators to be admissible in the space of all matrix estimators having finite risks under each of the same loss functions, respectively. Furthermore in the former model, one of these sufficient conditions, correspondingly under one of the loss functions, is also proved to be necessary, if additional conditions are assumed.     

Estimative influence measures for the multivariate general linear model

Within the context of the multiviriate general linear model, and using a Bayesian formulation and Kullback-Leibler divergences this paper provides a framework and the resultant methods for the problem of detecting and characterizing influential subsets of observations when the goal is to estimate parameters. It is further indicated how these influence measures inherently depend upon one's exact estimative intent. The relationship to previous work on observations influential in estimation is discussed. The estimative influence measures obtained here are also compared with predictive influence functions previously obtained. Several examples are presented illustrating the methodology.     

Monitoring multivariate simple linear profiles using robust estimators

Brief Abstract

This article focuses on estimation of multivariate simple linear profiles. While outliers may hamper the expected performance of the ordinary regression estimators, this study resorts to robust estimators as the remedy of the estimation problem in presence of contaminated observations. More specifically, three robust estimators M, S and MM are employed. Extensive simulation runs show that in the absence of outliers or for small amount of contamination, the robust methods perform as well as the classical least square method, while for medium and large amounts of contamination the proposed estimators perform considerably better than classical method.     

Linearly admissible estimators of mean vector with respect to balanced loss function in multivariate statistics

The authors discuss the bias of the estimate of the variance of the overall effect synthesized from individual studies by using the variance weighted method. This bias is proven to be negative. Furthermore, the conditions, the likelihood of underestimation and the bias from this conventional estimate are studied based on the assumption that the estimates of the effect are subject to normal distribution with common mean. The likelihood of underestimation is very high (e.g. it is greater than 85% when the sample sizes in two combined studies are less than 120). The alternative less biased estimates for the cases with and without the homogeneity of the variances are given in order to adjust for the sample size and the variation of the population variance. In addition, the sample size weight method is suggested if the consistence of the sample variances is violated Finally, a real example is presented to show the difference by using the above three estimate methods.     

A test of the mean square error criterion for linear admissible estimators

A test for choosing between a linear admissible estimator and the least squares estimator (LSE) is developed. A characterization of linear admissible estimators useful for comparing estimators is presented and necessary and sufficient conditions for superiority of a linear admissible estimator over the LS estimetor is derived for the test. The test is based on the MSE matrix superiority, but also new resl?!ts concerning covariance matrix comparisons of linear estimators are derived. Further,shown that the test of Toro - Vizcarrondo and Wailace applies iioi only the restricted least squares estimators but also to certain estimators outside this class.     

Influence analysis in multivariate linear general models

In this paper we obtain several influence measures for the multivariate linear general model through the approach proposed by Muñoz-Pichardo et al. (1995), which is based on the concept of conditional bias. An interesting charasteristic of this approach is that it does not require any distributional hypothesis. Appling the obtained results to the multivariate regression model, we obtain some measures proposed by other authors. Nevertheless, on the results obtained in this paper, we emphasize two aspects. First, they provide a theoretical foundation for measures proposed by other authors for the mul¬tivariate regression model. Second, they can be applied to any linear model that can be formulated as a particular case of the multivariate linear general model. In particular, we carry out an application to the multivariate analysis of covariance.     

A family of admissible minimax estimators of the mean of a multivariate,normal distribution

Let X has a p-dimensional normal distribution with mean vector θ and identity covariance matrix I. In a compound decision problem consisting of squared-error estimation of θ, Strawderman (1971) placed a Beta (α, 1) prior distribution on a normal class of priors to produce a family of Bayes minimax estimators. We propose an incomplete Gamma(α, β) prior distribution on the same normal class of priors to produce a larger family of Bayes minimax estimators. We present the results of a Monte Carlo study to demonstrate the reduced risk of our estimators in comparison with the Strawderman estimators when θ is away from the zero vector.     

Linearly admissible estimators on linear functions of regression coefficient under balanced loss function

Linearly admissible estimators on linear functions of regression coefficient are studied in a singular linear model and balanced loss when the design matrix has not full column rank. The sufficient and necessary conditions for linear estimators to be admissible are obtained respectively in homogeneous and inhomogeneous classes.     

Mean-Squared errors of small area estimators under a multivariate linear model for repeated measures data

In this paper, we discuss the derivation of the first and second moments for the proposed small area estimators under a multivariate linear model for repeated measures data. The aim is to use these moments to estimate the mean-squared errors (MSE) for the predicted small area means as a measure of precision. At the first stage, we derive the MSE when the covariance matrices are known. At the second stage, a method based on parametric bootstrap is proposed for bias correction and for prediction error that reflects the uncertainty when the unknown covariance is replaced by its suitable estimator.     

Limiting admissible estimators for variance components

Simultaneous estimation of the vector of the variance components for mixed and random models under the quadratic loss function is considered. For a large class of such models there are identified classes of admissible biased invariant quadratic estimators that are better than some admissible unbiased estimators. Numerous numerical results presented in the paper show that for many of the commonly used balanced models the improvements in the quadratic risk may be considerable over a large set of the parameter space.     

A prediction analysis in a constrained multivariate general linear model with future observations

Abstract

We give a mathematical analysis to some fundamental prediction problems on a constrained multivariate general linear model (CMGLM) with future observations, including the derivation of analytical formulas for calculating the best linear unbiased predictors (BLUPs) of all unknown parameter matrices, and the presentation of many novel and valuable properties of the BLUPs.     

Admissible linear estimators of the multivariate normal mean without extra information

Suppose y is normally distributed with mean IRⁿ and covariance σ²V, where σ²>0 and V>0 is known. The n. s. conditions that a linear estimator Ay+a of μ be admissible in the class of all estimators of μ which depend only on y are derived. In particular, the usual estimator δ₀(y)=y is admissible in this class. The results are applied to the normal linear model and the admissibilities of many well-known linear estimators are demonstrated.     

Improved ridge estimators in a linear regression model

In this paper, the notion of the improved ridge estimator (IRE) is put forward in the linear regression model y=X β+e. The problem arises if augmenting the equation 0=c′α+ε instead of 0=C α+? to the model. Three special IREs are considered and studied under the mean-squared error criterion and the prediction error sum of squares criterion. The simulations demonstrate that the proposed estimators are effective and recommendable, especially when multicollinearity is severe.     

Best minimum bias linear estimators in gauss-markoff model

In this note we present a criterion for linear estimation which is similar to MV-MB-LE of Rao (1978) in Gauss-Markoff model (Y, XB, α²G). We call this criterion MMS-MB-LE (Minimum Mean Square Error-Minimum Bias-Linear Estimation)> Representations of solutions to such estimators similar to those of Rao (1978) are provided.