Rao distance as a measure of influence in the multivariate linear model

Several methods have been suggested to detect influential observations in the linear regression model and a number of them have been extended for the multivariate regression model. In this article we consider the multivariate general linear model, Y = XB + k , which contains the linear regression model and the multivariate regression model as particular cases. Assuming that the random disturbances are normally distributed, the BLUE of v B is also normally distributed. Since the distribution of the BLUE of v B and the distribution of the BLUE of v B in the model with the omission of a set of observations differ, to study the influence that a set of observations has on the BLUE of v B , we propose to measure the distance between both distributions. To do this we use Rao distance.     

Fundamental Equations of BLUE and BLUP in the Multivariate Linear Model with Applications

Ordinary least squares estimator (OLSE), best linear unbiased estimator (BLUE), and best linear unbiased predictor (BLUP) in the general linear model with new observations are generalized to the general multivariate linear model. The fundamental equations of BLUE and BLUP in the multivariate linear model are derived by two methods, including the vectorization method and projection method. By using the matrix rank method, some new results of linear BLUE-sufficiency, linear BLUP-sufficiency, and the equality of OLSE, BLUE, and BLUP are given in the multivariate linear model.     

Equality of two blues and ridge-type estimates

Equality is shown of the g-inverse and Moore-Penrose inverse representation of the BLUE in the general linear model. The proof is based on a matrix identity which allows also to establish a functional relationship between the BLUE and Ridge-type estimates.     

On equality of ordinary least squares estimator,best linear unbiased estimator and best linear unbiased predictor in the general linear model

The equality of ordinary least squares estimator (OLSE), best linear unbiased estimator (BLUE) and best linear unbiased predictor (BLUP) in the general linear model with new observations is investigated through matrix rank method, some new necessary and sufficient conditions are given.     

Some matrix results related to a partitioned singular linear model

Consider the linear model (y, Xβ V), where the model matrix X may not have a full column rank and V might be singular. In this paper we introduce a formula for the difference between the BLUES of Xβ under the full model and the model where one observation has been deleted. We also consider the partitioned linear regression model where the model matrix is (X₁: X₂) the corresponding vector of unknown parameters being (β′₁ : β′₂)′. We show that the BLUE of X₁ β₁ under a specific reduced model equals the corresponding BLUE under the original full model and consider some interesting consequences of this result.     

Best quadratic unbiased estimation in variance-covariance component models 2

This paper deals with the existence of best quadratic unbiased estimators in variance covariance component models. It extends and unifies results previously obtained by Seely, Zyskind, Klonecki, Zmy?lony, Gnot, Kleffe and Pincus. The author considers a quasinormally distributed random vector y such that Ey = Xβ, Cov y∈L, where L is a linear space of symmetric square matrices. Conditions for the existence of a BLUE of Ey and a BQUE of Cov y (Eyy′) are investigated. A BLUE exists iff symmetry conditions for certain matrices are met while a BQUE exists iff some modified quadratic subspace conditions are met. At the end of the paper three examples are studied in which all these conditions are met: The Random Coefficient Regression Model, the multivariate linear model and the Behrens-Fisher model. The proofs of the theorems are obtained by considering linear model in y and yy′, respectively.     

On the weighted least-squares,the ordinary least-squares and the best linear unbiased estimators under a restricted growth curve model

Necessary and sufficient conditions are given for a restricted growth curve model to be consistent. The general expressions of the weighted least-squares estimators (WLSEs), the ordinary least-squares estimators (OLSEs) and the best linear unbiased estimator (BLUE) under this model are also derived. Moreover, some algebraic and statistical properties of these estimators are presented by rank method.     

The BLUE's covariance matrix revisited: A review

In this paper we comment on and review some unexpected but interesting features of the BLUE (best linear unbiased estimator) of the expectation vector in the general linear model and in particular, the BLUE's covariance matrix. Most of these features appear in the literature but are rather scattered or hidden.     

A note on the equality of the OLSE and the BLUE of the parametric function in the general Gauss–Markov model

In this note we consider the equality of the ordinary least squares estimator (OLSE) and the best linear unbiased estimator (BLUE) of the estimable parametric function in the general Gauss–Markov model. Especially we consider the structures of the covariance matrix V for which the OLSE equals the BLUE. Our results are based on the properties of a particular reparametrized version of the original Gauss–Markov model.      

A projector oriented approach to the best linear unbiased estimator

The paper provides a projector based approach to the best linear unbiased estimator (BLUE). By revisiting the so called generalized projection operator, introduced in Rao (J R Stat Soc Ser B Stat Methodol 36:442–448, 1974), a number of new formulae for BLUE is established. Furthermore, some attention is paid to the coincidence of the BLUE and the ordinary least squares estimator.     

Influence analysis in multivariate linear general models

In this paper we obtain several influence measures for the multivariate linear general model through the approach proposed by Muñoz-Pichardo et al. (1995), which is based on the concept of conditional bias. An interesting charasteristic of this approach is that it does not require any distributional hypothesis. Appling the obtained results to the multivariate regression model, we obtain some measures proposed by other authors. Nevertheless, on the results obtained in this paper, we emphasize two aspects. First, they provide a theoretical foundation for measures proposed by other authors for the mul¬tivariate regression model. Second, they can be applied to any linear model that can be formulated as a particular case of the multivariate linear general model. In particular, we carry out an application to the multivariate analysis of covariance.     

Computational comparison of the general weighted moments estimators of the scale parameter of a Pareto distribution with a known shape parameter with other estimators based on a multiply type II-censored sample

Wu et al. [Computational comparison for weighted moments estimators and BLUE of the scale parameter of a Pareto distribution with known shape parameter under type II multiply censored sample, Appl. Math. Comput. 181 (2006), pp. 1462–1470] proposed the weighted moments estimators (WMEs) of the scale parameter of a Pareto distribution with known shape parameter on a multiply type II-censored sample. They claimed that some WMEs are better than the best linear unbiased estimator (BLUE) based on the exact mean-squared error (MSE). In this paper, the general WME (GWME) is proposed and the computational comparison of the proposed estimator with the WMEs and BLUE is done on the basis of the exact MSE for given sample sizes and different censoring schemes. As a result, the GWME is performing better than the best estimator among 12 WMEs and BLUE for all cases. Therefore, GWME is recommended for use. At last, one example is given to demonstrate the proposed GWME.     

The admissible minimax estimator in Gauss–Markov model under a balanced loss function

In this paper, we investigate the admissible minimax estimator (AME) of regression coefficient in Gauss–Markov model under a balanced loss function. In the class of homogeneous linear estimators, we obtain the AME under two occasions, respectively. We also prove that the AME is a shrinkage estimator of the best linear unbiased estimator (BLUE). Furthermore, we prove that the AME dominates the BLUE under certain conditions.     

Remove unwanted variation retrieves unknown experimental designs

Remove unwanted variation (RUV) is an estimation and normalization system in which the underlying correlation structure of a multivariate dataset is estimated from negative control measurements, typically gene expression values, which are assumed to stay constant across experimental conditions. In this paper we derive the weight matrix which is estimated and incorporated into the generalized least squares estimates of RUV-inverse, and show that this weight matrix estimates the average covariance matrix across negative control measurements. RUV-inverse can thus be viewed as an estimation method adjusting for an unknown experimental design. We show that for a balanced incomplete block design (BIBD), RUV-inverse recovers intra- and interblock estimates of the relevant parameters and combines them as a weighted sum just like the best linear unbiased estimator (BLUE), except that the weights are globally estimated from the negative control measurements instead of being individually optimized to each measurement as in the classical, single measurement BIBD BLUE.     

Projectors and linear estimation in general linear models

The paper gives a self-contained account of minimum disper­sion linear unbiased estimation of the expectation vector in a linear model with the dispersion matrix belonging to some, rather arbitrary, set of nonnegative definite matrices. The approach to linear estimation in general linear models recommended here is a direct generalization of some ideas and results presented by Rao (1973, 19 74) for the case of a general Gauss-Markov model

A new insight into the nature of some estimation problems originaly arising in the context of a general Gauss-Markov model as well as the correspondence of results known in the literature to those obtained in the present paper for general linear models are also given. As preliminary results the theory of projectors defined by Rao (1973) is extended.     

On the natural restrictions in the singular Gauss–Markov model

A Gauss–Markov model is said to be singular if the covariance matrix of the observable random vector in the model is singular. In such a case, there exist some natural restrictions associated with the observable random vector and the unknown parameter vector in the model. In this paper, we derive through the matrix rank method a necessary and sufficient condition for a vector of parametric functions to be estimable, and necessary and sufficient conditions for a linear estimator to be unbiased in the singular Gauss–Markov model. In addition, we give some necessary and sufficient conditions for the ordinary least-square estimator (OLSE) and the best linear unbiased estimator (BLUE) under the model to satisfy the natural restrictions.      

Nonnegative Unbiased Estimation of Scale Parameters and Associated Quantiles Based on a Ranked Set Sample

In this article, we are interested in estimating the scale parameter in location and scale families. It is well known that the best linear unbiased estimator (BLUE) of scale parameter based on a simple random sample (SRS) is nonnegative. However, the BLUE of scale parameter based on a ranked set sample (RSS) can assume negative values. We suggest various modifications of BLUE of scale parameter based on RSS so that the resulting estimators are unbiased as well as nonnegative. Their performances in terms of relative efficiencies are compared and some recommendations are made for normal, logistic, double exponential, two-parameter exponential and Weibull distributions. We also briefly discuss an application of the proposed nonnegative BLUE of scale parameter for quantile estimation for the above populations.     

Bias corrected estimates in multivariate student t regression models

The t distribution has proved to be a useful alternative to the normal distribution especially When robust estimation is desired. We consider the multivariate nonlinear Student-t regression model and show that the biased of the estimates of the regression coefficients can be computed from an auxiliary generalized linear regression. We give a formula for the biases of the estimates of the parameters in the scale matrix, which also can be computed by means of a generalized linear regression. We briefly discuss some important special cases and present simulation results which indicate that our bias-corrected estimates outperform the uncorrected ones in small samples.     

Recursive improvement of estimates in a Gauss-Markov model with linear restrictions

The minimum-dispersion linear unbiased estimator of a set of estimable functions in a general Gauss-Markov model with double linear restrictions is considered. The attention is focused on developing a recursive formula in which an initial estimator, obtained from the unrestricted model, is corrected with respect to the restrictions successively incorporated into the model. The established formula generalizes known results developed for the simple Gauss-Markov model.