Predictions and estimations under a group of linear models with random coefficients

This article investigates the problem of establishing best linear unbiased predictors and best linear unbiased estimators of all unknown parameters in a group of linear models with random coefficients and correlated covariance matrix. We shall derive a variety of fundamental statistical properties of the predictors and estimators by using some matrix analysis tools. In particular, we shall establish necessary and sufficient conditions for the predictors and estimators to be equivalent under single and combined equations in the group of models by using the method of matrix equations, matrix rank formulas, and partitioned matrix calculations.     

Some equalities for estimations of partial coefficients under a general linear regression model

Estimations of partial coefficients in a general regression models involve some complicated operations of matrices and their generalized inverses. In this note, we use the matrix rank method to derive necessary and sufficient conditions for the ordinary least-squares estimator and the best linear unbiased estimator of partial coefficients in a general linear regression model to equal.     

Characterizing Relationships Between Estimations Under a General Linear Model with Explicit and Implicit Restrictions by Rank of Matrix

In the investigation of the restricted linear model ? _r  = {y, X β | A β = b, σ² Σ}, the parameter constraints A β = b are often handled by transforming the model into certain implicitly restricted model. Any estimation derived from the explicitly and implicitly restricted models on the vector β and its functions should be equivalent, although the expressions of the estimation under the two models may be different. However, people more likely want to directly compare different expressions of estimations and yield a conclusion on their equivalence by using some algebraic operations on expressions of estimations. In this article, we give some results on equivalence of the well-known OLSEs and BLUEs under the explicitly and implicitly restricted linear models by using some expansion formulas for ranks of matrices.     

Effect of adding regressors on the equality of the BLUEs under two linear models

In this paper we consider the estimation of regression coefficients in two partitioned linear models, shortly denoted as , and , which differ only in their covariance matrices. We call and full models, and correspondingly, and small models. We give a necessary and sufficient condition for the equality between the best linear unbiased estimators (BLUEs) of X₁β₁ under and . In particular, we consider the equality of the BLUEs under the full models assuming that they are equal under the small models.     

Some matrix results related to a partitioned singular linear model

Consider the linear model (y, Xβ V), where the model matrix X may not have a full column rank and V might be singular. In this paper we introduce a formula for the difference between the BLUES of Xβ under the full model and the model where one observation has been deleted. We also consider the partitioned linear regression model where the model matrix is (X₁: X₂) the corresponding vector of unknown parameters being (β′₁ : β′₂)′. We show that the BLUE of X₁ β₁ under a specific reduced model equals the corresponding BLUE under the original full model and consider some interesting consequences of this result.     

Quasi-minimax estimation in the general linear regression model

This paper is mainly concerned with minimax estimation in the general linear regression model y=Xβ+ε$y=X\beta +\epsilon$ under ellipsoidal restrictions on the parameter space and quadratic loss function. We confine ourselves to estimators that are linear in the response vector y  . The minimax estimators of the regression coefficient β$\beta$ are derived under homogeneous condition and heterogeneous condition, respectively. Furthermore, these obtained estimators are the ridge-type estimators and mean dispersion error (MDE) superior to the best linear unbiased estimator b=(X^′W^-1X)^-1X^′W^-1y$b=(X^{\prime }{W}^{-1}X{)}^{-1}{X}^{\prime }{W}^{-1}y$ under some conditions.     

Two kinds of restricted modified estimators in linear regression model

In this paper, we introduce two kinds of new restricted estimators called restricted modified Liu estimator and restricted modified ridge estimator based on prior information for the vector of parameters in a linear regression model with linear restrictions. Furthermore, the performance of the proposed estimators in mean squares error matrix sense is derived and compared. Finally, a numerical example and a Monte Carlo simulation are given to illustrate some of the theoretical results.     

Numerical treatment of restricted gauss-markov model 1

The singular value decomposition (SVD) has been widely used in the ordinary linear model and other statistical problems. In this paper, we shall introduce the generalized singular value decomposition (GSVD) of any two matrices X and H having the same number of columns to moti-vate the numerical treatment of large scale restricted Gauss-Markov model (y,XβHβ = r,σ²1), a situation to reveal the relationship (or restriction) existing among the parameters of the model. Many approaches to restricted linear model are already available. Those approaches apply the generalized inverse of matrices and emphasize the the-oretical solution of the problem rather than the development of efficient and numerical stable algorithm for the computation of estimators. The possible merit of the method present here might lie in the facts that they directly lead to an efficient, numerically stable and easily programmed algorithm for     

On f-tests and linear hypothesis in a general linear model

A simple method of setting linear hypotheses testable by F-tests in a general linear model when the covariance matrix has a general form and is completely unknown, is provided. With some additional conditions imposed on the covariance matrix, there exist the UMP invariant tests of certain linear hypotheses. We derive them to compare the powers with those of F-tests obtained under no restrictions on the covariance matrix. The results are illustrated in a multiple regression model with some examples.     

The relative efficiency of the restricted estimators in linear regression models

This paper deals with the problem of multicollinearity in a multiple linear regression model with linear equality restrictions. The restricted two parameter estimator which was proposed in case of multicollinearity satisfies the restrictions. The performance of the restricted two parameter estimator over the restricted least squares (RLS) estimator and the ordinary least squares (OLS) estimator is examined under the mean square error (MSE) matrix criterion when the restrictions are correct and not correct. The necessary and sufficient conditions for the restricted ridge regression, restricted Liu and restricted shrunken estimators, which are the special cases of the restricted two parameter estimator, to have a smaller MSE matrix than the RLS and the OLS estimators are derived when the restrictions hold true and do not hold true. Theoretical results are illustrated with numerical examples based on Webster, Gunst and Mason data and Gorman and Toman data. We conduct a final demonstration of the performance of the estimators by running a Monte Carlo simulation which shows that when the variance of the error term and the correlation between the explanatory variables are large, the restricted two parameter estimator performs better than the RLS estimator and the OLS estimator under the configurations examined.     

Recursive improvement of estimates in a Gauss-Markov model with linear restrictions

The minimum-dispersion linear unbiased estimator of a set of estimable functions in a general Gauss-Markov model with double linear restrictions is considered. The attention is focused on developing a recursive formula in which an initial estimator, obtained from the unrestricted model, is corrected with respect to the restrictions successively incorporated into the model. The established formula generalizes known results developed for the simple Gauss-Markov model.     

Computations of predictors/estimators under a linear random-effects model with parameter restrictions

This paper considers the problem of simultaneously predicting/estimating unknown parameter spaces in a linear random-effects model with both parameter restrictions and missing observations. We shall establish explicit formulas for calculating the best linear unbiased predictors (BLUPs) of all unknown parameters in such a model, and derive a variety of mathematical and statistical properties of the BLUPs under general assumptions. We also discuss some matrix expressions related to the covariance matrix of the BLUP, and present various necessary and sufficient conditions for several equalities and inequalities of the covariance matrix of the BLUP to hold.     

On additive and block decompositions of WLSEs under a multiple partitioned regression model

While considering the mechanism of weighted least-squares estimators (WLSEs) of regression coefficients in a partitioned linear model, Tian and Takane [On sum decompositions of weighted least-squares estimators under the partitioned linear model, Comm. Statist. Theory Methods 37 (2008), pp. 55–69] gave some identifying conditions for the WLSEs to be the sum of WLSEs under its two small models based on orthogonality of regressors with respect to the given weight matrix. The purpose of this paper is to show how to establish additive and block decompositions of WLSEs under a multiple partitioned linear model and its k small models based on orthogonality of regressors with respect to a given weight matrix.     

Estimation of a linear model under microaggregation by individual ranking

Summary Microaggregation by individual ranking is one of themost commonly applied disclosure control techniques for continuous microdata. The paper studies the effect of microaggregation by individual ranking on the least squares estimation of a multiple linear regression model. It is shown that the traditional least squares estimates are asymptotically unbiased. Moreover, the least squares estimates asymptotically have the same variances as the least squares estimates based on the original (non-aggregated) data. Thus, asymptotically, microaggregation by individual ranking does not result in a loss of efficiency in the least squares estimation of a multiple linear regression model. I thank Hans Schneeweiss for very helpful discussions and comments. Financial support from the Deutsche Forschungsgemeinschaft (German Science Foundation) is gratefully acknowledged.     

The bivariate linear model: a geometris approach

The geometric approach to the general linear model is in accessible to the majorityof statistics students be cause the computations require matrix algebra.This article presents the geometric approach for the special case of the bivariate linear model,for which the only tool require dis the in ner product.The geometric approach is introduced by showing the dual2-dimensional and5-dimensional representations of several bivariate samples x of size5.The assumptions of the bivariate model are stated geometrically,and the distributions of the regression coefficient sare derived.Theanalysis of variance(ANOVA)right triangle is pictured and the sides of the triang leare associated with their corresponding entries in the ANOVA table.     

Identification of the variance components in the general two-variance linear model

Bayesian analyses frequently employ two-stage hierarchical models involving two-variance parameters: one controlling measurement error and the other controlling the degree of smoothing implied by the model's higher level. These analyses can be hampered by poorly identified variances which may lead to difficulty in computing and in choosing reference priors for these parameters. In this paper, we introduce the class of two-variance hierarchical linear models and characterize the aspects of these models that lead to well-identified or poorly identified variances. These ideas are illustrated with a spatial analysis of a periodontal data set and examined in some generality for specific two-variance models including the conditionally autoregressive (CAR) and one-way random effect models. We also connect this theory with other constrained regression methods and suggest a diagnostic that can be used to search for missing spatially varying fixed effects in the CAR model.