Characterizing Relationships Between Estimations Under a General Linear Model with Explicit and Implicit Restrictions by Rank of Matrix

In the investigation of the restricted linear model ? _r  = {y, X β | A β = b, σ² Σ}, the parameter constraints A β = b are often handled by transforming the model into certain implicitly restricted model. Any estimation derived from the explicitly and implicitly restricted models on the vector β and its functions should be equivalent, although the expressions of the estimation under the two models may be different. However, people more likely want to directly compare different expressions of estimations and yield a conclusion on their equivalence by using some algebraic operations on expressions of estimations. In this article, we give some results on equivalence of the well-known OLSEs and BLUEs under the explicitly and implicitly restricted linear models by using some expansion formulas for ranks of matrices.     

Characterization of Admissible Linear Estimators in Multivariate Linear Model with Respect to Inequality Constraints under Matrix Loss Function

In this article, we study the characterization of admissible linear estimators in a multivariate linear model with inequality constraint, under a matrix loss function. In the homogeneous class, we present several equivalent, necessary and sufficient conditions for a linear estimator of estimable functions to be admissible. In the inhomogeneous class, we find that the necessary and sufficient conditions depend on the rank of the matrix in the constraint. When the rank is greater than one, the necessary and sufficient conditions are obtained. When the rank is equal to one, we have necessary conditions and sufficient conditions separately. We also obtain the necessary and sufficient conditions for a linear estimator of inestimable function to be admissible in both classes.     

Comparing the BLUEs Under Two Linear Models

In this article, we consider two linear models, ?₁ = {y, X β, V ₁} and ?₂ = {y, X β, V ₂}, which differ only in their covariance matrices. Our main focus lies on the difference of the best linear unbiased estimators, BLUEs, of X β under these models. The corresponding problems between the models {y, X β, I _n } and {y, X β, V}, i.e., between the OLSE (ordinary least squares estimator) and BLUE, are pretty well studied. Our purpose is to review the corresponding considerations between the BLUEs of X β under ?₁ and ?₂. This article is an expository one presenting also new results.     

Influence Measures Based on Cressie-Read Divergence Measures in Multivariate Linear Model

We define a new family of influence measures based on the divergence measures, in the multivariate general linear model. Influence measures are obtained by quantifying the divergence between the sample distribution of an estimate obtained with all the observations and the sample distribution of the same estimate obtained without any observation. This approach is applied to best linear unbiased estimates of estimable functions. Therefore, these diagnostics can be applied to every statistical multivariate technique that can be formulated like this kind of model. Some examples are considered to clarify the applicability of the introduced diagnostics.     

Predictions and estimations under a group of linear models with random coefficients

This article investigates the problem of establishing best linear unbiased predictors and best linear unbiased estimators of all unknown parameters in a group of linear models with random coefficients and correlated covariance matrix. We shall derive a variety of fundamental statistical properties of the predictors and estimators by using some matrix analysis tools. In particular, we shall establish necessary and sufficient conditions for the predictors and estimators to be equivalent under single and combined equations in the group of models by using the method of matrix equations, matrix rank formulas, and partitioned matrix calculations.     

Computations of predictors/estimators under a linear random-effects model with parameter restrictions

This paper considers the problem of simultaneously predicting/estimating unknown parameter spaces in a linear random-effects model with both parameter restrictions and missing observations. We shall establish explicit formulas for calculating the best linear unbiased predictors (BLUPs) of all unknown parameters in such a model, and derive a variety of mathematical and statistical properties of the BLUPs under general assumptions. We also discuss some matrix expressions related to the covariance matrix of the BLUP, and present various necessary and sufficient conditions for several equalities and inequalities of the covariance matrix of the BLUP to hold.     

On the natural restrictions in the singular Gauss–Markov model

A Gauss–Markov model is said to be singular if the covariance matrix of the observable random vector in the model is singular. In such a case, there exist some natural restrictions associated with the observable random vector and the unknown parameter vector in the model. In this paper, we derive through the matrix rank method a necessary and sufficient condition for a vector of parametric functions to be estimable, and necessary and sufficient conditions for a linear estimator to be unbiased in the singular Gauss–Markov model. In addition, we give some necessary and sufficient conditions for the ordinary least-square estimator (OLSE) and the best linear unbiased estimator (BLUE) under the model to satisfy the natural restrictions.      

Minimax Empirical Bayes Estimators in Multivariate Mixed Linear Models with Unequal Replications

Predictive influence of explanatory variables has been studied in both univariate and multivariate distributions. In the Bayesian approach, the same problem is considered in absence of multicollinearity in the dataset. The aim of this article is to study the same in the presence of perfect multicollinearity. To do this, we first derived the predictive distributions for full model and reduced model using vague prior density. Then the discrepancies between these predictive distributions are measured by the Kullback–Leibler (K–L) directed measure of divergence to assess the influence of deleted explanatory variables. Finally, distribution of the discrepancies is derived and the test procedure is performed.     

带线性约束的多元线性回归模型参数估计

本文首先构造线性约束条件下的多元线性回归模型的样本似然函数,利用Lagrange法证明其合理性。其次,从似然函数的角度讨论线性约束条件对模型参数的影响,对由传统理论得出的参数估计作出贝叶斯与经验贝叶斯的改进。做贝叶斯改进时,将矩阵正态-Wishart分布作为模型参数和精度阵的联合共轭先验分布,结合构造的似然函数得出参数的后验分布,计算出参数的贝叶斯估计;做经验贝叶斯改进时,将样本分组,从方差的角度讨论由子样得出的参数估计对总样本的参数估计的影响,计算出经验贝叶斯估计。最后,利用Matlab软件生成的随机矩阵做模拟。结果表明,这两种改进后的参数估计均较由传统理论得出的参数估计更精确,拟合结果的误差比更小,可信度更高,在大数据的情况下,这种计算方法的速度更快。     

Weighted Estimator for the Linear Transformation Models with Multivariate Failure Time Data

In this article, a simple and efficient weighted method is proposed to improve the estimation efficiency for the linear transformation models with multivariate failure time data. Asymptotic properties of the estimators with a closed-form variance-covariance matrix are established. In addition, a goodness-of-fit test is developed to evaluate the adequacy of the model. The performance of proposed method and the comparison on the efficiency between the proposed method and the working independence method (Lu, 2005) are conducted in finite-sample situation by simulation studies. Finally a real data set from the Busselton Population Health Surveys is illustrated to validate the proposed methodology. The related proofs of the theorems are given in the Appendix.     

Joint Mean-Covariance Models with Applications to Longitudinal Data in Partially Linear Model

Semiparametric regression models and estimating covariance functions are very useful in longitudinal study. Unfortunately, challenges arise in estimating the covariance function of longitudinal data collected at irregular time points. In this article, for mean term, a partially linear model is introduced and for covariance structure, a modified Cholesky decomposition approach is proposed to heed the positive-definiteness constraint. We estimate the regression function by using the local linear technique and propose quasi-likelihood estimating equations for both the mean and covariance structures. Moreover, asymptotic normality of the resulting estimators is established. Finally, simulation study and real data analysis are used to illustrate the proposed approach.     

Tuning Parameter Selector for the Penalized Likelihood Method in Multivariate Generalized Linear Models

Variable selection is fundamental to high-dimensional multivariate generalized linear models. The smoothly clipped absolute deviation (SCAD) method can solve the problem of variable selection and estimation. The choice of the tuning parameter in the SCAD method is critical, which controls the complexity of the selected model. This article proposes a criterion to select the tuning parameter for the SCAD method in multivariate generalized linear models, which is shown to be able to identify the true model consistently. Simulation studies are conducted to support theoretical findings, and two real data analysis are given to illustrate the proposed method.     

Admissibility of Linear Predictors in the Superpopulation Model with Respect to Inequality Constraints under Matrix Loss Function

Admissibility of linear predictors for the linear quantity Qy is investigated in a superpopulation model with respect to some inequality constraints. Necessary and sufficient conditions for a linear predictor to be admissible in the class of homogeneous linear predictors and the class of inhomogeneous linear predictors are obtained, respectively, under matrix loss function.     

Parametric Estimator of Linear Model with Interval-Censored Data

In this article, we consider the estimation of regression parameters in linear model in the presence of interval-censored data. When the response variable is interval-censored, the traditional methods can not be used to estimate the parameters directly. In this article, unbiased transformation is carried out and a new random variable which has the same expectation as the function of the response variable is established. With the regression analysis for the constructed statistic we conclude the estimator by least square method.     

Multivariate Linear Regression Model with Elliptically Contoured Distributed Errors and Monotone Missing Dependent Variables

In this article, the multivariate linear regression model is studied under the assumptions that the error term of this model is described by the elliptically contoured distribution and the observations on the response variables are of a monotone missing pattern. It is primarily concerned with estimation of the model parameters, as well as with the development of the likelihood ratio test in order to examine the existence of linear constraints on the regression coefficients. An illustrative example is presented for the explanation of the results.     

Nonparametric Estimation of the Multivariate Distribution Function in a Censored Regression Model with Applications

In a regression model with univariate censored responses, a new estimator of the joint distribution function of the covariates and response is proposed, under the assumption that the response and the censoring variable are independent conditionally to the covariates. This estimator is based on the conditional Kaplan–Meier estimator of Beran (1981 Beran , R. ( 1981 ). Nonparametric regression with randomly censored survival data. Technical Report, University of California, Berkeley, California . [Google Scholar]), and happens to be an extension of the multivariate empirical distribution function used in the uncensored case. We derive asymptotic i.i.d. representations for the integrals with respect to the measure defined by this estimated distribution function. These representations hold even in the case where the covariates are multidimensional under some additional assumption on the censoring. Applications to censored regression and to density estimation are considered.     

A Test for Multivariate Analysis of Variance in High Dimension

In this article, we consider the problem of testing a general multivariate linear hypothesis in a multivariate linear model when the N × p observation matrix is normally distributed with unknown covariance matrix, and N ≤ p. This includes the case of testing the equality of several mean vectors. A test is proposed which is a generalized version of the two-sample test proposed by Srivastava and Du (2008 Srivastava , M. S. , Du , M. ( 2008 ). A test for the mean vector with fewer observations than the dimension . J. Multivariate Anal. 99 : 386 – 402 .[Crossref], [Web of Science ®] , [Google Scholar]). The asymptotic null and nonnull distributions are obtained. The performance of this test is compared, theoretically as well as numerically, with the corresponding generalized version of the two-sample Dempster (1958 Dempster , A. P. (1958). A high dimensional two sample significance test. Ann. Math. Statist. 29:995–1010.[Crossref] , [Google Scholar]) test, or more appropriately Bai and Saranadasa (1996 Bai , Z. , Saranadasa , H. ( 1996 ). Effect of high dimension: an example of a two sample problem . Statistica Sinica 6 : 311 – 329 .[Web of Science ®] , [Google Scholar]) test who gave its asymptotic version.