Local regression for vector responses

We explore a class of vector smoothers based on local polynomial regression for fitting nonparametric regression models which have a vector response. The asymptotic bias and variance for the class of estimators are derived for two different ways of representing the variance matrices within both a seemingly unrelated regression and a vector measurement error framework. We show that the asymptotic behaviour of the estimators is different in these four cases. In addition, the placement of the kernel weights in weighted least squares estimators is very important in the seeming unrelated regressions problem (to ensure that the estimator is asymptotically unbiased) but not in the vector measurement error model. It is shown that the component estimators are asymptotically uncorrelated in the seemingly unrelated regressions model but asymptotically correlated in the vector measurement error model. These new and interesting results extend our understanding of the problem of smoothing dependent data.     

The existence of the mean of the estimator in seemingly unrelated regressions

The purpose of this note is to spell out the conditions for the existence of the mean of the coefficient; estimator in seemingly unrelated regressions.     

Estimation of Seemingly Unrelated Tobit Regressions via the EM Algorithm

An expectation-maximum (EM) likelihood algorithm is used to estimate two seemingly unrelated Tobit regressions in which the dependent variables are truncated normal. An illustrative example on the determination of the life-health insurance and pension benefits is also given.     

An Application of Matrix Power Series to Linear Models

In the system of two seemingly unrelated regressions, employing a matrix power series, we show that the two-stage estimator is better than the ordinary least square estimator (OLSE) in terms of the mean square error matrix (MSEM) criterion. The result enriches the existing literature and can be applied to many fields of applications related to economics and statistics.     

Seemingly unrelated reduced-rank regression model

Reduced-rank regression models proposed by Anderson [1951. Estimating linear restrictions on regression coefficients for multivariate normal distributions. Ann. Math. Statist. 22, 327–351] have been used in various applications in social and natural sciences. In this paper we combine the features of these models with another popular, seemingly unrelated regression model proposed by Zellner [1962. An efficient method of estimating seemingly unrelated regressions and tests for aggregation bias. J. Amer. Statist. Assoc. 57, 348–368]. In addition to estimation and inference aspects of the new model, we also discuss an application in the area of marketing.     

Bootstrapping estimators for the seemingly unrelated regressions model

In this paper we consider the possibility of using the bootstrap to estimate the finite sample variability of feasible generalized least squares and improved estimators applied to the seemingly unrelated regressions model. The improved estimators we employ include members of the Stein-rule family and a hierarchical Bayes estimator proposed by Blattberg and George (1991). Simulation experiments are carried out using several SUR examples as well as a very large example based on the price-promotion model, and data, from marketing research.     

Bayesian prediction for small areas using sur models

Sample surveys are usually designed and analyzed to produce estimates for larger areas and/or populations. Nevertheless, sample sizes are often not large enough to give adequate precision for small area estimates of interest. To circumvent such difficulties, borrowing strength from related small areas via modeling becomes essential. In line with this, we propose a hierarchical multivariate Bayes prediction method for small area estimation based on the seemingly unrelated regressions (SUR) model. The performance of the proposed method was evaluated through simulation studies.     

Seemingly unrelated regression on the autoregressive (Ar(p)) singular equation system

This paper studies the estimation of seemingly unrelated regressions (SUR) of singular equation systems with an autoregressive error process (AR(p)) for each equation.Parameter estimates of the autoregressive singular equation system are not generally invariant to the equation deleted. Under the model specification restriction on the autoregressive parameters, the invariance property is preserved, and this paper shows that a single equation generalized least squares (GLS) estimation for a general autoregressive error process is equivalent to the SURGLS estimation of the AR(p) singular equation system.     

Seemingly unrelated regressions with covariance matrix of cross-equation ridge regression residuals

Generalized least squares estimation of a system of seemingly unrelated regressions is usually a two-stage method: (1) estimation of cross-equation covariance matrix from ordinary least squares residuals for transforming data, and (2) application of least squares on transformed data. In presence of multicollinearity problem, conventionally ridge regression is applied at stage 2. We investigate the usage of ridge residuals at stage 1, and show analytically that the covariance matrix based on the least squares residuals does not always result in more efficient estimator. A simulation study and an application to a system of firms' gross investment support our finding.     

Covariance matrix estimation in a seemingly unrelated regression model under Stein’s loss

Statistical Methods & Applications - A seemingly unrelated regression model has been commonly used for describing a set of different regression models with correlations. This paper discusses...     

Some overall properties of seemingly unrelated regression models

Seemingly unrelated regression models are extensions of linear regression models which allow correlated errors between equations. Estimations and inferences of singular seemingly unrelated regression models involve some complicated operations of the given matrices in the models and their generalized inverses. In this study, we characterize the consistency, natural restrictions, estimability of parametric functions under a singular seemingly unrelated regression model using the matrix rank method. We also derive necessary and sufficient conditions for the ordinary least squares estimators and the best linear unbiased estimators of parametric functions to be equal under seemingly unrelated regression models.     

Seemingly unrelated systems of econometric equations

A generalization of Zellner's SUR model is derived for sets of seemingly unrelated systems of econometric equations. The resulting structural form – worked out for a set of Cowles Commission-type simultaneous equations systems – is general enough to include any SUR-type or panel-type specification of systems of econometric equations with contemporaneously correlated errors. Maximum estimation efficiency is obtained by treating all the individual subsystems at once rather than in a subsystem-by-subsystem fashion.     

Useful matrix transformations for panel data analysis: a survey

This paper surveys some useful matrix transformations which simplify the derivation of GLS as WLS in an error component model. This is particularly important for large panel data applications where brute force inversion of large data matrices may not be feasible. This WLS transformation is known in the literature as the Fuller and Baltese (1974) transformation and its extension to error component models with heteroscedasticity, serial correlation, unbalancedness as well as a set of seemingly unrelated regressions are considered.     

The Equivalence of Parameter Estimates from Growth Curve Models and Seemingly Unrelated Regression Models

Seemingly unrelated regression models and growth curve models are examples of multivariate models that require special estimation techniques. Parameters in seemingly unrelated regression models can be estimated by using two-stage Aitken estimation based on unrestricted residuals; parameters in growth curve models can be estimated by using a Potthoff-Roy (1964) transformation based on an estimate of the dispersion. With proper choice of the seemingly unrelated regression model, the two multivariate models and corresponding parameter estimates are shown to be equivalent. Recognition of the equivalence simplifies the presentation of these more complicated multivariate models. The connection is also of interest for more flexible growth curve models.     

Seemingly unrelated regression tree

Nonparametric seemingly unrelated regression provides a powerful alternative to parametric seemingly unrelated regression for relaxing the linearity assumption. The existing methods are limited, particularly with sharp changes in the relationship between the predictor variables and the corresponding response variable. We propose a new nonparametric method for seemingly unrelated regression, which adopts a tree-structured regression framework, has satisfiable prediction accuracy and interpretability, no restriction on the inclusion of categorical variables, and is less vulnerable to the curse of dimensionality. Moreover, an important feature is constructing a unified tree-structured model for multivariate data, even though the predictor variables corresponding to the response variable are entirely different. This unified model can offer revelatory insights such as underlying economic meaning. We propose the key factors of tree-structured regression, which are an impurity function detecting complex nonlinear relationships between the predictor variables and the response variable, split rule selection with negligible selection bias, and tree size determination solving underfitting and overfitting problems. We demonstrate our proposed method using simulated data and illustrate it using data from the Korea stock exchange sector indices.     

Estimating large-scale general linear and seemingly unrelated regressions models after deleting observations

A new numerical method to solve the downdating problem (and variants thereof), namely removing the effect of some observations from the generalized least squares (GLS) estimator of the general linear model (GLM) after it has been estimated, is extensively investigated. It is verified that the solution of the downdated least squares problem can be obtained from the estimation of an equivalent GLM, where the original model is updated with the imaginary deleted observations. This updated GLM has a non positive definite dispersion matrix which comprises complex covariance values and it is proved herein to yield the same normal equations as the downdated model. Additionally, the problem of deleting observations from the seemingly unrelated regressions model is addressed, demonstrating the direct applicability of this method to other multivariate linear models. The algorithms which implement the novel downdating method utilize efficiently the previous computations from the estimation of the original model. As a result, the computational cost is significantly reduced. This shows the great usability potential of the downdating method in computationally intensive problems. The downdating algorithms have been applied to real and synthetic data to illustrate their efficiency.     

Lattice conditional independence models for seemingly unrelated regressions

Seemingly unrelated regressions (SUR) models appear frequently in econometrics and in the analyses of repeated measures designs and longitudinal data. It is known that iterative algorithms are generally required to obtain the MLEs of the regression parameters. Under a minimal set of lattice conditional independence (LCI) restrictions imposed on the covariance structure, however, closed-form MLEs can be obtained by standard linear regression techniques (Andersson and Perlman, 1993, 1994, 1998). In this paper, simulation is used to study the efficiency of these LCI model-based estimators. We also propose two possible improvements of the usual two-stage estimators for the regression parameters.     

SEPARATE VERSUS SYSTEM METHODS OF STEIN-RULE ESTIMATION IN SEEMINGLY UNRELATED REGRESSION MODELS

ABSTRACT

Despite the sizeable literature associated with the seemingly unrelated regression models, not much is known about the use of Stein-rule estimators in these models. This gap is remedied in this paper, in which two families of Stein-rule estimators in seemingly unrelated regression equations are presented and their large sample asymptotic properties explored and evaluated. One family of estimators uses a shrinkage factor obtained solely from the equation under study while the other has a shrinkage factor based on all the equations of the model. Using a quadratic loss measure and Monte-Carlo sampling experiments, the finite sample risk performance of these estimators is also evaluated and compared with the traditional feasible generalized least squares estimator.     

Multiple-population shrinkage estimation via sliced inverse regression

The problem of dimension reduction in multiple regressions is investigated in this paper, in which data are from several populations that share the same variables. Assuming that the set of relevant predictors is the same across the regressions, a joint estimation and selection method is proposed, aiming to preserve the common structure, while allowing for population-specific characteristics. The new approach is based upon the relationship between sliced inverse regression and multiple linear regression, and is achieved through the lasso shrinkage penalty. A fast alternating algorithm is developed to solve the corresponding optimization problem. The performance of the proposed method is illustrated through simulated and real data examples.