A clustering approach to interpretable principal components

A new method for constructing interpretable principal components is proposed. The method first clusters the variables, and then interpretable (sparse) components are constructed from the correlation matrices of the clustered variables. For the first step of the method, a new weighted-variances method for clustering variables is proposed. It reflects the nature of the problem that the interpretable components should maximize the explained variance and thus provide sparse dimension reduction. An important feature of the new clustering procedure is that the optimal number of clusters (and components) can be determined in a non-subjective manner. The new method is illustrated using well-known simulated and real data sets. It clearly outperforms many existing methods for sparse principal component analysis in terms of both explained variance and sparseness.     

Exploratory factor and principal component analyses: some new aspects

Exploratory Factor Analysis (EFA) and Principal Component Analysis (PCA) are popular techniques for simplifying the presentation of, and investigating the structure of, an (n×p) data matrix. However, these fundamentally different techniques are frequently confused, and the differences between them are obscured, because they give similar results in some practical cases. We therefore investigate conditions under which they are expected to be close to each other, by considering EFA as a matrix decomposition so that it can be directly compared with the data matrix decomposition underlying PCA. Correspondingly, we propose an extended version of PCA, called the EFA-like PCA, which mimics the EFA matrix decomposition in the sense that they contain the same unknowns. We provide iterative algorithms for estimating the EFA-like PCA parameters, and derive conditions that have to be satisfied for the two techniques to give similar results. Throughout, we consider separately the cases n>p and p≥n. All derived algorithms and matrix conditions are illustrated on two data sets, one for each of these two cases.     

Maximum likelihood estimation of the bimodal failure rate for censored and tied observations

DIMITROV, RACHEV and YAKOVLEV ( 1985 ) have obtained the isotonic maximum likelihood estimator for the bimodal failure rate function. The authors considered only the complete failure time data. The generalization of this estimator for the case of censored and tied observations is now proposed.     

On a statistic useful in dimensionality reduction in multivariable linear stochastic system

In this paper we study the sampling properties of a test statistic which has important applications in the area of linear stochastic control systems with multi-inputs and multi-outputs. The statistic is the ratio of a partial sum of the eigenvalues of a sample covariance matrix and its trace. It turns out that using a method due to Sugiura we may derive a useful approximation for its distribution up to and including terms of order l/n, where n denotes the appropriate size. Numerical illustrations using real data are given.     

Combining Economic Forecasts

A method for combining forecasts may or may not account for dependence and differing precision among forecasts. In this article we test a variety of such methods in the context of combining forecasts of GNP from four major econometric models. The methods include one in which forecasting errors are jointly normally distributed and several variants of this model as well as some simpler procedures and a Bayesian approach with a prior distribution based on exchangeability of forecasters. The results indicate that a simple average, the normal model with an independence assumption, and the Bayesian model perform better than the other approaches that are studied here.     

Normalized Quadratic Systems of Consumer Demand Functions

Empirically estimated demand systems frequently fail to satisfy the appropriate theoretical curvature conditions. We propose and estimate two demand systems for which these conditions can be imposed globally; the first is derived from a normalized quadratic reciprocal indirect utility function and the second is derived from a normalized quadratic expenditure function. The former is flexible if there are no restrictions on its free parameters, but loses flexibility if the curvature conditions need to be imposed. The latter is flexible, in the class of functions satisfying local money metric scaling, even if the curvature conditions need to be imposed.     

The Quantitative Significance of the Lucas Critique

Doan, Litterman, and Sims (DLS) have suggested using conditional forecasts to do policy analysis with Bayesian vector autoregression (BVAR) models. Their method seems to violate the Lucas critique, which implies that coefficients of a BVAR model will change when there is a change in policy rules. In this article, we attempt to determine whether the Lucas critique is important quantitatively in a BVAR macro model that we construct. We find evidence following two candidate policy rule changes of significant coefficient instability and of a deterioration in the performance of the DLS method.