A generalized least squares estimation method for VARMA models

In this paper a new generalized least squares procedure for estimating VARMA models is proposed. This method differs from existing ones in explicitly considering the stochastic structure of the approximation error that arises when lagged innovations are replaced with lagged residuals obtained from a long VAR. Simulation results indicate that this method performs better than the Double Regression method and similar to Mauricio's (1995) exact maximum likelihood estimation procedure.     

Asymptotic linearity of serial and nonserial multivariate signed rank statistics

Asymptotic linearity plays a key role in estimation and testing in the presence of nuisance parameters. This property is established, in the very general context of a multivariate general linear model with elliptical VARMA errors, for the serial and nonserial multivariate rank statistics considered in Hallin and Paindaveine (Ann. Statist. 30 (2002a) 1103; Bernoulli 8 (2002b) 787 Ann. Statist. 32 (2004), to appear) and Oja and Paindaveine (J. Statist. Plann. Inference (2004), to appear). These statistics, which are multivariate versions of classical signed rank statistics, involve (i) multivariate signs based either on (pseudo-)Mahalanobis residuals, or on a modified version (absolute interdirections) of Randles's interdirections, and (ii) a concept of ranks based either on (pseudo-)Mahalanobis distances or on lift-interdirections.     

Two Canonical VARMA Forms: Scalar Component Models Vis-à-Vis the Echelon Form

In this article we study two methodologies which identify and specify canonical form VARMA models. The two methodologies are: (1) an extension of the scalar component methodology which specifies canonical VARMA models by identifying scalar components through canonical correlations analysis; and (2) the Echelon form methodology, which specifies canonical VARMA models through the estimation of Kronecker indices. We compare the actual forms and the methodologies on three levels. Firstly, we present a theoretical comparison. Secondly, we present a Monte Carlo simulation study that compares the performances of the two methodologies in identifying some pre-specified data generating processes. Lastly, we compare the out-of-sample forecast performance of the two forms when models are fitted to real macroeconomic data.     

Spectral representation and autocovariance structure of Markov switching DSGE models

Abstract

We investigate the L²-structure of Markov switching Dynamic Stochastic General Equilibrium (MS DSGE) models and derive conditions for strict and second-order stationarity. Then we determine the autocovariance function of the process driven by a stationary MS DSGE model and give a stable VARMA representation of it. It turns out that the autocovariance structure of the process coincides with that of a standard VARMA. Finally, we propose a method to derive the spectral density in a matrix closed-form of MS DSGE models. Our results relate with the works of Francq and Zakoian, Krolzig, Zhang and Stine. Numerical and empirical illustrations complete the article.     

Linear bootstrap methods for vector autoregressive moving-average models

We provide the theoretical justification of bootstrapping stationary invertible echelon vector autoregressive moving-average (VARMA) models using linear methods. The asymptotic validity of the bootstrap is established with strong white noise under parametric and nonparametric assumptions. Our methods are practical and useful for building reliable simulation-based inference and forecasting without implementing nonlinear estimation techniques such as ML which is usually burdensome, time demanding or impractical, particularly in big or highly persistent systems. The relevance of our procedures is more pronounced in the context of dynamic simulation-based techniques such as maximized Monte Carlo (MMC) tests [see Dufour J-M. Monte Carlo tests with nuisance parameters: a general approach to finite-sample inference and nonstandard asymptotics in econometrics. J Econom. 2006;133(2):443–477 and Dufour J-M, Jouini T. Finite-sample simulation-based tests in VAR models with applications to Granger causality testing. J Econom. 2006;135(1–2):229–254 for the VAR case]. Simulation evidence shows that, compared with conventional asymptotics, our bootstrap methods have good finite-sample properties in approximating the actual distribution of the studentized echelon VARMA parameter estimates, and in providing echelon parameter confidence sets with satisfactory coverage.     

Growth mixture models in longitudinal research

Latent growth curve models as structural equation models are extensively discussed in various research fields (Curran and Muthén in Am. J. Community Psychol. 27:567–595, 1999; Duncan et al. in An introduction to latent variable growth curve modeling. Concepts, issues and applications, 2nd edn., Lawrence Earlbaum, Mahwah, 2006; Muthén and Muthén in Alcohol. Clin. Exp. Res. 24(6):882–891, 2000a; in J. Stud. Alcohol. 61:290–300, 2000b). Recent methodological and statistical extension are focused on the consideration of unobserved heterogeneity in empirical data. Muthén extended the classic structural equation approach by mixture components, i.e. categorical latent classes (Muthén in Marcouldies, G.A., Sckumacker, R.E. (eds.), New developments and techniques in structural equation modeling, pp. 1–33, Lawrance Erlbaum, Mahwah, 2001a; in Behaviometrika 29(1):81–117, 2002; in Kaplan, D. (ed.), The SAGE handbook of quantitative methodology for the social sciences, pp. 345–368, Sage, Thousand Oaks, 2004). The paper discusses applications of growth mixture models with data on delinquent behavior of adolescents from the German panel study Crime in the modern City (CrimoC) (Boers et al. in Eur. J. Criminol. 7:499–520, 2010; Reinecke in Delinquenzverläufe im Jugendalter: Empirische Überprüfung von Wachstums- und Mischverteilungsmodellen, Institut für sozialwissenschaftliche Forschung e.V., Münster, 2006a; in Methodology 2:100–112, 2006b; in van Montfort, K., Oud, J., Satorra, A. (eds.), Longitudinal models in the behavioral and related sciences, pp. 239–266, Lawrence Erlbaum, Mahwah, 2007). Observed as well as unobserved heterogeneity will be considered with growth mixture models. Special attention is given to the distribution of the outcome variables as counts. Poisson and negative binomial distributions with zero inflation are considered in the proposed growth mixture models variables. Different model specifications will be emphasized with respect to their particular parameterizations.     

Artificial neural networks for some macroeconomic series: A first report

There is a tendency for the true variability of feasible GLS estimators to be understated by asymptotic standard errors. For estimation of SUR models, this tendency becomes more severe in large equation systems when estimation of the error covariance matrix, C, becomes problematic. We explore a number of potential solutions involving the use of improved estimators for the disturbance covariance matrix and bootstrapping. In particular, Ullah and Racine (1992) have recently introduced a new class of estimators for SUR models that use nonparametric kernel density estimation techniques. The proposed estimators have the same structure as the feasible GLS estimator of Zellner (1962) differing only in the choice of estimator for C. Ullah and Racine (1992) prove that their nonparametric density estimator of C can be expressed as Zellner's original estimator plus a positive definite matrix that depends on the smoothing parameter chosen for the density estimation. It is this structure of the estimator that most interests us as it has the potential to be especially useful in large equation systems.

Atkinson and Wilson (1992) investigated the bias in the conventional and bootstrap estimators of coefficient standard errors in SUR models. They demonstrated that under certain conditions the former were superior, but they caution that neither estimator uniformly dominated and hence bootstrapping provides little improvement in the estimation of standard errors for the regression coefficients. Rilstone and Veal1 (1996) argue that an important qualification needs to be made to this somewhat negative conclusion. They demonstrated that bootstrapping can result in improvements in inferences if the procedures are applied to the t-ratios rather than to the standard errors. These issues are explored for the case of large equation systems and when bootstrapping is combined with improved covariance estimation.     

Multivariate time series prediction using a hybridization of VARMA models and Bayesian networks

In this paper, a new hybrid model of vector autoregressive moving average (VARMA) models and Bayesian networks is proposed to improve the forecasting performance of multivariate time series. In the proposed model, the VARMA model, which is a popular linear model in time series forecasting, is specified to capture the linear characteristics. Then the errors of the VARMA model are clustered into some trends by K-means algorithm with Krzanowski–Lai cluster validity index determining the number of trends, and a Bayesian network is built to learn the relationship between the data and the trend of its corresponding VARMA error. Finally, the estimated values of the VARMA model are compensated by the probabilities of their corresponding VARMA errors belonging to each trend, which are obtained from the Bayesian network. Compared with VARMA models, the experimental results with a simulation study and two multivariate real-world data sets indicate that the proposed model can effectively improve the prediction performance.     

Value-at-risk estimation by LS-SVR and FS-LS-SVR based on GAS model

ABSTRACT

Conditional risk measuring plays an important role in financial regulation and depends on volatility estimation. A new class of parameter models called Generalized Autoregressive Score (GAS) model has been successfully applied for different error's densities and for different problems of time series prediction in particular for volatility modeling and VaR estimation. To improve the estimating accuracy of the GAS model, this study proposed a semi-parametric method, LS-SVR and FS-LS-SVR applied to the GAS model to estimate the conditional VaR. In particular, we fit the GAS(1,1) model to the return series using three different distributions. Then, LS-SVR and FS-LS-SVR approximate the GAS(1,1) model. An empirical research was performed to illustrate the effectiveness of the proposed method. More precisely, the experimental results from four stock indexes returns suggest that using hybrid models, GAS-LS-SVR and GAS-FS-LS-SVR provides improved performances in the VaR estimation.     

A new diagnostic tool for VARMA(p,q) models

A new diagnostic method for VARMA(p,q) time series models is introduced. The procedure is based on a statistic that generalizes to a multivariate setting the properties of the usual univariate ARMA(p,q) residual correlations. A multiple version of the cumulative periodogram statistic is also suggested. Simulation studies and one real data application are presented.     

A note on the asymptotic and exact Fisher information matrices of a Markov switching VARMA process

Statistical Methods & Applications - We study the asymptotic and exact Fisher information (FI) matrices of Markov switching vector autoregressive moving average (MS VARMA) models. In a related...     

A predictive view of Bayesian clustering

This work considers probability models for partitions of a set of n elements using a predictive approach, i.e., models that are specified in terms of the conditional probability of either joining an already existing cluster or forming a new one. The inherent structure can be motivated by resorting to hierarchical models of either parametric or nonparametric nature. Parametric examples include the product partition models (PPMs) and the model-based approach of Dasgupta and Raftery (J. Amer. Statist. Assoc. 93 (1998) 294), while nonparametric alternatives include the Dirichlet process, and more generally, the species sampling models (SSMs). Under exchangeability, PPMs and SSMs induce the same type of partition structure. The methods are discussed in the context of outlier detection in normal linear regression models and of (univariate) density estimation.     

Inference for linear and nonlinear stable error processes via estimating functions

This paper describes an estimating function approach for parameter estimation in linear and nonlinear times series models with infinite variance stable errors. Joint estimates of location and scale parameters are derived for classes of autoregressive (AR) models and random coefficient autoregressive (RCA) models with stable errors, as well as for AR models with stable autoregressive conditionally heteroscedastic (ARCH) errors. Fast, on-line, recursive parametric estimation for the location parameter based on estimating functions is discussed using simulation studies. A real financial time series is also discussed in some detail.     

A tutorial on rank-based coefficient estimation for censored data in small- and large-scale problems

The analysis of survival endpoints subject to right-censoring is an important research area in statistics, particularly among econometricians and biostatisticians. The two most popular semiparametric models are the proportional hazards model and the accelerated failure time (AFT) model. Rank-based estimation in the AFT model is computationally challenging due to optimization of a non-smooth loss function. Previous work has shown that rank-based estimators may be written as solutions to linear programming (LP) problems. However, the size of the LP problem is O(n ²+p) subject to n ² linear constraints, where n denotes sample size and p denotes the dimension of parameters. As n and/or p increases, the feasibility of such solution in practice becomes questionable. Among data mining and statistical learning enthusiasts, there is interest in extending ordinary regression coefficient estimators for low-dimensions into high-dimensional data mining tools through regularization. Applying this recipe to rank-based coefficient estimators leads to formidable optimization problems which may be avoided through smooth approximations to non-smooth functions. We review smooth approximations and quasi-Newton methods for rank-based estimation in AFT models. The computational cost of our method is substantially smaller than the corresponding LP problem and can be applied to small- or large-scale problems similarly. The algorithm described here allows one to couple rank-based estimation for censored data with virtually any regularization and is exemplified through four case studies.     

The Dantzig Selector in Cox's Proportional Hazards Model

Abstract. The Dantzig selector (DS) is a recent approach of estimation in high‐dimensional linear regression models with a large number of explanatory variables and a relatively small number of observations. As in the least absolute shrinkage and selection operator (LASSO), this approach sets certain regression coefficients exactly to zero, thus performing variable selection. However, such a framework, contrary to the LASSO, has never been used in regression models for survival data with censoring. A key motivation of this article is to study the estimation problem for Cox's proportional hazards (PH) function regression models using a framework that extends the theory, the computational advantages and the optimal asymptotic rate properties of the DS to the class of Cox's PH under appropriate sparsity scenarios. We perform a detailed simulation study to compare our approach with other methods and illustrate it on a well‐known microarray gene expression data set for predicting survival from gene expressions.     

Large Bayesian VARs: A Flexible Kronecker Error Covariance Structure

ABSTRACT

We introduce a class of large Bayesian vector autoregressions (BVARs) that allows for non-Gaussian, heteroscedastic, and serially dependent innovations. To make estimation computationally tractable, we exploit a certain Kronecker structure of the likelihood implied by this class of models. We propose a unified approach for estimating these models using Markov chain Monte Carlo (MCMC) methods. In an application that involves 20 macroeconomic variables, we find that these BVARs with more flexible covariance structures outperform the standard variant with independent, homoscedastic Gaussian innovations in both in-sample model-fit and out-of-sample forecast performance.     

Testing parameter significance in instrumental variables probit estimators: some simulation

Binary choice models that contain endogenous regressors can now be estimated routinely using modern software. Each of the two packages, Stata 11 [Stata Statistical Software: Release 11, StataCorp LP, College Station, TX, 2009] and Limdep 9 [Econometric Software Inc., Plainview, NY, 2008], contains two estimators that can be used to estimate such a model. This paper compares the performance of maximum likelihood, Newey's Amemiya's generalized least-squares (AGLS) estimator, an instrumental variables plug-in estimator and others in samples of sizes 200 and 1000 using simulation. Specifically, this paper focuses on tests of parameter significance under various degrees of instrument strength and severity of endogeneity. Although the maximum-likelihood estimator performs well in large samples, there is some evidence that the more computationally robust AGLS estimator may perform better in smaller samples when instruments are weak. It also appears that instruments in endogenous probit estimation need to be even stronger than when used in linear instrumental variables (IV) estimation.     

Penalised spline estimation for generalised partially linear single-index models

Generalised linear models are frequently used in modeling the relationship of the response variable from the general exponential family with a set of predictor variables, where a linear combination of predictors is linked to the mean of the response variable. We propose a penalised spline (P-spline) estimation for generalised partially linear single-index models, which extend the generalised linear models to include nonlinear effect for some predictors. The proposed models can allow flexible dependence on some predictors while overcome the “curse of dimensionality”. We investigate the P-spline profile likelihood estimation using the readily available R package mgcv, leading to straightforward computation. Simulation studies are considered under various link functions. In addition, we examine different choices of smoothing parameters. Simulation results and real data applications show effectiveness of the proposed approach. Finally, some large sample properties are established.     

A Class of Markov Chain Models for Average Run Length Computations for Autocorrelated Processes

The average run length (ARL) of conventional control charts is typically computed assuming temporal independence. However, this assumption is frequently violated in practical applications. Alternative ARL computations have often been conducted via time consuming and yet not necessarily very accurate simulations. In this article, we develop a class of Markov chain models for evaluating the run length performance of traditional control charts for autocorrelated processes. We show extensions from the univariate AR(1) model to the general multivariate VARMA(p, q) time series. The results of the proposed method are highly comparable to those of simulations and with significantly less computational overhead.