Analyzing multiple vector autoregressions through matrix-variate normal distribution with two covariance matrices

Abstract

This article proposes a new approach to analyze multiple vector autoregressive (VAR) models that render us a newly constructed matrix autoregressive (MtAR) model based on a matrix-variate normal distribution with two covariance matrices. The MtAR is a generalization of VAR models where the two covariance matrices allow the extension of MtAR to a structural MtAR analysis. The proposed MtAR can also incorporate different lag orders across VAR systems that provide more flexibility to the model. The estimation results from a simulation study and an empirical study on macroeconomic application show favorable performance of our proposed models and method.     

A close look at the spatial structure implied by the CAR and SAR models

Modeling spatial interactions that arise in spatially referenced data is commonly done by incorporating the spatial dependence into the covariance structure either explicitly or implicitly via an autoregressive model. In the case of lattice (regional summary) data, two common autoregressive models used are the conditional autoregressive model (CAR) and the simultaneously autoregressive model (SAR). Both of these models produce spatial dependence in the covariance structure as a function of a neighbor matrix W and often a fixed unknown spatial correlation parameter. This paper examines in detail the correlation structures implied by these models as applied to an irregular lattice in an attempt to demonstrate their many counterintuitive or impractical results. A data example is used for illustration where US statewide average SAT verbal scores are modeled and examined for spatial structure using different spatial models.     

Bayesian inference in joint modelling of location and scale parameters of the t distribution for longitudinal data

This paper presents a fully Bayesian approach to multivariate t regression models whose mean vector and scale covariance matrix are modelled jointly for analyzing longitudinal data. The scale covariance structure is factorized in terms of unconstrained autoregressive and scale innovation parameters through a modified Cholesky decomposition. A computationally flexible data augmentation sampler coupled with the Metropolis-within-Gibbs scheme is developed for computing the posterior distributions of parameters. The Bayesian predictive inference for the future response vector is also investigated. The proposed methodologies are illustrated through a real example from a sleep dose–response study.     

A multivariate volatility vine copula model

This article proposes a dynamic framework for modeling and forecasting of realized covariance matrices using vine copulas to allow for more flexible dependencies between assets. Our model automatically guarantees positive definiteness of the forecast through the use of a Cholesky decomposition of the realized covariance matrix. We explicitly account for long-memory behavior by using fractionally integrated autoregressive moving average (ARFIMA) and heterogeneous autoregressive (HAR) models for the individual elements of the decomposition. Furthermore, our model incorporates non-Gaussian innovations and GARCH effects, accounting for volatility clustering and unconditional kurtosis. The dependence structure between assets is studied using vine copula constructions, which allow for nonlinearity and asymmetry without suffering from an inflexible tail behavior or symmetry restrictions as in conventional multivariate models. Further, the copulas have a direct impact on the point forecasts of the realized covariances matrices, due to being computed as a nonlinear transformation of the forecasts for the Cholesky matrix. Beside studying in-sample properties, we assess the usefulness of our method in a one-day-ahead forecasting framework, comparing recent types of models for the realized covariance matrix based on a model confidence set approach. Additionally, we find that in Value-at-Risk (VaR) forecasting, vine models require less capital requirements due to smoother and more accurate forecasts.     

Specification Test for Spatial Autoregressive Models

This article considers a simple test for the correct specification of linear spatial autoregressive models, assuming that the choice of the weight matrix W_n is true. We derive the limiting distributions of the test under the null hypothesis of correct specification and a sequence of local alternatives. We show that the test is free of nuisance parameters asymptotically under the null and prove the consistency of our test. To improve the finite sample performance of our test, we also propose a residual-based wild bootstrap and justify its asymptotic validity. We conduct a small set of Monte Carlo simulations to investigate the finite sample properties of our tests. Finally, we apply the test to two empirical datasets: the vote cast and the economic growth rate. We reject the linear spatial autoregressive model in the vote cast example but fail to reject it in the economic growth rate example. Supplementary materials for this article are available online.     

ESTIMATION OF FAMILIAL CORRELATIONS UNDER AUTOREGRESSIVE CIRCULAR COVARIANCE

Circular covariance matrices play an important role in modeling phenomena in numerous epidemiological, communications and physical contexts. In this article, we propose a parsimonious, autoregressive type of circular covariance structure for modeling correlations between the “siblings” of a “family”. This structure, similar to AR(1) structure used in time series models, involves only two parameters. We derive the maximum likelihood estimators of these parameters, and discuss testing of hypotheses about the autoregressive parameter. Estimation of “parent-sib” correlation, namely, the interclass correlation, is also considered. Estimation of the parameters when there are unequal numbers of siblings in different families is also discussed.     

Maximum likelihood estimation of a generalized star(p; 1p) model

Summary A STAR model is characterized by autoregressive terms lagged both in time and space. The model we call GSTAR presents also contemporaneous spatial correlation. Under the hypothesis of stationarity we derive conditional maximum likelihood estimators of the autoregressive parameters and a consistent estimator of their covariance matrix.     

A NOTE ON THE INVERSE COVARIANCE MATRIX OF THE AUTOREGRESSIVE PROCESS1

The inverse covariance matrix of an autoregressive process of arbitrary order is found explicitly using the notion of the information matrix for the vector random variable, not the parameters. Any process for which a simple conditional representation exists, can be treated in the same way. The approach has merit in the teaching of statistics.     

On the efficiency of regression analysis with AR(p) errors

In this paper we will consider a linear regression model with the sequence of error terms following an autoregressive stationary process. The statistical properties of the maximum likelihood and least squares estimators of the regression parameters will be summarized. Then, it will be proved that, for some typical cases of the design matrix, both methods produce asymptotically equivalent estimators. These estimators are also asymptotically efficient. Such cases include the most commonly used models to describe trend and seasonality like polynomial trends, dummy variables and trigonometric polynomials. Further, a very convenient asymptotic formula for the covariance matrix will be derived. It will be illustrated through a brief simulation study that, for the simple linear trend model, the result applies even for sample sizes as small as 20.     

OPTIMAL QUADRATIC UNBIASED ESTIMATION FOR MODELS WITH LINEAR TOEPLITZ COVARIANCE STRUCTURE

This paper deals with the problem of quadratic unbiased estimation for models with linear Toeplitz covariance structure. These serial covariance models are very useful to modelize time or spatial correlations by means of linear models. Optimality and local optimality is examined in different ways. For the nested Toeplitz models, it is shown that there does not exist a Uniformly Minimum Variance Quadratic Unbiased Estimator for at least one linear combination of covariance parameters. Moreover, empirical unbiased estimators are identified as Locally Minimum Variance Quadratic Unbiased Estimators for a particular choice on covariance parameters corresponding to the case where the covariance matrix of the observed random vector is proportional to the identity matrix. The complete Toeplitz-circulant model is also studied. For this model, the existence of a Uniformly Minimum Variance Quadratic Unbiased Estimator for each covariance parameter is proved.     

The Generalized Conditional Autoregressive Wishart Model for Multivariate Realized Volatility

It is well known that in finance variances and covariances of asset returns move together over time. Recently, much interest has been aroused by an approach involving the use of the realized covariance (RCOV) matrix constructed from high-frequency returns as the ex-post realization of the covariance matrix of low-frequency returns. For the analysis of dynamics of RCOV matrices, we propose the generalized conditional autoregressive Wishart (GCAW) model. Both the noncentrality matrix and scale matrix of the Wishart distribution are driven by the lagged values of RCOV matrices, and represent two different sources of dynamics, respectively. The GCAW is a generalization of the existing models, and accounts for symmetry and positive definiteness of RCOV matrices without imposing any parametric restriction. Some important properties such as conditional moments, unconditional moments, and stationarity are discussed. Empirical examples including sequences of daily RCOV matrices from the New York Stock Exchange illustrate that our model outperforms the existing models in terms of model fitting and forecasting.     

Forecasting realized volatility: A review

Forecast methods for realized volatilities are reviewed. Basic theoretical and empirical features of realized volatilities as well as versions of estimators of realized volatility are briefly investigated. Major forecast models featuring the empirical aspects of persistency and asymmetry are discussed in terms of forecasting models for which the heterogeneous autoregressive (HAR) model is one of the most basic one in the recent literature. Forecast methods addressing the issues of jump, break, implied volatility, and market microstructure noise are reviewed. Forecasting realized covariance matrix is also considered.     

正交多项式回归模型参数估计的格子设计及其最小二乘估计

对二元二次多项式回归模型进行预先正交化处理，提出使用因子空间的N等份的格子设计的观点，推导出了信息矩阵的一般性结构，并给出了该设计的非退化条件及其最小二乘估计和对应的协方差矩阵。     

Existence conditions of the uniformly minimum risk unbiased estimators in extended growth curve models

Necessary and sufficient existence conditions are derived for the uniformly minimum risk unbiased estimators of the parameters in extended growth curve models with the general covariance matrix or the uniform covariance structure or the serial covariance structure under convex losses and matrix losses, respectively.     

Bootstrap unit root test based on least absolute deviation estimation under dependence assumptions

In this paper, a bootstrap test based on the least absolute deviation (LAD) estimation for the unit root test in first-order autoregressive models with dependent residuals is considered. The convergence in probability of the bootstrap distribution function is established. Under the frame of dependence assumptions, the asymptotic behavior of the bootstrap LAD estimator is independent of the covariance matrix of the residuals, which automatically approximates the target distribution.     

FITTING SPATIAL CORRELATION MODELS: APPROXIMATING A LIKELIHOOD APPROXIMATION

The paper considers a class of spatial correlation models (stationary Gaussian processes) which includes (spatial) conditional autoregressive, simultaneous autoregressive, moving average and direct covariance models. Given observations on a finite rectangular lattice, a likelihood approximation for estimating the parameters in the spectral density of the model is discussed. The approximation consists of applying the trapezoidal rule, with a her grid of frequencies than the usual Fourier frequencies, to compute the integral in an appraximation due to Whittle (1954) and later modified by Guyon (1984). With this approximation, a Fisher scoring type algorithm has a simple form and in some casea reduces to iteratively reweighted least squares. Methods for computing the unbiased two-dimensional periodogram required by the method are presented and the accuracy of the approximation is discussed. The asymptotic distribution of the parameter estimates computed from the likelihood approximation is also given.     

Classification Rules under Autoregressive and General Circulant Covariance

We develop classification rules for data that have an autoregressive circulant covariance structure under the assumption of multivariate normality. We also develop classification rules assuming a general circulant covariance structure. The new classification rules are efficient in reducing the misclassification error rates when the number of observations is not large enough to estimate the unknown variance–covariance matrix. The proposed classification rules are demonstrated by simulation study for their validity and illustrated by a real data analysis for their use. Analyses of both simulated data and real data show the effectiveness of our new classification rules.     

Chaos: But Not in Both Directions!

This paper will informally explore the reversal of some stochastic autoregressive processes, which lead to deterministically chaotic processes. Correspondingly, the stochastic reversal of map models is shown to lead to a new class of invariant distribution. Finally, some connections between congruential recursions and independence in discretized chaotic processes are illustrated.     

Double threshold autoregressive conditionally heteroscedastic model building by genetic algorithms

Asymmetric behaviour in both mean and variance is often observed in real time series. The approach we adopt is based on double threshold autoregressive conditionally heteroscedastic (DTARCH) model with normal innovations. This model allows threshold nonlinearity in mean and volatility to be modelled as a result of the impact of lagged changes in assets and squared shocks, respectively. A methodology for building DTARCH models is proposed based on genetic algorithms (GAs). The most important structural parameters, that is regimes and thresholds, are searched for by GAs, while the remaining structural parameters, that is the delay parameters and models orders, vary in some pre-specified intervals and are determined using exhaustive search and an Asymptotic Information Criterion (AIC) like criterion. For each structural parameters trial set, a DTARCH model is fitted that maximizes the (penalized) likelihood (AIC criterion). For this purpose the iteratively weighted least squares algorithm is used. Then the best model according to the AIC criterion is chosen. Extension to the double threshold generalized ARCH (DTGARCH) model is also considered. The proposed methodology is checked using both simulated and market index data. Our findings show that our GAs-based procedure yields results that comparable to that reported in the literature and concerned with real time series. As far as artificial time series are considered, the proposed procedure seems to be able to fit the data quite well. In particular, a comparison is performed between the present procedure and the method proposed by Tsay [Tsay, R.S., 1989, Testing and modeling threshold autoregressive processes. Journal of the American Statistical Association, Theory and Methods, 84, 231–240.] for estimating the delay parameter. The former almost always yields better results than the latter. However, adopting Tsay's procedure as a preliminary stage for finding the appropriate delay parameter may save computational time specially if the delay parameter may vary in a large interval.