Autoregressiv model identification for multivariate time series

A procedure is developed for the identification of autoregressive models for stationary invertible multivariate Gaussian time series. Model selection is based on either the AIC information criterion or on a statistic called CVR, cross-validatory residual sum of squares. An example is given to show that the forecasts generated by these models compare favorably with those generated by other common time series modeling techniques.     

Quantile hidden semi-Markov models for multivariate time series

Statistics and Computing - Parametric regression, such as linear regression, plays an important role in statistics. The use of parametric regression models typically involves the specification of a...     

On multivariate variable-kernel density estimates for time series

Let X₁ be a strictly stationary multiple time series with values in R^d and with a common density f. Let X₁,.,.,X_n, be n consecutive observations of X₁. Let k = k_n, be a sequence of positive integers, and let H_ni be the distance from X_i to its kth nearest neighbour among X_j, j i. The multivariate variable-kernel estimate f_n, of f is defined by where K is a given density. The complete convergence of f_n, to f on compact sets is established for time series satisfying a dependence condition (referred to as the strong mixing condition in the locally transitive sense) weaker than the strong mixing condition. Appropriate choices of k are explicitly given. The results apply to autoregressive processes and bilinear time-series models.     

A semiparametric approach for modelling multivariate nonlinear time series

In this article, a semiparametric time‐varying nonlinear vector autoregressive (NVAR) model is proposed to model nonlinear vector time series data. We consider a combination of parametric and nonparametric estimation approaches to estimate the NVAR function for both independent and dependent errors. We use the multivariate Taylor series expansion of the link function up to the second order which has a parametric framework as a representation of the nonlinear vector regression function. After the unknown parameters are estimated by the maximum likelihood estimation procedure, the obtained NVAR function is adjusted by a nonparametric diagonal matrix, where the proposed adjusted matrix is estimated by the nonparametric kernel estimator. The asymptotic consistency properties of the proposed estimators are established. Simulation studies are conducted to evaluate the performance of the proposed semiparametric method. A real data example on short‐run interest rates and long‐run interest rates of United States Treasury securities is analyzed to demonstrate the application of the proposed approach. The Canadian Journal of Statistics 47: 668–687; 2019 © 2019 Statistical Society of Canada     

Tests for noncorrelation of two multivariate ARMA time series

In many situations, we want to verify the existence of a relationship between multivariate time series. In this paper, we generalize the procedure developed by Haugh (1976) for univariate time series in order to test the hypothesis of noncorrelation between two multivariate stationary ARMA series. The test statistics are based on residual cross-correlation matrices. Under the null hypothesis of noncorrelation, we show that an arbitrary vector of residual cross-correlations asymptotically follows the same distribution as the corresponding vector of cross-correlations between the two innovation series. From this result, it follows that the test statistics considered are asymptotically distributed as chi-square random variables. Two test procedures are described. The first one is based on the residual cross-correlation matrix at a particular lag, whilst the second one is based on a portmanteau type statistic that generalizes Haugh's statistic. We also discuss how the procedures for testing noncorrelation can be adapted to determine the directions of causality in the sense of Granger (1969) between the two series. An advantage of the proposed procedures is that their application does not require the estimation of a global model for the two series. The finite-sample properties of the statistics introduced were studied by simulation under the null hypothesis. It led to modified statistics whose upper quantiles are much better approximated by those of the corresponding chi-square distribution. Finally, the procedures developed are applied to two different sets of economic data.     

Covariance changes detection in multivariate time series

This paper studies the detection of step changes in the variances and in the correlation structure of the components of a vector of time series. Two procedures based on the likelihood ratio test (LRT) statistic and on a cumulative sums (cusum) statistic are considered and compared in a simulation study. We conclude that for a single covariance change the cusum procedure is more powerful in small and medium samples, whereas the likelihood ratio test is more powerful in large samples. However, for several covariance changes the cusum procedure works clearly better. The procedures are illustrated in two real data examples.     

Estimation of a nonparametric regression spectrum for multivariate time series

Estimation of a nonparametric regression spectrum based on the periodogram is considered. Neither trend estimation nor smoothing of the periodogram is required. Alternatively, for cases where spectral estimation of phase shifts fails and the shift does not depend on frequency, a time domain estimator of the lag-shift is defined. Asymptotic properties of the frequency and time domain estimators are derived. Simulations and a data example illustrate the methods.     

Kullback-Leibler divergence to evaluate posterior sensitivity to different priors for autoregressive time series models

In this paper we use the Kullback-Leibler divergence to measure the distance between the posteriors of the autoregressive (AR) model coefficients, aiming to evaluate mathematically the sensitivity of the coefficients posterior to different types of priors, i.e. Jeffreys’, g, and natural conjugate priors. In addition, we evaluate the impact of the posteriors distance in Bayesian estimates of mean and variance of the model coefficients by generating a large number of Monte Carlo simulations from the posteriors. Simulation study results show that the coefficients posterior is sensitive to prior distributions, and the posteriors distance has more influence on Bayesian estimates of variance than those of mean of the model coefficients. Same results are obtained from the application to real-world time series datasets.     

On confidence regions for the mean of a multivariate time series

We consider the problem of setting up a confidence region for the mean of amultivariate timeseries ont he basis of a part-realisation of that series.A procedure for setting up a confidence interval for the mean of a univariate time series Is implicitin Jones(1976).We present an analogous procedure for setting up a confidence region for the mean of a multivariatet ime series.This procedure is base donastatistic which is an analogue of Hotelling'sT'.Our results are applied to a comparison of climate means obtained from experiments with a General Circulation Model of the earth's atmosphere.     

On testing for multivariate ARCH effects in vector time series models

Using a spectral approach, the authors propose tests to detect multivariate ARCH effects in the residuals from a multivariate regression model. The tests are based on a comparison, via a quadratic norm, between the uniform density and a kernel‐based spectral density estimator of the squared residuals and cross products of residuals. The proposed tests are consistent under an arbitrary fixed alternative. The authors present a new application of the test due to Hosking (1980) which is seen to be a special case of their approach involving the truncated uniform kernel. However, they typically obtain more powerful procedures when using a different weighting. The authors consider especially the procedure of Robinson (1991) for choosing the smoothing parameter of the spectral density estimator. They also introduce a generalized version of the test for ARCH effects due to Ling & Li (1997). They investigate the finite‐sample performance of their tests and compare them to existing tests including those of Ling & Li (1997) and the residual‐based diagnostics of Tse (2002).Finally, they present a financial application.     

On testing for causality in variance between two multivariate time series

Verifying the existence of a relationship between two multivariate time series represents an important consideration. In this article, the procedure developed by Cheung and Ng [A causality-in-variance test and its application to financial market prices, J. Econom. 72 (1996), pp. 33–48] designed to test causality in variance for univariate time series is generalized in several directions. A first approach proposes test statistics based on residual cross-covariance matrices of squared (standardized) residuals and cross products of (standardized) residuals. In a second approach, transformed residuals are defined for each residual vector time series, and test statistics are constructed based on the cross-correlations of these transformed residuals. Test statistics at individual lags and portmanteau-type test statistics are developed. Conditions are given under which the new test statistics converge in distribution towards chi-square distributions. The proposed methodology can be used to determine the directions of causality in variance, and appropriate test statistics are presented. Monte Carlo simulation results show that the new test statistics offer satisfactory empirical properties. An application with two bivariate financial time series illustrates the methods.     

Trend estimation of multivariate time series with controlled smoothness

This paper extends the univariate time series smoothing approach provided by penalized least squares to a multivariate setting, thus allowing for joint estimation of several time series trends. The theoretical results are valid for the general multivariate case, but particular emphasis is placed on the bivariate situation from an applied point of view. The proposal is based on a vector signal-plus-noise representation of the observed data that requires the first two sample moments and specifying only one smoothing constant. A measure of the amount of smoothness of an estimated trend is introduced so that an analyst can set in advance a desired percentage of smoothness to be achieved by the trend estimate. The required smoothing constant is determined by the chosen percentage of smoothness. Closed form expressions for the smoothed estimated vector and its variance-covariance matrix are derived from a straightforward application of generalized least squares, thus providing best linear unbiased estimates for the trends. A detailed algorithm applicable for estimating bivariate time series trends is also presented and justified. The theoretical results are supported by a simulation study and two real applications. One corresponds to Mexican and US macroeconomic data within the context of business cycle analysis, and the other one to environmental data pertaining to a monitored site in Scotland.     

Nonparametric Bayesian inference for multivariate density functions using Feller priors

Multivariate density estimation plays an important role in investigating the mechanism of high-dimensional data. This article describes a nonparametric Bayesian approach to the estimation of multivariate densities. A general procedure is proposed for constructing Feller priors for multivariate densities and their theoretical properties as nonparametric priors are established. A blocked Gibbs sampling algorithm is devised to sample from the posterior of the multivariate density. A simulation study is conducted to evaluate the performance of the procedure.     

Sparse moving maxima models for tail dependence in multivariate financial time series

The multivariate maxima of moving maxima (M4) model has the potential to model both the cross-sectional and temporal tail-dependence for a rich class of multivariate time series. The main difficulty of applying M4 model to real data is due to the estimation of a large number of parameters in the model and the intractability of its joint likelihood. In this paper, we consider a sparse M4 random coefficient model (SM4R), which has a parsimonious number of parameters and it can potentially capture the major stylized facts exhibited by devolatized asset returns found in empirical studies. We study the probabilistic properties of the newly proposed model. Statistical inference can be made based on the Generalized Method of Moments (GMM) approach. We also demonstrate through real data analysis that the SM4R model can be effectively used to improve the estimates of the Value-at-Risk (VaR) for portfolios consisting of multivariate financial returns while ignoring either temporal or cross-sectional tail dependence could potentially result in serious underestimate of market risk.     

CUSUM control schemes for monitoring the covariance matrix of multivariate time series

Modified cumulative sum (CUSUM) control charts and CUSUM schemes for residuals are suggested to detect changes in the covariance matrix of multivariate time series. Several properties of these schemes are derived when the in-control process is a stationary Gaussian process. A Monte Carlo study reveals that the proposed approaches show similar or even better performance than the schemes based on the multivariate exponentially weighted moving average (MEWMA) recursion. We illustrate how the control procedures can be applied to monitor the covariance structure of developed stock market indices.     

Surveillance of the covariance matrix of multivariate nonlinear time series

In this paper, sequential procedures for the surveillance of the covariance matrices of multivariate nonlinear time series are introduced. Two different types of control charts are proposed. The first type is based on the exponential smoothing of each component of a local measure for the covariances. The control statistic is equal to the Mahalanobis distance of this quantity with its in-control mean. In our second approach, the Mahalanobis distance is first determined and after that it is exponentially smoothed. We discuss three examples of local measures.

Several properties of the proposed schemes are discussed assuming the target process to be generated by a multivariate GARCH(1, 1) model. The generalization to the family of spherical distributions allows the modelling of frequently observed fat tails in financial data. Some results of an extensive Monte Carlo simulation study are provided in order to judge the performance of the presented control schemes. As a performance measure we use the average run length. An empirical example illustrates the importance of the fast detection of the changes in the covariance structure of the returns of financial assets.     

Model selection criteria for reduced rank multivariate time series: a simulation study

The main focus of our paper is to compare the performance of different model selection criteria used for multivariate reduced rank time series. We consider one of the most commonly used reduced rank model, that is, the reduced rank vector autoregression (RRVAR (p, r)) introduced by Velu et al. [Reduced rank models for multiple time series. Biometrika. 1986;7(31):105–118]. In our study, the most popular model selection criteria are included. The criteria are divided into two groups, that is, simultaneous selection and two-step selection criteria, accordingly. Methods from the former group select both an autoregressive order p and a rank r simultaneously, while in the case of two-step criteria, first an optimal order p is chosen (using model selection criteria intended for the unrestricted VAR model) and then an optimal rank r of coefficient matrices is selected (e.g. by means of sequential testing). Considered model selection criteria include well-known information criteria (such as Akaike information criterion, Schwarz criterion, Hannan–Quinn criterion, etc.) as well as widely used sequential tests (e.g. the Bartlett test) and the bootstrap method. An extensive simulation study is carried out in order to investigate the efficiency of all model selection criteria included in our study. The analysis takes into account 34 methods, including 6 simultaneous methods and 28 two-step approaches, accordingly. In order to carefully analyse how different factors affect performance of model selection criteria, we consider over 150 simulation settings. In particular, we investigate the influence of the following factors: time series dimension, different covariance structure, different level of correlation among components and different level of noise (variance). Moreover, we analyse the prediction accuracy concerned with the application of the RRVAR model and compare it with results obtained for the unrestricted vector autoregression. In this paper, we also present a real data application of model selection criteria for the RRVAR model using the Polish macroeconomic time series data observed in the period 1997–2007.