Threshold Vector Arma Models

In this article, we propose the threshold vector autoregressive moving average model (TVARMA). It is a multivariate nonlinear time series model characterized by two or more regimes that follow a vector ARMA structure and where the switching among them is regulated by a latent variable. The TVARMA model represents a generalization of some nonlinear models proposed in the literature and shows interesting features that are explored. The condition for the strong and weak stationarity of the TVARMA model are presented and the moments up to order two of the process are derived.     

On Mixture Double Autoregressive Time Series Models

This article proposes a mixture double autoregressive model by introducing the flexibility of mixture models to the double autoregressive model, a novel conditional heteroscedastic model recently proposed in the literature. To make it more flexible, the mixing proportions are further assumed to be time varying, and probabilistic properties including strict stationarity and higher order moments are derived. Inference tools including the maximum likelihood estimation, an expectation–maximization (EM) algorithm for searching the estimator and an information criterion for model selection are carefully studied for the logistic mixture double autoregressive model, which has two components and is encountered more frequently in practice. Monte Carlo experiments give further support to the new models, and the analysis of an empirical example is also reported.     

A Bayesian nonparametric Markovian model for non-stationary time series

Stationary time series models built from parametric distributions are, in general, limited in scope due to the assumptions imposed on the residual distribution and autoregression relationship. We present a modeling approach for univariate time series data, which makes no assumptions of stationarity, and can accommodate complex dynamics and capture non-standard distributions. The model for the transition density arises from the conditional distribution implied by a Bayesian nonparametric mixture of bivariate normals. This results in a flexible autoregressive form for the conditional transition density, defining a time-homogeneous, non-stationary Markovian model for real-valued data indexed in discrete time. To obtain a computationally tractable algorithm for posterior inference, we utilize a square-root-free Cholesky decomposition of the mixture kernel covariance matrix. Results from simulated data suggest that the model is able to recover challenging transition densities and non-linear dynamic relationships. We also illustrate the model on time intervals between eruptions of the Old Faithful geyser. Extensions to accommodate higher order structure and to develop a state-space model are also discussed.     

A multivariate von mises distribution with applications to bioinformatics

Motivated by problems of modelling torsional angles in molecules, Singh, Hnizdo & Demchuk (2002) proposed a bivariate circular model which is a natural torus analogue of the bivariate normal distribution and a natural extension of the univariate von Mises distribution to the bivariate case. The authors present here a multivariate extension of the bivariate model of Singh, Hnizdo & Demchuk (2002). They study the conditional distributions and investigate the shapes of marginal distributions for a special case. The methods of moments and pseudo‐likelihood are considered for the estimation of parameters of the new distribution. The authors investigate the efficiency of the pseudo‐likelihood approach in three dimensions. They illustrate their methods with protein data of conformational angles     

Statistical Analysis Of Mixture Vector Autoregressive Models

In this paper, we reconsider the mixture vector autoregressive model, which was proposed in the literature for modelling non‐linear time series. We complete and extend the stationarity conditions, derive a matrix formula in closed form for the autocovariance function of the process and prove a result on stable vector autoregressive moving‐average representations of mixture vector autoregressive models. For these results, we apply techniques related to a Markovian representation of vector autoregressive moving‐average processes. Furthermore, we analyse maximum likelihood estimation of model parameters by using the expectation–maximization algorithm and propose a new iterative algorithm for getting the maximum likelihood estimates. Finally, we study the model selection problem and testing procedures. Several examples, simulation experiments and an empirical application based on monthly financial returns illustrate the proposed procedures.     

Testing homogeneity in a multivariate mixture model

Testing homogeneity is a fundamental problem in finite mixture models. It has been investigated by many researchers and most of the existing works have focused on the univariate case. In this article, the authors extend the use of the EM‐test for testing homogeneity to multivariate mixture models. They show that the EM‐test statistic asymptotically has the same distribution as a certain transformation of a single multivariate normal vector. On the basis of this result, they suggest a resampling procedure to approximate the P‐value of the EM‐test. Simulation studies show that the EM‐test has accurate type I errors and adequate power, and is more powerful and computationally efficient than the bootstrap likelihood ratio test. Two real data sets are analysed to illustrate the application of our theoretical results. The Canadian Journal of Statistics 39: 218–238; 2011 © 2011 Statistical Society of Canada     

Using the Residual White Noise Autoregressive Order Determination Criterion to Identify Unit Roots in Arima Models

We present a simplified form of a univariate identification approach for time series models based on the residual white noise autoregressive order determination criterion and linear estimation methods. We also show how the procedure can be used to identify the degree of differencing necessary to induce stationarity in data. The performance of this approach is also contrasted with Portmanteau tests for detection of white noise residuals and with Dickey-Fuller and Bayesian procedures for detection of unit roots. Simulated and economic data are used to demonstrate the capabilities of the modified approach.     

Stationarity and invertibility regions for low order starma models

The building of STARMA, space-time autoregressive moving average, models requires a working knowledge of the conditions under which a particular model represents a stationary process. Constraints on the parameter space that ensure stationarity are developed for all STARMA models of autoregressive temporal order le*ss than or equal to two and spatial order less than or equalto one when the model form utilizes scaled weights. Invertibility conditions for these same models are also given.     

Generalized integer-valued random coefficient for a first order structure autoregressive (RCINAR) process

A random coefficient autoregressive process for count data based on a generalized thinning operator is presented. Existence and weak stationarity conditions for these models are established. For the particular case of the (generalized) binomial thinning, it is proved that the necessary and sufficient conditions for weak stationarity are the same as those for continuous-valued AR(1) processes. These kinds of processes are appropriate for modelling non-linear integer-valued time series. They allow for over-dispersion and are appropriate when including covariates. Model parameters estimators are calculated and their properties studied analytically and/or through simulation.     

Posterior sampling in two classes of multivariate fractionally integrated models: corrigendum to Ravishanker,N. and B. K. Ray (1997) Australian Journal of Statistics 39 (3), 295–311

We discuss posterior sampling for two distinct multivariate generalisations of the univariate autoregressive integrated moving average (ARIMA) model with fractional integration. The existing approach to Bayesian estimation, introduced by Ravishanker & Ray, claims to provide a posterior‐sampling algorithm for fractionally integrated vector autoregressive moving averages (FIVARMAs). We show that this algorithm produces posterior draws for vector autoregressive fractionally integrated moving averages (VARFIMAs), a model of independent interest that has not previously received attention in the Bayesian literature.     

On diagnostic checking of the autoregressive conditional intensity model

The autoregressive conditional intensity model proposed by Russell (1998) is a promising option for fitting multivariate high frequency irregularly spaced data. The authors acknowledge the validity of this model by showing the independence of its generalized residuals, a crucial assumption of the model formulation not readily recognized by researchers. The authors derive the large‐sample distribution of the autocorrelations of the generalized residual series and use it to construct a goodness‐of‐fit test for the model. Empirical results compare the performance of their test with other off‐the‐shelf tests such as the Ljung–Box test. They illustrate the use of their test with transaction records of the HSBC stock.     

Multivariate autoregressive extreme value process and its application for modeling the time series properties of the extreme daily asset prices

Abstract

In this article we suggest a new multivariate autoregressive process for modeling time-dependent extreme value distributed observations. The idea behind the approach is to transform the original observations to latent variables that are univariate normally distributed. Then the vector autoregressive DCC model is fitted to the multivariate latent process. The distributional properties of the suggested model are extensively studied. The process parameters are estimated by applying a two-stage estimation procedure. We derive a prediction interval for future values of the suggested process. The results are applied in an empirically study by modeling the behavior of extreme daily stock prices.     

Kendall's tau for serial dependence

The authors show how Kendall's tau can be adapted to test against serial dependence in a univariate time series context. They provide formulas for the mean and variance of circular and noncircular versions of this statistic, and they prove its asymptotic normality under the hypothesis of independence. They present also a Monte Carlo study comparing the power and size of a test based on Kendall's tau with the power and size of competing procedures based on alternative parametric and nonparametric measures of serial dependence. In particular, their simulations indicate that Kendall's tau outperforms Spearman's rho in detecting first‐order autoregressive dependence, despite the fact that these two statistics are asymptotically equivalent under the null hypothesis, as well as under local alternatives.     

On a mixture autoregressive model

We generalize the Gaussian mixture transition distribution (GMTD) model introduced by Le and co-workers to the mixture autoregressive (MAR) model for the modelling of non-linear time series. The models consist of a mixture of K stationary or non-stationary AR components. The advantages of the MAR model over the GMTD model include a more full range of shape changing predictive distributions and the ability to handle cycles and conditional heteroscedasticity in the time series. The stationarity conditions and autocorrelation function are derived. The estimation is easily done via a simple EM algorithm and the model selection problem is addressed. The shape changing feature of the conditional distributions makes these models capable of modelling time series with multimodal conditional distributions and with heteroscedasticity. The models are applied to two real data sets and compared with other competing models. The MAR models appear to capture features of the data better than other competing models do.     

Properties of generalized Levinson–Durbin–Whittle sequences

For a discrete time, second-order stationary process the Levinson–Durbin recursion is used to determine best fitting one-step-ahead linear autoregressive predictors of successively increasing order, best in the sense of minimizing the mean square error. Whittle [1963. On the fitting of multivariate autoregressions, and the approximate canonical factorization of a spectral density matrix. Biometrika 50, 129–134] generalized the recursion to the case of vector autoregressive processes. The recursion defines what is termed a Levinson–Durbin–Whittle sequence, and a generalized Levinson–Durbin–Whittle sequence is also defined. Generalized Levinson–Durbin–Whittle sequences are shown to satisfy summation formulas which generalize summation formulas satisfied by binomial coefficients. The formulas can be expressed in terms of the partial correlation sequence, and they assume simple forms for time-reversible processes. The results extend comparable formulas obtained in Shaman [2007. Generalized Levinson–Durbin sequences, binomial coefficients and autoregressive estimation. Working paper] for univariate processes.     

Bootstrap LR tests of stationarity,common trends and cointegration

This paper considers the likelihood ratio (LR) tests of stationarity, common trends and cointegration for multivariate time series. As the distribution of these tests is not known, a bootstrap version is proposed via a state- space representation. The bootstrap samples are obtained from the Kalman filter innovations under the null hypothesis. Monte Carlo simulations for the Gaussian univariate random walk plus noise model show that the bootstrap LR test achieves higher power for medium-sized deviations from the null hypothesis than a locally optimal and one-sided Lagrange Multiplier (LM) test that has a known asymptotic distribution. The power gains of the bootstrap LR test are significantly larger for testing the hypothesis of common trends and cointegration in multivariate time series, as the alternative asymptotic procedure – obtained as an extension of the LM test of stationarity – does not possess properties of optimality. Finally, it is shown that the (pseudo-)LR tests maintain good size and power properties also for the non-Gaussian series. An empirical illustration is provided.     

Applying multivariate techniques to high-dimensional temporally correlated fMRI data

In first-level analyses of functional magnetic resonance imaging data, adjustments for temporal correlation as a Satterthwaite approximation or a prewhitening method are usually implemented in the univariate model to keep the nominal test level. In doing so, the temporal correlation structure of the data is estimated, assuming an autoregressive process of order one.We show that this is applicable in multivariate approaches too - more precisely in the so-called stabilized multivariate test statistics. Furthermore, we propose a block-wise permutation method including a random shift that renders an approximation of the temporal correlation structure unnecessary but also approximately keeps the nominal test level in spite of the dependence of sample elements.Although the intentions are different, a comparison of the multivariate methods with the multiple ones shows that the global approach may achieve advantages if applied to suitable regions of interest. This is illustrated using an example from fMRI studies.     

A Short-Cut Derivation for the Solution of Autoregressive Models from Sharp Algebraic Arguments

This article uses algebraic arguments to cast light on the solution of vector autoregressive models in the presence of unit roots. First, the linear case and then the multi-lag specification are investigated. Clear-cut representations of the model solutions are obtained, closed-form expressions of the coefficient matrices are provided, and integration features and cointegration mechanisms for stationarity recovery are elucidated.     

Bayesian autoregressive spectral analysis

The article describes an operational Bayesian approach to making inferences for the spectral density function for univariate autoregressive processes and for the AR operator of multivariate autoregressive processes. The derivation of the approach is described. Numerical examples, including the Wolfer Sunspot numbers, are used to demonstrate the practical usefulness of the approach.     

A multivariate regression model for continuous genetic traits

Summary.  In many commonly used models for multivariate traits, the likelihood is specified as a mixture of nested sums of products over the unobserved genotypes of all the family members, in which the familial covariance matrices vary in size and structure for different families, and their sizes can be immense for large family units. These issues pose computational difficulties in many applications. Bonney's compound regressive model for univariate traits simplifies the familial covariance structure and reduces the mixture of nested sums only to the parent–offspring level, thus enhancing computation significantly. This model has been extended to the multivariate case in the absence of unobserved genotypes. Here, we further extend this model to incorporate major genes, covariates and multiple loci. As is typical in practice, this causes new computational difficulties. We study the computational issues and explore the behaviour of this extended model.