Modelling extremes of time-dependent data by Markov-switching structures

We investigate the extremal clustering behaviour of stationary time series that possess two regimes, where the switch is governed by a hidden two-state Markov chain. We also suppose that the process is conditionally Markovian in each latent regime. We prove under general assumptions that above high thresholds these models behave approximately as a random walk in one (called dominant) regime and as a stationary autoregression in the other (dominated) regime. Based on this observation, we propose an estimation and simulation scheme to analyse the extremal dependence structure of such models, taking into account only observations above high thresholds. The properties of the estimation method are also investigated. Finally, as an application, we fit a model to high-level exceedances of water discharge data, simulate extremal events from the fitted model, and show that the (model-based) flood peak, flood duration and flood volume distributions match their observed counterparts.     

Testing for intercept‐scale switch in linear autoregression

Autoregressive models with switching regime are a frequently used class of nonlinear time series models, which are popular in finance, engineering, and other fields. We consider linear switching autoregressions in which the intercept and variance possibly switch simultaneously, while the autoregressive parameters are structural and hence the same in all states, and we propose quasi‐likelihood‐based tests for a regime switch in this class of models. Our motivation is from financial time series, where one expects states with high volatility and low mean together with states with low volatility and higher mean. We investigate the performance of our tests in a simulation study, and give an application to a series of IBM monthly stock returns. The Canadian Journal of Statistics 40: 427–446; 2012 © 2012 Statistical Society of Canada     

我国通货膨胀率非线性特征研究

 本文应用带单位根的门限自回归模型,对我国1990年来以来通货膨胀率的动态路径进行了模拟分析。估计和检验发现了我国通货膨胀具有明显的非线性特征,模型较好地拟合了通货膨胀的动态调整过程。我国通货膨胀调整存在减速通货膨胀状态、适中通货膨胀状态和加速通货膨胀状态三个区制。适中通货膨胀状态是一个平稳的自回归过程,减速通货膨胀状态、加速通货膨胀状态则是具有单位根的自回归过程,具有自我加速的作用。在不同的区制下,通货膨胀率均有较高的持久性,但中间状态的持久性明显低于其他两种状态。     

Stationary mixture transition distribution (MTD) models via predictive distributions

This paper combines two ideas to construct autoregressive processes of arbitrary order. The first idea is the construction of first order stationary processes described in Pitt et al. [(2002). Constructing first order autoregressive models via latent processes. Scand. J. Statist.29, 657–663] and the second idea is the construction of higher order processes described in Raftery [(1985). A model for high order Markov chains. J. Roy. Statist. Soc. B.47, 528–539]. The resulting models provide appealing alternatives to model non-linear and non-Gaussian time series.     

Bayesian curve fitting and clustering with Dirichlet process mixture models for microarray data

In the field of molecular biology, it is often of interest to analyze microarray data for clustering genes based on similar profiles of gene expression to identify genes that are differentially expressed under multiple biological conditions. One of the notable characteristics of a gene expression profile is that it shows a cyclic curve over a course of time. To group sequences of similar molecular functions, we propose a Bayesian Dirichlet process mixture of linear regression models with a Fourier series for the regression coefficients, for each of which a spike and slab prior is assumed. A full Gibbs-sampling algorithm is developed for an efficient Markov chain Monte Carlo (MCMC) posterior computation. Due to the so-called “label-switching” problem and different numbers of clusters during the MCMC computation, a post-process approach of Fritsch and Ickstadt (2009) is additionally applied to MCMC samples for an optimal single clustering estimate by maximizing the posterior expected adjusted Rand index with the posterior probabilities of two observations being clustered together. The proposed method is illustrated with two simulated data and one real data of the physiological response of fibroblasts to serum of Iyer et al. (1999).     

A (Semi)Parametric Functional Coefficient Logarithmic Autoregressive Conditional Duration Model

In this article, we propose a class of logarithmic autoregressive conditional duration (ACD)-type models that accommodates overdispersion, intermittent dynamics, multiple regimes, and asymmetries in financial durations. In particular, our functional coefficient logarithmic autoregressive conditional duration (FC-LACD) model relies on a smooth-transition autoregressive specification. The motivation lies on the fact that the latter yields a universal approximation if one lets the number of regimes grows without bound. After establishing sufficient conditions for strict stationarity, we address model identifiability as well as the asymptotic properties of the quasi-maximum likelihood (QML) estimator for the FC-LACD model with a fixed number of regimes. In addition, we also discuss how to consistently estimate a semiparametric variant of the FC-LACD model that takes the number of regimes to infinity. An empirical illustration indicates that our functional coefficient model is flexible enough to model IBM price durations.     

Threshold Vector Arma Models

In this article, we propose the threshold vector autoregressive moving average model (TVARMA). It is a multivariate nonlinear time series model characterized by two or more regimes that follow a vector ARMA structure and where the switching among them is regulated by a latent variable. The TVARMA model represents a generalization of some nonlinear models proposed in the literature and shows interesting features that are explored. The condition for the strong and weak stationarity of the TVARMA model are presented and the moments up to order two of the process are derived.     

Bayesian model selection and parameter estimation for possibly asymmetric and non-stationary time series using a reversible jump Markov chain Monte Carlo approach

A Markov chain Monte Carlo (MCMC) approach, called a reversible jump MCMC, is employed in model selection and parameter estimation for possibly non-stationary and non-linear time series data. The non-linear structure is modelled by the asymmetric momentum threshold autoregressive process (MTAR) of Enders & Granger (1998) or by the asymmetric self-exciting threshold autoregressive process (SETAR) of Tong (1990). The non-stationary and non-linear feature is represented by the MTAR (or SETAR) model in which one ( 𝜌 1 ) of the AR coefficients is greater than one, and the other ( 𝜌 2 ) is smaller than one. The other non-stationary and linear, stationary and nonlinear, and stationary and linear features, represented respectively by ( 𝜌 1 = 𝜌 2 = 1 ), ( 𝜌 1 p 𝜌 2 < 1 ) and ( 𝜌 1 = 𝜌 2 < 1 ), are also considered as possible models. The reversible jump MCMC provides estimates of posterior probabilities for these four different models as well as estimates of the AR coefficients 𝜌 1 and 𝜌 2 . The proposed method is illustrated by analysing six series of US interest rates in terms of model selection, parameter estimation, and forecasting.     

On the detection of changes in autoregressive time series,II. Resampling procedures

We study an autoregressive time series model with a possible change in the regression parameters. Approximations to the critical values for change-point tests are obtained through various bootstrapping methods. Theoretical results show that the bootstrapping procedures have the same limiting behavior as their asymptotic counterparts discussed in Hušková et al. [2007. On the detection of changes in autoregressive time series, I. Asymptotics. J. Statist. Plann. Inference 137, 1243–1259]. In fact, a small simulation study illustrates that the bootstrap tests behave better than the original asymptotic tests if performance is measured by the α$\alpha$- and β$\beta$-errors, respectively.     

Structured priors for multivariate time series

A class of prior distributions for multivariate autoregressive models is presented. This class of priors is built taking into account the latent component structure that characterizes a collection of autoregressive processes. In particular, the state-space representation of a vector autoregressive process leads to the decomposition of each time series in the multivariate process into simple underlying components. These components may have a common structure across the series. A key feature of the proposed priors is that they allow the modeling of such common structure. This approach also takes into account the uncertainty in the number of latent processes, consequently handling model order uncertainty in the multivariate autoregressive framework. Posterior inference is achieved via standard Markov chain Monte Carlo (MCMC) methods. Issues related to inference and exploration of the posterior distribution are discussed. We illustrate the methodology analyzing two data sets: a synthetic data set with quasi-periodic latent structure, and seasonally adjusted US monthly housing data consisting of housing starts and housing sales over the period 1965 to 1974.     

Stochastic volatility modelling in continuous time with general marginal distributions: Inference,prediction and model selection

We compare results for stochastic volatility models where the underlying volatility process having generalized inverse Gaussian (GIG) and tempered stable marginal laws. We use a continuous time stochastic volatility model where the volatility follows an Ornstein–Uhlenbeck stochastic differential equation driven by a Lévy process. A model for long-range dependence is also considered, its merit and practical relevance discussed. We find that the full GIG and a special case, the inverse gamma, marginal distributions accurately fit real data. Inference is carried out in a Bayesian framework, with computation using Markov chain Monte Carlo (MCMC). We develop an MCMC algorithm that can be used for a general marginal model.     

A class of observation-driven random coefficient INAR(1) processes based on negative binomial thinning

Integer-valued time series models and their applications have attracted a lot of attention over the last years. In this paper, we introduce a class of observation-driven random coefficient integer-valued autoregressive processes based on negative binomial thinning, where the autoregressive parameter depends on the observed values of the previous moment. Basic probability and statistics properties of the process are established. The unknown parameters are estimated by the conditional least squares and empirical likelihood methods. Specially, we consider three aspects of the empirical likelihood method: maximum empirical likelihood estimate, confidence region and EL test. The performance of the two estimation methods is compared through simulation studies. Finally, an application to a real data example is provided.     

Bayesian Analysis of Two-Regime Threshold Autoregressive Moving Average Model with Exogenous Inputs

We consider Bayesian analysis of threshold autoregressive moving average model with exogenous inputs (TARMAX). In order to obtain the desired marginal posterior distributions of all parameters including the threshold value of the two-regime TARMAX model, we use two different Markov chain Monte Carlo (MCMC) methods to apply Gibbs sampler with Metropolis-Hastings algorithm. The first one is used to obtain iterative least squares estimates of the parameters. The second one includes two MCMC stages for estimate the desired marginal posterior distributions and the parameters. Simulation experiments and a real data example show support to our approaches.     

Canonical correlation analysis for the vector AR(1) model with ARCH innovations

This paper extends the results of canonical correlation analysis of Anderson [2002. Canonical correlation analysis and reduced-rank regression in autoregressive models. Ann. Statist. 30, 1134–1154] to a vector AR(1) process with a vector ARCH(1) innovations. We obtain the limiting distributions of the sample matrices, the canonical correlations and the canonical vectors of the process. The extension is important because many time series in economics and finance exhibit conditional heteroscedasticity. We also use simulation to demonstrate the effects of ARCH innovations on the canonical correlation analysis in finite sample. Both the limiting distributions and simulation results show that overlooking the ARCH effects in canonical correlation analysis can easily lead to erroneous inference.     

Introducing model uncertainty by moving blocks bootstrap

It is common in parametric bootstrap to select the model from the data, and then treat as if it were the true model. Chatfield (1993, 1996) has shown that ignoring the model uncertainty may seriously undermine the coverage accuracy of prediction intervals. In this paper, we propose a method based on moving block bootstrap for introducing the model selection step in the resampling algorithm. We present a Monte Carlo study comparing the finite sample properties of the proposel method with those of alternative methods in the case of prediction intervas.     

Properties of generalized Levinson–Durbin–Whittle sequences

For a discrete time, second-order stationary process the Levinson–Durbin recursion is used to determine best fitting one-step-ahead linear autoregressive predictors of successively increasing order, best in the sense of minimizing the mean square error. Whittle [1963. On the fitting of multivariate autoregressions, and the approximate canonical factorization of a spectral density matrix. Biometrika 50, 129–134] generalized the recursion to the case of vector autoregressive processes. The recursion defines what is termed a Levinson–Durbin–Whittle sequence, and a generalized Levinson–Durbin–Whittle sequence is also defined. Generalized Levinson–Durbin–Whittle sequences are shown to satisfy summation formulas which generalize summation formulas satisfied by binomial coefficients. The formulas can be expressed in terms of the partial correlation sequence, and they assume simple forms for time-reversible processes. The results extend comparable formulas obtained in Shaman [2007. Generalized Levinson–Durbin sequences, binomial coefficients and autoregressive estimation. Working paper] for univariate processes.     

Bayesian inference for dynamic social network data

We consider a continuous-time model for the evolution of social networks. A social network is here conceived as a (di-) graph on a set of vertices, representing actors, and the changes of interest are creation and disappearance over time of (arcs) edges in the graph. Hence we model a collection of random edge indicators that are not, in general, independent. We explicitly model the interdependencies between edge indicators that arise from interaction between social entities. A Markov chain is defined in terms of an embedded chain with holding times and transition probabilities. Data are observed at fixed points in time and hence we are not able to observe the embedded chain directly. Introducing a prior distribution for the parameters we may implement an MCMC algorithm for exploring the posterior distribution of the parameters by simulating the evolution of the embedded process between observations.     

A Markov Model of Switching-Regime ARCH

In this article I present a new approach to model more realistically the variability of financial time series. I develop a Markov-ARCH model that incorporates the features of both Hamilton's switching-regime model and Engle's autoregressive conditional heteroscedasticity (ARCH) model to examine the issue of volatility persistence in the monthly excess returns of the three-month treasury bill. The issue can be resolved by taking into account occasional shifts in the asymptotic variance of the Markov-ARCH process that cause the spurious persistence of the volatility process. I identify two periods during which there is a regime shift, the 1974:2–1974:8 period associated with the oil shock and the 1979:9–1982:8 period associated with the Federal Reserve's policy change. The variance approached asymptotically in these two episodes is more than 10 times as high as the asymptotic variance for the remainder of the sample. I conclude that regime shifts have a greater impact on the properties of the data, and I cannot reject the null hypothesis of no ARCH effects within the regimes. As a consequence of the striking findings in this article, previous empirical results that adopt an ARCH approach in modeling monthly or lower frequency interest-rate dynamics are rendered questionable.     

中国金融风险周期监测与央行货币政策非对称性效果识别

本文采用时变参数因子增广向量自回归模型（TVP-FAVAR）,并基于动态模型平均法测度了金融子系统变量的时变权重,通过加权计算得到我国金融风险周期指数（FRI）。然后改进构建了分区制货币政策模型系统,并采用逻辑平滑转换向量自回归模型（LST-VAR）研究了高低区制下,价格型和数量型货币政策对金融风险的传导效应,在此基础上,设计并测度了我国货币政策的时滞效应。研究发现,我国金融风险具有明显的两区制特征,样本区间内FRI大多时期处于低风险区制,而高风险区制的时间段与国内外重大金融风险事件相吻合。两种紧缩的货币政策均有利于抑制金融风险及其波动,且在高风险区制的抑制效应更为显著。对于货币政策时滞效应,数量型货币政策对金融风险的抑制作用大于价格型货币政策,但2008、2012和2015年三个高金融风险期的时滞效应均较小。最后,根据研究结果提出相应政策建议。     

Autoregressive Moving Average Infinite Hidden Markov-Switching Models

Markov-switching models are usually specified under the assumption that all the parameters change when a regime switch occurs. Relaxing this hypothesis and being able to detect which parameters evolve over time is relevant for interpreting the changes in the dynamics of the series, for specifying models parsimoniously, and may be helpful in forecasting. We propose the class of sticky infinite hidden Markov-switching autoregressive moving average models, in which we disentangle the break dynamics of the mean and the variance parameters. In this class, the number of regimes is possibly infinite and is determined when estimating the model, thus avoiding the need to set this number by a model choice criterion. We develop a new Markov chain Monte Carlo estimation method that solves the path dependence issue due to the moving average component. Empirical results on macroeconomic series illustrate that the proposed class of models dominates the model with fixed parameters in terms of point and density forecasts.