A wavelet-based time-varying autoregressive model for non-stationary and irregular time series

In this work we propose an autoregressive model with parameters varying in time applied to irregularly spaced non-stationary time series. We expand all the functional parameters in a wavelet basis and estimate the coefficients by least squares after truncation at a suitable resolution level. We also present some simulations in order to evaluate both the estimation method and the model behavior on finite samples. Applications to silicates and nitrites irregularly observed data are provided as well.     

Priors and component structures in autoregressive time series models

New approaches to prior specification and structuring in autoregressive time series models are introduced and developed. We focus on defining classes of prior distributions for parameters and latent variables related to latent components of an autoregressive model for an observed time series. These new priors naturally permit the incorporation of both qualitative and quantitative prior information about the number and relative importance of physically meaningful components that represent low frequency trends, quasi-periodic subprocesses and high frequency residual noise components of observed series. The class of priors also naturally incorporates uncertainty about model order and hence leads in posterior analysis to model order assessment and resulting posterior and predictive inferences that incorporate full uncertainties about model order as well as model parameters. Analysis also formally incorporates uncertainty and leads to inferences about unknown initial values of the time series, as it does for predictions of future values. Posterior analysis involves easily implemented iterative simulation methods, developed and described here. One motivating field of application is climatology, where the evaluation of latent structure, especially quasi-periodic structure, is of critical importance in connection with issues of global climatic variability. We explore the analysis of data from the southern oscillation index, one of several series that has been central in recent high profile debates in the atmospheric sciences about recent apparent trends in climatic indicators.     

Factor Multivariate Stochastic Volatility via Wishart Processes

This paper proposes a high dimensional factor multivariate stochastic volatility (MSV) model in which factor covariance matrices are driven by Wishart random processes. The framework allows for unrestricted specification of intertemporal sensitivities, which can capture the persistence in volatilities, kurtosis in returns, and correlation breakdowns and contagion effects in volatilities. The factor structure allows addressing high dimensional setups used in portfolio analysis and risk management, as well as modeling conditional means and conditional variances within the model framework. Owing to the complexity of the model, we perform inference using Markov chain Monte Carlo simulation from the posterior distribution. A simulation study is carried out to demonstrate the efficiency of the estimation algorithm. We illustrate our model on a data set that includes 88 individual equity returns and the two Fama-French size and value factors. With this application, we demonstrate the ability of the model to address high dimensional applications suitable for asset allocation, risk management, and asset pricing.     

Factor Multivariate Stochastic Volatility via Wishart Processes

This paper proposes a high dimensional factor multivariate stochastic volatility (MSV) model in which factor covariance matrices are driven by Wishart random processes. The framework allows for unrestricted specification of intertemporal sensitivities, which can capture the persistence in volatilities, kurtosis in returns, and correlation breakdowns and contagion effects in volatilities. The factor structure allows addressing high dimensional setups used in portfolio analysis and risk management, as well as modeling conditional means and conditional variances within the model framework. Owing to the complexity of the model, we perform inference using Markov chain Monte Carlo simulation from the posterior distribution. A simulation study is carried out to demonstrate the efficiency of the estimation algorithm. We illustrate our model on a data set that includes 88 individual equity returns and the two Fama–French size and value factors. With this application, we demonstrate the ability of the model to address high dimensional applications suitable for asset allocation, risk management, and asset pricing.     

Multivariate Stochastic Volatility via Wishart Processes: A Comment

This comment refers to an error in the methodology for estimating the parameters of the model developed by Philipov and Glickman for modeling multivariate stochastic volatility via Wishart processes. For estimation they used Bayesian techniques. The derived expressions for the full conditionals of the model parameters as well as the expression for the acceptance ratio of the covariance matrix are erroneous. In this erratum all necessary formulae are given to guarantee an appropriate implementation and application of the model.     

Posterior consistency for the spectral density of non-Gaussian stationary time series

Various nonparametric approaches for Bayesian spectral density estimation of stationary time series have been suggested in the literature, mostly based on the Whittle likelihood approximation. A generalization of this approximation involving a nonparametric correction of a parametric likelihood has been proposed in the literature with a proof of posterior consistency for spectral density estimation in combination with the Bernstein–Dirichlet process prior for Gaussian time series. In this article, we will extend the posterior consistency result to non-Gaussian time series by employing a general consistency theorem for dependent data and misspecified models. As a special case, posterior consistency for the spectral density under the Whittle likelihood is also extended to non-Gaussian time series. Small sample properties of this approach are illustrated with several examples of non-Gaussian time series.     

Structural changes in autoregressive models for binary time series

We study autoregressive models for binary time series with possible changes in their parameters. A procedure for detection and testing of a single change is suggested. The limiting behavior of the test statistic is derived. The performance of the test is analyzed under the null hypothesis as well as under different alternatives via a simulation study. Application of the method to a real data set on US recession is provided as an illustration.     

A simple hidden markov model for bayesian modeling with time dependent data

Consider a set of real valued observations collected over time. We pro¬pose a simple hidden Markow model for these realizations in which the the predicted distribution of the next future observation given the past is easily computed. The hidden or unobservable set of parameters is assumed to have a Markov structure of a special type. The model is quite flexible and can be used to incorporate different types of prior information in straightforward and sensible ways.     

State space modeling of multiple time series

Time series methods offer the possibility of making accurate forecasts even when the underlying structural model is unknown, by replacing the structural restrictions needed to reduce sampling error and improve forecasts with restrictions determined from the data. While there has been considerable success with relatively simple univariate time series modeling procedures, the complex interrela- tionships possible with multiple series requite more powerful techniques.Based on the insights of linear systems theory, a multivariate state space methos for both stationary and nonstationary problems is described and related to ARMA models. The states or dynamic factors of the procedure are chosen to be robust in the presence of model misspecification, in constrast to ARMA models which lack this property. In addition, by treating th emidel choice as a formal approximation problem certain new optimal properties of the procedure with respect to specification are established; in particular, it is shown that no other model of equal or smaller order fits the observed autocovariance sequence any better in the sense of a Hankel norm. Finally, in the treatment of nonstationary series, a natural decomposition into long run and short run dynamics results in easily implemented two step procedures that use characteristics of the data to identify and model trend and cycle components that correspond to cointegration and error correction models. Applications include annualo U.S. GNP and money stock growth rates, monthly California beef prices and inventories, and monthly stock prices for large retailers.     

The Prediction of Time Series With Trends and Seasonalities

A maximization of the expected entropy of the predictive distribution interpretation of Akaike's minimum AIC procedure is exploited for the modeling and prediction of time series with trend and seasonal mean value functions and stationary covariances. The AIC criterion best one-step-ahead and best twelve-step-ahead prediction models can be different. The different models exhibit the relative optimality properties for which they were designed. The results are related to open questions on optimal trend estimation and optimal seasonal adjustment of time series.     

Multivariate analysis with an autoregressive covariance model

This paper addresses the problem of testing the multivariate linear hypothesis when the errors follow an antedependence model (Gabriel, 1961, 1962). Antedependence can be formulated as a nonstationary autoregressive model of general order. Three test statistics are derived that provide analogs to three commonly used MANOVA statistics: Wilks' Lambda, the Lawley-Hotelling Trace, and Pillai's Trace. Formulas are given for each of these statistics that show how they can be obtained From any statistical computing package that calculates the usual MANOVA statistics. These antedependent statistics would be appropriate in analyzing certain multivariate data sets in which repeated measurements are taken on the same subjects over a period of time.     

A non-stationary integer-valued autoregressive model

It is frequent to encounter a time series of counts which are small in value and show a trend having relatively large fluctuation. To handle such a non-stationary integer-valued time series with a large dispersion, we introduce a new process called integer-valued autoregressive process of order p with signed binomial thinning (INARS(p)). This INARS(p) uniquely exists and is stationary under the same stationary condition as in the AR(p) process. We provide the properties of the INARS(p) as well as the asymptotic normality of the estimates of the model parameters. This new process includes previous integer-valued autoregressive processes as special cases. To preserve integer-valued nature of the INARS(p) and to avoid difficulty in deriving the distributional properties of the forecasts, we propose a bootstrap approach for deriving forecasts and confidence intervals. We apply the INARS(p) to the frequency of new patients diagnosed with acquired immunodeficiency syndrome (AIDS) in Baltimore, Maryland, U.S. during the period of 108 months from January 1993 to December 2001.     

Multivariate time series prediction using a hybridization of VARMA models and Bayesian networks

In this paper, a new hybrid model of vector autoregressive moving average (VARMA) models and Bayesian networks is proposed to improve the forecasting performance of multivariate time series. In the proposed model, the VARMA model, which is a popular linear model in time series forecasting, is specified to capture the linear characteristics. Then the errors of the VARMA model are clustered into some trends by K-means algorithm with Krzanowski–Lai cluster validity index determining the number of trends, and a Bayesian network is built to learn the relationship between the data and the trend of its corresponding VARMA error. Finally, the estimated values of the VARMA model are compensated by the probabilities of their corresponding VARMA errors belonging to each trend, which are obtained from the Bayesian network. Compared with VARMA models, the experimental results with a simulation study and two multivariate real-world data sets indicate that the proposed model can effectively improve the prediction performance.     

Threshold negative binomial autoregressive model

This article studies an observation-driven model for time series of counts, which allows for overdispersion and negative serial dependence in the observations. The observations are supposed to follow a negative binomial distribution conditioned on past information with the form of thresh old models, which generates a two-regime structure on the basis of the magnitude of the lagged observations. We use the weak dependence approach to establish the stationarity and ergodicity, and the inference for regression parameters are obtained by the quasi-likelihood. Moreover, asymptotic properties of both quasi-maximum likelihood estimators and the threshold estimator are established, respectively. Simulation studies are considered and so are two applications, one of which is the trading volume of a stock and another is the number of major earthquakes.     

A transitional Markov switching autoregressive model

ABSTRACT

This paper is concerned with properties of a transitional Markov switching autoregressive (TMSAR) model, together with its maximum-likelihood estimation and inference. We extend existing MSAR models by allowing dependence of AR parameters on hidden states at time points prior to the current time t. A stationary solution is given and expressions for the theoretical autocovariance function are derived. Two time series are analyzed and the new model outperforms two existing MSAR models in terms of maximized log-likelihood, residual correlations, and one-step-ahead forecasting performance. The new model also gives more regime changes in agreement with real events.     

Double AR model without intercept: An alternative to modeling nonstationarity and heteroscedasticity

This paper presents a double AR model without intercept (DARWIN model) and provides us a new way to study the nonstationary heteroscedastic time series. It is shown that the DARWIN model is always nonstationary and heteroscedastic, and its sample properties depend on the Lyapunov exponent. An easy-to-implement estimator is proposed for the Lyapunov exponent, and it is unbiased, strongly consistent, and asymptotically normal. Based on this estimator, a powerful test is constructed for testing the ordinary oscillation of the model. Moreover, this paper proposes the quasi-maximum likelihood estimator (QMLE) for the DARWIN model, which has an explicit form. The strong consistency and asymptotic normality of the QMLE are established regardless of the sign of the Lyapunov exponent. Simulation studies are conducted to assess the performance of the estimation and testing, and an empirical example is given for illustrating the usefulness of the DARWIN model.     

On a mixture vector autoregressive model

The authors show how to extend univariate mixture autoregressive models to a multivariate time series context. Similar to the univariate case, the multivariate model consists of a mixture of stationary or nonstationary autoregressive components. The authors give the first and second order stationarity conditions for a multivariate case up to order 2. They also derive the second order stationarity condition for the univariate mixture model up to arbitrary order. They describe an EM algorithm for estimation, as well as a diagnostic checking procedure. They study the performance of their method via simulations and include a real application.     

Censored time series analysis with autoregressive moving average models

The authors consider time series observations with data irregularities such as censoring due to a detection limit. Practitioners commonly disregard censored data cases which often result in biased estimates. The authors present an attractive remedy for handling autocorrelated censored data based on a class of autoregressive and moving average (ARMA) models. In particular, they introduce an imputation method well suited for fitting ARMA models in the presence of censored data. They demonstrate the effectiveness of their technique in terms of bias, efficiency, and information loss. They also describe its adaptation to a specific context of meteorological time series data on cloud ceiling height, which are measured subject to the detection limit of the recording device.