Asymptotic Results for Spatial ARMA Models

Causal quadrantal-type spatial ARMA(p, q) models with independent and identically distributed innovations are considered. In order to select the orders (p, q) of these models and estimate their autoregressive parameters, estimators of the autoregressive coefficients, derived from the extended Yule–Walker equations are defined. Consistency and asymptotic normality are obtained for these estimators. Then, spatial ARMA model identification is considered and simulation study is given.     

ARCH and Bilinear Time Series Models: Comparison and Combination

Two extensions to the ARMA model, bilinearity and ARCH errors are compared, and their combination is considered. Starting with the ARMA model, tests for each extension are discussed, along with various least squares and maximum likelihood estimates of the parameters and tests of the estimated models based on these. The effects each may have on the identification, estimation, and testing of the other are given, and it is seen that to distinguish between the two properly, it is necessary to combine them into a bilinear model with ARCH errors. Some consequences of the misspecification caused by considering only the ARMA model are noted, and the methods are applied to two real time series.     

The effect of temporal aggregation on the estimation accuracy of ARMA models

ABSTRACT

Autoregressive Moving Average (ARMA) time series model fitting is a procedure often based on aggregate data, where parameter estimation plays a key role. Therefore, we analyze the effect of temporal aggregation on the accuracy of parameter estimation of mixed ARMA and MA models. We derive the expressions required to compute the parameter values of the aggregate models as functions of the basic model parameters in order to compare their estimation accuracy. To this end, a simulation experiment shows that aggregation causes a severe accuracy loss that increases with the order of aggregation, leading to poor accuracy.     

An Application of Nonlinear Time Series Forecasting

By means of a real application, it is seen how ARIMA forecasts can be improved when nonlinearities are present. The autocorrelation function (ACF) of the squared residuals provides a convenient tool to check the linearity assumption. Once nonlinearity has been detected, parsimonious bilinear processes seem rather adequate to model it. The detection of nonlinearity and the forecast improvement appear to be rather robust with respect to changes in the linear and bilinear specification. Finally, what bilinear models seem to capture are periods of atypical behavior or sequences of outliers.     

On the pade tablé and its relationship to the r and sarrays and arm a modeling

The Box-Jenkins method is a popular and important technique for modeling and forecasting of time series. Unfortunately the problem of determining the appropriate ARMA forecasting model (or indeed if an ARMA model holds) is a major drawback to the use of the Box-Jenkins methodology. Gray et al. (1978) and Woodward and Gray (1979) have proposed methods of estimating p and qin ARMA modeling based on the R and Sarrays that circumvent some of these modeling difficulties.

In this paper we generalize the R and S arrays by showing a relationship to Padé approximunts and then show that these arrays have a much wider application than in just determining model order. Particular non-ARMA models can be identified as well. This includes certain processes that consist of deterministic functions plus ARMA noise, indeed we believe that the combined R and S arrays are the best overall tool so fur developed for the identification of general 2nd order (not just stationary) time scries models.     

Identification of Periodic Moving-Average Models

Abstract

ARMA models with seasonally-varying parameters and orders, known as periodic ARMA (PARMA) models, have found wide applications in modeling of seasonal processes. This article considers the identification of orders of periodic MA (PMA) models. The identification is based on the cut-off property of the periodic autocorrelation function (PeACF). We derive an explicit expression for the asymptotic variance of the sample PeACF to be used in establishing its bands. A simulated example is also provided which agrees well with the theoretical results.     

R2 Bounds for Predictive Models: What Univariate Properties Tell us About Multivariate Predictability

ABSTRACT

A long-standing puzzle in macroeconomic forecasting has been that a wide variety of multivariate models have struggled to out-predict univariate models consistently. We seek an explanation for this puzzle in terms of population properties. We derive bounds for the predictive R² of the true, but unknown, multivariate model from univariate ARMA parameters alone. These bounds can be quite tight, implying little forecasting gain even if we knew the true multivariate model. We illustrate using CPI inflation data. Supplementary materials for this article are available online.     

Variance stabilizing filters#

Abstract

In this paper new filters for removing unspecified form of heteroscedasticity are proposed. The filters build on the assumption that the variance of a pre-whitened time series can be viewed as a latent stochastic process by its own. This makes the filters flexible and useful in many situations. A simulation study shows that removing heteroscedasticity before fitting a model leads to efficiency gains and bias reductions when estimating the parameters of ARMA models. A real data study shows that pre-filtering can increase the forecasting precision of quarterly US GDP growth.     

ARMA MODELS REALIZATION AND IMPULSE RESPONSES

A parallel is made between the role played by covariances in the determination of auto-regressive models and the role played by impulse responses in the determination of ARMA models.

Auto-regressive models are known to maximize the Burg-entropy under covariance constraints. Auto-regressive-moving-average models give the maximum of the Burg-entropy among processes sharing the same covariances and impulse responses up to a certain lag. Such models are constructed by iterative or algebraic methods under the different constraints.

A new recursive method of identification of the order of an ARMA model is also developed, based on the generalized reflection coefficients.     

Order identification for gaussian moving averages using the covariation

In the traditional Box-Jenkins procedure for fitting ARMA time series models to data, the first step is order identification. The sample autocorrelation function can be used to identify pure moving average behavior. In this paper we consider using the autocovariation function identify the order of a univariate Gaussian time series. Simulation evidence indicates the suggested method may be a superior order identification tool when at least 100 observations are taken.     

Estimation in a bivariate integer-valued autoregressive process

ABSTRACT

A bivariate integer-valued autoregressive time series model is presented. The model structure is based on binomial thinning. The unconditional and conditional first and second moments are considered. Correlation structure of marginal processes is shown to be analogous to the ARMA(2, 1) model. Some estimation methods such as the Yule–Walker and conditional least squares are considered and the asymptotic distributions of the obtained estimators are derived. Comparison between bivariate model with binomial thinning and bivariate model with negative binomial thinning is given.     

Bayesian inference and forecasting in the stationary bilinear model

A stationary bilinear (SB) model can be used to describe processes with a time-varying degree of persistence that depends on past shocks. This study develops methods for Bayesian inference, model comparison, and forecasting in the SB model. Using monthly U.K. inflation data, we find that the SB model outperforms the random walk, first-order autoregressive AR(1), and autoregressive moving average ARMA(1,1) models in terms of root mean squared forecast errors. In addition, the SB model is superior to these three models in terms of predictive likelihood for the majority of forecast observations.     

A NOTE ON ARMA PARAMETERISATION*

This paper considers the relationship between ARMA parameterisations of models for y(t) and Ay(t), where A is invertible and y(t) is a vector time series (t = 0,±1,…). An ARMA model for the transformed series Ay(t) may have fewer parameters than a model for y(t). This paper shows that such a saving is illusory because the apparently saved parameters are exactly balanced by the number of new parameters appearing in A.     

Bayesian estimation for time-series regressions improved with exact likelihoods

We propose an estimation procedure for time-series regression models under the Bayesian inference framework. With the exact method of Wise [Wise, J. (1955). The autocorrelation function and spectral density function. Biometrika, 42, 151–159], an exact likelihood function can be obtained instead of the likelihood conditional on initial observations. The constraints on the parameter space arising from the stationarity conditions are handled by a reparametrization, which was not taken into consideration by Chib [Chib, S. (1993). Bayes regression with autoregressive errors: A Gibbs sampling approach. J. Econometrics, 58, 275–294] or Chib and Greenberg [Chib, S. and Greenberg, E. (1994). Bayes inference in regression model with ARMA(p, q) errors. J. Econometrics, 64, 183–206]. Simulation studies show that our method leads to better inferential results than their results.     

Maximum likelihood estimation for arma models in the presence of ARMA errors

An ARMA(p, q) process observed with an ARMA(c, d) error has an ARMA (p + c, k) representation with k = max(c + q, p + d) whose parameters satisfy some nonlinear constraints. Identification of the model is discussed. We develop Newton-Raphson estimators for the ARMA(p + c, k) process which take advantage of the information contained in the nonlinear restrictions. Explicit expressions for the derivatives of the restrictions are derived.     

Confidence Intervals for Conditional Tail Risk Measures in ARMA–GARCH Models

ABSTRACT

ARMA–GARCH models are widely used to model the conditional mean and conditional variance dynamics of returns on risky assets. Empirical results suggest heavy-tailed innovations with positive extreme value index for these models. Hence, one may use extreme value theory to estimate extreme quantiles of residuals. Using weak convergence of the weighted sequential tail empirical process of the residuals, we derive the limiting distribution of extreme conditional Value-at-Risk (CVaR) and conditional expected shortfall (CES) estimates for a wide range of extreme value index estimators. To construct confidence intervals, we propose to use self-normalization. This leads to improved coverage vis-à-vis the normal approximation, while delivering slightly wider confidence intervals. A data-driven choice of the number of upper order statistics in the estimation is suggested and shown to work well in simulations. An application to stock index returns documents the improvements of CVaR and CES forecasts.     

Autoregressive moving-average convolution processes on the unit circle

ARMA convolution models for processes in continuous space (in this case the unit circle) and discrete time are derived as a natural extension of the usual Box-Jenkins models. Both weakly time-stationary and nonstationary processes are considered. Sufficient conditions for the existence of weakly time-stationary AR_cMA_c processes are derived, and the covariance functions for some processes are computed. It is demonstrated that the usual scalar and multivariate ARMA processes can be embedded within the larger class of AR_CMA_c models. A possible application of these models to sea-surface temperature prediction is discussed.     

M‐estimation for general ARMA Processes with Infinite Variance

Abstract. General autoregressive moving average (ARMA) models extend the traditional ARMA models by removing the assumptions of causality and invertibility. The assumptions are not required under a non‐Gaussian setting for the identifiability of the model parameters in contrast to the Gaussian setting. We study M‐estimation for general ARMA processes with infinite variance, where the distribution of innovations is in the domain of attraction of a non‐Gaussian stable law. Following the approach taken by Davis et al. (1992) and Davis (1996) , we derive a functional limit theorem for random processes based on the objective function, and establish asymptotic properties of the M‐estimator. We also consider bootstrapping the M‐estimator and extend the results of Davis & Wu (1997) to the present setting so that statistical inferences are readily implemented. Simulation studies are conducted to evaluate the finite sample performance of the M‐estimation and bootstrap procedures. An empirical example of financial time series is also provided.     

A simulation study and evaluation of multivariate forecast based control charts applied to ARMA processes

Much research had been performed in the area of control charting techniques for monitoring autocorrelated processes, especially regarding forecast based monitoring schemes. Forecast based monitoring schemes involve fitting an appropriate time-series model to the process, generating one step ahead forecast errors, and monitoring the forecast errors with traditional control charts. Another method introduced into the literature involves using multivariate control charts to monitor the ARMA derived one-step-ahead (OSA) and two-step-ahead (TSA) forecast errors. This article provides a broad simulation study and evaluation of the suggested multivariate approaches in regards to various ARMA(1,1) and AR(1) processes, and a comparison to their univariate counterparts.     

Probabilistic Properties of Parametric Dual and Inverse Time Series Models Generated by ARMA Models

For the class of autoregressive-moving average (ARMA) processes, we examine the relationship between the dual and the inverse processes. It is demonstrated that the inverse process generated by a causal and invertible ARMA (p, q) process is a causal and invertible ARMA (q, p) model. Moreover, it is established that this representation is strong if and only if the generating process is Gaussian. More precisely, it is derived that the linear innovation process of the inverse process is an all-pass model. Some examples and applications to time reversibility are given to illustrate the obtained results.