Semiparametric Time Series Models with Log‐concave Innovations: Maximum Likelihood Estimation and its Consistency

We study semiparametric time series models with innovations following a log‐concave distribution. We propose a general maximum likelihood framework that allows us to estimate simultaneously the parameters of the model and the density of the innovations. This framework can be easily adapted to many well‐known models, including autoregressive moving average (ARMA), generalized autoregressive conditionally heteroscedastic (GARCH), and ARMA‐GARCH models. Furthermore, we show that the estimator under our new framework is consistent in both ARMA and ARMA‐GARCH settings. We demonstrate its finite sample performance via a thorough simulation study and apply it to model the daily log‐return of the FTSE 100 index.     

On change point test for ARMA–GARCH models: Bootstrap approach

The problem of testing for a parameter change has been a core issue in time series analysis. It is well known that the estimates-based CUSUM test often suffers from severe size distortions in general GARCH type models. The residual-based CUSUM test has been used as an alternative, which, however, has a defect not to detect the ARMA parameter changes in ARMA–GARCH models. As a remedy, one can employ the score vector-based CUSUM test in ARMA–GARCH models as in Oh and Lee (0000). However, it shows some size distortions for relatively small samples. Hence, we consider the bootstrap counterpart for obtaining a more stable test. Focus is made on the verification of the weak consistency of the proposed test. An empirical study is illustrated for its evaluation.     

A note on Jarque–Bera normality test for ARMA–GARCH innovations

In this paper, we study the Jarque–Bera (JB) normality test for the innovations of ARMA–GARCH models, whose construction is based on the residuals. The validity of the JB test for ARMA–GARCH innovations should be carefully investigated in advance of actual practice, since the residual-based test may behave differently, depending upon the structure of the time series models and the form of the test statistic (cf. Chen and Kuan, 2003, Hwang and Baek, 2009, Lee and Wei, 1999). In order to demonstrate the validity of the JB test, we prove that the asymptotic distribution of the original form of the JB test is identical to that of the test statistic based on true errors under mild conditions. Simulation results are provided for illustration.     

Comparison of the finite mixture of ARMA-GARCH,back propagation neural networks and support-vector machines in forecasting financial returns

The use of GARCH type models and computational-intelligence-based techniques for forecasting financial time series has been proved extremely successful in recent times. In this article, we apply the finite mixture of ARMA-GARCH model instead of AR or ARMA models to compare with the standard BP and SVM in forecasting financial time series (daily stock market index returns and exchange rate returns). We do not apply the pure GARCH model as the finite mixture of the ARMA-GARCH model outperforms the pure GARCH model. These models are evaluated on five performance metrics or criteria. Our experiment shows that the SVM model outperforms both the finite mixture of ARMA-GARCH and BP models in deviation performance criteria. In direction performance criteria, the finite mixture of ARMA-GARCH model performs better. The memory property of these forecasting techniques is also examined using the behavior of forecasted values vis-à-vis the original values. Only the SVM model shows long memory property in forecasting financial returns.     

Consistent testing for non‐correlation of two cointegrated ARMA time series

A consistent approach to the problem of testing non‐correlation between two univariate infinite‐order autoregressive models was proposed by Hong (1996). His test is based on a weighted sum of squares of residual cross‐correlations, with weights depending on a kernel function. In this paper, the author follows Hong's approach to test non‐correlation of two cointegrated (or partially non‐stationary) ARMA time series. The test of Pham, Roy & Cédras (2003) may be seen as a special case of his approach, as it corresponds to the choice of a truncated uniform kernel. The proposed procedure remains valid for testing non‐correlation between two stationary invertible multivariate ARMA time series. The author derives the asymptotic distribution of his test statistics under the null hypothesis and proves that his procedures are consistent. He also studies the level and power of his proposed tests in finite samples through simulation. Finally, he presents an illustration based on real data.     

The effect of non-normal disturbances and conditional heteroskedasticity on multiple cointegration tests

!t is well-known that Johansen's multiple cointegration tests' results and those of Johansen and Juselius' tests for restricrions on cointegrating vectors and their weights have far-reaching implications for economic modelling and analysis. Therefore, it is important to ensure that the tests have desirable finite sample properties. Although the statistics are derived under Gaussian distribution,the asympotic results are derived under a much wider class of distributions. Using simulation, this paper investigates the effect of non-normal disturbances on these tests in finite samples. Further, ARCH/GARCH type conditional heteroskedasticity is present in many economic and financial time series. This paper examines the finite properties of the tests when the error term follows ARCH/GARCH type processes. From the evidence, it appears that researchers should not be overly concerned by the possibility of small departures from non-normality when using Johansen's suggested techniques even in finite samples. ARCH and GARCH effects may be more problematic, however. In particular it becomes more important ro test whether the restriction implicit in the integrated (or near-integrated) ARCH-type Drocess actually holds in time series for the application of the cointegraiion rank tests and the test for restrictions on cointegrating weights. The tests for restrictions on cointegrating vectors apper to be robust for non-normal errors and for all ARCH and GARCH type processes considered.     

Value-at-risk forecasting based on Gaussian mixture ARMA–GARCH model

In this paper, we develop a new forecasting algorithm for value-at-risk (VaR) based on ARMA–GARCH (autoregressive moving average–generalized autoregressive conditional heteroskedastic) models whose innovations follow a Gaussian mixture distribution. For the parameter estimation, we employ the conditional least squares and quasi-maximum-likelihood estimator (QMLE) for ARMA and GARCH parameters, respectively. In particular, Gaussian mixture parameters are estimated based on the residuals obtained from the QMLE of GARCH parameters. Our algorithm provides a handy methodology, spending much less time in calculation than the existing resampling and bias-correction method developed in Hartz et al. [Accurate value-at-risk forecasting based on the normal-GARCH model, Comput. Stat. Data Anal. 50 (2006), pp. 3032–3052]. Through a simulation study and a real-data analysis, it is shown that our method provides an accurate VaR prediction.     

Asymptotic Inefficiency of Mean-Correction on Parameter Estimation for a Periodic First-Order Autoregressive Model

A common practice in time series analysis is to fit a centered model to the mean-corrected data set. For stationary autoregressive moving-average (ARMA) processes, as far as the parameter estimation is concerned, fitting an ARMA model without intercepts to the mean-corrected series is asymptotically equivalent to fitting an ARMA model with intercepts to the observed series. We show that, related to the parameter least squares estimation of periodic ARMA models, the second approach can be arbitrarily more efficient than the mean-corrected counterpart. This property is illustrated by means of a periodic first-order autoregressive model. The asymptotic variance of the estimators for both approaches is derived. Moreover, empirical experiments based on simulations investigate the finite sample properties of the estimators.     

基于图方法的MA和ARMA模型系数检验

应用图模型方法来讨论传统的MA和ARMA模型,证明了MA和ARMA模型的系数为去掉其他时间序列分量线性效应的条件下的偏相关系数,且利用图模型推断算法提出了一种新的参数估计和检验方法。     

Prequential omnibus goodness-of-fit tests for stochastic processes: A numerical study

This article is a contribution to the study of an omnibus goodness-of-fit (Gof) test based on Rosenblatt Probability Integral Transform (RPIT) within Dawid's prequential framework. This Gof test is easy to use since it has a common test statistic (with apparently the same asymptotic distribution) for a wide range of stochastic models. Intensive Monte-Carlo simulations are presented to investigate the behavior of this test for several stochastic models: renewal, autoregressive (AR, ARMA, ARCH, GARCH) and Poisson processes, generalized linear models... These simulations suggest that the RPIT test could be used to test the fit of a wide range of stochastic models but it may be not powerful when compared to Gof tests specifically designed for the tested processes. It is also conjectured that this test is still appropriate for testing the Gof of any discrete-time stochastic process provided that efficient estimators are used.     

Generalized EGARCH Random Effect Models Application to Financial Time Series

In this article, we propose a simple alternative model to analyze the volatility of the financial time series. In the applications, the performance of this model is compared with the performance of the GARCH type models. Using GARCH, EGARCH, and the proposed models, we analyze the time series of the Bovespa and Dow Jones Industrial Average indexes. In the applications we can see that the proposed models have good performance compared with the usual GARCH type model.     

Data cloning estimation of GARCH and COGARCH models

GARCH models include most of the stylized facts of financial time series and they have been largely used to analyse discrete financial time series. In the last years, continuous-time models based on discrete GARCH models have been also proposed to deal with non-equally spaced observations, as COGARCH model based on Lévy processes. In this paper, we propose to use the data cloning methodology in order to obtain estimators of GARCH and COGARCH model parameters. Data cloning methodology uses a Bayesian approach to obtain approximate maximum likelihood estimators avoiding numerically maximization of the pseudo-likelihood function. After a simulation study for both GARCH and COGARCH models using data cloning, we apply this technique to model the behaviour of some NASDAQ time series.     

Parameter Estimation Robust to Low-Frequency Contamination

We provide methods to robustly estimate the parameters of stationary ergodic short-memory time series models in the potential presence of additive low-frequency contamination. The types of contamination covered include level shifts (changes in mean) and monotone or smooth time trends, both of which have been shown to bias parameter estimates toward regions of persistence in a variety of contexts. The estimators presented here minimize trimmed frequency domain quasi-maximum likelihood (FDQML) objective functions without requiring specification of the low-frequency contaminating component. When proper sample size-dependent trimmings are used, the FDQML estimators are consistent and asymptotically normal, asymptotically eliminating the presence of any spurious persistence. These asymptotic results also hold in the absence of additive low-frequency contamination, enabling the practitioner to robustly estimate model parameters without prior knowledge of whether contamination is present. Popular time series models that fit into the framework of this article include autoregressive moving average (ARMA), stochastic volatility, generalized autoregressive conditional heteroscedasticity (GARCH), and autoregressive conditional heteroscedasticity (ARCH) models. We explore the finite sample properties of the trimmed FDQML estimators of the parameters of some of these models, providing practical guidance on trimming choice. Empirical estimation results suggest that a large portion of the apparent persistence in certain volatility time series may indeed be spurious. Supplementary materials for this article are available online.     

ASSESSING AND TESTING FOR THRESHOLD NONLINEARITY IN STOCK RETURNS

This paper proposes a test for threshold nonlinearity in a time series with generalized autore‐gressive conditional heteroscedasticity (GARCH) volatility dynamics. This test is used to examine whether financial returns on market indices exhibit asymmetric mean and volatility around a threshold value, using a double‐threshold GARCH model. The test adopts the reversible‐jump Markov chain Monte Carlo idea of Green, proposed in 1995, to calculate the posterior probabilities for a conventional GARCH model and a double‐threshold GARCH model. Posterior evidence favouring the threshold GARCH model indicates threshold nonlinearity with asymmetric behaviour of the mean and volatility. Simulation experiments demonstrate that the test works very well in distinguishing between the conventional GARCH and the double‐threshold GARCH models. In an application to eight international financial market indices, including the G‐7 countries, clear evidence supporting the hypothesis of threshold nonlinearity is discovered, simultaneously indicating an uneven mean‐reverting pattern and volatility asymmetry around a threshold return value.     

Forecasting Contemporaneously Aggregated Vector ARMA Processes

Given a multiple time series that is generated by a multivariate ARMA process and assuming the objective is to forecast a weighted sum of the individual variables, then under a mean squared error measure of forecasting precision, it is preferable to forecast the disaggregated multiple time series and aggregate the forecasts, rather than forecast the aggregated series directly, if the involved processes are known. This result fails to hold if the processes used for forecasting are estimated from a given set of time series data. The implications of these results for empirical research are investigated using different sets of economic data.     

The effect of temporal aggregation on the estimation accuracy of time series models

In time series analysis, Autoregressive Moving Average (ARMA) models play a central role. Because of the importance of parameter estimation in ARMA modeling and since it is based on aggregate time series so often, we analyze the effect of temporal aggregation on estimation accuracy. We derive the relationships between the aggregate and the basic parameters and compute the actual values of the former from those of the latter in order to measure and compare their estimation accuracy. We run a simulation experiment that shows that aggregation seriously worsens estimation accuracy and that the impact increases with the order of aggregation.     

On Fan's adaptive Neyman tests for comparing two spectral densities

In this paper, we consider tests for assessing whether two stationary and independent time series have the same spectral densities (or same autocovariance functions). Both frequency domain and time domain test statistics for this purpose are reviewed. The adaptive Neyman tests are then introduced and their performances are investigated. Our tests are adaptive, that is, they are constructed completely by the data and do not involve any unknown smoothing parameters. Simulation studies show that our proposed tests are at least comparable to the current tests in most cases. Furthermore, our tests are much more powerful in some cases, such as against the long orders of autoregressive moving average (ARMA) models such as seasonal ARMA series.     

GARCH-Type Models and Performance of Information Criteria

This article discusses the ability of information criteria toward the correct selection of different especially higher-order generalized autoregressive conditional heteroscedasticity (GARCH) processes, based on their probability of correct selection as a measure of performance. Each of the considered GARCH processes is further simulated at different parameter combinations to study the possible effect of different volatility structures on these information criteria. We notice an impact from the volatility structure of time series on the performance of these criteria. Moreover, the influence of sample size, having an impact on the performance of these criteria toward correct selection, is observed.     

BL-GARCH models and asymmetries in volatility

In this paper the class of Bilinear GARCH (BL-GARCH) models is proposed. BL-GARCH models allow to capture asymmetries in the conditional variance of financial and economic time series by means of interactions between past shocks and volatilities. The availability of likelihood based inference is an attractive feature of BL-GARCH models. Under the assumption of conditional normality, the log-likelihood function can be maximized by means of an EM type algorithm. The main reason for using the EM algorithm is that it allows to obtain parameter estimates which naturally guarantee the positive definiteness of the conditional variance with no need for additional parameter constraints. We also derive a robust LM test statistic which can be used for model identification. Finally, the effectiveness of BL-GARCH models in capturing asymmetric volatility patterns in financial time series is assessed by means of an application to a time series of daily returns on the NASDAQ Composite stock market index.     

Measuring Time Series Predictability Using Support Vector Regression

Most studies involving statistical time series analysis rely on assumptions of linearity, which by its simplicity facilitates parameter interpretation and estimation. However, the linearity assumption may be too restrictive for many practical applications. The implementation of nonlinear models in time series analysis involves the estimation of a large set of parameters, frequently leading to overfitting problems. In this article, a predictability coefficient is estimated using a combination of nonlinear autoregressive models and the use of support vector regression in this model is explored. We illustrate the usefulness and interpretability of results by using electroencephalographic records of an epileptic patient.