Indirect estimation of randomized generalized autoregressive conditional heteroskedastic models

The class of generalized autoregressive conditional heteroskedastic (GARCH) models can be used to describe the volatility with less parameters than autoregressive conditional heteroskedastic (ARCH)-type models, their distributions are heavy-tailed, with time-dependent conditional variance, and are able to model clustering of volatility. Despite all these facts, the way that GARCH models are built imposes limits on the heaviness of the tails of their unconditional distribution. The class of randomized generalized autoregressive conditional heteroskedastic (R-GARCH) models includes the ARCH and GARCH models allowing the use of stable innovations. Estimation methods and empirical analysis of R-GARCH models are the focus of this work. We present the indirect inference method to estimate the R-GARCH models, some simulations and an empirical application.     

Binomial AR(1) processes with innovational outliers

Abstract

Binomial integer-valued AR processes have been well studied in the literature, but there is little progress in modeling bounded integer-valued time series with outliers. In this paper, we first review some basic properties of the binomial integer-valued AR(1) process and then we introduce binomial integer-valued AR(1) processes with two classes of innovational outliers. We focus on the joint conditional least squares (CLS) and the joint conditional maximum likelihood (CML) estimates of models’ parameters and the probability of occurrence of the outlier. Their large-sample properties are illustrated by simulation studies. Artificial and real data examples are used to demonstrate good performances of the proposed models.     

Nonlinear Autoregression with Positive Innovations

Use of nonlinear models in analyzing time series data is becoming increasingly popular. This paper considers a broad class of nonlinear autoregressive models where the autoregressive part is additive and the terms are nonlinear functions of the past data. Also, the innovation distribution is supported on the non-negative reals and satisfies a tail regularity condition. The linear parameters of the autoregression are estimated using a linear programming recipe which yields much more accurate estimates than traditional methods such as conditional least squares. Limiting distribution of the linear programming estimators is obtained. Simulation studies validate the asymptotic results and reveal excellent small sample properties of the LPE estimator.     

Extended binomial AR(1) processes with generalized binomial thinning operator

Abstract

In this article, we introduce an extended binomial AR(1) model based on the generalized binomial thinning operator. This operator relaxes the independence assumption of the binomial thinning operator and contains dependent Bernoulli counting series. The new model contains the binomial AR(1) model as a particular case. Some probabilistic and statistical properties are explored. Estimators of the model parameters are derived by conditional maximum likelihood (CML), conditional least squares (CLS) and weighted conditional least squares (WCLS) methods. Some asymptotic properties and numerical results of the estimators are studied. The good performance of the new model is illustrated, among other competitive models in the literature, by an application to the monthly drunken driving counts.     

Preliminary test of fit in a general class of conditionally heteroscedastic nonlinear time series

This article is concerned with a general class of conditionally heteroscedastic time series including possibly nonlinear and asymmetric autoregressive conditional heteroscedastic (ARCH) and generalized ARCH models. A problem of preliminary test of fit (PTF, hereafter) within the broad class under consideration is discussed. It is noted that contrary to usual tests in the literature of conditionally heteroscedastic time series, PTF does not require any specification of the conditional variance in advance. Based on the joint limit distributions of sample autocorrelations, a certain Portmanteau-type statistic for PTF is proposed, and its limit is shown to be a chi-square distribution. In addition, some simulation studies, under various innovations, are reported to support our theoretical results.     

Some statistical results on autoregressive conditionally heteroscedastic models

The aim of this paper is to present some statistical aspects of an order 1 autoregressive model with errors following a stationary and ergodic generalized threshold ARCH process. So, to analyse the precision of forecasts obtained with these models a probabilistic study will be done. Moreover, a consistent test for a general AR(1) model with errors following an ergodic white noise of null conditional median will be developed and adapted to our stochastic process.     

Transformed symmetric generalized autoregressive moving average models

Cordeiro and Andrade [Transformed generalized linear models. J Stat Plan Inference. 2009;139:2970–2987] incorporated the idea of transforming the response variable to the generalized autoregressive moving average (GARMA) model, introduced by Benjamin et al. [Generalized autoregressive moving average models. J Am Stat Assoc. 2003;98:214–223], thus developing the transformed generalized autoregressive moving average (TGARMA) model. The goal of this article is to develop the TGARMA model for symmetric continuous conditional distributions with a possible nonlinear structure for the mean that enables the fitting of a wide range of models to several time series data types. We derive an iterative process for estimating the parameters of the new model by maximum likelihood and obtain a simple formula to estimate the parameter that defines the transformation of the response variable. Furthermore, we determine the moments of the original dependent variable which generalize previous published results. We illustrate the theory by means of real data sets and evaluate the results developed through simulation studies.     

Quantile Regression for Location‐Scale Time Series Models with Conditional Heteroscedasticity

This paper considers quantile regression for a wide class of time series models including autoregressive and moving average (ARMA) models with asymmetric generalized autoregressive conditional heteroscedasticity errors. The classical mean‐variance models are reinterpreted as conditional location‐scale models so that the quantile regression method can be naturally geared into the considered models. The consistency and asymptotic normality of the quantile regression estimator is established in location‐scale time series models under mild conditions. In the application of this result to ARMA‐generalized autoregressive conditional heteroscedasticity models, more primitive conditions are deduced to obtain the asymptotic properties. For illustration, a simulation study and a real data analysis are provided.     

Residuals for the linear model with general covariance structure

A general theory is presented for residuals from the general linear model with correlated errors. It is demonstrated that there are two fundamental types of residual associated with this model, referred to here as the marginal and the conditional residual. These measure respectively the distance to the global aspects of the model as represented by the expected value and the local aspects as represented by the conditional expected value. These residuals may be multivariate. Some important dualities are developed which have simple implications for diagnostics. The results are illustrated by reference to model diagnostics in time series and in classical multivariate analysis with independent cases.     

Lindley first-order autoregressive model with applications

ABSTRACT

A new stationary first-order autoregressive process with Lindley marginal distribution, denoted as LAR(1) is introduced. We derive the probability function for the innovation process. We consider many properties of this process, involving spectral density, some multi-step ahead conditional measures, run probabilities, stationary solution, uniqueness and ergodicity. We estimate the unknown parameters of the process using three methods of estimation and investigate properties of the estimators with some numerical results to illustrate them. Some applications of the process are discussed to two real data sets and it is shown that the LAR(1) model fits better than other known non Gaussian AR(1) models.     

Constructing First Order Stationary Autoregressive Models via Latent Processes

First order stationary autoregressive (AR(1)) models are introduced for which there exists a linear relation between the expectations of the observations, and where it is readily possible to arrange the marginal distributions to be other than normal.     

Self-weighted recursive estimation of GARCH models

The generalized autoregressive conditional heteroscedasticity (GARCH) processes are frequently used to investigate and model financial returns. They are routinely estimated by computationally complex off-line estimation methods, for example, by the conditional maximum likelihood procedure. However, in many empirical applications (especially in the context of high-frequency financial data), it seems necessary to apply numerically more effective techniques to calibrate and monitor such models. The aims of this contribution are: (i) to review the previously introduced recursive estimation algorithms and to derive self-weighted alternatives applying general recursive identification instruments, and (ii) to examine these methods by means of simulations and an empirical application.     

Likelihood Function and Canonical Correlation Analysis of the Peña–Box Model

The Peña–Box model is a type of dynamic factor model whose factors try to capture the time-effect movements of a multiple time series. The Peña–Box model can be expressed as a vector autoregressive (VAR) model with constraints. This article derives the maximum likelihood estimates and the likelihood ratio test of the VAR model for Gaussian processes. Then a test statistic constructed by canonical correlation coefficients is presented and adjusted for conditional heteroscedasticity. Simulations confirm the validity of adjustments for conditional heteroscedasticity, and show that the proposed statistics perform better than the statistics used in the existing literature.     

A note on properties of spatial yule-walker estimators

For two-dimensional spatial autoregressive (AR) models, asymptotic properties of the spatial Yule-Walker (YW) estimators (Tjøstheim, 1978) are studied. These estimators although consistent, are shown to be asymptotically biased. Estimators from the first-order spatial bilateral AR model are looked at in more detail and the spatial YW estimators for this model are compared with the exact maximum likelihood estimators. Small sample properties of both estimators are also discussed briefly and some simulation results are presented.     

Asymptotic and Bootstrap Inference for AR(∞) Processes with Conditional Heteroskedasticity

The main contribution of this paper is a proof of the asymptotic validity of the application of the bootstrap to AR(∞) processes with unmodelled conditional heteroskedasticity. We first derive the asymptotic properties of the least-squares estimator of the autoregressive sieve parameters when the data are generated by a stationary linear process with martingale difference errors that are possibly subject to conditional heteroskedasticity of unknown form. These results are then used in establishing that a suitably constructed bootstrap estimator will have the same limit distribution as the least-squares estimator. Our results provide theoretical justification for the use of either the conventional asymptotic approximation based on robust standard errors or the bootstrap approximation of the distribution of autoregressive parameters. A simulation study suggests that the bootstrap approach tends to be more accurate in small samples.     

Estimation in conditional first order autoregression with discrete support

We consider estimation in the class of first order conditional linear autoregressive models with discrete support that are routinely used to model time series of counts. Various groups of estimators proposed in the literature are discussed: moment-based estimators; regression-based estimators; and likelihood-based estimators. Some of these have been used previously and others not. In particular, we address the performance of new types of generalized method of moments estimators and propose an exact maximum likelihood procedure valid for a Poisson marginal model using backcasting. The small sample properties of all estimators are comprehensively analyzed using simulation. Three situations are considered using data generated with: a fixed autoregressive parameter and equidispersed Poisson innovations; negative binomial innovations; and, additionally, a random autoregressive coefficient. The first set of experiments indicates that bias correction methods, not hitherto used in this context to our knowledge, are some-times needed and that likelihood-based estimators, as might be expected, perform well. The second two scenarios are representative of overdispersion. Methods designed specifically for the Poisson context now perform uniformly badly, but simple, bias-corrected, Yule-Walker and least squares estimators perform well in all cases.     

Real-Time Forecasts of the Real Price of Oil

We construct a monthly real-time dataset consisting of vintages for 1991.1–2010.12 that is suitable for generating forecasts of the real price of oil from a variety of models. We document that revisions of the data typically represent news, and we introduce backcasting and nowcasting techniques to fill gaps in the real-time data. We show that real-time forecasts of the real price of oil can be more accurate than the no-change forecast at horizons up to 1 year. In some cases, real-time mean squared prediction error (MSPE) reductions may be as high as 25% 1 month ahead and 24% 3 months ahead. This result is in striking contrast to related results in the literature for asset prices. In particular, recursive vector autoregressive (VAR) forecasts based on global oil market variables tend to have lower MSPE at short horizons than forecasts based on oil futures prices, forecasts based on autoregressive (AR) and autoregressive moving average (ARMA) models, and the no-change forecast. In addition, these VAR models have consistently higher directional accuracy.     

Beta seasonal autoregressive moving average models

In this paper, we introduce the class of beta seasonal autoregressive moving average (βSARMA) models for modelling and forecasting time series data that assume values in the standard unit interval. It generalizes the class of beta autoregressive moving average models [Rocha AV and Cribari-Neto F. Beta autoregressive moving average models. Test. 2009;18(3):529–545] by incorporating seasonal dynamics to the model dynamic structure. Besides introducing the new class of models, we develop parameter estimation, hypothesis testing inference, and diagnostic analysis tools. We also discuss out-of-sample forecasting. In particular, we provide closed-form expressions for the conditional score vector and for the conditional Fisher information matrix. We also evaluate the finite sample performances of conditional maximum likelihood estimators and white noise tests using Monte Carlo simulations. An empirical application is presented and discussed.     

A copula-based Markov chain model for the analysis of binary longitudinal data

A fully parametric first-order autoregressive (AR(1)) model is proposed to analyse binary longitudinal data. By using a discretized version of a copula, the modelling approach allows one to construct separate models for the marginal response and for the dependence between adjacent responses. In particular, the transition model that is focused on discretizes the Gaussian copula in such a way that the marginal is a Bernoulli distribution. A probit link is used to take into account concomitant information in the behaviour of the underlying marginal distribution. Fixed and time-varying covariates can be included in the model. The method is simple and is a natural extension of the AR(1) model for Gaussian series. Since the approach put forward is likelihood-based, it allows interpretations and inferences to be made that are not possible with semi-parametric approaches such as those based on generalized estimating equations. Data from a study designed to reduce the exposure of children to the sun are used to illustrate the methods.