Flexible Bivariate INAR(1) Processes Using Copulas

Multivariate count time series data occur in many different disciplines. The class of INteger-valued AutoRegressive (INAR) processes has the great advantage to consider explicitly both the discreteness and autocorrelation characterizing this type of data. Moreover, extensions of the simple INAR(1) model to the multi-dimensional space make it possible to model more than one series simultaneously. However, existing models do not offer great flexibility for dependence modelling, allowing only for positive correlation. In this work, we consider a bivariate INAR(1) (BINAR(1)) process where cross-correlation is introduced through the use of copulas for the specification of the joint distribution of the innovations. We mainly emphasize on the parametric case that arises under the assumption of Poisson marginals. Other marginal distributions are also considered. A short application on a bivariate financial count series illustrates the model.     

Fractional approaches for the distribution of innovation sequence of INAR(1) processes

Abstract

In this paper, we present a fractional decomposition of the probability generating function of the innovation process of the first-order non-negative integer-valued autoregressive [INAR(1)] process to obtain the corresponding probability mass function. We also provide a comprehensive review of integer-valued time series models, based on the concept of thinning operators with geometric-type marginals. In particular, we develop two fractional approaches to obtain the distribution of innovation processes of the INAR(1) model and show that the distribution of the innovations sequence has geometric-type distribution. These approaches are discussed in detail and illustrated through a few examples.     

A new geometric INAR(1) process based on counting series with deflation or inflation of zeros

In this paper, we introduce a new non-negative integer-valued autoregressive time series model based on a new thinning operator, so called generalized zero-modified geometric (GZMG) thinning operator. The first part of the paper is devoted to the distribution, GZMG distribution, which is obtained as the convolution of the zero-modified geometric (ZMG) distributed random variables. Some properties of this distribution are derived. Then, we construct a thinning operator based on the counting processes with ZMG distribution. Finally, an INAR(1) time series model is introduced and its properties including estimation issues are derived and discussed. A small Monte Carlo experiment is conducted to evaluate the performance of maximum likelihood estimators in finite samples. At the end of the paper, we consider an empirical illustration of the introduced INAR(1) model.     

Diagnostic checks for discrete data regression models using posterior predictive simulations

Model checking with discrete data regressions can be difficult because the usual methods such as residual plots have complicated reference distributions that depend on the parameters in the model. Posterior predictive checks have been proposed as a Bayesian way to average the results of goodness-of-fit tests in the presence of uncertainty in estimation of the parameters. We try this approach using a variety of discrepancy variables for generalized linear models fitted to a historical data set on behavioural learning. We then discuss the general applicability of our findings in the context of a recent applied example on which we have worked. We find that the following discrepancy variables work well, in the sense of being easy to interpret and sensitive to important model failures: structured displays of the entire data set, general discrepancy variables based on plots of binned or smoothed residuals versus predictors and specific discrepancy variables created on the basis of the particular concerns arising in an application. Plots of binned residuals are especially easy to use because their predictive distributions under the model are sufficiently simple that model checks can often be made implicitly. The following discrepancy variables did not work well: scatterplots of latent residuals defined from an underlying continuous model and quantile–quantile plots of these residuals.     

Integer autoregressive models with structural breaks

Even though integer-valued time series are common in practice, the methods for their analysis have been developed only in recent past. Several models for stationary processes with discrete marginal distributions have been proposed in the literature. Such processes assume the parameters of the model to remain constant throughout the time period. However, this need not be true in practice. In this paper, we introduce non-stationary integer-valued autoregressive (INAR) models with structural breaks to model a situation, where the parameters of the INAR process do not remain constant over time. Such models are useful while modelling count data time series with structural breaks. The Bayesian and Markov Chain Monte Carlo (MCMC) procedures for the estimation of the parameters and break points of such models are discussed. We illustrate the model and estimation procedure with the help of a simulation study. The proposed model is applied to the two real biometrical data sets.     

A geometric time series model with a new dependent Bernoulli counting series

ABSTRACT

New generalized binomial thinning operator with dependent counting series is introduced. An integer valued time series model with geometric marginals based on this thinning operator is constructed. Main features of the process are analyzed and determined. Estimation of the parameters are presented and some asymptotic properties of the obtained estimators are discussed. Behavior of the estimators is described through the numerical results. Also, model is applied on the real data set and compared to some relevant INAR(1) models.     

Modelling of low count heavy tailed time series data consisting large number of zeros and ones

In this paper, we construct a new mixture of geometric INAR(1) process for modeling over-dispersed count time series data, in particular data consisting of large number of zeros and ones. For some real data sets, the existing INAR(1) processes do not fit well, e.g., the geometric INAR(1) process overestimates the number of zero observations and underestimates the one observations, whereas Poisson INAR(1) process underestimates the zero observations and overestimates the one observations. Furthermore, for heavy tails, the PINAR(1) process performs poorly in the tail part. The existing zero-inflated Poisson INAR(1) and compound Poisson INAR(1) processes have the same kind of limitations. In order to remove this problem of under-fitting at one point and over-fitting at others points, we add some extra probability at one in the geometric INAR(1) process and build a new mixture of geometric INAR(1) process. Surprisingly, for some real data sets, it removes the problem of under and over-fitting over all the observations up to a significant extent. We then study the stationarity and ergodicity of the proposed process. Different methods of parameter estimation, namely the Yule-Walker and the quasi-maximum likelihood estimation procedures are discussed and illustrated using some simulation experiments. Furthermore, we discuss the future prediction along with some different forecasting accuracy measures. Two real data sets are analyzed to illustrate the effective use of the proposed model.     

The predictive distributions of thinning‐based count processes

This paper shows that the term structure of conditional (i.e. predictive) distributions allows for closed form expression in a large family of (possibly higher order or infinite order) thinning‐based count processes such as INAR(p), INARCH(p), NBAR(p), and INGARCH(1,1). Such predictive distributions are currently often deemed intractable by the literature and existing approximation methods are usually time consuming and induce approximation errors. In this paper, we propose a Taylor's expansion algorithm for these predictive distributions, which is both exact and fast. Through extensive simulation exercises, we demonstrate its advantages with respect to existing methods in terms of the computational gain and/or precision.     

Negative binomial time series models based on expectation thinning operators

The study of count data time series has been active in the past decade, mainly in theory and model construction. There are different ways to construct time series models with a geometric autocorrelation function, and a given univariate margin such as negative binomial. In this paper, we investigate negative binomial time series models based on the binomial thinning and two other expectation thinning operators, and show how they differ in conditional variance or heteroscedasticity. Since the model construction is in terms of probability generating functions, typically, the relevant conditional probability mass functions do not have explicit forms. In order to do simulations, likelihood inference, graphical diagnostics and prediction, we use a numerical method for inversion of characteristic functions. We illustrate the numerical methods and compare the various negative binomial time series models for a real data example.     

A bivariate first-order signed integer-valued autoregressive process

Bivariate integer-valued time series occur in many areas, such as finance, epidemiology, business etc. In this article, we present bivariate autoregressive integer-valued time-series models, based on the signed thinning operator. Compared to classical bivariate INAR models, the new processes have the advantage to allow for negative values for both the time series and the autocorrelation functions. Strict stationarity and ergodicity of the processes are established. The moments and the autocovariance functions are determined. The conditional least squares estimator of the model parameters is considered and the asymptotic properties of the obtained estimators are derived. An analysis of a real dataset from finance and a simulation study are carried out to assess the performance of the model.     

On Shifted Geometric INAR(1) Models Based on Geometric Counting Series

Two types of shifted geometric integer valued autoregressive models of order one (SGINAR(1)) are proposed. Both are based on the thinning operator generated by counting series of i.i.d. geometric random variables. Their correlation properties are derived and compared. Also, regression and conditional variance are considered. Nonparametric estimators of model parameters are obtained and their asymptotic characterizations are given. Finally, these two models are applied to a real-life data set and they are compared to some referent INAR(1) models.     

Separated hypotheses testing for autoregressive models with non-negative residuals

Normal residual is one of the usual assumptions in autoregressive model but sometimes in practice we are faced with non-negative residuals. In this paper, we have derived modified maximum likelihood estimators of parameters of the residuals and autoregressive coefficient. Also asymptotic distribution of modified maximum likelihood estimators in both stationary and non-stationary models are computed. So that, we can derive asymptotic distribution of unit root, Vuong's and Cox's tests statistics in stationary situation. Using simulation, it shows that Akaike information criterion and Vuong's test work to select the optimal autoregressive model with non-negative residuals. Sometimes Vuong's test select two competing models as equivalent models. These models may be suitable or unsuitable equivalent models. So we consider Cox's test to make inference after model selection. Kolmogorov–Smirnov test confirms our results. Also we have computed tracking interval for competing models to choosing between two close competing models when Vuong's test and Cox's test cannot detect the differences.     

Residual analysis for parametric models fit to censored data

The focus of this paper is on residual analysis for the lognormal and extreme value or Weibull models, although the proposed methods can be applied to any parametric model. Residuals developed by Barlow and Prentice (1988) for the Cox proportional hazards model are extended to the parametric model setting. Three different residuals are proposed based on this approach with two residuals measuring the impact of survival time and one measuring the impact of the covariates included in the model. In addition, a residual derived from the deviations equality presented in Efron and Johnstone (1990) and the residual proposed by Joergensen (1984) for censored data models are discussed.     

A geometric time-series model with an alternative dependent Bernoulli counting series

In this article, we first introduce an alternative way for construction of the generalized binomial thinning operator with dependent counting series. Some properties of this thinning operator are derived and discussed. Then, by using this thinning operator, we introduce an integer-valued time-series model with geometric marginals. Some conditional and unconditional properties of this model are derived and discussed. Some estimation methods are considered and for some of them, asymptotic properties of the obtained estimates are derived. Performances of the estimates are discussed through some simulations. Finally, a real data example is considered and the goodness-of-fit of this model is compared with the models based on the binomial, negative binomial, and dependent binomial thinning operators.     

Semi-parametric forecasts of the implied volatility surface using regression trees

We present a new semi-parametric model for the prediction of implied volatility surfaces that can be estimated using machine learning algorithms. Given a reasonable starting model, a boosting algorithm based on regression trees sequentially minimizes generalized residuals computed as differences between observed and estimated implied volatilities. To overcome the poor predictive power of existing models, we include a grid in the region of interest, and implement a cross-validation strategy to find an optimal stopping value for the boosting procedure. Back testing the out-of-sample performance on a large data set of implied volatilities from S&P 500 options, we provide empirical evidence of the strong predictive power of our model.     

Deviance residuals in generalised log-gamma regression models with censored observations

In this article, we compare three residuals based on the deviance component in generalised log-gamma regression models with censored observations. For different parameter settings, sample sizes and censoring percentages, various simulation studies are performed and the empirical distribution of each residual is displayed and compared with the standard normal distribution. For all cases studied, the empirical distributions of the proposed residuals are in general symmetric around zero, but only a martingale-type residual presented negligible kurtosis for the majority of the cases studied. These studies suggest that the residual analysis usually performed in normal linear regression models can be straightforwardly extended for the martingale-type residual in generalised log-gamma regression models with censored data. A lifetime data set is analysed under log-gamma regression models and a model checking based on the martingale-type residual is performed.     

Residuals for log-Burr XII regression models in survival analysis

In this paper, we compare three residuals to assess departures from the error assumptions as well as to detect outlying observations in log-Burr XII regression models with censored observations. These residuals can also be used for the log-logistic regression model, which is a special case of the log-Burr XII regression model. For different parameter settings, sample sizes and censoring percentages, various simulation studies are performed and the empirical distribution of each residual is displayed and compared with the standard normal distribution. These studies suggest that the residual analysis usually performed in normal linear regression models can be straightforwardly extended to the modified martingale-type residual in log-Burr XII regression models with censored data.     

multiple and conditional deletion diagnostics for general linear models

In this paper we develop multiple case deletion statistics for the general linear model so that a residual vector and a leverage matrix are identified which have roles analogous to residuals and leverage for ordinary least squares models. We extend the notion of the conditional deletion diagnostic to general linear models. The residuals, leverage and deletion diagnostics are illustrated with data modelled by a linear growth curve.     

On Fisher’s dispersion test for integer-valued autoregressive Poisson models with applications

The integer-valued autoregressive (INAR) model has been widely used in diverse fields. Since the task of identifying the underlying distribution of time-series models is a crucial step for further inferences, we consider the goodness-of-fit test for the Poisson assumption on first-order INAR models. For a test, we employ Fisher’s dispersion test due to its simplicity and then derive its null limiting distribution. As an illustration, a simulation study and real data analysis are conducted for the counts of coal mining disasters, the monthly crime data set from New South Wales, and the annual numbers of worldwide earthquakes.     

Thinning operations for modeling time series of counts—a survey

The analysis of time series of counts is an emerging field of science. To obtain an ARMA-like autocorrelation structure, many models make use of thinning operations to adapt the ARMA recursion to the integer-valued case. Most popular among these probabilistic operations is the concept of binomial thinning, leading to the class of INARMA models. These models are proved to be useful, especially for processes of Poisson counts, but may lead to difficulties in the case of different count distributions. Therefore, several alternative thinning concepts have been developed. This article reviews such thinning operations and shows how they are successfully applied to define integer-valued ARMA models.