Efficient estimation of auto-regression parameters and innovation distributions for semiparametric integer-valued AR(p) models

Summary.  Integer-valued auto-regressive (INAR) processes have been introduced to model non-negative integer-valued phenomena that evolve over time. The distribution of an INAR( p ) process is essentially described by two parameters: a vector of auto-regression coefficients and a probability distribution on the non-negative integers, called an immigration or innovation distribution. Traditionally, parametric models are considered where the innovation distribution is assumed to belong to a parametric family. The paper instead considers a more realistic semiparametric INAR( p ) model where there are essentially no restrictions on the innovation distribution. We provide an (semiparametrically) efficient estimator of both the auto-regression parameters and the innovation distribution.     

Risk aggregation with dependence and overdispersion based on the compound Poisson INAR(1) process

Abstract

This paper considers an extension of the classical discrete time risk model for which the claim numbers are assumed to be temporal dependence and overdispersion. The risk model proposed is based on the first-order integer-valued autoregressive (INAR(1)) process with discrete compound Poisson distributed innovations. The explicit expression for the moment generating function of the discounted aggregate claim amount is derived. Some numerical examples are provided to illustrate the impacts of dependence and overdispersion on related quantities such as the stop-loss premium, the value at risk and the tail value at risk.     

Some asymptotic properties in INAR(1) processes with Poisson marginals

The first-order integer-valued autoregressive (INAR(1)) process with Poisson marginal distributions is considered. It is shown that the sample autocovariance function of the model is asymptotically normally distributed. We derive asymptotic distribution of Yule-Walker type estimators of parameters. It turns out that our Yule-Walker type estimators are better than the conditional least squares estimators proposed by Klimko and Nelson (1978) and Al-Osh and Alzaid (1987). also, we study the relationship between the model andM/M/∞ queueing system.     

Binomial AR(1) processes with innovational outliers

Abstract

Binomial integer-valued AR processes have been well studied in the literature, but there is little progress in modeling bounded integer-valued time series with outliers. In this paper, we first review some basic properties of the binomial integer-valued AR(1) process and then we introduce binomial integer-valued AR(1) processes with two classes of innovational outliers. We focus on the joint conditional least squares (CLS) and the joint conditional maximum likelihood (CML) estimates of models’ parameters and the probability of occurrence of the outlier. Their large-sample properties are illustrated by simulation studies. Artificial and real data examples are used to demonstrate good performances of the proposed models.     

Process capability analysis for serially dependent processes of Poisson counts

Process capability indices evaluate the actual compliance of a process with given external specifications in a single number. For the case of a process of independent and identically distributed Poisson counts, two types of index have been proposed and investigated in the literature. The assumption of serial independence, however, is quite unrealistic for practice. We consider the case of an underlying Poisson INAR(1) process which has an AR(1)-like autocorrelation structure. We show that the performance of the estimated indices is degraded heavily if serial dependence is ignored. Therefore, we develop approaches for estimating the process capability (both for the observation and innovation process), which explicitly consider the observed degree of autocorrelation. For this purpose, we introduce a new unbiased estimator of the innovations’ mean of a Poisson INAR(1) process and derive its exact as well as asymptotic stochastic properties. In this context, we also present new explicit expressions for the third- and fourth-order moments of a Poisson INAR(1) process. Then the capability indices and the performance of their estimators are analysed and recommendations for practice are given.     

Detecting mean increases in Poisson INAR(1) processes with EWMA control charts

Processes of serially dependent Poisson counts are commonly observed in real-world applications and can often be modeled by the first-order integer-valued autoregressive (INAR) model. For detecting positive shifts in the mean of a Poisson INAR(1) process, we propose the one-sided s exponentially weighted moving average (EWMA) control chart, which is based on a new type of rounding operation. The s-EWMA chart allows computing average run length (ARLs) exactly and efficiently with a Markov chain approach. Using an implementation of this procedure for ARL computation, the s-EWMA chart is easily designed, which is demonstrated with a real-data example. Based on an extensive study of ARLs, the out-of-control performance of the chart is analyzed and compared with that of a c chart and a one-sided cumulative sum (CUSUM) chart. We also investigate the robustness of the chart against departures from the assumed Poisson marginal distribution.     

Estimating monotonic change in the rate and dependence parameters of INAR(1) process (Case study: IP counts data)

In this article, we consider a first-order integer-valued autoregressive (INAR(1)) model. Then, we propose change point estimators for the rate and dependence parameters in INAR(1) model using maximum likelihood estimation method when the type of change belongs to a family of monotonic changes. To monitor the process, a combined EWMA and c control chart is considered. The results show that the proposed change point estimators provide efficient estimates of the change time. At the end, to illustrate the application of the proposed estimators, a real case related to IP counts data is investigated.     

A Proposal for a New Bound for Discrete Distributions

In this work we re-examine some classical bounds for non negative integer-valued random variables by means of information theoretic or maxentropic techniques using fractional moments as constraints. The proposed new bound, no more analytically expressible in terms of moments or moment generating function (mgf), is built by mixing classical bounds and the Maximum Entropy (ME) approximant of the underlying distribution; such a new bound is able to exploit optimally all the information content provided by the sequence of given moments or by the mgf. Particular care will be devoted to obtain fractional moments from the available information given in terms of integer moments and/or moment generating function. Numerical examples show clearly that the bound improvement involving the ME approximant based on fractional moments is not trivial.     

A new geometric INAR(1) process based on counting series with deflation or inflation of zeros

In this paper, we introduce a new non-negative integer-valued autoregressive time series model based on a new thinning operator, so called generalized zero-modified geometric (GZMG) thinning operator. The first part of the paper is devoted to the distribution, GZMG distribution, which is obtained as the convolution of the zero-modified geometric (ZMG) distributed random variables. Some properties of this distribution are derived. Then, we construct a thinning operator based on the counting processes with ZMG distribution. Finally, an INAR(1) time series model is introduced and its properties including estimation issues are derived and discussed. A small Monte Carlo experiment is conducted to evaluate the performance of maximum likelihood estimators in finite samples. At the end of the paper, we consider an empirical illustration of the introduced INAR(1) model.     

Integer-valued autoregressive models for counts showing underdispersion

The Poisson distribution is a simple and popular model for count-data random variables, but it suffers from the equidispersion requirement, which is often not met in practice. While models for overdispersed counts have been discussed intensively in the literature, the opposite phenomenon, underdispersion, has received only little attention, especially in a time series context. We start with a detailed survey of distribution models allowing for underdispersion, discuss their properties and highlight possible disadvantages. After having identified two model families with attractive properties as well as only two model parameters, we combine these models with the INAR(1) model (integer-valued autoregressive), which is particularly well suited to obtain auotocorrelated counts with underdispersion. Properties of the resulting stationary INAR(1) models and approaches for parameter estimation are considered, as well as possible extensions to higher order autoregressions. Three real-data examples illustrate the application of the models in practice.     

Diagnostic checks for integer-valued autoregressive models using expected residuals

Integer-valued time series models make use of thinning operators for coherency in the nature of count data. However, the thinning operators make residuals unobservable and are the main difficulty in developing diagnostic tools for autocorrelated count data. In this regard, we introduce a new residual, which takes the form of predictive distribution functions, to assess probabilistic forecasts, and this new residual is supplemented by a modified usual residuals. Under integer-valued autoregressive (INAR) models, the properties of these two residuals are investigated and used to evaluate the predictive performance and model adequacy of the INAR models. We compare our residuals with the existing residuals through simulation studies and apply our method to select an appropriate INAR model for an over-dispersed real data.     

On first-order integer-valued autoregressive process with Katz family innovations

This paper considers the first-order integer-valued autoregressive (INAR) process with Katz family innovations. This family of INAR processes includes a broad class of INAR(1) processes with Poisson, negative binomial, and binomial innovations, respectively, featuring equi-, over-, and under-dispersion. Its probabilistic properties such as ergodicity and stationarity are investigated and the formula of the marginal mean and variance is provided. Further, a statistical process control procedure based on the cumulative sum control chart is considered to monitor autocorrelated count processes. A simulation and real data analysis are conducted for illustration.     

On Fisher’s dispersion test for integer-valued autoregressive Poisson models with applications

The integer-valued autoregressive (INAR) model has been widely used in diverse fields. Since the task of identifying the underlying distribution of time-series models is a crucial step for further inferences, we consider the goodness-of-fit test for the Poisson assumption on first-order INAR models. For a test, we employ Fisher’s dispersion test due to its simplicity and then derive its null limiting distribution. As an illustration, a simulation study and real data analysis are conducted for the counts of coal mining disasters, the monthly crime data set from New South Wales, and the annual numbers of worldwide earthquakes.     

A discrete-time risk model with Poisson ARCH claim-number process

Abstract

In this paper, we propose a discrete-time risk model with the claim number following an integer-valued autoregressive conditional heteroscedasticity (ARCH) process with Poisson deviates. In this model, the current claim number depends on the previous observations. Within this framework, the equation for finding the adjustment coefficient is derived. Numerical studies are also carried out to examine the impact of the Poisson ARCH dependence structure on the ruin probability.     

Time series models associated with Mittag-Leffler type distributions and its properties

ABSTRACT

We have provided a fractional generalization of the Poisson renewal processes by replacing the first time derivative in the relaxation equation of the survival probability by a fractional derivative of order α(0 < α ? 1). A generalized Laplacian model associated with the Mittag-Leffler distribution is examined. We also discuss some properties of this new model and its relevance to time series. Distribution of gliding sums, regression behaviors, and sample path properties are studied. Finally we introduce the q-Mittag-Leffler process associated with the q-Mittag-Leffler distribution.     

Modelling of low count heavy tailed time series data consisting large number of zeros and ones

In this paper, we construct a new mixture of geometric INAR(1) process for modeling over-dispersed count time series data, in particular data consisting of large number of zeros and ones. For some real data sets, the existing INAR(1) processes do not fit well, e.g., the geometric INAR(1) process overestimates the number of zero observations and underestimates the one observations, whereas Poisson INAR(1) process underestimates the zero observations and overestimates the one observations. Furthermore, for heavy tails, the PINAR(1) process performs poorly in the tail part. The existing zero-inflated Poisson INAR(1) and compound Poisson INAR(1) processes have the same kind of limitations. In order to remove this problem of under-fitting at one point and over-fitting at others points, we add some extra probability at one in the geometric INAR(1) process and build a new mixture of geometric INAR(1) process. Surprisingly, for some real data sets, it removes the problem of under and over-fitting over all the observations up to a significant extent. We then study the stationarity and ergodicity of the proposed process. Different methods of parameter estimation, namely the Yule-Walker and the quasi-maximum likelihood estimation procedures are discussed and illustrated using some simulation experiments. Furthermore, we discuss the future prediction along with some different forecasting accuracy measures. Two real data sets are analyzed to illustrate the effective use of the proposed model.     

Integer autoregressive models with structural breaks

Even though integer-valued time series are common in practice, the methods for their analysis have been developed only in recent past. Several models for stationary processes with discrete marginal distributions have been proposed in the literature. Such processes assume the parameters of the model to remain constant throughout the time period. However, this need not be true in practice. In this paper, we introduce non-stationary integer-valued autoregressive (INAR) models with structural breaks to model a situation, where the parameters of the INAR process do not remain constant over time. Such models are useful while modelling count data time series with structural breaks. The Bayesian and Markov Chain Monte Carlo (MCMC) procedures for the estimation of the parameters and break points of such models are discussed. We illustrate the model and estimation procedure with the help of a simulation study. The proposed model is applied to the two real biometrical data sets.     

Simultaneous confidence regions for the parameters of a Poisson INAR(1) model

The INAR(1) model (integer-valued autoregressive) is commonly used to model serially dependent processes of Poisson counts. We propose several asymptotic simultaneous confidence regions for the two parameters of a Poisson INAR(1) model, and investigate their performance and robustness for finite-length time series in a simulation study. Practical recommendations are derived, and the application of the confidence regions is illustrated by a real-data example.     

Modelling a non-stationary BINAR(1) Poisson process

ABSTRACT

Non-stationarity in bivariate time series of counts may be induced by a number of time-varying covariates affecting the bivariate responses due to which the innovation terms of the individual series as well as the bivariate dependence structure becomes non-stationary. So far, in the existing models, the innovation terms of individual INAR(1) series and the dependence structure are assumed to be constant even though the individual time series are non-stationary. Under this assumption, the reliability of the regression and correlation estimates is questionable. Besides, the existing estimation methodologies such as the conditional maximum likelihood (CMLE) and the composite likelihood estimation are computationally intensive. To address these issues, this paper proposes a BINAR(1) model where the innovation series follow a bivariate Poisson distribution under some non-stationary distributional assumptions. The method of generalized quasi-likelihood (GQL) is used to estimate the regression effects while the serial and bivariate correlations are estimated using a robust moment estimation technique. The application of model and estimation method is made in the simulated data. The GQL method is also compared with the CMLE, generalized method of moments (GMM) and generalized estimating equation (GEE) approaches where through simulation studies, it is shown that GQL yields more efficient estimates than GMM and equally or slightly more efficient estimates than CMLE and GEE.     

A Study for Missing Values in PINAR(1)T Processes

In this paper, we propose several approaches to estimate the parameters of the periodic first-order integer-valued autoregressive process with period T (PINAR(1)_T) in the presence of missing data. By using incomplete data, we propose two approaches that are based on the conditional expectation and conditional likelihood to estimate the parameters of interest. Then we study three kinds of imputation methods for the missing data. The performances of these approaches are compared via simulations.