Monitoring correlated processes with binomial marginals

Few approaches for monitoring autocorrelated attribute data have been proposed in the literature. If the marginal process distribution is binomial, then the binomial AR(1) model as a realistic and well-interpretable process model may be adequate. Based on known and newly derived statistical properties of this model, we shall develop approaches to monitor a binomial AR(1) process, and investigate their performance in a simulation study. A case study demonstrates the applicability of the binomial AR(1) model and of the proposed control charts to problems from statistical process control.     

Binomial AR(1) processes: moments,cumulants, and estimation

The modelling and analysis of count-data time series are areas of emerging interest with various applications in practice. We consider the particular case of the binomial AR(1) model, which is well suited for describing binomial counts with a first-order autoregressive serial dependence structure. We derive explicit expressions for the joint (central) moments and cumulants up to order 4. Then, we apply these results for expressing moments and asymptotic distribution of the squared difference estimator as an alternative to the sample autocovariance. We also analyse the asymptotic distribution of the conditional least-squares estimators of the parameters of the binomial AR(1) model. The finite-sample performance of these estimators is investigated in a simulation study, and we apply them to real data about computerized workstations.     

HAC Corrections for Strongly Autocorrelated Time Series

Applied work routinely relies on heteroscedasticity and autocorrelation consistent (HAC) standard errors when conducting inference in a time series setting. As is well known, however, these corrections perform poorly in small samples under pronounced autocorrelations. In this article, I first provide a review of popular methods to clarify the reasons for this failure. I then derive inference that remains valid under a specific form of strong dependence. In particular, I assume that the long-run properties can be approximated by a stationary Gaussian AR(1) model, with coefficient arbitrarily close to one. In this setting, I derive tests that come close to maximizing a weighted average power criterion. Small sample simulations show these tests to perform well, also in a regression context.     

First order autoregressive time series with negative binomial and geometric marginals

In this paper we present first order autoregressive (AR(1)) time series with negative binomial and geometric marginals. These processes are the discrete analogues of the gamma and exponential processes introduced by Sim (1990). Many properties of the processes discussed here, such as autocorrelation, regression and joint distributions, are studied.     

The sample autocorrelation function of I(1) processes

In case of a random walk the theoretical autocorrelations tend to one asymptotically. The sample autocorrelations, however, may decline rather fast even with large samples. We will explain this observation by deriving the asymptotic distribution that turns out to be closely related to the Dickey-Fuller (1979) distribution. Moreover we discuss the behaviour of the sample autocorrelations of integrated MA(1) and AR(1) processes. In order to prove our results we consider more general I(1) processes and apply the functional central limit theorem injected to time series analysis by Phillips (1987). We obtain unit root tests that are based on autocorrelation estimators of higher lags. We discuss their finite sample behaviour experimentally.     

Cressie–Read Power-Divergence Statistics for Non-Gaussian Vector Stationary Processes

Abstract.  For a class of vector-valued non-Gaussian stationary processes, we develop the Cressie–Read power-divergence (CR) statistic approach which has been proposed for the i.i.d. case. The CR statistic includes empirical likelihood as a special case. Therefore, by adopting this CR statistic approach, the theory of estimation and testing based on empirical likelihood is greatly extended. We use an extended Whittle likelihood as score function and derive the asymptotic distribution of the CR statistic. We apply this result to estimation of autocorrelation and the AR coefficient, and get narrower confidence intervals than those obtained by existing methods. We also consider the power properties of the test based on asymptotic theory. Under a sequence of contiguous local alternatives, we derive the asymptotic distribution of the CR statistic. The problem of testing autocorrelation is discussed and we introduce some interesting properties of the local power.     

Extended binomial AR(1) processes with generalized binomial thinning operator

Abstract

In this article, we introduce an extended binomial AR(1) model based on the generalized binomial thinning operator. This operator relaxes the independence assumption of the binomial thinning operator and contains dependent Bernoulli counting series. The new model contains the binomial AR(1) model as a particular case. Some probabilistic and statistical properties are explored. Estimators of the model parameters are derived by conditional maximum likelihood (CML), conditional least squares (CLS) and weighted conditional least squares (WCLS) methods. Some asymptotic properties and numerical results of the estimators are studied. The good performance of the new model is illustrated, among other competitive models in the literature, by an application to the monthly drunken driving counts.     

Parameter estimation for binomial AR(1) models with applications in finance and industry

Methods for analyzing and modeling count data time series are used in various fields of practice, and they are particularly relevant for applications in finance and economy. We consider the binomial autoregressive (AR(1)) model for count data processes with a first-order AR dependence structure and a binomial marginal distribution. We present four approaches for estimating its model parameters based on given time series data, and we derive expressions for the asymptotic distribution of these estimators. Then we investigate the finite-sample performance of the estimators and of the respective asymptotic approximations in a simulation study, including a discussion of the 2-block jackknife. We illustrate our methods and findings with a real-data example about transactions at the Korea stock market. We conclude with an application of our results for obtaining reliable estimates for process capability indices.     

Dependence Estimation for High‐frequency Sampled Multivariate CARMA Models

The paper considers high‐frequency sampled multivariate continuous‐time autoregressive moving average (MCARMA) models and derives the asymptotic behaviour of the sample autocovariance function to a normal random matrix. Moreover, we obtain the asymptotic behaviour of the cross‐covariances between different components of the model. We will see that the limit distribution of the sample autocovariance function has a similar structure in the continuous‐time and in the discrete‐time model. As a special case, we consider a CARMA (one‐dimensional MCARMA) process. For a CARMA process, we prove Bartlett's formula for the sample autocorrelation function. Bartlett's formula has the same form in both models; only the sums in the discrete‐time model are exchanged by integrals in the continuous‐time model. Finally, we present limit results for multivariate MA processes as well, which are not known in this generality in the multivariate setting yet.     

Process capability analysis for serially dependent processes of Poisson counts

Process capability indices evaluate the actual compliance of a process with given external specifications in a single number. For the case of a process of independent and identically distributed Poisson counts, two types of index have been proposed and investigated in the literature. The assumption of serial independence, however, is quite unrealistic for practice. We consider the case of an underlying Poisson INAR(1) process which has an AR(1)-like autocorrelation structure. We show that the performance of the estimated indices is degraded heavily if serial dependence is ignored. Therefore, we develop approaches for estimating the process capability (both for the observation and innovation process), which explicitly consider the observed degree of autocorrelation. For this purpose, we introduce a new unbiased estimator of the innovations’ mean of a Poisson INAR(1) process and derive its exact as well as asymptotic stochastic properties. In this context, we also present new explicit expressions for the third- and fourth-order moments of a Poisson INAR(1) process. Then the capability indices and the performance of their estimators are analysed and recommendations for practice are given.     

Estimation in a bivariate integer-valued autoregressive process

ABSTRACT

A bivariate integer-valued autoregressive time series model is presented. The model structure is based on binomial thinning. The unconditional and conditional first and second moments are considered. Correlation structure of marginal processes is shown to be analogous to the ARMA(2, 1) model. Some estimation methods such as the Yule–Walker and conditional least squares are considered and the asymptotic distributions of the obtained estimators are derived. Comparison between bivariate model with binomial thinning and bivariate model with negative binomial thinning is given.     

Sample moments of the autocorrelations of moving average processes and a modification to bartlett'sasymptotic variance formula

In this paper we express the sample autocorrelations for a moving average process of order q as a function of its own theoretical autocorrelations and the sample autocorrelations for the generating white noise series. Approximate analytic expressions are then obtained forthe moments of the sample autocorrelations of the moving average process.

Using these expressions, together with numerical evidence, we show that Bartlett's asymptotic formula for the variance of the sample autocorrelations of moving average processes, which is used widely in identifying these processes, is a large overestimate when considering finitesample sizes.

Our approach is for motivational purposes and so is purely formal, the amount of mathematics presented being kept to a minimum.     

A new geometric first-order integer-valued autoregressive (NGINAR(1)) process

A new stationary first-order integer-valued autoregressive process with geometric marginal distributions is introduced based on negative binomial thinning. Some properties of the process are established. Estimators of the parameters of the process are obtained using the methods of conditional least squares, Yule–Walker and maximum likelihood. Also, the asymptotic properties of the estimators are derived involving their distributions. Some numerical results of the estimators are presented with a discussion to the obtained results. Real data are used and a possible application is discussed.     

Some weighted mixed portmanteau tests for diagnostic checking in linear time series models

The popular diagnostic checking methods in linear time series models are portmanteau tests based on either residual autocorrelation functions (acf) or partial autocorrelation functions (pacf). In this paper, we device some new weighted mixed portmanteau tests by appropriately combining individual tests based on both acf and pacf. We derive the asymptotic distribution of such weighted mixed portmanteau statistics and study their size and power. It is found that the weighted mixed tests outperform when higher order ARMA models are fitted and diagnostic checks are performed via testing lack of residual autocorrelations. Simulation results suggest to use the proposed tests as complementary to those classical tests found in literature. An illustrative application is given to demonstrate the usefulness of the mixed test.     

A New Test for Short Memory in Long Memory Time Series

This article considers short memory characteristics in a long memory process. We derive new asymptotic results for the sample autocorrelation difference ratios. We used these results to develop a new portmanteau test that determines if short memory parameters are statistically significant. In simulations, the new test can detect short memory components more often than the Ljung-Box test when these short memory components are in fact within a long memory process. Interestingly, our test finds short memory autocorrelations in U.S. inflation rate data, whereas the Ljung-Box test fails to find these autocorrelations. Modeling these short memory autocorrelations of the inflation rate data leads to improved model accuracy and more precise prediction.     

Asymptotic variance–covariance matrix of sample autocorrelations for threshold-asymmetric GARCH processes

In the field of financial time series, threshold-asymmetric conditional variance models can be used to explain asymmetric volatilities [C.W. Li and W.K. Li, On a double-threshold autoregressive heteroscedastic time series model, J. Appl. Econometrics 11 (1996), pp. 253–274]. In this paper, we consider a broad class of threshold-asymmetric GARCH processes (TAGARCH, hereafter) including standard ARCH and GARCH models as special cases. Since sample autocorrelation function provides a useful information to identify an appropriate time-series model for the data, we derive asymptotic distributions of sample autocorrelations both for original process and for squared process. It is verified that standard errors of sample autocorrelations for TAGARCH models are significantly different from unity for lower lags and they are exponentially converging to unity for higher lags. Furthermore they are shown to be asymptotically dependent while being independent of standard GARCH models. These results will be interesting in the light of the fact that TAGARCH processes are serially uncorrelated. A simulation study is reported to illustrate our results.     

THE EFFECTS OF CORRELATION AMONG OBSERVATIONS ON THE ACCURACY OF APPROXIMATING THE DISTRIBUTION OF SAMPLE MEAN BY ITS ASYMPTOTIC DISTRIBUTION1

In this paper, we investigate the effects of correlation among observations on the accuracy of approximating the distribution of sample mean by its asymptotic distribution. The accuracy is investigated by the Berry-Esseen bound (BEB), which gives an upper bound on the error of approximation of the distribution function of the sample mean from its asymptotic distribution for independent observations. For a given sample size (n₀) the BEB is obtained when the observations are independent. Let this be BEB. We then find the sample size (n_*) required to have BEB below BEB₀, when the observations are dependent. Comparison of n_* with n₀ reveals the effects of correlation among observations on the accuracy of the asymptotic distribution as an approximation. It is shown that the effects of correlation among observations are not appreciable if the correlation is moderate to small but it can be severe for extreme correlations.     

A comparison of LS/ML and GMM estimation in a simple AR(1) model

This paper compares least squares (LS)/maximum likelihood (ML) and generalised method of moments (GMM) estimation in a simple. Gaussian autoregressive of order one (AR(1)) model. First, we show that the usual LS/ML estimator is a corner solution to a general minimisation problem that involves two moment conditions, while the new GMM we devise is not. Secondly, we examine asymptotic and finite sample properties of the new GMM estimator in comparison to the usual LS/ML estimator in a simple AR(1) model. For both stable and unstable (unit root) specifications, we show asymptotic equivalence of the distributions of the two estimators. However, in finite samples, the new GMM estimator performs better.     

Estimation du comportement asymptotique des autocovariances et autocorrelations empiriques de processus multivariéeas

Statistics based on the sample autocovariances are widely used in time-series analysis. Estimators of the asymptotic covariance between the sample autocovariances are commonly derived from the so-called Bartlett's formula. However, this formula essentially holds for linear processes. This entails that for a wide range of nonlinear time series the above-mentioned estimators are not suitable. In this paper the behaviour of an alternative estimator is studied within the framework of centered or uncentered multivariate strongly mixing processes. Applications to differential functions of sample autocovariances, such as the sample autocorrelations, are considered.     

A central limit theorem for the sample autocorrelations of a Lévy driven continuous time moving average process

In this article we consider Lévy driven continuous time moving average processes observed on a lattice, which are stationary time series. We show asymptotic normality of the sample mean, the sample autocovariances and the sample autocorrelations. A comparison with the classical setting of discrete moving average time series shows that in the last case a correction term should be added to the classical Bartlett formula that yields the asymptotic variance. An application to the asymptotic normality of the estimator of the Hurst exponent of fractional Lévy processes is also deduced from these results.