CUSUM control schemes for monitoring the covariance matrix of multivariate time series

Modified cumulative sum (CUSUM) control charts and CUSUM schemes for residuals are suggested to detect changes in the covariance matrix of multivariate time series. Several properties of these schemes are derived when the in-control process is a stationary Gaussian process. A Monte Carlo study reveals that the proposed approaches show similar or even better performance than the schemes based on the multivariate exponentially weighted moving average (MEWMA) recursion. We illustrate how the control procedures can be applied to monitor the covariance structure of developed stock market indices.     

Autoregressiv model identification for multivariate time series

A procedure is developed for the identification of autoregressive models for stationary invertible multivariate Gaussian time series. Model selection is based on either the AIC information criterion or on a statistic called CVR, cross-validatory residual sum of squares. An example is given to show that the forecasts generated by these models compare favorably with those generated by other common time series modeling techniques.     

Application of the Generalized Likelihood Ratio Test for Detecting Changes in the Mean of Multivariate GARCH Processes

We derive several multivariate control charts to monitor the mean vector of multi-variate GARCH processes under the presence of changes, by means of maximizing the generalized likelihood ratio. This presentation is rounded up by a comparative performance study based on extensive Monte Carlo simulations. An empirical illustration shows how the obtained results can be applied to real data.     

Statistical surveillance of the mean vector and the covariance matrix of nonlinear time series

The purpose of this paper is to jointly monitor the mean vector and the covariance matrix of multivariate nonlinear times series. The underlying target process is assumed to be a constant conditional correlation process Bollerslev (Rev Econ Stat 72:498–505, 1990) or a dynamic conditional correlation model Engle (J Bus Econ Stat 20:339–350, 2002). We introduce several EWMA and CUSUM control charts. These control schemes are based on univariate EWMA statistics, multivariate EWMA recursions, and different types of cumulative sums. The recursions are applied to local measures for means and covariances, e.g. the present observations and the conditional covariances. Further, they are applied to means and covariances of residuals. The control statistics are obtained by computing the Mahalanobis distance between the EWMA or CUSUM statistics and their expectations if no change occurs. Via Monte Carlo simulation the performance of the proposed charts is compared. Our empirical study illustrates an application of these control procedures to bivariate logarithmic returns of the European indices FTSE100 and DAX. In order to assess the performance of the introduced schemes we apply the average run length and the maximum conditional expected delay.     

A statistical approach to social network monitoring

Social network monitoring consists of monitoring changes in networks with the aim of detecting significant ones and attempting to identify assignable cause(s) contributing to the occurrence of a change. This paper proposes a method that helps to overcome some of the weaknesses of the existing methods. A Poisson regression model for the probability of the number of communications between network members as a function of vertex attributes is constructed. Multivariate exponentially weighted moving average (MEWMA) and multivariate cumulative sum (MCUSUM) control charts are used to monitor the network formation process. The results indicate more efficient performance for the MEWMA chart in identifying significant changes.     

CUSUM charts for monitoring the mean of a multivariate Gaussian process

In this paper control charts for the mean of a multivariate Gaussian process are considered. Using the generalized likelihood ratio approach and the sequential probability ratio test under an additional constraint on the magnitude of the change various types of CUSUM control charts are derived. It is analyzed under which conditions these schemes are directionally invariant. These charts are compared with several other control schemes proposed in literature. The performance of the charts is studied based on the maximum average delay.     

Monitoring means and covariances of multivariate non linear time series with heavy tails

In this paper, the focus is on sequential analysis of multivariate financial time series with heavy tails. The mean vector and the covariance matrix of multivariate non linear models are simultaneously monitored by modifying conventional control charts to identify structural changes in the data. The considered target process is a constant conditional correlation model (cf. Bollerslev, 1990 Bollerslev, T. (1990). Modeling the coherence in short-run nominal exchange rates: A multivariate generalized ARCH model. Rev. Econ. Stat. 72:498–505.[Crossref], [Web of Science ®] , [Google Scholar]), an extended constant conditional correlation model (cf. He and Teräsvirta, 2004 He, C., Teräsvirta, T. (2004). An extended constant conditional correlation GARCH model and its fourth-moment structure. Economet. Theory 20:904–926.[Crossref], [Web of Science ®] , [Google Scholar]), a dynamic conditional correlation model (cf. Engle, 2002 Engle, R.F. (2002). Dynamic conditional correlation: A simple class of multivariate GARCH models. J. Bus. Econ. Stat. 20(3):339–350.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]), or a generalized dynamic conditional correlation model (cf. Capiello et al., 2006 Capiello, L., Engle, R., Sheppard, K. (2006). Asymmetric correlations in the dynamics of global equity and bond returns. J. Financial Economet. 4(4):537–572.[Crossref] , [Google Scholar]). For statistical surveillance we use control charts based on residuals. Further, the procedures are constructed for t-distribution. The detection speed of these charts is compared via Monte Carlo simulation. In the empirical study, the procedure with the best performance is applied to log-returns of the stock market indices FTSE and CAC.     

Understanding the Kalman Filter

This is an expository article. Here we show how the successfully used Kalman filter, popular with control engineers and other scientists, can be easily understood by statisticians if we use a Bayesian formulation and some well-known results in multivariate statistics. We also give a simple example illustrating the use of the Kalman filter for quality control work.     

An extension of the multivariate Chebyshev's inequality to a random vector with a singular covariance matrix

ABSTRACT

We extend Chebyshev's inequality to a random vector with a singular covariance matrix. Then we consider the case of a multivariate normal distribution for this generalization.     

Phase-II monitoring and diagnosing of multivariate categorical processes using generalized linear test-based control charts

In this paper, two control charts based on the generalized linear test (GLT) and contingency table are proposed for Phase-II monitoring of multivariate categorical processes. The performances of the proposed methods are compared with the exponentially weighted moving average-generalized likelihood ratio test (EWMA-GLRT) control chart proposed in the literature. The results show the better performance of the proposed control charts under moderate and large shifts. Moreover, a new scheme is proposed to identify the parameter responsible for an out-of-control signal. The performance of the proposed diagnosing procedure is evaluated through some simulation experiments.     

Estimates of regression coefficients based on the sign covariance matrix

Summary. A new estimator of the regression parameters is introduced in a multivariate multiple-regression model in which both the vector of explanatory variables and the vector of response variables are assumed to be random. The affine equivariant estimate matrix is constructed using the sign covariance matrix (SCM) where the sign concept is based on Oja's criterion function. The influence function and asymptotic theory are developed to consider robustness and limiting efficiencies of the SCM regression estimate. The estimate is shown to be consistent with a limiting multinormal distribution. The influence function, as a function of the length of the contamination vector, is shown to be linear in elliptic cases; for the least squares (LS) estimate it is quadratic. The asymptotic relative efficiencies with respect to the LS estimate are given in the multivariate normal as well as the t -distribution cases. The SCM regression estimate is highly efficient in the multivariate normal case and, for heavy-tailed distributions, it performs better than the LS estimate. Simulations are used to consider finite sample efficiencies with similar results. The theory is illustrated with an example.     

The use of Andrews curves for detecting the out-of-control variables when a multivariate control chart signals

The aim of this paper is to present a new method for solving the problem of detecting the out-of-control variables when a multivariate control chart signals. The main idea is based on Andrews curves. The proposed method is investigated thoroughly and is proved to have interesting results in comparison to a competing method.     

Bayesian modelling of the mean and covariance matrix in normal nonlinear models

An important problem in statistics is the study of longitudinal data taking into account the effect of other explanatory variables such as treatments and time. In this paper, a new Bayesian approach for analysing longitudinal data is proposed. This innovative approach takes into account the possibility of having nonlinear regression structures on the mean and linear regression structures on the variance–covariance matrix of normal observations, and it is based on the modelling strategy suggested by Pourahmadi [M. Pourahmadi, Joint mean-covariance models with applications to longitudinal data: Unconstrained parameterizations, Biometrika, 87 (1999), pp. 667–690.]. We initially extend the classical methodology to accommodate the fitting of nonlinear mean models then we propose our Bayesian approach based on a generalization of the Metropolis–Hastings algorithm of Cepeda [E.C. Cepeda, Variability modeling in generalized linear models, Unpublished Ph.D. Thesis, Mathematics Institute, Universidade Federal do Rio de Janeiro, 2001]. Finally, we illustrate the proposed methodology by analysing one example, the cattle data set, that is used to study cattle growth.     

Hierarchical Bayesian analysis of a discrete time series of Poisson counts

A problem involving non-stationary, discrete-time series of counts from a Poisson process with a varying but smooth intensity function is studied. A smoothness prior for the underlying intensity process is modelled using the hierarchical Bayesian approach, which is shown to provide an AR(1) representation for the intensity process. Since conjugate priors are not assumed, analytic derivation of estimates and predictions of the Poisson series are not available. Some reasonably good approximations are given and illustrated using data on British road casualties before and after the introduction of the seatbelt law.     

A Comparison of Spatiotemporal Surveillance Methods for Nonhomogeneous Change Size

Spatiotemporal surveillance, especially in detection of emerging outbreaks is of particular importance. When an outbreak spreads across some areas, the incidence rate at the center of the outbreak area might be expected to be much higher than the rate at its edge. However, to the best of our knowledge, all existing methods assume a uniformly increasing rate across the entire area of the outbreak. The purpose of this study is to compare the performance of the spatiotemporal surveillance methods such as multivariate cumulative sum (MCUSUM) or multivariate exponentially weighted moving average (MEWMA) when the changes in size are nonhomogeneous. Monte Carlo simulations were conducted to examine the properties of these spatiotemporal surveillance methods and compared them in terms of the detection speed and the identification rate under various scenarios. The results showed that when nonhomogeneous change sizes are involved, the MCUSUM method taking into account spatial nonhomogeneity of increase rates yields a better identification than the method ignoring such change size pattern although the detection speeds are similar. Further, a case study for the detection of male thyroid cancer data in New Mexico in the United States was performed to demonstrate the applicability of these methods.     

Exponentially weighted moving average charts for correlated multivariate Poisson processes

In this article, we study exponentially weighted moving average (EWMA) control schemes to monitor the multivariate Poisson distribution with a general covariance structure, so that the practitioner can simultaneously monitor multiple correlated attribute processes more effectively. The statistical performance of the charts is assessed in terms of the run length properties and compared against other mainstream attribute control schemes. The application of the proposed methods to real-life and simulated datasets is demonstrated.     

On control charts for monitoring the variance of a time series

In this paper we derive control charts for the variance of a Gaussian process using the likelihood ratio approach, the generalized likelihood ratio approach, the sequential probability ratio method and a generalized sequential probability ratio procedure, the Shiryaev–Roberts procedure and a generalized modified Shiryaev–Roberts approach. Recursive presentations for the calculation of the control statistics are given for autoregressive processes of order 1. In an extensive simulation study these schemes are compared with existing control charts for the variance. In order to asses the performance of the schemes both the average run length and the average delay are used.     

Application of copulas to multivariate control charts

The most popular multivariate control chart for monitoring the mean of a distribution is probably the Hotelling T² rule. Unfortunately, this rule relies on the assumption that the distribution under control is Gaussian, which is rarely true in practice. The objective of this paper is to propose a new approach for the non-normal multivariate case. It consists in the construction of a tolerance region obtained from a density level set estimation. The method follows a “plug-in” approach in which the density of the observations is previously estimated. This estimation is conducted using copulas modeling, an increasingly popular tool in multivariate modeling.     

Making control charts more effective by time series analysis: three illustrative applications

Control charts contribute to the monitoring and improvement of process quality by helping to separate out special cause variation from common cause variation. By common cause variation we mean the usual variation in an in-control process. Special causes can be thought of as disturbances, possibly transitory, impacting a process that is in a state of statistical control. However, there is no clear place in this scheme of special causes and common causes for systematic non-iid variation, such as trend, seasonal, autoregression variation, and intervention effects from efforts to improve the proess. When systematic non-iid variation is present, time series modeling and fitting can fill in this picture. In the time series framework, observations influenced by special causes can be treated as outliers from the currently-entertained time-series model and can be detected by outlier detection methods. We discuss three data sets that illustrate how this can be done in order to make control charts more effective. We show also how a standard control-chart supplement called "pattern analysis" can be useful in time-series work.