Statistical Monitoring of Autocorrelated Simple Linear Profiles Based on Principal Components Analysis

In this article, a transformation method using the principal component analysis approach is first applied to remove the existing autocorrelation within each profile in Phase I monitoring of autocorrelated simple linear profiles. This easy-to-use approach is independent of the autocorrelation coefficient. Moreover, since it is a model-free method, it can be used for Phase I monitoring procedures. Then, five control schemes are proposed to monitor the parameters of the profile with uncorrelated error terms. The performances of the proposed control charts are evaluated and are compared through simulation experiments based on different values of autocorrelation coefficient as well as different shift scenarios in the parameters of the profile in terms of probability of receiving an out-of-control signal.     

On the Monitoring of Autocorrelated Linear Profiles

Control charts are commonly used to monitor quality of a process or product characterized by a quality characteristic or a vector of quality characteristics. However, in many practical situations the quality of a process or product can be characterized by a function or profile. Here we consider a linear function and investigate the violation of common independence assumption implicitly considered in most control charting applications. We specifically consider the case when profiles are not independent from each other over time. In this article, the effect of autocorrelation between profiles is investigated using average run length (ARL) criterion. Simulation results indicate significant impact on the ARL values when autocorrelation is overlooked. In addition, three methods based on time series approach are used to eliminate the effect of autocorrelation. Their performances are compared using ARL criterion.     

Mantel test for spatial functional data

Statistics for spatial functional data is an emerging field in statistics which combines methods of spatial statistics and functional data analysis to model spatially correlated functional data. Checking for spatial autocorrelation is an important step in the statistical analysis of spatial data. Several statistics to achieve this goal have been proposed. The test based on the Mantel statistic is widely known and used in this context. This paper proposes an application of this test to the case of spatial functional data. Although we focus particularly on geostatistical functional data, that is functional data observed in a region with spatial continuity, the test proposed can also be applied with functional data which can be measured on a discrete set of areas of a region (areal functional data) by defining properly the distance between the areas. Based on two simulation studies, we show that the proposed test has a good performance. We illustrate the methodology by applying it to an agronomic data set.     

SVM-like decision theoretical classification of high-dimensional vectors

In this paper, we consider the classification of high-dimensional vectors based on a small number of training samples from each class. The proposed method follows the Bayesian paradigm, and it is based on a small vector which can be viewed as the regression of the new observation on the space spanned by the training samples. The classification method provides posterior probabilities that the new vector belongs to each of the classes, hence it adapts naturally to any number of classes. Furthermore, we show a direct similarity between the proposed method and the multicategory linear support vector machine introduced in Lee et al. [2004. Multicategory support vector machines: theory and applications to the classification of microarray data and satellite radiance data. Journal of the American Statistical Association 99 (465), 67–81]. We compare the performance of the technique proposed in this paper with the SVM classifier using real-life military and microarray datasets. The study shows that the misclassification errors of both methods are very similar, and that the posterior probabilities assigned to each class are fairly accurate.     

Simple Robust Tests for Autocorrelated Errors in Time Series Design Intervention Models

A simple, robust test for the autocorrelation parameter in an intervention time-series model (AB design) is proposed. It is analogous to the traditional tests and can easily be computed by using the freeware R. In the same way as traditional tests of autocorrelation are based on least squares (LS) fits of a linear model, our robust test is based on the highly efficient Wilcoxon fit of the linear model. We present the results of a Monte Carlo study which show that our robust test inherits the good efficiency properties of this Wilcoxon fit. Its empirical power is only slightly less than the empirical power of the least squares test over situations with normally distributed errors while it exhibited much more power over situations with error distributions having tails heavier than those of a normal distribution. It also showed robustness of validity over all null situations simulated. We also present the results of the application of our test to a real data set which illustrates the robustness of our test.     

The effect of autocorrelation on the retrospective X-chart

Quality control chart interpretation is usually based on the assumption that successive observations are independent over time. In this article we show the effect of autocorrelation on the retrospective Shewhart chart for individuals, often referred to as the X-chart, with the control limits based on moving ranges. It is shown that the presence of positive first lag autocorrelation results in an increased number of false alarms from the control chart. Negative first lag autocorrelation can result in unnecessarily wide control limits such that significant shifts in the process mean may go undetected. We use first-order autoregressive and first-order moving average models in our simulation of small samples of autocorrelated data.     

On the problem of model selection in bilinear time series analyses

One of the problems in bilinear time series (BLTS) analysis is that of identification. Unlike linear models, the identification in BLTS modelling is not always based on the autocorrelation function (or spectrum) since it is sometimes misleading, The authors, therefore., derive in this note the autocorrelation function of a function of a bilinear process which can be used for identification as well as for testing the linearity.     

Likelihood ratio test-based chart for monitoring the process variability

This article proposes a new chart with the generalized likelihood ratio (GLR) test statistics for monitoring the process variance of a normally distributed process. The new chart can be easily designed and constructed and the computation results show that it provides quite a satisfactory performance, including the detection of the decrease in the variance and the individual observation at the sampling point which are very important in many practical applications. Average run length (ARL) comparisons between other procedures and the new chart are presented. The optimal parameters that can be used as a design aid in selecting specific parameter values based on the ARL are described. The application of our proposed method is illustrated by a real data example from chemical process control.     

Monitoring the mean of autocorrelated observations with one generally weighted moving average control chart

Traditionally, using a control chart to monitor a process assumes that process observations are normally and independently distributed. In fact, for many processes, products are either connected or autocorrelated and, consequently, obtained observations are autocorrelative rather than independent. In this scenario, applying an independence assumption instead of autocorrelation for process monitoring is unsuitable. This study examines a generally weighted moving average (GWMA) with a time-varying control chart for monitoring the mean of a process based on autocorrelated observations from a first-order autoregressive process (AR(1)) with random error. Simulation is utilized to evaluate the average run length (ARL) of exponentially weighted moving average (EWMA) and GWMA control charts. Numerous comparisons of ARLs indicate that the GWMA control chart requires less time to detect various shifts at low levels of autocorrelation than those at high levels of autocorrelation. The GWMA control chart is more sensitive than the EWMA control chart for detecting small shifts in a process mean.     

The effect of Phase I sample size on the run length performance of control charts for autocorrelated data

Traditional control charts assume independence of observations obtained from the monitored process. However, if the observations are autocorrelated, these charts often do not perform as intended by the design requirements. Recently, several control charts have been proposed to deal with autocorrelated observations. The residual chart, modified Shewhart chart, EWMAST chart, and ARMA chart are such charts widely used for monitoring the occurrence of assignable causes in a process when the process exhibits inherent autocorrelation. Besides autocorrelation, one other issue is the unknown values of true process parameters to be used in the control chart design, which are often estimated from a reference sample of in-control observations. Performances of the above-mentioned control charts for autocorrelated processes are significantly affected by the sample size used in a Phase I study to estimate the control chart parameters. In this study, we investigate the effect of Phase I sample size on the run length performance of these four charts for monitoring the changes in the mean of an autocorrelated process, namely an AR(1) process. A discussion of the practical implications of the results and suggestions on the sample size requirements for effective process monitoring are provided.     

Monitoring Variability and Analyzing Multivariate Autocorrelated Processes

Traditional multivariate quality control charts are based on independent observations. In this paper, we explain how to extend univariate residual charts to multivariate cases and how to combine the traditional statistical process control (SPC) approaches to monitor changes in process variability in a dynamic environment. We propose using Alt's (1984) W chart on vector autoregressive (VAR) residuals to monitor the variability for multivariate processes in the presence of autocorrelation. We study examples jointly using the Hotelling T² chart on VAR residuals, the W chart, and the Portmanteau test to diagnose the types of shift in process parameters.     

An investigation of lag identification tools for vector nonlinear time series

Exploratory methods for determining appropriate lagged vsrlables in a vector nonlinear time series model are investigated. The first is a multivariate extension of the R statistic considered by Granger and Lin (1994), which is based on an estimate of the mutual information criterion. The second method uses Kendall's ρ and partial ρ statistics for lag determination. The methods provide nonlinear analogues of the autocorrelation and partial autocorrelation matrices for a vector time series. Simulation studies indicate that the R statistic reliabiy identifies appropriate lagged nonlinear moving average terms in a vector time series, while Kendall's ρ and partial ρ statistics have some power in identifying appropirate lagged nonlinear moving average and autoregressive terms, respectively, when the nonlinear relationship between lagged variables is monotonic. For illustration, the methods are applied to set of annual temperature and tree ring measurements at Campito Mountain In California.     

Tests for structural breaks in memory parameters of long-memory heterogeneous autoregressive models

Tests for structural breaks in the coefficients of the long-memory heterogeneous autoregressive (HAR) models are developed. The tests are based on the partial sum process of the normalized efficient score vector. The tests have the nice property of identifying the parameters of the daily, weekly, and monthly regressors in which breaks occur. Limiting null distributions of the proposed tests are proven to be derived from standard Brownian bridges. A finite sample Monte-Carlo experiment shows reasonable size and power properties of the proposed tests. The proposed method is illustrated by a real data analysis.     

Phase II monitoring of binary profiles in the presence of within-profile autocorrelation based on Markov Model

This paper introduces a Markov model in Phase II profile monitoring with autocorrelated binary response variable. In the proposed approach, a logistic regression model is extended to describe the within-profile autocorrelation. The likelihood function is constructed and then a particle swarm optimization algorithm (PSO) is tuned and utilized to estimate the model parameters. Furthermore, two control charts are extended in which the covariance matrix is derived based on the Fisher information matrix. Simulation studies are conducted to evaluate the detecting capability of the proposed control charts. A numerical example is also given to illustrate the application of the proposed method.     

Data reduction by separation of signal and noise components for multivariate spatial images

Using the spatial dependence of observations from multivariate images, it is possible to construct methods for data reduction that perform better than the widely used principal components procedure. Switzer and Green introduced the min/max autocorrelation factors (MAF) process for transforming the data to a new set of vectors where the components are arranged according to the amount of autocorrelation. MAF performs well when the underlying image consists of large homogeneous regions. For images with many transitions between smaller homogeneous regions, however, MAF may not perform well. A modification of the MAF process, the restricted min/max autocorrelation factors (RMAF) process, which takes into account the transitions between homogeneous regions, is introduced. Simulation experiments show that large improvements can be achieved using RMAF rather than MAF.     

The effect of autocorrelation on the ewma maxmin tolerance limits

Amin et al. (1999) developed an exponentially weighted moving average (EWMA) control chart, based on the smallest and largest observations in each sample. The resulting plot of the extremes suggests that the MaxMin EWMA may also be viewed as smoothed tolerance limits. Tolerance limits are limits that include a specific proportion of the population at a given confidence level. In the context of process control, they are used to make sure that production will not be outside specifications. Amin and Li (2000) provided the coverages of the MaxMin EWMA tolerance limits for independent data. In this article, it is shown how autocorrelation affects the confidence level of MaxMin tolerance limits, for a specified level of coverage of the population, and modified smoothed tolerance limits are suggested for autocorrelated processes.     

Multivariate Change Point Control Chart Based on Data Depth for Phase I Analysis

A multivariate change point control chart based on data depth (CPDP) is considered for detecting shifts in either the mean vector, the covariance matrix, or both of the processes for Phase I. The proposed chart is preferable from a robustness point of view, has attractive detection performance, and can be especially useful in Phase I analysis setting, where there is limited information about the underlying process. Comparison results and an illustrative example show that our CPDP chart has great potential for Phase I analysis of multivariate individual observations. The application of CPDP chart is illustrated in a real data example.     

Goodness-of-fit tests for binomial AR(1) processes

The binomial AR(1) model describes a nonlinear process with a first-order autoregressive (AR(1)) structure and a binomial marginal distribution. To develop goodness-of-fit tests for the binomial AR(1) model, we investigate the observed marginal distribution of the binomial AR(1) process, and we tackle its autocorrelation structure. Motivated by the family of power-divergence statistics for handling discrete multivariate data, we derive the asymptotic distribution of certain categorized power-divergence statistics for the case of a binomial AR(1) process. Then we consider Bartlett's formula, which is widely used in time series analysis to provide estimates of the asymptotic covariance between sample autocorrelations, but which is not applicable when the underlying process is nonlinear. Hence, we derive a novel Bartlett-type formula for the asymptotic distribution of the sample autocorrelations of a binomial AR(1) process, which is then applied to develop tests concerning the autocorrelation structure. Simulation studies are carried out to evaluate the size and power of the proposed tests under diverse alternative process models. Several real examples are used to illustrate our methods and findings.     

Multivariate Control Chart Based on Multivariate Smirnov Test

Robust control charts are useful in statistical process control (SPC) when there is limited knowledge about the underlying process distribution, especially for multivariate observations. This article develops a new robust and self-starting multivariate procedure based on multivariate Smirnov test (MST), which integrates a multivariate two-sample goodness-of-fit (GOF) test based on multivariate empirical distribution function (MEDF) and the change-point model. As expected, simulation results show that our proposed control chart is robust to nonnormally distributed data, and moreover, it is efficient in detecting process shifts, especially large shifts, which is one of the main drawbacks of most robust control charts in the literature. As it avoids the need for a lengthy data-gathering step, the proposed chart is particularly useful in start-up or short-run situations. Comparison results and a real data example show that our proposed chart has great potential for application.     

District-level poverty estimation: a proposed method

This paper develops a method of estimating micro-level poverty in cases where data are scarce. The method is applied to estimate district-level poverty using the household level Indian national sample survey data for two states, viz., West Bengal and Madhya Pradesh. The method involves estimation of state-level poverty indices from the data formed by pooling data of all the districts (each time excluding one district) and multiplying this poverty vector with a known weight matrix to obtain the unknown district-level poverty vector. The proposed method is expected to yield reliable estimates at the district level, because the district-level estimate is now based on a much larger sample size obtained by pooling data of several districts. This method can be an alternative to the “small area estimation technique” for estimating poverty at sub-state levels in developing countries.