Integration of support vector machines and control charts for multivariate process monitoring

Statistical process control tools have been used routinely to improve process capabilities through reliable on-line monitoring and diagnostic processes. In the present paper, we propose a novel multivariate control chart that integrates a support vector machine (SVM) algorithm, a bootstrap method, and a control chart technique to improve multivariate process monitoring. The proposed chart uses as the monitoring statistic the predicted probability of class (PoC) values from an SVM algorithm. The control limits of SVM-PoC charts are obtained by a bootstrap approach. A simulation study was conducted to evaluate the performance of the proposed SVM–PoC chart and to compare it with other data mining-based control charts and Hotelling's T ² control charts under various scenarios. The results showed that the proposed SVM–PoC charts outperformed other multivariate control charts in nonnormal situations. Further, we developed an exponential weighed moving average version of the SVM–PoC charts for increasing sensitivity to small shifts.     

Monitoring correlated processes with binomial marginals

Few approaches for monitoring autocorrelated attribute data have been proposed in the literature. If the marginal process distribution is binomial, then the binomial AR(1) model as a realistic and well-interpretable process model may be adequate. Based on known and newly derived statistical properties of this model, we shall develop approaches to monitor a binomial AR(1) process, and investigate their performance in a simulation study. A case study demonstrates the applicability of the binomial AR(1) model and of the proposed control charts to problems from statistical process control.     

Statistical control charts for monitoring the mean of a stationary process

Recently statistical process control (SPC) methodologies have been developed to accommodate autocorrelated data. A primary method to deal with autocorrelated data is the use of residual charts. Although this methodology has the advantage that it can be applied to any autocorrelated data it needs time series modeling efforts. In addition for a X residual chart the detection capability is sometimes small compared to the X chart and EWMA chart. Zhang (1998) proposed the EWMAST chart which is constructed by charting the EWMA statistic for stationary processes to monitor the process mean. The performance of the EWMAST chart the X chart the X residual chart and other charts were compared in Zhang (1998). In this paper comparisons are made among the EWMAST chart the CUSUM residual chart and EWMA residual chart as well as the X residual chart and X chart via the average run length.     

Average run lengths for cusum control charts applied to residuals

A common approach to building control charts for autocorrelated data is to apply classical SPC to the residuals from a time series model of the process. However, Shewhart charts and even CUSUM charts are less sensitive to small shifts in the process mean when applied to residuals than when applied to independent data. Using an approximate analytical model, we show that the average run length of a CUSUM chart for residuals can be reduced substantially by modifying traditional chart design guidelines to account for the degree of autocorrelation in the data.     

Multivariate Control Chart Based on Multivariate Smirnov Test

Robust control charts are useful in statistical process control (SPC) when there is limited knowledge about the underlying process distribution, especially for multivariate observations. This article develops a new robust and self-starting multivariate procedure based on multivariate Smirnov test (MST), which integrates a multivariate two-sample goodness-of-fit (GOF) test based on multivariate empirical distribution function (MEDF) and the change-point model. As expected, simulation results show that our proposed control chart is robust to nonnormally distributed data, and moreover, it is efficient in detecting process shifts, especially large shifts, which is one of the main drawbacks of most robust control charts in the literature. As it avoids the need for a lengthy data-gathering step, the proposed chart is particularly useful in start-up or short-run situations. Comparison results and a real data example show that our proposed chart has great potential for application.     

A new distribution-free control scheme based on order statistics

We establish a class of nonparametric Shewhart-type control charts based on a reference sample drawn from the process. The proposed nonparametric control chart takes advantage of the location of two different order statistics of the reference and test sample respectively. The decision rule of the new monitoring scheme is filled out by the number of test observations that are located between the control limits. The general setup of the new class of control charts is presented in detail, while the operating characteristic function is studied for both in- and out-of-control processes. Closed formulae for the evaluation of the alarm rate and the average run length are concluded for plausible shift in the underlying distribution to Lehmann alternatives. Several numerical results, displayed for the new family of nonparametric control charts, depict that the proposed control scheme attains competitive performance.     

Integration of classification algorithms and control chart techniques for monitoring multivariate processes

We propose new multivariate control charts that can effectively deal with massive amounts of complex data through their integration with classification algorithms. We call the proposed control chart the ‘Probability of Class (PoC) chart’ because the values of PoC, obtained from classification algorithms, are used as monitoring statistics. The control limits of PoC charts are established and adjusted by the bootstrap method. Experimental results with simulated and real data showed that PoC charts outperform Hotelling's T ² control charts. Further, a simulation study revealed that a small proportion of out-of-control observations are sufficient for PoC charts to achieve the desired performance.     

A Robust Control Chart for Monitoring the Mean of an Autocorrelated Process

Residual control charts are frequently used for monitoring autocorrelated processes. In the design of a residual control chart, values of the true process parameters are often estimated from a reference sample of in-control observations by using least squares (LS) estimators. We propose a robust control chart for autocorrelated data by using Modified Maximum Likelihood (MML) estimators in constructing a residual control chart. Average run length (ARL) is simulated for the proposed chart when the underlying process is AR(1). The results show the superiority of the new chart under several situations. Moreover, the chart is robust to plausible deviations from assumed distribution of errors.     

One-Class Classification-Based Control Charts for Monitoring Autocorrelated Multivariate Processes

In recent years, statistical process control (SPC) of multivariate and autocorrelated processes has received a great deal of attention. Modern manufacturing/service systems with more advanced technology and higher production rates can generate complex processes in which consecutive observations are dependent and each variable is correlated. These processes obviously violate the assumption of the independence of each observation that underlies traditional SPC and thus deteriorate the performance of its traditional tools. The popular way to address this issue is to monitor the residuals—the difference between the actual value and the fitted value—with the traditional SPC approach. However, this residuals-based approach requires two steps: (1) finding the residuals; and (2) monitoring the process. Also, an accurate prediction model is necessary to obtain the uncorrelated residuals. Furthermore, these residuals are not the original values of the observations and consequently may have lost some useful information about the targeted process. The main purpose of this article is to examine the feasibility of using one-class classification-based control charts to handle multivariate and autocorrelated processes. The article uses simulated data to present an analysis and comparison of one-class classification-based control charts and the traditional Hotelling's T ² chart.     

Bootstrap-Based T 2 Multivariate Control Charts

Control charts have been used effectively for years to monitor processes and detect abnormal behaviors. However, most control charts require a specific distribution to establish their control limits. The bootstrap method is a nonparametric technique that does not rely on the assumption of a parametric distribution of the observed data. Although the bootstrap technique has been used to develop univariate control charts to monitor a single process, no effort has been made to integrate the effectiveness of the bootstrap technique with multivariate control charts. In the present study, we propose a bootstrap-based multivariate T ² control chart that can efficiently monitor a process when the distribution of observed data is nonnormal or unknown. A simulation study was conducted to evaluate the performance of the proposed control chart and compare it with a traditional Hotelling's T ² control chart and the kernel density estimation (KDE)-based T ² control chart. The results showed that the proposed chart performed better than the traditional T ² control chart and performed comparably with the KDE-based T ² control chart. Furthermore, we present a case study to demonstrate the applicability of the proposed control chart to real situations.     

CUSUM control schemes for monitoring the covariance matrix of multivariate time series

Modified cumulative sum (CUSUM) control charts and CUSUM schemes for residuals are suggested to detect changes in the covariance matrix of multivariate time series. Several properties of these schemes are derived when the in-control process is a stationary Gaussian process. A Monte Carlo study reveals that the proposed approaches show similar or even better performance than the schemes based on the multivariate exponentially weighted moving average (MEWMA) recursion. We illustrate how the control procedures can be applied to monitor the covariance structure of developed stock market indices.     

EWNA charts for monitoring the mean and the autocovariances of stationary processes

In this paper various types of EWMA control charts are introduced for the simultaneous monitoring of the mean and the autocovariances. The target process is assumed to be a stationary process up to fourth-order or an ARMA process with heavy tailed innovations. The case of a Gaussian process is included in our results as well. The charts are compared within a simulation study. As a measure of the performance the average run length is taken. The target process is an ARMA (1,1) process with Student-t distributed innovations. The behavior of the charts is analyzed with respect to several out-of-control models. The best design parameters are determined for each chart. Our comparisons show that the multivariate EWMA chart applied to the residuals has the best overall performance.     

Mixed multivariate EWMA-CUSUM control charts for an improved process monitoring

Multivariate exponential weighted moving average and cumulative sum charts are the most common memory type multivariate control charts. They make use of the present and past information to detect small shifts in the process parameter(s). In this article, we propose two new multivariate control charts using a mixed version of their design setups. The plotting statistics of the proposed charts are based on the cumulative sum of the multivariate exponentially weighted moving averages. The performances of these schemes are evaluated in terms of average run length. The proposals are compared with their existing counterparts, including HotellingT², MCUSUM, MEWMA, and MC1 charts. An application example is also presented for practical considerations using a real dataset.     

Multivariate Quality Control Chart for Autocorrelated Processes

Traditional multivariate statistical process control (SPC) techniques are based on the assumption that the successive observation vectors are independent. In recent years, due to automation of measurement and data collection systems, a process can be sampled at higher rates, which ultimately leads to autocorrelation. Consequently, when the autocorrelation is present in the data, it can have a serious impact on the performance of classical control charts. This paper considers the problem of monitoring the mean vector of a process in which observations can be modelled as a first-order vector autoregressive VAR (1) process. We propose a control chart called Z-chart which is based on the single step finite intersection test (Timm, 1996). An important feature of the proposed method is that it not only detects an out of control status but also helps in identifying variable(s) responsible for the out of control situation. The proposed method is illustrated with the help of suitable illustrations.     

CUSUM charts for monitoring the mean of a multivariate Gaussian process

In this paper control charts for the mean of a multivariate Gaussian process are considered. Using the generalized likelihood ratio approach and the sequential probability ratio test under an additional constraint on the magnitude of the change various types of CUSUM control charts are derived. It is analyzed under which conditions these schemes are directionally invariant. These charts are compared with several other control schemes proposed in literature. The performance of the charts is studied based on the maximum average delay.     

The effect of Phase I sample size on the run length performance of control charts for autocorrelated data

Traditional control charts assume independence of observations obtained from the monitored process. However, if the observations are autocorrelated, these charts often do not perform as intended by the design requirements. Recently, several control charts have been proposed to deal with autocorrelated observations. The residual chart, modified Shewhart chart, EWMAST chart, and ARMA chart are such charts widely used for monitoring the occurrence of assignable causes in a process when the process exhibits inherent autocorrelation. Besides autocorrelation, one other issue is the unknown values of true process parameters to be used in the control chart design, which are often estimated from a reference sample of in-control observations. Performances of the above-mentioned control charts for autocorrelated processes are significantly affected by the sample size used in a Phase I study to estimate the control chart parameters. In this study, we investigate the effect of Phase I sample size on the run length performance of these four charts for monitoring the changes in the mean of an autocorrelated process, namely an AR(1) process. A discussion of the practical implications of the results and suggestions on the sample size requirements for effective process monitoring are provided.     

Multivariate control charts based on a projection approach

Summary: In this paper the projection approach of Runger (1996) is applied to construct control charts for a multivariate process. It is assumed that a shift in the mean might only occur in a known subspace of the parameter space. The projection method permits a reduction of the dimensionality of the control problem.Several control schemes based on projections are introduced. We consider CUSUM type charts as well as EWMA schemes. The underlying variables are assumed to be independent and normally distributed. Using the average run length all control charts are compared with each other. Moreover, it is analyzed how sensitive the charts react on a false choice of the subspace.     

Identifying the time of a step change with multivariate single control charts

Change point estimation procedures simplify the efforts to search for and identify special causes in multivariate statistical process monitoring. After a signal is generated by the simultaneously used control charts or a single control chart, add-on change point procedure estimates the time of the change. In this study, multivariate joint change point estimation performance for simultaneous monitoring of both location and dispersion is compared under the assumption that various single charts are used to monitor the process. The change detection performance for several structural changes for the mean vector and covariance matrix is also discussed. It is concluded that choice of the control chart to obtain a signal may affect the change point detection performance.     

A study of economic design of control charts for cumulative count of conforming items

In this paper the economic design of Cumulative Count of Conforming (CCC) control charts to maintain the current control of fraction nonconforming of a process is studied. CCC chart is an attribute chart for monitoring high quality processes by plotting the cumulative count of conforming items between two nonconforming ones on a suitable chart. A process model is proposed to obtain an appropriate loss function. An alogorithm to search for the optimal setting of the sampling and control parameters is derived. Numerical illustrations of the method and some properties of the optimal economic design are provided.     

Multivariate Control Charts Based on Hybrid Novelty Scores

We propose a new nonparametric multivariate control chart that integrates a novelty score. The proposed control chart uses as its monitoring statistic a hybrid novelty score, calculated based on the distance to local observations as well as on the distance to the convex hull constructed by its neighbors. The control limits of the proposed control chart were established based on a bootstrap method. A rigorous simulation study was conducted to examine the properties of the proposed control chart under various scenarios and compare it with existing multivariate control charts in terms of average run length (ARL) performance. The simulation results showed that the proposed control chart outperformed both the parametric and nonparametric Hotelling's T ² control charts, especially in nonnormal situations. Moreover, experimental results with real semiconductor data demonstrated the applicability and effectiveness of the proposed control chart. To increase the capability to detect small mean shift, we propose an exponentially weighted hybrid novelty score control chart. Simulation results indicated that exponentially weighted hybrid score charts outperformed the hybrid novelty score based control charts.