Monitoring and change-point estimation for spline-modeled non-linear profiles in phase II

In some applications of statistical quality control, quality of a process or a product is best characterized by a functional relationship between a response variable and one or more explanatory variables. This relationship is referred to as a profile. In certain cases, the quality of a process or a product is better described by a non-linear profile which does not follow a specific parametric model. In these circumstances, nonparametric approaches with greater flexibility in modeling the complicated profiles are adopted. In this research, the spline smoothing method is used to model a complicated non-linear profile and the Hotelling T² control chart based on the spline coefficients is used to monitor the process. After receiving an out-of-control signal, a maximum likelihood estimator is employed for change point estimation. The simulation studies, which include both global and local shifts, provide appropriate evaluation of the performance of the proposed estimation and monitoring procedure. The results indicate that the proposed method detects large global shifts while it is very sensitive in detecting local shifts.     

Nonparametric control chart based on change-point model

A change-point control chart for detecting shifts in the mean of a process is developed for the case where the nominal value of the mean is unknown but some historical samples are available. This control chart is a nonparametric chart based on the Mann–Whitney statistic for a change in mean and adapted for repeated sequential use. We do not require any knowledge of the underlying distribution such as the normal assumption. Particularly, this distribution robustness could be a significant advantage in start-up or short-run situations where we usually do not have knowledge of the underlying distribution. The simulated results show that our approach has a good performance across the range of possible shifts and it can be used during the start-up stages of the process.      

On variable bandwidth selection in local polynomial regression

The performances of data-driven bandwidth selection procedures in local polynomial regression are investigated by using asymptotic methods and simulation. The bandwidth selection procedures considered are based on minimizing 'prelimit' approximations to the (conditional) mean-squared error (MSE) when the MSE is considered as a function of the bandwidth h . We first consider approximations to the MSE that are based on Taylor expansions around h=0 of the bias part of the MSE. These approximations lead to estimators of the MSE that are accurate only for small bandwidths h . We also consider a bias estimator which instead of using small h approximations to bias naïvely estimates bias as the difference of two local polynomial estimators of different order and we show that this estimator performs well only for moderate to large h . We next define a hybrid bias estimator which equals the Taylor-expansion-based estimator for small h and the difference estimator for moderate to large h . We find that the MSE estimator based on this hybrid bias estimator leads to a bandwidth selection procedure with good asymptotic and, for our Monte Carlo examples, finite sample properties.     

Some results on estimating a change-point using non-parametric type statistics

A Mann-Whitney type statistic is used to estimate a change-point when a change, at an unknown point in a sequence of random variables, has taken place. This estimate is compared, using Monte Carlo techniques, with the normal theory maximum likelihood estimate, when a location change has occurred, for different underlying distributions ranging from the normal to the long tailed “normal over uniform” distribution. The distribution of the Mann-Whitney type estimate remains fairly constant over the various distributions. Two generalisations of the statistic are considered and investigated.     

Statistical methods for the analysis of high-throughput data based on functional profiles derived from the Gene Ontology

The increasing availability of high-throughput data, that is, massive quantities of molecular biology data arising from different types of experiments such as gene expression or protein microarrays, leads to the necessity of methods for summarizing the available information. As annotation quality improves it is becoming common to rely on biological annotation databases, such as the Gene Ontology (GO), to build functional profiles which characterize a set of genes or proteins using the distribution of their annotations in the database. In this work we describe a statistical model for such profiles, provide methods to compare profiles and develop inferential procedures to assess this comparison. An R-package implementing the methods will be available at publication time.     

The CUSUM statistics of change-point models based on dependent sequences

In this paper, we investigate the mean change-point models based on associated sequences. Under some weak conditions, we obtain a limit distribution of CUSUM statistic which can be used to judge the mean change-mount δn is satisfied or dissatisfied n1/2δn=o(1). We also study the consistency of sample covariances and change-point location statistics. Based on Normality and Lognormality data, some simulations such as empirical sizes, empirical powers and convergence are presented to test our results. As an important application, we use CUSUM statistics to do the mean change-point analysis for a financial series.     

Local influence of nonlinear mixed effects model based on M-estimation

Abstract

In this work we mainly study the local influence in nonlinear mixed effects model with M-estimation. A robust method to obtain maximum likelihood estimates for parameters is presented, and the local influence of nonlinear mixed models based on robust estimation (M-estimation) by use of the curvature method is systematically discussed. The counting formulas of curvature for case weights perturbation, response variable perturbation and random error covariance perturbation are derived. Simulation studies are carried to access performance of the methods we proposed. We illustrate the diagnostics by an example presented in Davidian and Giltinan, which was analyzed under the non-robust situation.     

Truncated sequential change-point detection based on renewal counting processes II

The standard approach in change-point theory is to base the statistical analysis on a sample of fixed size. Alternatively, one observes some random phenomenon sequentially and takes action as soon as one observes some statistically significant deviation from the “normal” behaviour. The present paper is a continuation of Gut and Steinebach [2002. Truncated sequential change-point detection based on renewal counting processes. Scand. J. Statist. 29, 693–719] the main point being that here we look in more detail into the behaviour of the relevant stopping times, in particular the time it takes from the actual change-point until the change is detected, more precisely, we prove asymptotics for stopping times under alternatives.     

Bootstrap inference in local polynomial regression of time series

In this paper we consider the inferential aspect of the nonparametric estimation of a conditional function , where X _t,m represents the vector containing the m conditioning lagged values of the series. Here is an arbitrary measurable function. The local polynomial estimator of order p is used for the estimation of the function g, and of its partial derivatives up to a total order p. We consider α-mixing processes, and we propose the use of a particular resampling method, the local polynomial bootstrap, for the approximation of the sampling distribution of the estimator. After analyzing the consistency of the proposed method, we present a simulation study which gives evidence of its finite sample behaviour.     

Phase II monitoring of binary profiles in the presence of within-profile autocorrelation based on Markov Model

This paper introduces a Markov model in Phase II profile monitoring with autocorrelated binary response variable. In the proposed approach, a logistic regression model is extended to describe the within-profile autocorrelation. The likelihood function is constructed and then a particle swarm optimization algorithm (PSO) is tuned and utilized to estimate the model parameters. Furthermore, two control charts are extended in which the covariance matrix is derived based on the Fisher information matrix. Simulation studies are conducted to evaluate the detecting capability of the proposed control charts. A numerical example is also given to illustrate the application of the proposed method.     

Information approach for a lifetime change-point model based on the exponential-logarithmic distribution

ABSTRACT

The exponential-logarithmic distribution is a distribution which has a decreasing failure function and various applications such as in biological and engineering fields. In this paper, we study a change-point problem of this distribution. A procedure based on Schwarz information criterion is proposed to detect changes in parameters of this distribution. Simulations are conducted to indicate the performance of the proposed procedure under different scenarios. Applications on two real data are provided to illustrate the detection procedure.     

Acceptance sampling plan based on an exponentially weighted moving average statistic with the yield index for autocorrelation between polynomial profiles

Acceptance sampling plans based on process yield indices provide a proven resource for the lot-sentencing problem when the required fraction defective is very low. In this study, a new sampling plan based on the exponentially weighted moving average (EWMA) model with yield index for lot sentencing for autocorrelation between polynomial profiles is proposed. The advantage of the EWMA statistic is the accumulation of quality history from previous lots. In addition, the number of profiles required for lot sentencing is more economical than in the traditional single sampling plan. Considering the acceptable quality level (AQL) at the producer's risk and the lot tolerance percent defective (LTPD) at the consumer's risk, we proposed a new search algorithm to determine the optimal plan parameters. The plan parameters are tabulated for various combinations of the smoothing constant of the EWMA statistic, AQL, LTPD, and two risks. A comparison study and two numerical examples are provided to show the applicability of the proposed sampling plan.     

Local M-estimation for Conditional Variance in Heteroscedastic Regression Models

In this article, we develop a local M-estimation for the conditional variance in heteroscedastic regression models. The estimator is based on the local linear smoothing technique and the M-estimation technique, and it is shown to be not only asymptotically equivalent to the local linear estimator but also robust. The consistency and asymptotic normality of the local M-estimator for the conditional variance in heteroscedastic regression models are obtained under mild conditions. The simulation studies demonstrate that the proposed estimators perform well in robustness.     

A control chart for variance based on squared ranks

A nonparametric control chart for variance is proposed. The chart is constructed following the change-point approach through the recursive use of the squared ranks test for variance. It is capable of detecting changes in the behaviour of individual observations with performance similar to a self-starting CUSUM chart for scale when normality is assumed, and a relatively better power when assessing nonnormal observations. A comparison is also made with two equivalent nonparametric charts based on Mood and Ansari-Bradley statistics. When dealing with symmetrical distributions, the proposed chart shows smaller (better) out-of-control average run length (ARL), and a competing performance otherwise. In addition, sensitivity to changes in mean and variance at the same time was tested. Extensive Monte Carlo simulation was used to measure performance, and a practical example is provided to illustrate how the proposed control chart can be implemented in practice.     

Detection of a change-point in variance by a weighted sum of powers of variances test

This paper proposes a weighted sum of powers of variances test for detecting changes in variance of a data sequence. Asymptotic critical value formulas are derived for this test. The modified weighted sum of powers of variances test is also introduced so that the accuracy of change-point detection is highly improved for a sample of small size. Simulation studies and real data analysis are presented to assess the proposed tests.     

Estimation and diagnostics for heteroscedastic nonlinear regression models based on scale mixtures of skew-normal distributions

An extension of some standard likelihood based procedures to heteroscedastic nonlinear regression models under scale mixtures of skew-normal (SMSN) distributions is developed. This novel class of models provides a useful generalization of the heteroscedastic symmetrical nonlinear regression models (Cysneiros et al., 2010), since the random term distributions cover both symmetric as well as asymmetric and heavy-tailed distributions such as skew-t, skew-slash, skew-contaminated normal, among others. A simple EM-type algorithm for iteratively computing maximum likelihood estimates of the parameters is presented and the observed information matrix is derived analytically. In order to examine the performance of the proposed methods, some simulation studies are presented to show the robust aspect of this flexible class against outlying and influential observations and that the maximum likelihood estimates based on the EM-type algorithm do provide good asymptotic properties. Furthermore, local influence measures and the one-step approximations of the estimates in the case-deletion model are obtained. Finally, an illustration of the methodology is given considering a data set previously analyzed under the homoscedastic skew-t nonlinear regression model.     

The monitoring of simple linear regression profiles with two observations per sample

We evaluate and compare the performance of Phase II simple linear regression profile approaches when only two observations are used to establish each profile. We propose an EWMA control chart based on average squared deviations from the in-control line, to be used in conjunction with two EWMA control charts based on the slope and Y-intercept estimators, to monitor changes in the three regression model parameters, i.e., the slope, intercept and variance. Simulations establish that the performance of the proposed technique is generally better than that of other approaches in detecting parameter shifts.     

Identifying the time of step change in the mean of autocorrelated processes

Control charts are used to detect changes in a process. Once a change is detected, knowledge of the change point would simplify the search for and identification of the special cause. Consequently, having an estimate of the process change point following a control chart signal would be useful to process analysts. Change-point methods for the uncorrelated process have been studied extensively in the literature; however, less attention has been given to change-point methods for autocorrelated processes. Autocorrelation is common in practice and is often modeled via the class of autoregressive moving average (ARMA) models. In this article, a maximum likelihood estimator for the time of step change in the mean of covariance-stationary processes that fall within the general ARMA framework is developed. The estimator is intended to be used as an “add-on” following a signal from a phase II control chart. Considering first-order pure and mixed ARMA processes, Monte Carlo simulation is used to evaluate the performance of the proposed change-point estimator across a range of step change magnitudes following a genuine signal from a control chart. Results indicate that the estimator provides process analysts with an accurate and useful estimate of the last sample obtained from the unchanged process. Additionally, results indicate that if a change-point estimator designed for the uncorrelated process is applied to an autocorrelated process, the performance of the estimator can suffer dramatically.