MOSUM monitoring for variance change in nonparametric regression models

ABSTRACT

This article considers the monitoring for variance change in nonparametric regression models. First, the local linear estimator of the regression function is given. A moving square cumulative sum procedure is proposed based on residuals of the estimator. And the asymptotic results of the statistic under the null hypothesis and the alternative hypothesis are obtained. Simulations and Application support our procedure.     

Assessing goodness-of-fit of categorical regression models based on case-control data

Demonstrated equivalence between a categorical regression model based on case‐control data and an I‐sample semiparametric selection bias model leads to a new goodness‐of‐fit test. The proposed test statistic is an extension of an existing Kolmogorov–Smirnov‐type statistic and is the weighted average of the absolute differences between two estimated distribution functions in each response category. The paper establishes an optimal property for the maximum semiparametric likelihood estimator of the parameters in the I‐sample semiparametric selection bias model. It also presents a bootstrap procedure, some simulation results and an analysis of two real datasets.     

Group-sequential logrank methods for trial designs using bivariate non-competing event-time outcomes

We discuss the multivariate (2L-variate) correlation structure and the asymptotic distribution for the group-sequential weighted logrank statistics formulated when monitoring two correlated event-time outcomes in clinical trials. The asymptotic distribution and the variance–covariance for the 2L-variate weighted logrank statistic are derived as available in various group-sequential trial designs. These methods are used to determine a group-sequential testing procedure based on calendar times or information fractions. We apply the theoretical results to a group-sequential method for monitoring a clinical trial with early stopping for efficacy when the trial is designed to evaluate the joint effect on two correlated event-time outcomes. We illustrate the method with application to a clinical trial and describe how to calculate the required sample sizes and numbers of events.

     

Sensitivity analysis in maximum likelihood factor analysis

The present paper deals with sensitivity analysis in maximum likelihood factor analysis. To investigate the influence of a small change of data we derive theoretical influence functions I(x; LL^T ) and I(x; Δ) for a common variance matrix T= LL^T and a unique variance matrix Δ respectively. Numerical examples are shown to illustrate our procedure.     

Moran's I statistic-based nonparametric test with spatio-temporal observations

Moran's I statistic [Moran, (1950), ‘Notes on Continuous Stochastic Phenomena’, Biometrika, 37, 17–23] has been widely used to evaluate spatial autocorrelation. This paper is concerned with Moran's I-induced testing procedure in residual analysis. We begin with exploring the Moran's I statistic in both its original and extended forms analytically and numerically. We demonstrate that the magnitude of the statistic in general depends not only on the underlying correlation but also on certain heterogeneity in the individual observations. One should exercise caution when interpreting the outcome on correlation by the Moran's I-induced procedure. On the other hand, the effect on the Moran's I due to heterogeneity in the observations enables a regression model checking procedure with the residuals. This novel application of Moran's I is justified by simulation and illustrated by an analysis of wildfire records from Alberta, Canada.     

The Effectiveness of Multistage Ranked Set Sampling in Stratifying the Population

The spectral analysis of Gaussian linear time-series processes is usually based on uni-frequential tools because the spectral density functions of degree 2 and higher are identically zero and there is no polyspectrum in this case. In finite samples, such an approach does not allow the resolution of closely adjacent spectral lines, except by using autoregressive models of excessively high order in the method of maximum entropy. In this article, multi-frequential periodograms designed for the analysis of discrete and mixed spectra are defined and studied for their properties in finite samples. For a given vector of frequencies ω, the sum of squares of the corresponding trigonometric regression model fitted to a time series by unweighted least squares defines the multi-frequential periodogram statistic IM(ω). When ω is unknown, it follows from the properties of nonlinear models whose parameters separate (i.e., the frequencies and the cosine and sine coefficients here) that the least-squares estimator of frequencies is obtained by maximizing I ^M(ω). The first-order, second-order and distribution properties of I ^M(ω) are established theoretically in finite samples, and are compared with those of Schuster's uni-frequential periodogram statistic. In the multi-frequential periodogram analysis, the least-squares estimator of frequencies is proved to be theoretically unbiased in finite samples if the number of periodic components of the time series is correctly estimated. Here, this number is estimated at the end of a stepwise procedure based on pseudo-Flikelihood ratio tests. Simulations are used to compare the stepwise procedure involving I ^M(ω) with a stepwise procedure using Schuster's periodogram, to study an approximation of the asymptotic theory for the frequency estimators in finite samples in relation to the proximity and signal-to-noise ratio of the periodic components, and to assess the robustness of I ^M(ω) against autocorrelation in the analysis of mixed spectra. Overall, the results show an improvement of the new method over the classical approach when spectral lines are adjacent. Finally, three examples with real data illustrate specific aspects of the method, and extensions (i.e., unequally spaced observations, trend modeling, replicated time series, periodogram matrices) are outlined.     

Goodness-of-fit testing of a weak memoryless property of life distributions

A life distribution is said to have a weak memoryless property if its conditional probability of survival beyond a fixed time point is equal to its (unconditional) survival probability at that point. Goodness‐of‐fit testing of this notion is proposed in the current investigation, both when the fixed time point is known and when it is unknown but estimable from the data. The limiting behaviour of the proposed test statistic is obtained and the null variance is explicitly given. The empirical power of the test is evaluated for a commonly known alternative using Monte Carlo methods, showing that the test performs well. The case when the fixed time point t₀ equals a quantile of the distribution F gives a distribution‐free test procedure. The procedure works even if t₀ is unknown but is estimable.     

A Simple Test Procedure When Data are Given by n Indepenent Blocks

In this article we consider a test procedure which is useful in the situations where data are given by n independent blocks and the experimental conditions differ between blocks. The basic idea is very simple. The significance of the sample for each block is calculated and then standardized by its null mean and variance. The sum of standardized significances is proposed as a test statistic. The normal approximation for large n and the exact method for small n are applied in the continuous case. For the discrete case, some devices are also proposed. Several examples are given in order to explain how to apply the procedure.     

A Comparison Between Two Multivariate EWMA Schemes

The signal issued by a control chart triggers the process professionals to investigate the special cause. Change point methods simplify the efforts to search for and identify the special cause. In this study, using maximum likelihood estimation, a multivariate joint change point estimation procedure for monitoring both location and dispersion simultaneously is proposed. After a signal is generated by the simultaneously used Hotelling's T ² and/or generalized variance control charts, the procedure starts detecting the time of the change. The performance of the proposed method for several structural changes for the mean vector and covariance matrix is discussed.     

Likelihood-Based Inference for Weak Exogeneity in I(2) Cointegrated VAR Models

This article develops limit theory for likelihood analysis of weak exogeneity in I(2) cointegrated vector autoregressive (VAR) models incorporating deterministic terms. Conditions for weak exogeneity in I(2) VAR models are reviewed, and the asymptotic properties of conditional maximum likelihood estimators and a likelihood-based weak exogeneity test are then investigated. It is demonstrated that weak exogeneity in I(2) VAR models allows us to conduct asymptotic conditional inference based on mixed Gaussian distributions. It is then proved that a log-likelihood ratio test statistic for weak exogeneity in I(2) VAR models is asymptotically χ² distributed. The article also presents an empirical illustration of the proposed test for weak exogeneity using Japan's macroeconomic data.     

Sequential change detection in the presence of unknown parameters

It is commonly required to detect change points in sequences of random variables. In the most difficult setting of this problem, change detection must be performed sequentially with new observations being constantly received over time. Further, the parameters of both the pre- and post- change distributions may be unknown. In Hawkins and Zamba (Technometrics 47(2):164–173, 2005), the sequential generalised likelihood ratio test was introduced for detecting changes in this context, under the assumption that the observations follow a Gaussian distribution. However, we show that the asymptotic approximation used in their test statistic leads to it being conservative even when a large numbers of observations is available. We propose an improved procedure which is more efficient, in the sense of detecting changes faster, in all situations. We also show that similar issues arise in other parametric change detection contexts, which we illustrate by introducing a novel monitoring procedure for sequences of Exponentially distributed random variable, which is an important topic in time-to-failure modelling.     

Wilcoxon-type rank-sum control charts based on progressively censored reference data

Abstract

In this article, we introduce a new distribution???free Shewhart???type control chart implementing a modified Wilcoxon-type rank sum statistic based on progressive Type-II censoring reference data. The proposed chart is also a tool for monitoring the incomplete data, because the censoring scheme applied allows the protection of experimental units at an early stage of the testing procedure. The setup of the new nonparametric control chart is presented in detail, while its operating characteristic function is studied. Explicit formulae for the evaluation of Alarm Rate and Average Run Length values for both in-control and out-of-control situations are established. A numerical study carried out depicts the performance and robustness of the proposed control chart. For illustration purposes, a practical example is also discussed.     

ROBUST TESTS BASED ON THE SAMPLE CHARACTERISTIC FUNCTION

A new method is described for robust analysis of variance in the balanced fixed effects case. The method uses the empirical characteristic function of the treatment samples, and has an interpretation in terms of S-estimators. The test statistic, under the null hypothesis, asymptotically follows a central chi-square distribution, and under contiguous alternatives a noncentral chi-square distribution. A Monte Carlo study suggests that, for finite samples, this is reasonably well approximated by the usual F distribution used in analysis of variance. The test statistic has a bounded influence function. The new procedure competes well with Huber's and a Wald-type procedure except in very heavy-tailed cases.     

Multiscale detection and location of multiple variance changes in the presence of long memory

Procedures for detecting change points in sequences of correlated observations (e.g., time series) can help elucidate their complicated structure. Current literature on the detection of multiple change points emphasizes the analysis of sequences of independent random variables. We address the problem of an unknown number of variance changes in the presence of long-range dependence (e.g., long memory processes). Our results are also applicable to time series whose spectrum slowly varies across octave bands. An iterated cumulative sum of squares procedure is introduced in order to look at the multiscale stationarity of a time series; that is, the variance structure of the wavelet coefficients on a scale by scale basis. The discrete wavelet transform enables us to analyze a given time series on a series of physical scales. The result is a partitioning of the wavelet coefficients into locally stationary regions. Simulations are performed to validate the ability of this procedure to detect and locate multiple variance changes. A ‘time’ series of vertical ocean shear measurements is also analyzed, where a variety of nonstationary features are identified.     

A new approach for monitoring process variance

ABSTRACT

Control charts are effective tools for signal detection in both manufacturing processes and service processes. Much service data come from a process with variables having non-normal or unknown distributions. The commonly used Shewhart variable control charts, which depend heavily on the normality assumption, should not be properly used in such circumstances. In this paper, we propose a new variance chart based on a simple statistic to monitor process variance shifts. We explore the sampling properties of the new monitoring statistic and calculate the average run lengths (ARLs) of the proposed variance chart. Furthermore, an arcsine transformed exponentially weighted moving average (EWMA) chart is proposed because the ARLs of this modified chart are more intuitive and reasonable than those of the variance chart. We compare the out-of-control variance detection performance of the proposed variance chart with that of the non-parametric Mood variance (NP-M) chart with runs rules, developed by Zombade and Ghute [Nonparametric control chart for variability using runs rules. Experiment. 2014;24(4):1683–1691], and the nonparametric likelihood ratio-based distribution-free exponential weighted moving average (NLE) chart and the combination of traditional exponential weighted moving average (EWMA) mean and EWMA variance (CEW) control chart proposed by Zou and Tsung [Likelihood ratio-based distribution-free EWMA control charts. J Qual Technol. 2010;42(2):174–196] by considering cases in which the critical quality characteristic has a normal, a double exponential or a uniform distribution. Comparison results showed that the proposed chart performs better than the NP-M with runs rules, and the NLE and CEW control charts. A numerical example of service times with a right-skewed distribution from a service system of a bank branch in Taiwan is used to illustrate the application of the proposed variance chart and of the arcsine transformed EWMA chart and to compare them with three existing variance (or standard deviation) charts. The proposed charts show better detection performance than those three existing variance charts in monitoring and detecting shifts in the process variance.     

Estimation and inference for varying coefficient partially nonlinear errors-in-variables models

In this article, we study the varying coefficient partially nonlinear model with measurement errors in the nonparametric part. A local corrected profile nonlinear least-square estimation procedure is proposed and the asymptotic properties of the resulting estimators are established. Further, a generalized likelihood ratio (GLR) statistic is proposed to test whether the varying coefficients are constant. The asymptotic null distribution of the statistic is obtained and a residual-based bootstrap procedure is employed to compute the p-value of the statistic. Some simulations are conducted to evaluate the performance of the proposed methods. The results show that the estimating and testing procedures work well in finite samples.     

An approximation of the distribution function of the LIML identifiability test statistic using the method of moments

This paper contains an application of the asymptotic expansion of a pFp() function to a problem encountered in econometrics. In particular we consider an approximation of the distribution function of the limited information maximum likelihood (LIML) identifiability test statistic using the method of moments. An expression for the Sth order asymptotic approximation of the moments of the LIML identifiability test statistic is derived and tabulated. The exact distribution function of the test statistic is approximated by a member of the class of F (variance ratio) distribution functions having the same first two integer moments. Some tabulations of the approximating distribution function are included.     

A note on successive comparisons between several ordered variances

ABSTRACT

In this article, a procedure for comparisons between k (k ? 3) successive populations with respect to the variance is proposed when it is reasonable to assume that variances satisfy simple ordering. Critical constants required for the implementation of the proposed procedure are computed numerically and selected values of the computed critical constants are tabulated. The proposed procedure for normal distribution is extended for making comparisons between successive exponential populations with respect to scale parameter. A comparison between the proposed procedure and its existing competitor procedures is carried out, using Monte Carlo simulation. Finally, a numerical example is given to illustrate the proposed procedure.     

Globally applicable control chart for online monitoring of stability of process mean

The shape features of run chart patterns of the most recent m observations arising from stable and unstable processes are different. Using this fact, a new monitoring statistic is defined whose value for given m depends on the pattern parameters but not on the process parameters. A control chart for this statistic for given m, therefore, will be globally applicable to normal processes. The simulation study reveals that the proposed statistic approximately follows normal distribution. The performances of the globally applicable control chart in terms of average run lengths (ARLs) are evaluated and compared with the X chart. Both in-control ARL and out-of-control ARLs with respect to different abnormal process conditions are found to be larger than the X chart. However, the proposed concept is promising because it can eliminate the burden of designing separate control charts for different quality characteristics or processes in a manufacturing set-up.     

A New Procedure to Monitor the Mean of a Quality Characteristic

The Shewhart, Bonferroni-adjustment, and analysis of means (ANOM) control charts are typically applied to monitor the mean of a quality characteristic. The Shewhart and Bonferroni procedure are utilized to recognize special causes in production process, where the control limits are constructed by assuming normal distribution for known parameters (mean and standard deviation), and approximately normal distribution regarding to unknown parameters. The ANOM method is an alternative to the analysis of variance method. It can be used to establish the mean control charts by applying equicorrelated multivariate non central t distribution. In this article, we establish new control charts, in phases I and II monitoring, based on normal and t distributions having as a cause a known (or unknown) parameter (standard deviation). Our proposed methods are at least as effective as the classical Shewhart methods and have some advantages.