The effect of serial correlation on the in-control average run length of cumulative score charts

The cumulative sum (CUSUM) technique is well-established in theory and practice of process control. For a variant of the CUSUM technique, the cumulative score chart, we investigate the effect of serial correlation on the in-control average run length (ARL). The Shewhart chart is a special case of the cumulative score chart. Using the fact that the cumulative score statistic is a correlated random walk with a reflecting and an absorbing barrier, we derive an approximate but closed-form expression for the ARL of a control variable that follows a first-order autoregressive process with normally distributed disturbances. We also give an expression for the asymptotic (large in-control ARL) case. Our method of approximation gives ARL values that are in good agreement with Monte Carlo estimates of the true values. For positive serial correlation the ARL decreases with increasing value of the correlation coefficient. For increasing negative serial correlation, the ARL may decrease or increase depending on the choice of the parameters of the chart; parameterizations can be found which are rather insensitive for negative serial correlation. We use our results to give recommendations on how to modify the control chart procedure in the presence of serial correlation.     

Lagged Regression Residuals and Serial-Correlation Tests

A new family of statistics is proposed to test for the presence of serial correlation in linear regression models. The tests are based on partial sums of lagged cross-products of regression residuals that define a class of interesting Gaussian processes. These processes are characterized in terms of regressor functions, the serial-correlation structure, the distribution of the noise process, and the order of the lag of the cross-products of residuals. It is shown that these four factors affect the lagged residual processes independently. Large-sample distributional results are presented for test statistics under the null hypothesis of no serial correlation or for alternatives from a range of interesting hypotheses. Some indication of the circumstances to which the asymptotic results apply in finite-sample situations and of those to which they should be applied with some caution are obtained through a simulation study. Tables of selected quantiles of the proposed tests are also given. The tests are illustrated with two examples taken from the empirical literature. It is also proposed that plots of lagged residual processes be used as diagnostic tools to gain insight into the correlation structure of residuals derived from regression fits.     

On the estimation of serial correlation in Markov-dependent production processes

In this paper, we present a study about the estimation of the serial correlation for Markov chain models which is used often in the quality control of autocorrelated processes. Two estimators, non-parametric and multinomial, for the correlation coefficient are discussed. They are compared with the maximum likelihood estimator [U.N. Bhat and R. Lal, Attribute control charts for Markov dependent production process, IIE Trans. 22 (2) (1990), pp. 181–188.] by using some theoretical facts and the Monte Carlo simulation under several scenarios that consider large and small correlations as well a range of fractions (p) of non-conforming items. The theoretical results show that for any value of p≠0.5 and processes with autocorrelation higher than 0.5, the multinomial is more precise than maximum likelihood. However, the maximum likelihood is better when the autocorrelation is smaller than 0.5. The estimators are similar for p=0.5. Considering the average of all simulated scenarios, the multinomial estimator presented lower mean error values and higher precision, being, therefore, an alternative to estimate the serial correlation. The performance of the non-parametric estimator was reasonable only for correlation higher than 0.5, with some improvement for p=0.5.     

Testing for Persistence in the Error Component Model: A One-Sided Approach

This article proposes new simple testing procedures for the joint null hypothesis of absence of persistent effects, in the form of random effects and first-order serial correlation in the error component model. The fact that the presence of random effects is clearly of a one-sided nature, together with the fact that in many empirical applications researchers worry about positive serial correlation leaves room for a power gain that arises from restricting the parameter space under the alternative hypothesis, compared to existing procedures that allow for two-sided alternatives. A Monte Carlo experiment shows that the proposed statistics have good size and power performance in very small samples like those typically used in applied work in panel data. An empirical example illustrates the usefulness of the proposed statistics.     

Study of a Markov model for a high-quality dependent process

For high-quality processes, non-conforming items are seldom observed and the traditional p (or np) charts are not suitable for monitoring the state of the process. A type of chart based on the count of cumulative conforming items has recently been introduced and it is especially useful for automatically collected one-at-a-time data. However, in such a case, it is common that the process characteristics become dependent as items produced one after another are inspected. In this paper, we study the problem of process monitoring when the process is of high quality and measurement values possess a certain serial dependence. The problem of assuming independence is examined and a Markov model for this type of process is studied, upon which suitable control procedures can be developed.     

Block Bootstrapping for Kernel Density Estimators under ψ-Weak Dependence

Block bootstrap methods are applied to kernel-type density estimator and its derivatives for ψ-weakly dependent processes. Nonparametric density estimation is discussed via moving block bootstrap (MBB) and disjoint block bootstrap (DBB). Asymptotic validity is proved for MBB and DBB. A Monte-Carlo experiment compares confidence intervals based on MBB and DBB with an existing method based on normal approximation (NA) in terms of serial correlation, dynamic asymmetry, and conditional heteroscedasticity. The experiment shows that, in cases of substantial serial correlation, MBB and DBB perform better than NA and, in the other cases, MBB and DBB perform as good as NA.     

Testing Serial Correlation in Single Index Models

In this article, we propose two testing procedures for the serial correlation in single index models by virtue of B spline approximation for unknown single index function. Under some regular conditions, we show that our proposed statistics asymptotically follow normal and χ² distribution. Many numerical studies illustrate that the proposed procedures can perform very well for moderate sample size.     

Testing Serial Correlation in Semiparametric Varying-Coefficient Partially Linear Models

We propose two test statistics for testing serial correlation in semiparametric varying-coefficient partially linear models. The proposed test statistics are not only for testing zero first-order serial correlation, but also for testing higher-order serial correlations. Under the null hypothesis of no serial correlation, the test statistics are shown to have asymptotic normal or chi-square distributions. By using R, some Monte Carlo experiments are conducted to examine the finite sample performances of the proposed tests. Simulation results show that the estimated size and power of the proposed tests behave well.     

Serial correlation and distributions on the shere

Estimation and tests for serial correlation in recation and regression models with normal error have been derive from various points of view; for example: Anderson (1948), Durbi for Watson (1950, 1951, 1971), Theil (1965), Durbin (1970), Haq (1970), Kadiyala (1970), Abrahamse & Louter (1971), Levenbac (1972), Berenblut & Webb (1973), Phillips & Harvey (1974), a Sims (1975). In this paper we derive likelihood functions and most powerful tests for serial correclation in Locationa and regression models with arbitrary but specificed error; the methods extend to include the determination of the likelihood for the parameter of the error distribution.

In Section 2, we survey the modthods that have been used in deriving the various tests and estimates in the literature. In Section 2, we introduce the stataistical model that directly describes the error distribution and we obtain the likelihood function for error correlation and determine locally and specifically kost powerful tests for correlation. In Section 3 we consider the case with normal error derive a normal distribution on the sphere by radial projection. The likelihood function and test are then specialized to the case of normal error in Section 4. The computational procedures for the tests and related power functions are examined in Section 5. Power comparisons for the textile data of Theil and Nagar (1961), the consumption data of Kelin (1950), and the plums and the wheat data of Hildreth & Lu (1960) are presented in Section 6, while the likelihood functions for correlation in these data are given in Section 7.     

Gatekeeping procedures with clinical trial applications

The objective of this paper is to give an overview of a relatively new area of multiplicity research that deals with the analysis of hierarchically ordered multiple objectives. Testing procedures for this problem are known as gatekeeping procedures and have found a variety of applications in clinical trials. This paper reviews main classes of these procedures, including serial and parallel gatekeeping procedures, and tree gatekeeping procedures that account for logical restrictions among multiple objectives. We focus on procedures based on marginal p-values; extensions to procedures that exploit the joint distribution of the p-values are also noted. Clinical trial examples are used to illustrate the procedures and their important properties.     

Control charts for multivariate spatial autoregressive models

This paper deals with spatial detection of changes in model parameters of spatial autoregressive processes. The respective sequential testing problems are formulated. Moreover, we introduce characteristic quantities to monitor means or covariances of multivariate spatial autoregressive processes. Additionally, we also take into account the simultaneous surveillance of the mean vector and the covariance matrix. The aim is to apply control charts, important tools of sequential analysis, to these quantities. The considered control procedures are based on either cumulative sums or exponential smoothing. Further, we illustrate the methodology of statistical process control studying the spectrum of additive colors in a satellite photograph. Via simulation studies, the proposed control procedures are calibrated for a predefined average run length. In addition, we compare the performance of the control procedures considering the out-of-control situation. Eventually, the control charts are applied, and the signals of the different schemes are visualized. The final results are critically discussed.     

Tests for an end-of-sample bubble in financial time series

ABSTRACT

In this paper, we examine the issue of detecting explosive behavior in economic and financial time series when an explosive episode is both ongoing at the end of the sample and of finite length. We propose a testing strategy based on a subsampling method in which a suitable test statistic is calculated on a finite number of end-of-sample observations, with a critical value obtained using subsample test statistics calculated on the remaining observations. This approach also has the practical advantage that, by virtue of how the critical values are obtained, it can deliver tests which are robust to, among other things, conditional heteroskedasticity and serial correlation in the driving shocks. We also explore modifications of the raw statistics to account for unconditional heteroskedasticity using studentization and a White-type correction. We evaluate the finite sample size and power properties of our proposed procedures and find that they offer promising levels of power, suggesting the possibility for earlier detection of end-of-sample bubble episodes compared to existing procedures.     

A non-parametric statistic for testing conditional heteroscedasticity for unobserved component models

When prediction intervals are constructed using unobserved component models (UCM), problems can arise due to the possible existence of components that may or may not be conditionally heteroscedastic. Accurate coverage depends on correctly identifying the source of the heteroscedasticity. Different proposals for testing heteroscedasticity have been applied to UCM; however, in most cases, these procedures are unable to identify the heteroscedastic component correctly. The main issue is that test statistics are affected by the presence of serial correlation, causing the distribution of the statistic under conditional homoscedasticity to remain unknown. We propose a nonparametric statistic for testing heteroscedasticity based on the well-known Wilcoxon''s rank statistic. We study the asymptotic validation of the statistic and examine bootstrap procedures for approximating its finite sample distribution. Simulation results show an improvement in the size of the homoscedasticity tests and a power that is clearly comparable with the best alternative in the literature. We also apply the test on real inflation data. Looking for the presence of a conditionally heteroscedastic effect on the error terms, we arrive at conclusions that almost all cases are different than those given by the alternative test statistics presented in the literature.     

Testing serial correlation for partially nonlinear models

Partially nonlinear models, as extensions of partially linear models are extensively used in statistical modeling. This paper considers the spline empirical log-likelihood ratio for testing serial correlation in partially nonlinear models. It is shown that the proposed empirical log-likelihood ratio converges to the standard chi-square distribution under the null hypothesis of no serial correlation. Some simulations are conducted to estimate the rejection probabilities under the null hypothesis and serial correlation. An example of application is also illustrated.     

A hierarchical model for extreme wind speeds

Summary.  A typical extreme value analysis is often carried out on the basis of simplistic inferential procedures, though the data being analysed may be structurally complex. Here we develop a hierarchical model for hourly gust maximum wind speed data, which attempts to identify site and seasonal effects for the marginal densities of hourly maxima, as well as for the serial dependence at each location. A Gaussian model for the random effects exploits the meteorological structure in the data, enabling increased precision for inferences at individual sites and in individual seasons. The Bayesian framework that is adopted is also exploited to obtain predictive return level estimates at each site, which incorporate uncertainty due to model estimation, as well as the randomness that is inherent in the processes that are involved.     

Serial correlation or random subject effects

In longitudinal data analysis with random subject effects, there is often within subject serial correlation and possibly unequally spaced observations. This serial correlation can be partially confounded with the random between subject effects. In real data, it is often not clear whether there is serial correlation, random subject effects or both. Using inference based on the likelihood function, it is not always possible to identify the correct model, especially in small samples. However, it is important that some effort be made to attempt to find a good model rather than just making assumptions. This often means trying models with random coefficients, with serial correlation, and with both. Model selection criteria such as likelihood ratio tests and Akaike's Information Criterion (AIC) can be used. The problem of modelling serial correlation with unequally spaced observations is addressed. A real data example is presented where there is an apparent heterogeneity of variances, possible serial correlation and between subject random effects. In this example, it turns out that the random subject effects explains both the serial correlation and the variance heterogeneity.     

Tests for serial correlation in mean and variance of a sequence of time series objects

In this era of Big Data, large-scale data storage provides the motivation for statisticians to analyse new types of data. The proposed work concerns testing serial correlation in a sequence of sets of time series, here referred to as time series objects. An example is serial correlation of monthly stock returns when daily stock returns are observed. One could consider a representative or summarized value of each object to measure the serial correlation, but this approach would ignore information about the variation in the observed data. We develop Kolmogorov–Smirnov-type tests with the standard bootstrap and wild bootstrap Ljung–Box test statistics for serial correlation in mean and variance of time series objects, which take the variation within a time series object into account. We study the asymptotic property of the proposed tests and present their finite sample performance using simulated and real examples.     

Geometric Anisotropic Spatial Point Pattern Analysis and Cox Processes

We consider spatial point processes with a pair correlation function, which depends only on the lag vector between a pair of points. Our interest is in statistical models with a special kind of ‘structured’ anisotropy: the pair correlation function is geometric anisotropic if it is elliptical but not spherical. In particular, we study Cox process models with an elliptical pair correlation function, including shot noise Cox processes and log Gaussian Cox processes, and we develop estimation procedures using summary statistics and Bayesian methods. Our methodology is illustrated on real and synthetic datasets of spatial point patterns.     

Diagnostics for the bootstrap and fast double bootstrap

ABSTRACT

The bootstrap is typically less reliable in the context of time-series models with serial correlation of unknown form than when regularity conditions for the conventional IID bootstrap apply. It is, therefore, useful to have diagnostic techniques capable of evaluating bootstrap performance in specific cases. Those suggested in this paper are closely related to the fast double bootstrap (FDB) and are not computationally intensive. They can also be used to gauge the performance of the FDB itself. Examples of bootstrapping time series are presented, which illustrate the diagnostic procedures, and show how the results can cast light on bootstrap performance.     

Contrast Estimation for Parametric Stationary Determinantal Point Processes

We study minimum contrast estimation for parametric stationary determinantal point processes. These processes form a useful class of models for repulsive (or regular, or inhibitive) point patterns and are already applied in numerous statistical applications. Our main focus is on minimum contrast methods based on the Ripley's K‐function or on the pair correlation function. Strong consistency and asymptotic normality of theses procedures are proved under general conditions that only concern the existence of the process and its regularity with respect to the parameters. A key ingredient of the proofs is the recently established Brillinger mixing property of stationary determinantal point processes. This work may be viewed as a complement to the study of Y. Guan and M. Sherman who establish the same kind of asymptotic properties for a large class of Cox processes, which in turn are models for clustering (or aggregation).