THE EFFECTS OF CORRELATION AMONG OBSERVATIONS ON THE ACCURACY OF APPROXIMATING THE DISTRIBUTION OF SAMPLE MEAN BY ITS ASYMPTOTIC DISTRIBUTION1

In this paper, we investigate the effects of correlation among observations on the accuracy of approximating the distribution of sample mean by its asymptotic distribution. The accuracy is investigated by the Berry-Esseen bound (BEB), which gives an upper bound on the error of approximation of the distribution function of the sample mean from its asymptotic distribution for independent observations. For a given sample size (n₀) the BEB is obtained when the observations are independent. Let this be BEB. We then find the sample size (n_*) required to have BEB below BEB₀, when the observations are dependent. Comparison of n_* with n₀ reveals the effects of correlation among observations on the accuracy of the asymptotic distribution as an approximation. It is shown that the effects of correlation among observations are not appreciable if the correlation is moderate to small but it can be severe for extreme correlations.     

Distribution of sample mean when observations are correlated

It i s well known that even if the sample observations are correlated and not normal, the sample mean is normal in 1arge samples. But how large is large? This question i s investigated in this paper. In particular , the relation between the rate of convergence and the correlation property of the observations i s explored. It i s observed that the correlation, in general, retards the rate of convergence.     

Wavelet Estimation of a Density in a GARCH-type Model

We consider the GARCH-type model: S = σ² Z, where σ² and Z are independent random variables. The density of σ² is unknown whereas the one of Z is known. We want to estimate the density of σ² from n observations of S under some dependence assumption (the exponentially strongly mixing dependence). Adopting the wavelet methodology, we construct a nonadaptive estimator based on projections and an adaptive estimator based on the hard thresholding rule. Taking the mean integrated squared error over Besov balls, we prove that the adaptive one attains a sharp rate of convergence.     

Asymptotics for multisample statistics

Consider a family of square-integrable R^d-valued statistics S_k = S_k(X_1,k1; X_2,k2;…; X_m,km), where the independent samples X_i,kj respectively have k_i i.i.d. components valued in some separable metric space X_i. We prove a strong law of large numbers, a central limit theorem and a law of the iterated logarithm for the sequence {S_k}, including both the situations where the sample sizes tend to infinity while m is fixed and those where the sample sizes remain small while m tends to infinity. We also obtain two almost sure convergence results in both these contexts, under the additional assumption that S_k is symmetric in the coordinates of each sample X_i,kj. Some extensions to row-exchangeable and conditionally independent observations are provided. Applications to an estimator of the dimension of a data set and to the Henze-Schilling test statistic for equality of two densities are also presented.     

Image estimators based on marked bins

The problem of approximating an ‘image’ S?? ^d from a random sample of points is considered. If S is included in a grid of square bins, a plausible estimator of S is defined as the union of the ‘marked’ bins (those containing a sample point). We obtain convergence rates for this estimator and study its performance in the approximation of the border of S. The practical aspects of implementation are discussed, including some technical improvements on the estimator, whose performance is checked through a real data example.     

On a new interpretation of the sample variance

It may not be an overstatement that one of the most widely reported measures of variation involves S ², the sample variance, which is also well-known to be alternatively expressed in the form of an U statistic with a symmetric kernel of degree 2 whatever be the population distribution function. We propose a very general new approach to construct unbiased estimators of a population variance by U statistics with symmetric kernels of degree higher than two. Surprisingly, all such estimators ultimately reduce to S ² (Theorem 3.1). While Theorem 3.1 is interesting and novel in its own right, it leads to a newer interpretation of S ² that is much broader than what is known in the statistical literature including economics, actuarial mathematics, and mathematical finance.     

Set estimation and nonparametric detection

The authors consider the estimation of a set S ? R^d from a random sample of n points. They examine the properties of a detection method, proposed by Devroye & Wise (1980), which relies on the use of a “naive” estimator of S defined as a union of balls centered at the sample points with common radius ?_n. They obtain the convergence rate for the probability of false alarm and show that the smoothing parameter ?_n can be used to incorporate some prior information on the shape of S. They suggest two general methods for selecting ?_n and illustrate them with a simulation study and a real data example.     

Space-time estimation of a particle system model

Let X be a discrete time contact process (CP) on ?², as defined by Durrett and Levin (1994, Stochastic spatial models: a user's guide to ecological applications. Philosophical Transactions of the Royal Society of London Series B, 343, 329–350). We study the estimation of the model based on space-time evolution of X, that is, T + 1 successive observations of X on a finite subset S of sites. We consider the maximum marginal pseudo-likelihood (MPL) estimator and show that, when T→∞, this estimator is consistent and asymptotically normal for a non-vanishing supercritical CP. Numerical studies confirm these theoretical ones.     

The Prediction Sum of Squares as a General Measure for Regression Diagnostics

Statistics that usually accompany the regression model do not provide insight into the quality of the data or the potential influence of the individual observations on the estimates. In this study, the Q² statistic is used as a criterion for detecting influential observations or outliers. The statistic is derived from the jackknifed residuals, the squared sum of which is generally known as the prediction sum of squares or PRESS. This article compares R ² with Q² and suggests that the latter be used as part of the data-quality check. It is shown, for two separate data sets obtained from regional cost of living and U.S. food industry studies, that in the presence of outliers the Q² statistic can be negative, because it is sensitive to the choice of regressors and the inclusion of influential observations. Once the outliers are dropped from the sample, the discrepancy between Q² and R ² values is negligible.     

A new S2 control chart using repetitive sampling

A new S² control chart is presented for monitoring the process variance by utilizing a repetitive sampling scheme. The double control limits called inner and outer control limits are proposed, whose coefficients are determined by considering the average run length (ARL) and the average sample number when the process is in control. The proposed control chart is compared with the existing Shewhart S² control chart in terms of the ARLs. The result shows that the proposed control chart is more efficient than the existing control chart in detecting the process shift.     

To be or not to be valid in testing the significance of the slope in simple quantitative linear models with autocorrelated errors

In this article, the validity of procedures for testing the significance of the slope in quantitative linear models with one explanatory variable and first-order autoregressive [AR(1)] errors is analyzed in a Monte Carlo study conducted in the time domain. Two cases are considered for the regressor: fixed and trended versus random and AR(1). In addition to the classical t -test using the Ordinary Least Squares (OLS) estimator of the slope and its standard error, we consider seven t -tests with n-2\,\hbox{df} built on the Generalized Least Squares (GLS) estimator or an estimated GLS estimator, three variants of the classical t -test with different variances of the OLS estimator, two asymptotic tests built on the Maximum Likelihood (ML) estimator, the F -test for fixed effects based on the Restricted Maximum Likelihood (REML) estimator in the mixed-model approach, two t -tests with n - 2 df based on first differences (FD) and first-difference ratios (FDR), and four modified t -tests using various corrections of the number of degrees of freedom. The FDR t -test, the REML F -test and the modified t -test using Dutilleul's effective sample size are the most valid among the testing procedures that do not assume the complete knowledge of the covariance matrix of the errors. However, modified t -tests are not applicable and the FDR t -test suffers from a lack of power when the regressor is fixed and trended ( i.e. , FDR is the same as FD in this case when observations are equally spaced), whereas the REML algorithm fails to converge at small sample sizes. The classical t -test is valid when the regressor is fixed and trended and autocorrelation among errors is predominantly negative, and when the regressor is random and AR(1), like the errors, and autocorrelation is moderately negative or positive. We discuss the results graphically, in terms of the circularity condition defined in repeated measures ANOVA and of the effective sample size used in correlation analysis with autocorrelated sample data. An example with environmental data is presented.     

Identifying Variables Contributing to Outliers in Phase I

When a process is monitored with a T ² control chart in a Phase II setting, the MYT decomposition is a valuable diagnostic tool for interpreting signals in terms of the process variables. The decomposition splits a signaling T ² statistic into independent components that can be associated with either individual variables or groups of variables. Since these components are T ² statistics with known distributions, they can be used to determine which of the process variable(s) contribute to the signal. However, this procedure cannot be applied directly to Phase I since the distributions of the individual components are unknown. In this article, we develop the MYT decomposition procedure for a Phase I operation, when monitoring a random sample of individual observations and identifying outliers. We use a relationship between the T ² statistic in Phase I with the corresponding T ² statistic resulting when an observation is omitted from this sample to derive the distributions of these components and demonstrate the Phase I application of the MYT decomposition.     

Optimizing the wald-wolfowitz runs statistic using a linkage tolerance: guidelines based on computer simulation

When performing the Wald-Wolfowitz runs test, observations from two samples are combined and ordered, and the test statistic is the number of sequences of observations from the same sample. This test statistic is equivalent to the number of links between observations from different samples, if we consider each observation to be linked to the next higher and next lower observations. While it is known that the Wald-Wolfowitz runs test is not very powerful, what would be the effect on the power of the Wald-Wolfowitz runs test if all observations within a specified Euclidean distance or “tolerance” were linked instead? This question is motivated by the simulation results of Whaley and Quade (1985), who found that for normal data, the power of the multi-dimensional runs test using a linkage tolerance compared favorably to Hotelling's T² in some instances. The results of a similar simulation procedure show that the power of the Wald-Wolfowitz runs test does indeed improve when observations are linked using a tolerance. The results also suggest that a better large sample approximation to the distribution of the test statistic needs to be found.     

Super efficient frequency estimation

In this paper we propose a modified Newton-Raphson method to obtain super efficient estimators of the frequencies of a sinusoidal signal in presence of stationary noise. It is observed that if we start from an initial estimator with convergence rate O_p(n⁻¹) and use Newton-Raphson algorithm with proper step factor modification, then it produces super efficient frequency estimator in the sense that its asymptotic variance is lower than the asymptotic variance of the corresponding least squares estimator. The proposed frequency estimator is consistent and it has the same rate of convergence, namely O_p(n^−3/2), as the least squares estimator. Monte Carlo simulations are performed to observe the performance of the proposed estimator for different sample sizes and for different models. The results are quite satisfactory. One real data set has been analyzed for illustrative purpose.     

Conditional Least Squares Estimators for the Offspring Mean in a Subcritical Branching Process with Immigration

Consider a Bienayme–Galton–Watson process with generation-dependent immigration, whose mean and variance vary regularly with non negative exponents α and β, respectively. We study the estimation problem of the offspring mean based on an observation of population sizes. We show that if β <2α, the conditional least squares estimator (CLSE) is strongly consistent. Conditions which are sufficient for the CLSE to be asymptotically normal will also be derived. The rate of convergence is faster than n ^?1/2, which is not the case in the process with stationary immigration.     

A bias-corrected histogram estimator for line transect sampling

The classical histogram method has already been applied in line transect sampling to estimate the parameter f(0), which in turns is used to estimate the population abundance D or the population size N. It is well know that the bias convergence rate for histogram estimator of f(0) is o(h²) as h → 0, under the shoulder condition assumption. If the shoulder condition is not true, then the bias convergence rate is only o(h). This paper proposed two new estimators for f(0), which can be considered as modifications of the classical histogram estimator. The first estimator is derived when the shoulder condition is assumed to be valid and it reduces the bias convergence rate from o(h²) to o(h³). The other one is constructed without using the shoulder condition assumption and it reduces the bias convergence rate from o(h) to o(h²). The asymptotic properties of the proposed estimators are derived and formulas for bin width are also given. The finite properties based on a real data set and an extensive simulation study demonstrated the potential practical use of the proposed estimators.     

Smooth estimation of a monotone density

We investigate the interplay of smoothness and monotonicity assumptions when estimating a density from a sample of observations. The nonparametric maximum likelihood estimator of a decreasing density on the positive half line attains a rate of convergence of [Formula: See Text] at a fixed point t if the density has a negative derivative at t. The same rate is obtained by a kernel estimator of bandwidth [Formula: See Text], but the limit distributions are different. If the density is both differentiable at t and known to be monotone, then a third estimator is obtained by isotonization of a kernel estimator. We show that this again attains the rate of convergence [Formula: See Text], and compare the limit distributions of the three types of estimators. It is shown that both isotonization and smoothing lead to a more concentrated limit distribution and we study the dependence on the proportionality constant in the bandwidth. We also show that isotonization does not change the limit behaviour of a kernel estimator with a bandwidth larger than [Formula: See Text], in the case that the density is known to have more than one derivative.     

Robustness of measures of common cause sigma in presence of data correlation

Process monitoring in the presence of data correlation is one of the most discussed issues in statistical process control literature over the past decade. However, the attention to retrospective analysis in the presence of data correlation with various common cause sigma estimators is lacking in the literature. Maragah et al. (1992), in an early paper on the retrospective analysis in presence of data correlation, addresses only a single common cause sigma estimator. This paper studies the effect of data correlation on retrospective X-chart with various common cause sigma estimates in stable period of AR(1) Process. This study is carried out with the aim of identifying suitable standard deviation statistic/statistics which is/are robust to the data correlation. This paper also discusses the robustness of common cause sigma estimates for monitoring the data following other time series models, namely ARMA(1,1) and AR(p). Further, the bias characteristics of robust standard deviation estimates have been discussed for the above time-series models. This paper further studies the performance of retrospective X-chart on forecast residuals from various forecasting methods of AR(1) process. The above studies were carried out through simulating the stable period of AR(1), AR(2), stable and invertible period of ARMA(1,1) processes. The average number of false alarms have been considered as a measure of performance. The results of simulation studies have been discussed.     

The double sampling S2 chart with estimated process variance

This paper proposes useful exact bounds for the parameters of the double sampling S² chart with known process variance and it also investigates the properties of the double sampling S² chart with estimated process variance, in terms of the average run length, the standard deviation of the run length and the average sample size, providing a numerical comparison with the known process variance case. It also provides guidelines to systematically design the double sampling S² chart both with known and estimated process variance and proposes two optimal design procedures with estimated process variance, for (a) minimizing the out-of-control average run length and (b) minimizing the out-of-control average sample size.     

A control chart based on sample ranges for monitoring the covariance matrix of the multivariate processes

For the univariate case, the R chart and the S ² chart are the most common charts used for monitoring the process dispersion. With the usual sample size of 4 and 5, the R chart is slightly inferior to the S ² chart in terms of efficiency in detecting process shifts. In this article, we show that for the multivariate case, the chart based on the standardized sample ranges, we call the RMAX chart, is substantially inferior in terms of efficiency in detecting shifts in the covariance matrix than the VMAX chart, which is based on the standardized sample variances. The user's familiarity with sample ranges is a point in favor of the RMAX chart. An example is presented to illustrate the application of the proposed chart.