Variance least squares estimators for multivariate linear mixed model

Non-iterative, distribution-free, and unbiased estimators of variance components by least squares method are derived for multivariate linear mixed model. A general inter-cluster variance matrix, a same-member only general inter-response variance matrix, and an uncorrelated intra-cluster error structure for each response are assumed. Projection method is suggested when unbiased estimators of variance components are not nonnegative definite matrices. A simulation study is conducted to investigate the properties of the proposed estimators in terms of bias and mean square error with comparison to the Gaussian (restricted) maximum likelihood estimators. The proposed estimators are illustrated by an application of gene expression familial study.     

A new approach for monitoring process variance

ABSTRACT

Control charts are effective tools for signal detection in both manufacturing processes and service processes. Much service data come from a process with variables having non-normal or unknown distributions. The commonly used Shewhart variable control charts, which depend heavily on the normality assumption, should not be properly used in such circumstances. In this paper, we propose a new variance chart based on a simple statistic to monitor process variance shifts. We explore the sampling properties of the new monitoring statistic and calculate the average run lengths (ARLs) of the proposed variance chart. Furthermore, an arcsine transformed exponentially weighted moving average (EWMA) chart is proposed because the ARLs of this modified chart are more intuitive and reasonable than those of the variance chart. We compare the out-of-control variance detection performance of the proposed variance chart with that of the non-parametric Mood variance (NP-M) chart with runs rules, developed by Zombade and Ghute [Nonparametric control chart for variability using runs rules. Experiment. 2014;24(4):1683–1691], and the nonparametric likelihood ratio-based distribution-free exponential weighted moving average (NLE) chart and the combination of traditional exponential weighted moving average (EWMA) mean and EWMA variance (CEW) control chart proposed by Zou and Tsung [Likelihood ratio-based distribution-free EWMA control charts. J Qual Technol. 2010;42(2):174–196] by considering cases in which the critical quality characteristic has a normal, a double exponential or a uniform distribution. Comparison results showed that the proposed chart performs better than the NP-M with runs rules, and the NLE and CEW control charts. A numerical example of service times with a right-skewed distribution from a service system of a bank branch in Taiwan is used to illustrate the application of the proposed variance chart and of the arcsine transformed EWMA chart and to compare them with three existing variance (or standard deviation) charts. The proposed charts show better detection performance than those three existing variance charts in monitoring and detecting shifts in the process variance.     

A control chart based on sample ranges for monitoring the covariance matrix of the multivariate processes

For the univariate case, the R chart and the S ² chart are the most common charts used for monitoring the process dispersion. With the usual sample size of 4 and 5, the R chart is slightly inferior to the S ² chart in terms of efficiency in detecting process shifts. In this article, we show that for the multivariate case, the chart based on the standardized sample ranges, we call the RMAX chart, is substantially inferior in terms of efficiency in detecting shifts in the covariance matrix than the VMAX chart, which is based on the standardized sample variances. The user's familiarity with sample ranges is a point in favor of the RMAX chart. An example is presented to illustrate the application of the proposed chart.     

On testing for causality in variance between two multivariate time series

Verifying the existence of a relationship between two multivariate time series represents an important consideration. In this article, the procedure developed by Cheung and Ng [A causality-in-variance test and its application to financial market prices, J. Econom. 72 (1996), pp. 33–48] designed to test causality in variance for univariate time series is generalized in several directions. A first approach proposes test statistics based on residual cross-covariance matrices of squared (standardized) residuals and cross products of (standardized) residuals. In a second approach, transformed residuals are defined for each residual vector time series, and test statistics are constructed based on the cross-correlations of these transformed residuals. Test statistics at individual lags and portmanteau-type test statistics are developed. Conditions are given under which the new test statistics converge in distribution towards chi-square distributions. The proposed methodology can be used to determine the directions of causality in variance, and appropriate test statistics are presented. Monte Carlo simulation results show that the new test statistics offer satisfactory empirical properties. An application with two bivariate financial time series illustrates the methods.     

Stein type confidence interval of the disturbance variance in a linear regression model with multivariate student-t distributed errors

This paper considers the interval estimation of the disturbance variance in a linear regression model with multivariate Student-t errors. The distribution function of the Stein type estimator under multivariate Student-t errors is derived, and the coverage probability of the Stein type confidence interval which is constructed under the normality assumption is numerically calculated under the multivariate Student-t distribution. It is shown that the coverage probability of the Stein type confidence interval is sometimes much smaller than the nominal level, and that it is larger than that of the usual confidence interval in almost all cases. For the case when it is known that errors have a multivariate Student-t distribution, sufficient conditions under which the Stein type confidence interval improves on the usual confidence interval are given, and the coverage probability of the stein type confidence interval is numerically evaluated.     

Tests for randomness of observations that involve two factors

Tests for randomness of observations that involve one factor have been considered by many authors among them are Mosteller [4], Bateman [21], Barton and David [1] and Shaughnessy [7]. However, on many occasions, data involve two different factors such as time and location, temperature and pressure, or levels of doses and responses of patients and so on. In this paper, we consider tests for randomness of observations that involve two factors for which data are given in a matrix form. Some new definitions of runs of a matrix of data are defined and discussed. A special kind of run is proposed for the test for randomness. Distributions and properties of this run are studied. Some critical regions are tabulated.     

Exponentially weighted moving average charts for correlated multivariate Poisson processes

In this article, we study exponentially weighted moving average (EWMA) control schemes to monitor the multivariate Poisson distribution with a general covariance structure, so that the practitioner can simultaneously monitor multiple correlated attribute processes more effectively. The statistical performance of the charts is assessed in terms of the run length properties and compared against other mainstream attribute control schemes. The application of the proposed methods to real-life and simulated datasets is demonstrated.     

On implementation of a test for Kronecker product covariance structure for multivariate repeated measures data

Under the assumption of multivariate normality the likelihood ratio test is derived to test a hypothesis for Kronecker product structure on a covariance matrix in the context of multivariate repeated measures data. Although the proposed hypothesis testing can be computationally performed by indirect use of Proc Mixed of SAS, the Proc Mixed algorithm often fails to converge. We provide an alternative algorithm. The algorithm is illustrated with two real data sets. A simulation study is also conducted for the purpose of sample size consideration.     

Addressing the effect of parameter estimation on phase II monitoring of multivariate multiple linear profiles via a new cluster-based approach

Abstract

Profile monitoring is applied when the quality of a product or a process can be determined by the relationship between a response variable and one or more independent variables. In most Phase II monitoring approaches, it is assumed that the process parameters are known. However, it is obvious that this assumption is not valid in many real-world applications. In fact, the process parameters should be estimated based on the in-control Phase I samples. In this study, the effect of parameter estimation on the performance of four Phase II control charts for monitoring multivariate multiple linear profiles is evaluated. In addition, since the accuracy of the parameter estimation has a significant impact on the performance of Phase II control charts, a new cluster-based approach is developed to address this effect. Moreover, we evaluate and compare the performance of the proposed approach with a previous approach in terms of two metrics, average of average run length and its standard deviation, which are used for considering practitioner-to-practitioner variability. In this approach, it is not necessary to know the distribution of the chart statistic. Therefore, in addition to ease of use, the proposed approach can be applied to other type of profiles. The superior performance of the proposed method compared to the competing one is shown in terms of all metrics. Based on the results obtained, our method yields less bias with small-variance Phase I estimates compared to the competing approach.     

CUSUM charts for monitoring the mean of a multivariate Gaussian process

In this paper control charts for the mean of a multivariate Gaussian process are considered. Using the generalized likelihood ratio approach and the sequential probability ratio test under an additional constraint on the magnitude of the change various types of CUSUM control charts are derived. It is analyzed under which conditions these schemes are directionally invariant. These charts are compared with several other control schemes proposed in literature. The performance of the charts is studied based on the maximum average delay.     

A powerful affine invariant test for multivariate normality based on interpoint distances of principal components

In this paper, a probability plots class of tests for multivariate normality is introduced. Based on independent standardized principal components of a d-variate normal data set, we obtained the sum of squared differences between corresponding observations of an ordered set of each principal component observations and the set of the population pth quantiles of the standard normal distribution. We proposed the sum of these d-sums of squared differences as an appropriate statistic for testing multivariate normality. We evaluated empirical critical values of the statistic and compared its power with those of some highly regarded techniques with a wonderful result.     

Combined synthetic and |S| chart for monitoring process dispersion

This article proposes a multivariate control chart, the syn-|S| chart, which comprises a standard |S| subchart and a multivariate synthetic sample generalized variance |S| (synthetic |S|) subchart, for detecting shifts in the covariance matrix of a multivariate normally distributed process. A procedure for the optimal design of the syn-|S| chart by minimizing the average extra quadratic loss is provided. The syn-|S| chart has better overall performance compared to the synthetic |S| chart and the standard |S| chart, based on the zero-state and steady-state modes. An example is given to illustrate the operation of the synthetic |S| chart.     

Mixed multivariate EWMA-CUSUM control charts for an improved process monitoring

Multivariate exponential weighted moving average and cumulative sum charts are the most common memory type multivariate control charts. They make use of the present and past information to detect small shifts in the process parameter(s). In this article, we propose two new multivariate control charts using a mixed version of their design setups. The plotting statistics of the proposed charts are based on the cumulative sum of the multivariate exponentially weighted moving averages. The performances of these schemes are evaluated in terms of average run length. The proposals are compared with their existing counterparts, including HotellingT², MCUSUM, MEWMA, and MC1 charts. An application example is also presented for practical considerations using a real dataset.     

Independence distribution preserving joint covariance structures for the multivariate two-group case

We characterize the general nonnegative-definite and positive-definite joint observation covariance structures for the two-group case such that the two sample mean vectors are independent of the two corresponding sample covariance matrices. Also, the sample covariance matrices are distributed as independent noncentral or central Wishart random matrices. We derive and utilize a representation of the general common non-negative-definite solution to a particular system of matrix equations with idempotent coefficient matrices.     

Step-Down diagnostic analysis for monitoring the covariance matrix of bivariate normal processes

ABSTRACT

A comparison among VMIX, VMAX and the adapted step-down Sullivan et al. (SE) tests for covariance matrix under bivariate normal assumption is presented. The type I error and power estimates were obtained by using Monte Carlo simulation under different scenarios with respect to covariance and correlation structures. In general, VMIX was more powerful than VMAX being SE more powerful than both, with few exceptions. SE test is more general since it can be used for normal and non-normal data, with no restriction with respect to the pattern of the covariance matrix shifts, and for larger dimension than the bivariate case.     

Some sampling effects of pairwise correlated observations on likelihood ratio tests for the difference between two means

We study the effects of the inclusion of pairs of correlated observations in a sample on likelihood ratio tests for the difference in two means. In particular, we assess how the inclusion of correlated data pairs (e.g., such as data inadvertently collected from sib-pairs) affects the sample size requirements necessary for the implementation of a Likelihood Ratio (LR) test for the difference between two means. Our results suggest that correlated data pairs beneficially or adversely effect sample size requirements for an LR test to a degree functionally related to the mixture parameters dictating their relative frequencies in the larger sample on which the test will be performed, the strength of the correlation between the observations, and the size of imbalances in the sample with respect to the number of observations in each group. The relevance and implications of the results for genetic and epidemiologic research are discussed.