Tests of multinormality based on location vectors and scatter matrices

Classical univariate measures of asymmetry such as Pearson’s (mean-median)/σ or (mean-mode)/σ often measure the standardized distance between two separate location parameters and have been widely used in assessing univariate normality. Similarly, measures of univariate kurtosis are often just ratios of two scale measures. The classical standardized fourth moment and the ratio of the mean deviation to the standard deviation serve as examples. In this paper we consider tests of multinormality which are based on the Mahalanobis distance between two multivariate location vector estimates or on the (matrix) distance between two scatter matrix estimates, respectively. Asymptotic theory is developed to provide approximate null distributions as well as to consider asymptotic efficiencies. Limiting Pitman efficiencies for contiguous sequences of contaminated normal distributions are calculated and the efficiencies are compared to those of the classical tests by Mardia. Simulations are used to compare finite sample efficiencies. The theory is also illustrated by an example.     

A new functional statistic for multivariate normality

The test statistics of assessing multivariate normality based on Roy’s union-intersection principle (Roy, Some Aspects of Multivariate Analysis, Wiley, New York, 1953) are generalizations of univariate normality, and are formed as the optimal value of a nonlinear multivariate function. Due to the difficulty of solving multivariate optimization problems, researchers have proposed various approximations. However, this paper shows that the (nearly) global solution contrarily results in unsatisfactory power performance in Monte Carlo simulations. Thus, instead of searching for a true optimal solution, this study proposes a functional statistic constructed by the q% quantile of the objective function values. A comparative Monte Carlo analysis shows that the proposed method is superior to two highly recommended tests when detecting widely-selected alternatives that characterize the various properties of multivariate normality.     

Tests for multinormality with applications to time series

Making use of a characterization of multivariate normality by Hermitian polynomials, we propose a multivariate normality test. The approach is then applied to time series analysis by constructing a test for Gaussianity of a stationary univariate series. Simulation study shows that the proposed test has reasonable power and outperforms other tests available in the literature when the innovation series of the time series is symmetric, but non-Gaussian.     

The Combination Test for Multivariate Normality

A basic graphical approach for checking normality is the Q - Q plot that compares sample quantiles against the population quantiles. In the univariate analysis, the probability plot correlation coefficient test for normality has been studied extensively. We consider testing the multivariate normality by using the correlation coefficient of the Q - Q plot. When multivariate normality holds, the sample squared distance should follow a chi-square distribution for large samples. The plot should resemble a straight line. A correlation coefficient test can be constructed by using the pairs of points in the probability plot. When the correlation coefficient test does not reject the null hypothesis, the sample data may come from a multivariate normal distribution or some other distributions. So, we use the following two steps to test multivariate normality. First, we check the multivariate normality by using the probability plot correction coefficient test. If the test does not reject the null hypothesis, then we test symmetry of the distribution and determine whether multivariate normality holds. This test procedure is called the combination test. The size and power of this test are studied, and it is found that the combination test, in general, is more powerful than other tests for multivariate normality.     

Multivariate extension of chi-squared univariate normality test

We propose a multivariate extension of the univariate chi-squared normality test. Using a known result for the distribution of quadratic forms in normal variables, we show that the proposed test statistic has an approximated chi-squared distribution under the null hypothesis of multivariate normality. As in the univariate case, the new test statistic is based on a comparison of observed and expected frequencies for specified events in sample space. In the univariate case, these events are the standard class intervals, but in the multivariate extension we propose these become hyper-ellipsoidal annuli in multivariate sample space. We assess the performance of the new test using Monte Carlo simulation. Keeping the type I error rate fixed, we show that the new test has power that compares favourably with other standard normality tests, though no uniformly most powerful test has been found. We recommend the new test due to its competitive advantages.     

New tests for multivariate normality based on Small's and Srivastava's graphical methods

In this paper, we propose a new measure of fit which can be used in the case of quantile–quantile plots. This measure, when applied to Small's and Srivastava's graphical methods provides two new tests for assessing multivariate normality. For different sample sizes and numbers of variables, the critical values of these tests were evaluated via simulations. The power of the new tests and its comparison with some other tests for multivariate normality are presented herein.     

A Generalization of Shapiro–Wilk's Test for Multivariate Normality

A goodness-of-fit test for multivariate normality is proposed which is based on Shapiro–Wilk's statistic for univariate normality and on an empirical standardization of the observations. The critical values can be approximated by using a transformation of the univariate standard normal distribution. A Monte Carlo study reveals that this test has a better power performance than some of the best known tests for multinormality against a wide range of alternatives.     

Applications of empirical characteristic functions in some multivariate problems

In this note we extend univariate tests for normality and symmetry based on empirical characteristic functions to the multivariate case.     

A new test for multivariate normality by combining extreme and nonextreme BHEP tests

In this article, we propose a new multiple test procedure for assessing multivariate normality, which combines BHEP (Baringhaus–Henze–Epps–Pulley) tests by considering extreme and nonextreme choices of the tuning parameter in the definition of the BHEP test statistic. Monte Carlo power comparisons indicate that the new test presents a reasonable power against a wide range of alternative distributions, showing itself to be competitive against the most recommended procedures for testing a multivariate hypothesis of normality. We further illustrate the use of the new test for the Fisher Iris dataset.     

A MATLAB package for multivariate normality test

A MATLAB package testing for multivariate normality (TMVN) is implemented as an interactive and graphical tool to examine multivariate normality (MVN). Monte Carlo simulation studies have failed to find a uniformly most powerful MVN test, which requires a rather extensive statistical inference procedure. TMVN contains several competitive MVN tests and provides a flexible and extensive testing environment for univariate or multivariate data analyses. Simulated results provide information of which test may possess more power for the selected non-MVN alternatives. Fisher's Iris data are used to show how TMVN can be used in practice.     

Some principles for surveillance adopted for multivariate processes with a common change point

The surveillance of multivariate processes has received growing attention during the last decade. Several generalizations of well-known methods such as Shewhart, CUSUM and EWMA charts have been proposed. Many of these multivariate procedures are based on a univariate summarized statistic of the multivariate observations, usually the likelihood ratio statistic. In this paper we consider the surveillance of multivariate observation processes for a shift between two fully specified alternatives. The effect of the dimension reduction using likelihood ratio statistics are discussed in the context of sufficiency properties. Also, an example of the loss of efficiency when not using the univariate sufficient statistic is given. Furthermore, a likelihood ratio method, the LR method, for constructing surveillance procedures is suggested for multivariate surveillance situations. It is shown to produce univariate surveillance procedures based on the sufficient likelihood ratios. As the LR procedure has several optimality properties in the univariate, it is also used here as a benchmark for comparisons between multivariate surveillance procedures     

Tests for multivariate normality based on canonical correlations

We propose new affine invariant tests for multivariate normality, based on independence characterizations of the sample moments of the normal distribution. The test statistics are obtained using canonical correlations between sets of sample moments in a way that resembles the construction of Mardia’s skewness measure and generalizes the Lin–Mudholkar test for univariate normality. The tests are compared to some popular tests based on Mardia’s skewness and kurtosis measures in an extensive simulation power study and are found to offer higher power against many of the alternatives.     

A general algorithm fob,univariate and multivariate goodness of pit tests based on graphical representation

This paper presents a general algorithm tor assessing the distributional assumptions. Empirical distributions of the corresponding test statistics are obtained and examples are given to illustrate various applications of the proposed test. By using the squared radii and angles, it is shown that the problem of assessing multivariate normality can be reduced to that of testing for a univariate distribution. A limited comparison is made to investigate the power of the proposed test. This work was supported in part by the National Science Foundation under Grant NO.G88135. Support from the Computer Applications ami Software Engineering (CASE) Center of Syracuse University is also gratefully acknowledged     

A Necessary Power Divergence Type Family Tests of Multivariate Normality

In a recent article, Cardoso de Oliveira and Ferreira have proposed a multivariate extension of the univariate chi-squared normality test, using a known result for the distribution of quadratic forms in normal variables. In this article, we propose a family of power divergence type test statistics for testing the hypothesis of multinormality. The proposed family of test statistics includes as a particular case the test proposed by Cardoso de Oliveira and Ferreira. We assess the performance of the new family of test statistics by using Monte Carlo simulation. In this context, the type I error rates and the power of the tests are studied, for important family members. Moreover, the performance of significant members of the proposed test statistics are compared with the respective performance of a multivariate normality test, proposed recently by Batsidis and Zografos. Finally, two well-known data sets are used to illustrate the method developed in this article as well as the specialized test of multivariate normality proposed by Batsidis and Zografos.     

Multivariate goodness-of-fit tests based on statistically equivalent blocks

Various nonparametric procedures are known for the goodness-of-fit test in the univariate case. The distribution-free nature of these procedures does not extend to the multivariate case. In this paper, we consider an application of the theory of statistically equivalent blocks(SEB)to obtain distribution-free procedures for the multivariate case. The sample values are transformed to random variables which are distributed as sample spacings from a uniform distribution on [0, 1], under the null hypothesis. Various test statistics are known, based on the spacings, which are used for testing uniformity in the univariate case. Any of these statistics can be used in the multivariate situation, based on the spacings generated from the SEB. This paper gives an expository development of the theory of SEB and a review of tests for goodness-of-fit, based on sample spacings. To show an application of the SEB, we consider a test of bivariate normality.     

Omnibus tests of multinormality based on skewness and kurtosis

Measures of univariate skewness and kurtosis have long been used as a test of univariate normality, several omnibus test procedures based on a combination of the measures having been proposed, see Pearson, D’Agestino and Bowman (1977) and Mardia (1979). Mardia (1970) proposed measures of multivariate skewness and kurtosis, and constructed a test of multinormality based on these measures. we obtain the correlation between these measures and propose several omnibus tests using the two measures. The performances of these tests are compared by means of a Monte Carlo study.     

An investigation of Bayesian inference approach to model validation with non-normal data

Quantitative model validation is playing an increasingly important role in performance and reliability assessment of a complex system whenever computer modelling and simulation are involved. The foci of this paper are to pursue a Bayesian probabilistic approach to quantitative model validation with non-normality data, considering data uncertainty and to investigate the impact of normality assumption on validation accuracy. The Box–Cox transformation method is employed to convert the non-normality data, with the purpose of facilitating the overall validation assessment of computational models with higher accuracy. Explicit expressions for the interval hypothesis testing-based Bayes factor are derived for the transformed data in the context of univariate and multivariate cases. Bayesian confidence measure is presented based on the Bayes factor metric. A generalized procedure is proposed to implement the proposed probabilistic methodology for model validation of complicated systems. Classic hypothesis testing method is employed to conduct a comparison study. The impact of data normality assumption and decision threshold variation on model assessment accuracy is investigated by using both classical and Bayesian approaches. The proposed methodology and procedure are demonstrated with a univariate stochastic damage accumulation model, a multivariate heat conduction problem and a multivariate dynamic system.     

The Multivariate Randomized Complete Block Design: A Novel Permutation Solution in Case of Ordered Categorical Variables

In this article, multivariate extensions of the combination-based test statistics for the comparison of several treatments in the multivariate Randomized Complete Block designs are introduced in case of categorical response variables. Several tests for the multivariate Randomized Complete Block designs, including MANOVA procedure, are compared with the method proposed via a Monte Carlo simulation study. The method has also been applied to a real case study in the field of sensorial testing studies. Results suggest that in each experimental situation where normality of the supposed underlying continuous model is hard to justify and especially when errors have heavy-tailed distributions, the proposed nonparametric procedure can be considered as a valid solution.     

Multivariate tests for non-additivity

A full bivariate generalization of the Anscombe-Tukey one degree of freedom for univariate non-additivity is presented, and is compared to other proposals. Higher dimensional extensions follow directly. In general, k(k+1)/2 degrees of freedom can be allocated to assessing non-additivity in k dimensions. Hence coordinate-wise additivity is necessary but not sufficient for multivariate additivity.