A new large sample goodness of fit test for multivariate normality based on chi squared probability plots

Based on a chi square transform of the multivariate normal data set, we proposed a technique for testing multinormality which is the sum of interpoint squared distances between an ordered set of the transformed observations and the set of the population pth quantiles of the chi squared distribution. The critical values of the test were evaluated for different sample sizes and random vector dimensions through extensive simulations. The empirical type-I-error rates and powers of the proposed test were compared with those of some other well known tests for MVN with the proposed test showing excellent results at large sample sizes.     

The Combination Test for Multivariate Normality

A basic graphical approach for checking normality is the Q - Q plot that compares sample quantiles against the population quantiles. In the univariate analysis, the probability plot correlation coefficient test for normality has been studied extensively. We consider testing the multivariate normality by using the correlation coefficient of the Q - Q plot. When multivariate normality holds, the sample squared distance should follow a chi-square distribution for large samples. The plot should resemble a straight line. A correlation coefficient test can be constructed by using the pairs of points in the probability plot. When the correlation coefficient test does not reject the null hypothesis, the sample data may come from a multivariate normal distribution or some other distributions. So, we use the following two steps to test multivariate normality. First, we check the multivariate normality by using the probability plot correction coefficient test. If the test does not reject the null hypothesis, then we test symmetry of the distribution and determine whether multivariate normality holds. This test procedure is called the combination test. The size and power of this test are studied, and it is found that the combination test, in general, is more powerful than other tests for multivariate normality.     

A power study of goodness-of-fit tests for multivariate normality implemented in R

Multivariate statistical analysis procedures often require data to be multivariate normally distributed. Many tests have been developed to verify if a sample could indeed have come from a normally distributed population. These tests do not all share the same sensitivity for detecting departures from normality, and thus a choice of test is of central importance. This study investigates through simulated data the power of those tests for multivariate normality implemented in the statistic software R and pits them against the variant of testing each marginal distribution for normality. The results of testing two-dimensional data at a level of significance α=5% showed that almost one-third of those tests implemented in R do not have a type I error below this. Other tests outperformed the naive variant in terms of power even when the marginals were not normally distributed. Even though no test was consistently better than all alternatives with every alternative distribution, the energy-statistic test always showed relatively good power across all tested sample sizes.     

A new test for multivariate normality by combining extreme and nonextreme BHEP tests

In this article, we propose a new multiple test procedure for assessing multivariate normality, which combines BHEP (Baringhaus–Henze–Epps–Pulley) tests by considering extreme and nonextreme choices of the tuning parameter in the definition of the BHEP test statistic. Monte Carlo power comparisons indicate that the new test presents a reasonable power against a wide range of alternative distributions, showing itself to be competitive against the most recommended procedures for testing a multivariate hypothesis of normality. We further illustrate the use of the new test for the Fisher Iris dataset.     

A Necessary Power Divergence Type Family Tests of Multivariate Normality

In a recent article, Cardoso de Oliveira and Ferreira have proposed a multivariate extension of the univariate chi-squared normality test, using a known result for the distribution of quadratic forms in normal variables. In this article, we propose a family of power divergence type test statistics for testing the hypothesis of multinormality. The proposed family of test statistics includes as a particular case the test proposed by Cardoso de Oliveira and Ferreira. We assess the performance of the new family of test statistics by using Monte Carlo simulation. In this context, the type I error rates and the power of the tests are studied, for important family members. Moreover, the performance of significant members of the proposed test statistics are compared with the respective performance of a multivariate normality test, proposed recently by Batsidis and Zografos. Finally, two well-known data sets are used to illustrate the method developed in this article as well as the specialized test of multivariate normality proposed by Batsidis and Zografos.     

On implementation of a test for Kronecker product covariance structure for multivariate repeated measures data

Under the assumption of multivariate normality the likelihood ratio test is derived to test a hypothesis for Kronecker product structure on a covariance matrix in the context of multivariate repeated measures data. Although the proposed hypothesis testing can be computationally performed by indirect use of Proc Mixed of SAS, the Proc Mixed algorithm often fails to converge. We provide an alternative algorithm. The algorithm is illustrated with two real data sets. A simulation study is also conducted for the purpose of sample size consideration.     

Visual assessment of matrix-variate normality

In recent years, the analysis of three-way data has become ever more prevalent in the literature. It is becoming increasingly common to analyse such data by means of matrix-variate distributions, the most prevalent of which is the matrix-variate normal distribution. Although many methods exist for assessing multivariate normality, there is a relative paucity of approaches for assessing matrix-variate normality. Herein, a new visual method is proposed for assessing matrix-variate normality by means of a distance–distance plot. In addition, a testing procedure is discussed to be used in tandem with the proposed visual method. The proposed approach is illustrated via simulated data as well as an application on analysing handwritten digits.     

A Monte Carlo comparison of Jarque–Bera type tests and Henze–Zirkler test of multivariate normality

In the paper, tests for multivariate normality (MVN) of Jarque-Bera type, based on skewness and kurtosis, have been considered. Tests proposed by Mardia and Srivastava, and the combined tests based on skewness and kurtosis defined by Jarque and Bera have been taken into account. In the Monte Carlo simulations, for each combination of p = 2, 3, 4, 5 number of traits and n = 10(5)50(10)100 sample sizes 10,000 runs have been done to calculate empirical Type I errors of tests under consideration, and empirical power against different alternative distributions. Simulation results have been compared to the Henze–Zirkler’s test. It should be stressed that no test yet proposed is uniformly better than all the others in every combination of conditions examined.     

Multivariate goodness-of-fit tests based on statistically equivalent blocks

Various nonparametric procedures are known for the goodness-of-fit test in the univariate case. The distribution-free nature of these procedures does not extend to the multivariate case. In this paper, we consider an application of the theory of statistically equivalent blocks(SEB)to obtain distribution-free procedures for the multivariate case. The sample values are transformed to random variables which are distributed as sample spacings from a uniform distribution on [0, 1], under the null hypothesis. Various test statistics are known, based on the spacings, which are used for testing uniformity in the univariate case. Any of these statistics can be used in the multivariate situation, based on the spacings generated from the SEB. This paper gives an expository development of the theory of SEB and a review of tests for goodness-of-fit, based on sample spacings. To show an application of the SEB, we consider a test of bivariate normality.     

Multi-sample inference for the simple-tree alternative based on one-sample confidence intervals

The problem of testing homogeneity of several group means is considered against some patterned alternatives for the one-way classified data. The patterns of interest include the simple-tree and the trend alternatives. The approach is to begin with some suitably defined one-sample confidence intervals for the groups in a graphical display. Depending on the pattern of interest, orientation features of the display are examined, more formally, using proposed overall tests or rules. In the classical setup under normality, the case of known common variance is treated in detail; extensions to the case of unknown variance are indicated. When normality is in doubt, a nonparametric procedure based on the sign test is proposed. The necessary critical values are percentiles of either a multivariate normal distribution or a multivariate t-distribution. Although some existing tables can be used for the critical values (or the P-values) in some special cases, in general, the use of simulations is recommended and the steps are detailed in the appendix. An illustrative numerical example is provided.     

A Comparison of Significance Testing Procedures for the Intraclass Correlation from Family Data

Different procedures for testing problems concerning intraclass correlation from familial data are considered in the case of varying number of siblings per family. Under the assumption of multivariate normality, the hypotheses that the intraclass correlation is equal to a specified value are tested. To assess the performance of the tests, Monte Carlo simulations are designed to compare their powers. The Neyman's (1959) C(α) test and the test based on the modified ANOVA F statistic are shown to be consistently more powerful than other procedures.     

Tests for multivariate normality based on canonical correlations

We propose new affine invariant tests for multivariate normality, based on independence characterizations of the sample moments of the normal distribution. The test statistics are obtained using canonical correlations between sets of sample moments in a way that resembles the construction of Mardia’s skewness measure and generalizes the Lin–Mudholkar test for univariate normality. The tests are compared to some popular tests based on Mardia’s skewness and kurtosis measures in an extensive simulation power study and are found to offer higher power against many of the alternatives.     

The limiting distribution of a test for multivariate structure

We define a chi-squared statistic for p-dimensional data as follows. First, we transform the data to remove the correlations between the p variables. Then, we discretize each variable into groups of equal size and compute the cell counts in the resulting p-way contingency table. Our statistic is just the usual chi-squared statistic for testing independence in a contingency table. Because the cells have been chosen in a data-dependent manner, this statistic does not have the usual limiting distribution. We derive the limiting joint distribution of the cell counts and the limiting distribution of the chi-squared statistic when the data is sampled from a multivariate normal distribution. The chi-squared statistic is useful in detecting hidden structure in raw data or residuals. It can also be used as a test for multivariate normality.     

Statistical analysis of a class of factor time series models

For a class of factor time series models, which is called a multivariate time series variance component (MTV) models, we consider the problem of testing whether an observed time series belongs to this class. We propose the test statistic, and derive its symptotic null distribution. Asymptotic optimality of the proposed test is discussed in view of the local asymptotic normality. Also, numerical evaluation of the local power illuminates some interesting features of the test.     

Testing hypotheses about covariance matrices using bootstrap methods

The usual chi-squared approximation to test statistics based on normal theory for testing covariance structures of multivariate populations is very sensitive to the normality assumption. Two general bootstrap procedures are developed in this paper to obtain approximately valid critical values for these test statistics when the data are not normally distributed. The first is based on separate sampling from individual samples, and the second is based on sampling from pooled samples. Although the second method requires more assumptions, its small sample properties are better.     

Goodness-of-fit testing by transforming to normality: comparison between classical and characteristic function-based methods

Chen and Balakrishnan [Chen, G. and Balakrishnan, N., 1995, A general purpose approximate goodness-of-fit test. Journal of Quality Technology, 27, 154–161] proposed an approximate method of goodness-of-fit testing that avoids the use of extensive tables. This procedure first transforms the data to normality, and subsequently applies the classical tests for normality based on the empirical distribution function, and critical points thereof. In this paper, we investigate the potential of this method in comparison to a corresponding goodness-of-fit test which instead of the empirical distribution function, utilizes the empirical characteristic function. Both methods are in full generality as they may be applied to arbitrary laws with continuous distribution function, provided that an efficient method of estimation exists for the parameters of the hypothesized distribution.     

Tests on the Equality of Two Multiple Correlation Coefficients

Asymptotic tests are suggested for testing the equality of two multiple correlation coefficients calculated from a single sample from a multivariate normal distribution. An F test is possible only when the two dependent variables coincide and one set of independent variables is a subset of the second set. Tests are compared by simulation for situations in which the F test is inapplicable. Special attention is paid to cases in which asymptotic normality of the test statistics does not hold.     

Spatial Clustering Tests Based on the Domination Number of a New Random Digraph Family

We use the domination number of a parametrized random digraph family called proportional-edge proximity catch digraphs (PCDs) for testing multivariate spatial point patterns. This digraph family is based on relative positions of data points from various classes. We extend the results on the distribution of the domination number of proportional-edge PCDs, and use the domination number as a statistic for testing segregation and association against complete spatial randomness. We demonstrate that the domination number of the PCD has binomial distribution when size of one class is fixed while the size of the other (whose points constitute the vertices of the digraph) tends to infinity and has asymptotic normality when sizes of both classes tend to infinity. We evaluate the finite sample performance of the test by Monte Carlo simulations and prove the consistency of the test under the alternatives. We find the optimal parameters for testing each of the segregation and association alternatives. Furthermore, the methodology discussed in this article is valid for data in higher dimensions also.     

Multivariate Birnbaum–Saunders regression model

In this paper, we propose a multivariate log-linear Birnbaum–Saunders regression model. We discuss maximum-likelihood estimation of the model parameters and provide closed-form expressions for the score function and for Fisher's information matrix. Hypothesis testing is performed using approximations obtained from the asymptotic normality of the maximum-likelihood estimator. Some influence methods, such as the local influence and generalized leverage are discussed and the normal curvatures for studying local influence are derived under some perturbation schemes. Further, a test for the homogeneity of the shape parameter of the multivariate regression model is investigated. A real data set is presented for illustrative purposes.     

On the Behrens–Fisher problem from the spatial median point of view

We present a non-parametric affine-invariant test for the multivariate Behrens–Fisher problem. The proposed method based on the spatial medians is asymptotic and does not require normality of the data. To improve its finite sample performance, we apply a correction of the type which was already used in a similar test based on trimmed means, however, our simulations show that in the case of heavy-tailed distributions our method performs better. Also in a simulation comparison with a recently published rank-based test our test yields satisfactory results.