An empirical study of the type I error rate and power for some selected normal-theory and nonparametric tests of the independence of two sets of variables

Normal-theory tests of the hypothesis of no relationship among two sets of variables require assumptions of independence, hamoscedasticity, and normality. If, however, the assumption of normality is not tenable, there are few guidelines for properly using these tests. Historically, the lack of a comprehensive hypothesis-testing framework in the nonparametric case has provided few alternatives to normal-theory procedures. Fortunately, this situation has changed with the introduction of nonparametric, general linear model-based tests that can be used with existing computing packages. Multivariate-nonparametric tests due to Puri and Sen (1969, 1971, 1985) and Conover and Iman (1981) are outlined, and the results of a simulation study of the performance of three nonparametric and one normal-theory test of the hypothesis of no relationship among two sets of variables are presented. These results suggest that multivariate-nonparametric tests should be considered for a variety of data conditions. especially heavy-tailed and badly skewed data for small samples and a large number of variates.