The effect of number of clusters and cluster size on statistical power and Type I error rates when testing random effects variance components in multilevel linear and logistic regression models |
| |
Authors: | Peter C Austin George Leckie |
| |
Institution: | 1. Institute for Clinical Evaluative Sciences, Toronto, ON, Canada;2. Institute of Health Management, Policy and Evaluation, University of Toronto, Toronto, ON, Canada;3. Schulich Heart Research Program, Sunnybrook Research Institute, Toronto, ON, Canada;4. Centre for Multilevel Modelling, University of Bristol, Bristol, UK |
| |
Abstract: | When using multilevel regression models that incorporate cluster-specific random effects, the Wald and the likelihood ratio (LR) tests are used for testing the null hypothesis that the variance of the random effects distribution is equal to zero. We conducted a series of Monte Carlo simulations to examine the effect of the number of clusters and the number of subjects per cluster on the statistical power to detect a non-null random effects variance and to compare the empirical type I error rates of the Wald and LR tests. Statistical power increased with increasing number of clusters and number of subjects per cluster. Statistical power was greater for the LR test than for the Wald test. These results applied to both the linear and logistic regressions, but were more pronounced for the latter. The use of the LR test is preferable to the use of the Wald test. |
| |
Keywords: | Statistical power multilevel analysis multilevel model hierarchical model variance components |
|
|