Confidence intervals for variance components in unbalanced one-way random effects model using non-normal distributions

In scenarios where the variance of a response variable can be attributed to two sources of variation, a confidence interval for a ratio of variance components gives information about the relative importance of the two sources. For example, if measurements taken from different laboratories are nine times more variable than the measurements taken from within the laboratories, then 90% of the variance in the responses is due to the variability amongst the laboratories and 10% of the variance in the responses is due to the variability within the laboratories. Assuming normally distributed sources of variation, confidence intervals for variance components are readily available. In this paper, however, simulation studies are conducted to evaluate the performance of confidence intervals under non-normal distribution assumptions. Confidence intervals based on the pivotal quantity method, fiducial inference, and the large-sample properties of the restricted maximum likelihood (REML) estimator are considered. Simulation results and an empirical example suggest that the REML-based confidence interval is favored over the other two procedures in unbalanced one-way random effects model.     

Between group variance component interval estimation for the unbalanced heteroscedastic one-way random effects model

The studied topic is motivated by the problem of interlaboratory comparisons. This paper focuses on the confidence interval estimation of the between group variance in the unbalanced heteroscedastic one-way random effects model. Several interval estimators are proposed and compared by means of the simulation study. The most recommended (safest) is the confidence interval based on Bonferroni's inequality.     

Confidence intervals on the intraclass correlation in the unbalanced one-way classification

Several methods are compared for constructing confidence intervals on the intraclass correlation coefficient in the unbalanced one-way classification. The results suggest that a conservative approximation of the exact procedure developed by Wald (1940) can be used for hand calculations, When the exact solution is desired, a solution procedure is recommended that is computationally convenient and allows the investigator to determine the precision of the estimate. In cases where a prior estimate of the correlation is available, researchers may select intervals based on either the analysis of variance or unweighted sums of squares estimator.     

Short confidence intervals for variance components

Four approximate methods are proposed to construct confidence intervals for the estimation of variance components in unbalanced mixed models. The first three methods are modifications of the Wald, arithmetic and harmonic mean procedures, see Harville and Fenech (1985), while the fourth is an adaptive approach, combining the arithmetic and harmonic mean procedures. The performances of the proposed methods were assessed by a Monte Carlo simulation study. It was found that the intervals based on Wald's method maintained the nominal confidence levels across all designs and values of the parameters under study. On the other hand, the arithmetic (harmonic) mean method performed well for small (large) values of the variance component, relative to the error variance component. The adaptive procedure performed rather well except for extremely unbalanced designs. Further, compared with equal tails intervals, the intervals which use special tables, e.g., Table 678 of Tate and Klett (1959), provided adequate coverage while having much shorter lengths and are thus recommended for use in practice.     

Estimation of variance components in an unbalanced one-way classification

In the unbalanced one-way random effects model the weighted least squares approach with estimated weights is used to develop a relatively simple estimator of variance components. As the number of classes increases, the proposed estimator is seen not only to be best asymptotically normal but also to be asymptotically equivalent to the maximum likelihood estimator.     

Generalized confidence intervals for proportions of total variance in mixed linear models

Exact confidence intervals for a proportion of total variance, based on pivotal quantities, only exist for mixed linear models having two variance components. Generalized confidence intervals (GCIs) introduced by Weerahandi [1993. Generalized confidence intervals (Corr: 94V89 p726). J. Am. Statist. Assoc. 88, 899–905] are based on generalized pivotal quantities (GPQs) and can be constructed for a much wider range of models. In this paper, the author investigates the coverage probabilities, as well as the utility of GCIs, for a proportion of total variance in mixed linear models having more than two variance components. Particular attention is given to the formation of GPQs and GCIs in mixed linear models having three variance components in situations where the data exhibit complete balance, partial balance, and partial imbalance. The GCI procedure is quite general and provides a useful method to construct confidence intervals in a variety of applications.     

Noninformative priors for the between-group variance in the unbalanced one-way random effects model with heterogeneous error variances

For the unbalanced one-way random effects model with heterogeneous error variances, we propose the non-informative priors for the between-group variance and develop the first- and second-order matching priors. It turns out that the second-order matching priors do not exist and the reference prior and Jeffreys prior do not satisfy a first-order matching criterion. We also show that the first-order matching prior meets the frequentist target coverage probabilities much better than the Jeffreys prior and reference prior through simulation study, and the Bayesian credible intervals based on the matching prior and reference prior give shorter intervals than the existing confidence intervals by examples.     

Inferences on the reliability in balanced and unbalanced one-way random models

In this article, the hypothesis testing and interval estimation for the reliability parameter are considered in balanced and unbalanced one-way random models. The tests and confidence intervals for the reliability parameter are developed using the concepts of generalized p-value and generalized confidence interval. Furthermore, some simulation results are presented to compare the performances between the proposed approach and the existing approach. For balanced models, the simulation results indicate that the proposed approach can provide satisfactory coverage probabilities and performs better than the existing approaches across the wide array of scenarios, especially for small sample sizes. For unbalanced models, the simulation results show that the two proposed approaches perform more satisfactorily than the existing approach in most cases. Finally, the proposed approaches are illustrated using two real examples.     

On the LBI criterion for the multivariate one-way random effects model under non-normality

The asymptotic null distribution of the locally best invariant (LBI) test criterion for testing the random effect in the one-way multivariable analysis of variance model is derived under normality and non-normality. The error of the approximation is characterized as O(1/n). The non-null asymptotic distribution is also discussed. In addition to providing a way of obtaining percentage points and p-values, the results of this paper are useful in assessing the robustness of the LBI criterion. Numerical results are presented to illustrate the accuracy of the approximation.     

Performance of Confidence Intervals in Regression Models with Unbalanced One-Fold Nested Error Structures

Abstract

In this article we consider the problem of constructing confidence intervals for a linear regression model with unbalanced nested error structure. A popular approach is the likelihood-based method employed by PROC MIXED of SAS. In this article, we examine the ability of MIXED to produce confidence intervals that maintain the stated confidence coefficient. Our results suggest that intervals for the regression coefficients work well, but intervals for the variance component associated with the primary level cannot be recommended. Accordingly, we propose alternative methods for constructing confidence intervals on the primary level variance component. Computer simulation is used to compare the proposed methods. A numerical example and SAS code are provided to demonstrate the methods.     

Non-negative estimation of variance components in heteroscedastic one-way random-effects ANOVA models

There is a considerable amount of literature dealing with inference about the parameters in a heteroscedastic one-way random-effects ANOVA model. In this paper, we primarily address the problem of improved quadratic estimation of the random-effect variance component. It turns out that such estimators with a smaller mean squared error compared with some standard unbiased quadratic estimators exist under quite general conditions. Improved estimators of the error variance components are also established.     

Some results on simultaneous confidence intervals for monotone contrasts in one-way anova model

The one-way ANOVA model with common variance is considered. Simultaneous confidence Intervals (SCI) for monotone contrasts in the means are derived and compared to alternative intervals gene¬rated by Williams (1977)     

Confidence intervals and tests on the variance ratio in random models with two variance components

The LM test is modified to test any value of the ratio of two variance components in a mixed effects linear model with two variance components. The test is exact, so it can be used to construct exact confidence intervals on this ratio.Exact Neyman-Pearson (NP) tests on the variance ratio are described.Their powers provide attainable upper bounds on powers of tests on the variance ratio.Efficiencies of LM tests, which include ANOVA tests, and NP tests are compared for unbalanced, random, one-way ANOVA models.Confidence intervals corresponding to LM tests and NP tests are described.     

A note on testing the nullity of the between group variance in the one-way random effects model under variance heterogeneity

In an unbalanced and heteroscedastic one-way random effects model, we compare, by way of simulation, several test statistics for testing the null hypothesis that the variance of the random effects, also named the between group variance, is zero. These tests are the classical F-test, the test proposed by Jeyaratnam & Othman, the Welch test, and a modified version of Welch's test.     

Confidence intervals for the difference of marginal probabilities in clustered matched-pair binary data

Although there are several available test statistics to assess the difference of marginal probabilities in clustered matched‐pair binary data, associated confidence intervals (CIs) are not readily available. Herein, the construction of corresponding CIs is proposed, and the performance of each CI is investigated. The results from Monte Carlo simulation study indicate that the proposed CIs perform well in maintaining the nominal coverage probability: for small to medium numbers of clusters, the intracluster correlation coefficient‐adjusted McNemar statistic and its associated Wald or Score CIs are preferred; however, this statistic becomes conservative when the number of clusters is larger so that alternative statistics and their associated CIs are preferred. In practice, a combination of the intracluster correlation coefficient‐adjusted McNemar statistic with an alternative statistic is recommended. To illustrate the practical application, a real clustered matched‐pair collection of data is used to illustrate testing the difference of marginal probabilities and constructing the associated CIs. Copyright © 2012 John Wiley & Sons, Ltd.     

On confidence intervals for the among-group variance in the one-way random effects model with unequal error variances

Based on a quadratic form of the group means, we consider two different approaches to construct a confidence interval for the among-group variance in the one-way random effects model with unequal error variances. In one approach the limits of the interval are determined by solving non-linear equations whereas in the second approach the bounds are given explicitly. By using correction terms for convexity in both approaches, we improve the primary intervals and obtain intervals whose actual confidence coefficients are closer to the nominal confidence coefficient. By means of a simulation study, we show that an improved confidence interval from each approach can be recommended for the practical use.     

Effects of non-normality on the power function in a one-way random model

The effects of non-normality on type-I and type-II errors in a one-way random model are investigated for moderate departures from normality. It is found that the probabilities of both errors are more sensitive to the kurtosis of between group effects than that of within group effects.