Approximate confidence intervals for a ratio of two variance components

New approximate confidence intervals for the ratio of two variance components in an unbalanced mixed .linear model with a single set of random effects are proposed. Contrary to the confidence intervals known in the literature the new intervals preserve the confidence coefficient and cover the exact confidence interval which, however, is not easy to establish as it requires the solution of complicated nonlinear equations.     

Likelihood ratio test for simultaneous testing of the mean and the variance of a normal distribution

In this paper, we consider the simultaneous testing of the mean and the variance of a normal distribution. The exact distribution of the likelihood ratio test statistic is obtained, which is not available in the literature. The critical points of the exact test are reported. We also consider some of the other exact and asymptotic tests. The powers of these tests are compared using the Monte Carlo simulations.     

The equivalence between likelihood ratio test and F-test for testing variance component in a balanced one-way random effects model

In mixed linear models, it is frequently of interest to test hypotheses on the variance components. F-test and likelihood ratio test (LRT) are commonly used for such purposes. Current LRTs available in literature are based on limiting distribution theory. With the development of finite sample distribution theory, it becomes possible to derive the exact test for likelihood ratio statistic. In this paper, we consider the problem of testing null hypotheses on the variance component in a one-way balanced random effects model. We use the exact test for the likelihood ratio statistic and compare the performance of F-test and LRT. Simulations provide strong support of the equivalence between these two tests. Furthermore, we prove the equivalence between these two tests mathematically.     

Confidence intervals for the between group variance in the unbalanced one-way random effects model of anaylsis of variance

A confidence interval for the between group variance is proposed which is deduced from Wald'sexact confidence interval for the rtio of the two variance components in the one-way random effects model and the exact confidence interval for the error variance resp.an unbiased estimator of the error variance. In a simulation study the confidence coeffecients for these two intervals are compared with the confidence coefficients of two other commonly used confidence intervals. There the confidence interval derived here yields confidence coefficiends which are always greater than the prescriped level.     

Tests for homogeneity of variance

Six procedures which convert tests of homogeneity of variance into tests for mean equality for independent groups are compared. The tests are the analysis of variance (ANOVA) and Welch F statistics. The Welch statistics are included since it was anticipated that ANOVA would not provide a robust test when samples of unequal sizes are obtained from non-normal populations. However, the Welch tests are not found to be uniformly preferrable. In addition, a prior recommendation for Miller's jackknife procedure is not supported for the unequal sample size case. The data indicates that the current tests for variance heterogeneity are either sensitive to non-normality or, if robust, lacking in power. Therefore, these tests cannot be recommended for the purpose of testing the validity of the ANOVA homogeneity assumption.     

Likelihood inference for small variance components

The authors explore likelihood‐based methods for making inferences about the components of variance in a general normal mixed linear model. In particular, they use local asymptotic approximations to construct confidence intervals for the components of variance when the components are close to the boundary of the parameter space. In the process, they explore the question of how to profile the restricted likelihood (REML). Also, they show that general REML estimates are less likely to fall on the boundary of the parameter space than maximum‐likelihood estimates and that the likelihood‐ratio test based on the local asymptotic approximation has higher power than the likelihood‐ratio test based on the usual chi‐squared approximation. They examine the finite‐sample properties of the proposed intervals by means of a simulation study.     

Short confidence intervals for variance components

Four approximate methods are proposed to construct confidence intervals for the estimation of variance components in unbalanced mixed models. The first three methods are modifications of the Wald, arithmetic and harmonic mean procedures, see Harville and Fenech (1985), while the fourth is an adaptive approach, combining the arithmetic and harmonic mean procedures. The performances of the proposed methods were assessed by a Monte Carlo simulation study. It was found that the intervals based on Wald's method maintained the nominal confidence levels across all designs and values of the parameters under study. On the other hand, the arithmetic (harmonic) mean method performed well for small (large) values of the variance component, relative to the error variance component. The adaptive procedure performed rather well except for extremely unbalanced designs. Further, compared with equal tails intervals, the intervals which use special tables, e.g., Table 678 of Tate and Klett (1959), provided adequate coverage while having much shorter lengths and are thus recommended for use in practice.     

Estimation of variance components in the mixed effects models: A comparison between analysis of variance and spectral decomposition

The mixed effects models with two variance components are often used to analyze longitudinal data. For these models, we compare two approaches to estimating the variance components, the analysis of variance approach and the spectral decomposition approach. We establish a necessary and sufficient condition for the two approaches to yield identical estimates, and some sufficient conditions for the superiority of one approach over the other, under the mean squared error criterion. Applications of the methods to circular models and longitudinal data are discussed. Furthermore, simulation results indicate that better estimates of variance components do not necessarily imply higher power of the tests or shorter confidence intervals.     

Extended tests for non-zero between-study variance

The ANOVA F-test, James tests and generalized F-test are extended to test hypotheses on the between-study variance for values greater than zero. Using simulations, we compare the performance of extended test procedures with respect to the actual attained type I error rate. Examples are provided to demonstrate the application of the procedures in ANOVA models and meta-analysis.     

A robust test for autocorrelation in the presence of a structural break in variance

It has been known that when there is a break in the variance (unconditional heteroskedasticity) of the error term in linear regression models, a routine application of the Lagrange multiplier (LM) test for autocorrelation can cause potentially significant size distortions. We propose a new test for autocorrelation that is robust in the presence of a break in variance. The proposed test is a modified LM test based on a generalized least squares regression. Monte Carlo simulations show that the new test performs well in finite samples and it is especially comparable to other existing heteroskedasticity-robust tests in terms of size, and much better in terms of power.     

The present status of confidence interval estimation on variance components in balanced and unbalanced random models

Much research has been conducted to develop confidence Intervals on linear combinations and ratios of variance components in balanced and unbalanced random models.This paper first presents confidence intervals on functions of variance components in balanced designs.These results assume that classical analysis of variance sums of squares are independent and have exact scaled chi-squared distributions.In unbalanced designs, either one or both of these assumptions are violated, and modifications to the balanced model intervals are required.We report results of some recent work that examines various modifications for some particular unbalanced designs.     

Confidence intervals for variance components in unbalanced one-way random effects model using non-normal distributions

In scenarios where the variance of a response variable can be attributed to two sources of variation, a confidence interval for a ratio of variance components gives information about the relative importance of the two sources. For example, if measurements taken from different laboratories are nine times more variable than the measurements taken from within the laboratories, then 90% of the variance in the responses is due to the variability amongst the laboratories and 10% of the variance in the responses is due to the variability within the laboratories. Assuming normally distributed sources of variation, confidence intervals for variance components are readily available. In this paper, however, simulation studies are conducted to evaluate the performance of confidence intervals under non-normal distribution assumptions. Confidence intervals based on the pivotal quantity method, fiducial inference, and the large-sample properties of the restricted maximum likelihood (REML) estimator are considered. Simulation results and an empirical example suggest that the REML-based confidence interval is favored over the other two procedures in unbalanced one-way random effects model.     

An extension of the median test to analysis of variance

In a k-way analysis of variance model, the major concern is testing for main effects and for the presence of interaction between the factors. When the assumptions of normality and equal variances are satisfied, the appropriate test to use is the usual F-test for ANOVA. However, when the normality assumption is not satisfied then a robust or nonparametric test is needed to conduct the analysis. In this paper a nonparametric method based on cell counts is proposed. Each cell is divided into L subcells based on predetermined outpoints and the resulting frequencies are laid out in a contingency table. Then the Pearson x² and tne likelihood ratio tests are performed. A comparison with the classical ANOVA F-test indicates that the proposed method is preferable when the data comes from a thick-tailed highly skewed distribution.     

Interval estimation of parameters in an unbalanced mixed two-fold nested classification-the last-stage uniformity case

A procedure for the construction of exact simultaneous confidence intervals on functions of the fixed-effects parameters and on functions of variance components in an unbalanced, mixed, two-fold nested classification is introduced. The type of model considered in this paper enables the construction of such intervals to be based on the corresponding ANOVA table using its mean square ratios.     

Detection of a change-point in variance by a weighted sum of powers of variances test

This paper proposes a weighted sum of powers of variances test for detecting changes in variance of a data sequence. Asymptotic critical value formulas are derived for this test. The modified weighted sum of powers of variances test is also introduced so that the accuracy of change-point detection is highly improved for a sample of small size. Simulation studies and real data analysis are presented to assess the proposed tests.     

Likelihood ratio tests for variance components in linear mixed models

Although the asymptotic distributions of the likelihood ratio for testing hypotheses of null variance components in linear mixed models derived by Stram and Lee [1994. Variance components testing in longitudinal mixed effects model. Biometrics 50, 1171–1177] are valid, their proof is based on the work of Self and Liang [1987. Asymptotic properties of maximum likelihood estimators and likelihood tests under nonstandard conditions. J. Amer. Statist. Assoc. 82, 605–610] which requires identically distributed random variables, an assumption not always valid in longitudinal data problems. We use the less restrictive results of Vu and Zhou [1997. Generalization of likelihood ratio tests under nonstandard conditions. Ann. Statist. 25, 897–916] to prove that the proposed mixture of chi-squared distributions is the actual asymptotic distribution of such likelihood ratios used as test statistics for null variance components in models with one or two random effects. We also consider a limited simulation study to evaluate the appropriateness of the asymptotic distribution of such likelihood ratios in moderately sized samples.     

Interval estimates for variance components

The fiducial approach to the two components of variance random effects model developed by Venables and James (1978) is related to the Bayesian approach of Box and Tiao (1973). The operating characteristics, under repeated sampling, of the resulting interval estimators for the “within classes” variance component are investigated, and the behaviour of the two sets of intervals is found to be very similar, the coverage frequency of 95% probability intervals being approximately 91% when the “between classes” variance component is zero but rising rapidly to 95% as the between component increases. The probability intervals are shown to be shorter on average than a comparable confidence interval based upon the within classes sum of squares, and to be robust against nonnormality in the class means.     

Generalized confidence intervals for proportions of total variance in mixed linear models

Exact confidence intervals for a proportion of total variance, based on pivotal quantities, only exist for mixed linear models having two variance components. Generalized confidence intervals (GCIs) introduced by Weerahandi [1993. Generalized confidence intervals (Corr: 94V89 p726). J. Am. Statist. Assoc. 88, 899–905] are based on generalized pivotal quantities (GPQs) and can be constructed for a much wider range of models. In this paper, the author investigates the coverage probabilities, as well as the utility of GCIs, for a proportion of total variance in mixed linear models having more than two variance components. Particular attention is given to the formation of GPQs and GCIs in mixed linear models having three variance components in situations where the data exhibit complete balance, partial balance, and partial imbalance. The GCI procedure is quite general and provides a useful method to construct confidence intervals in a variety of applications.     

On tests in variance components models 2

A procedure for finding exact tests for some hypotheses on variance components in unbalanced models is proposed. It is based on F-distributed statistics got by an orthogonal decomposition of the sample space.     

Confidence intervals for variance component ratios in unbalanced linear mixed models

Methods for constructing confidence intervals for variance component ratios in general unbalanced mixed models are developed. The methods are based on inverting the distribution of the signed root of the log-likelihood ratio statistic constructed from either the restricted maximum likelihood or the full likelihood. As this distribution is intractable, the inversion is rather based on using a saddlepoint approximation to its distribution. Apart from Wald's exact method, the resulting intervals are unrivalled in terms of achieving accuracy in overall coverage, underage, and overage. Issues related to the proper “reference set” with which to judge the coverage as well as issues connected to variance ratios being nonnegative with lower bound 0 are addressed. Applications include an unbalanced nested design and an unbalanced crossed design.