Short confidence intervals for variance components

Four approximate methods are proposed to construct confidence intervals for the estimation of variance components in unbalanced mixed models. The first three methods are modifications of the Wald, arithmetic and harmonic mean procedures, see Harville and Fenech (1985), while the fourth is an adaptive approach, combining the arithmetic and harmonic mean procedures. The performances of the proposed methods were assessed by a Monte Carlo simulation study. It was found that the intervals based on Wald's method maintained the nominal confidence levels across all designs and values of the parameters under study. On the other hand, the arithmetic (harmonic) mean method performed well for small (large) values of the variance component, relative to the error variance component. The adaptive procedure performed rather well except for extremely unbalanced designs. Further, compared with equal tails intervals, the intervals which use special tables, e.g., Table 678 of Tate and Klett (1959), provided adequate coverage while having much shorter lengths and are thus recommended for use in practice.     

A Note on Wald's Type Chi-squared Tests of Fit

The Wald's method for constructing chi-squared tests of fit has been formulated more accurately. It is shown that Wald's type statistics will follow the central chi-squared distribution if and only if the limit covariance matrix of standardized frequencies will not depend on unknown parameters. Several examples that illustrate this important fact are presented. In particular, it is shown that the goodness-of-fit statistic developed by Moore and Stubblebine does not follow the chi-squared limit distribution, and, hence, cannot be used for testing multivariate normality.     

A Comparative Study of Some Modified Chi-Squared Tests

Some recent results in the theory and applications of modified chi-squared goodness-of-fit tests are briefly discussed. It seems that for the first time power of modified chi-squared type tests for the logistic and three-parameter Weibull distributions based on moment type estimators is studied. Power of different modified tests against some alternatives for equiprobable fixed or random grouping intervals, and for Neyman–Pearson classes is investigated. It is shown that power of test statistic essentially depends on the quantity of Fisher's sample information this statistic uses. Some recommendations on implementing modified chi-squared type tests are given.     

On the optimality of rao's statistic

This paper establishes the asymptotic optimality of Rao's

test within a very wide class of tests that Includes the likeli hood ratio test and Wald's test. An expression for the defici¬ency of the tests in this class relative to Rao's test has also been obtained     

A modification of the partial sequential probability ratio test

For the problem of discriminating between two simple hypoth¬eses concerning a Koopman - Darmois parameter, a modification of the partial sequential probability ratio test is proposed where instead of drawing only one fixed sample, two fixed samples are drawn and then Wald's SPRT is started. The OC and the ASN func¬tions are derived. Numerical comparisons are made with Wald's and Read's procedures for testing the normal mean with known variance. For some parameter values, the test procedure has a lower ASN than that of Read's procedure.     

The present status of confidence interval estimation on variance components in balanced and unbalanced random models

Much research has been conducted to develop confidence Intervals on linear combinations and ratios of variance components in balanced and unbalanced random models.This paper first presents confidence intervals on functions of variance components in balanced designs.These results assume that classical analysis of variance sums of squares are independent and have exact scaled chi-squared distributions.In unbalanced designs, either one or both of these assumptions are violated, and modifications to the balanced model intervals are required.We report results of some recent work that examines various modifications for some particular unbalanced designs.     

Sample‐size calculations for multi‐group comparison in population pharmacokinetic experiments

This paper describes an approach for calculating sample size for population pharmacokinetic experiments that involve hypothesis testing based on multi‐group comparison detecting the difference in parameters between groups under mixed‐effects modelling. This approach extends what has been described for generalized linear models and nonlinear population pharmacokinetic models that involve only binary covariates to more complex nonlinear population pharmacokinetic models. The structural nonlinear model is linearized around the random effects to obtain the marginal model and the hypothesis testing involving model parameters is based on Wald's test. This approach provides an efficient and fast method for calculating sample size for hypothesis testing in population pharmacokinetic models. The approach can also handle different design problems such as unequal allocation of subjects to groups and unbalanced sampling times between and within groups. The results obtained following application to a one compartment intravenous bolus dose model that involved three different hypotheses under different scenarios showed good agreement between the power obtained from NONMEM simulations and nominal power. Copyright © 2009 John Wiley & Sons, Ltd.     

Harmonic mean approach to uunbalanced random effects models under heteroscedasticity

In this paper we consider unbalanced random effects models under heteroscedastic variances. By using' the harmonic mean approach, it is shown that the problems are analogous to those from balanced random effects models under horaoscedastic variances. Thus, by using the harmonic mean approach, statistical inferences about variance components are derived by using procedures from balanced models under homoscedastic variances. Laguerre polynomial expansion is used to approximate the sampling distributions of relevant statistics.     

Computer-aided unbalanced supersaturated designs involving interactions

Supersaturated designs (SSDs) are defined as fractional factorial designs whose experimental run size is smaller than the number of main effects to be estimated. While most of the literature on SSDs has focused only on main effects designs, the construction and analysis of such designs involving interactions has not been developed to a great extent. In this paper, we propose a backward elimination design-driven optimization (BEDDO) method, with one main goal in mind, to eliminate the factors which are identified to be fully aliased or highly partially aliased with each other in the design. Under the proposed BEDDO method, we implement and combine correlation-based statistical measures taken from classical test theory and design of experiments field, and we also present an optimality criterion which is a modified form of Cronbach's alpha coefficient. In this way, we provide a new class of computer-aided unbalanced SSDs involving interactions, that derive directly from BEDDO optimization.     

THE POWER OF STUDENT'S t TEST: CAN A NON-SIMILAR TEST DO BETTER?

Lehmann & Stein (1948) proved the existence of non-similar tests which can be more powerful than best similar tests. They used Student's problem of testing for a non-zero mean given a random sample from the normal distribution with unknown variance as an example. This raises the question: should we use a non-similar test instead of Student's t test? Questions like this can be answered by comparing the power of the test with the power envelope. This paper discusses the difficulties involved in computing power envelopes. It reports an empirical comparison of the power of the t test and the power envelope and finds that the two are almost identical especially for sample sizes greater than 20. These findings suggest that, as well as being uniformly most powerful (UMP) within the class of similar tests, Student's t test is approximately UMP within the class of all tests. For practical purposes it might also be regarded as UMP when moderate or large sample sizes are involved.     

Multivariate testing and model-checking for generalized order statistics with applications

The exponential family structure of the joint distribution of generalized order statistics is utilized to establish multivariate tests on the model parameters. For simple and composite null hypotheses, the likelihood ratio test (LR test), Wald's test, and Rao's score test are derived and turn out to have simple representations. The asymptotic distribution of the corresponding test statistics under the null hypothesis is stated, and, in case of a simple null hypothesis, asymptotic optimality of the LR test is addressed. Applications of the tests are presented; in particular, we discuss their use in reliability, and to decide whether a Poisson process is homogeneous. Finally, a power study is performed to measure and compare the quality of the tests for both, simple and composite null hypotheses.     

A note on testing the nullity of the between group variance in the one-way random effects model under variance heterogeneity

In an unbalanced and heteroscedastic one-way random effects model, we compare, by way of simulation, several test statistics for testing the null hypothesis that the variance of the random effects, also named the between group variance, is zero. These tests are the classical F-test, the test proposed by Jeyaratnam & Othman, the Welch test, and a modified version of Welch's test.     

Reply to comments on modeling asset returns with alternative stable distributions and some extensions *

This paper examines the sampling properties of a number of serial correlation tests in dynamic linear models which include one or two lags of the dependent variable. Among the tests considered are the Durbin-Watson (DW) bounds test, modified versions of the DW proposed recently by King and Wu and Inder, Durbin's m test, Inder's point optimal test and a Hausman type test. Sampling designs include models with one or two lags of the dependent variable. The m, Hausman, and Inder's tests have the best performance, while Inder's modified DW test appears to be better than the other DW based tests. Results also suggest that tests are less powerful and more sensitive to design parameters in models with higher dynamics, with the DW-based tests being the most sensitive.     

The Appropriateness of Some Common Procedures for Testing the Equality of Two Independent Binomial Populations

For testing the equality of two independent binomial populations the Fisher exact test and the chi-squared test with Yates's continuity correction are often suggested for small and intermediate size samples. The use of these tests is inappropriate in that they are extremely conservative. In this article we demonstrate that, even for small samples, the uncorrected chi-squared test (i.e., the Pearson chi-squared test) and the two-independent-sample t test are robust in that their actual significance levels are usually close to or smaller than the nominal levels. We encourage the use of these latter two tests.     

Hypotheses testing for generalized order statistics with simple order restrictions on model parameters under the alternative

In applications of generalized order statistics as, for instance, reliability analysis of engineering systems, prior knowledge about the order of the underlying model parameters is often available and may therefore be incorporated in inferential procedures. Taking this information into account, we establish the likelihood ratio test, Rao's score test, and Wald's test for test problems arising from the question of appropriate model selection for ordered data, where simple order restrictions are put on the parameters under the alternative hypothesis. For simple and composite null hypothesis, explicit representations of the corresponding test statistics are obtained along with some properties and their asymptotic distributions. A simulation study is carried out to compare the order restricted tests in terms of their power. In the set-up considered, the adapted tests significantly improve the power of the associated omnibus versions for small sample sizes, especially when testing a composite null hypothesis.     

Search for optimal designs in a three stagenested random model

In this paper we define a class of unbalanced designs, denoted by C_k,s,t, for estimating the components of variance in a k-stage nested random effects linear model. This class contains many of the designs proposed in the literature for nested components of variance models. We focus on the three-state model and discuss the determination of locally optimal designs within this class using a systematic computer search. For large sample sizes we show that approximate optimal designs may be obtained using a limit argument combined with numerical optimization. A comparison of our designs with previously published designs suggests that, in many cases, our designs result in substantial gains in efficiency.     

Test statistics arising from quasi likelihood: Bartlett adjustment and higher-order power

With reference to the quasi-likelihood arising from an unbiased estimating function, we consider a large class of test statistics which includes the likelihood ratio, Rao's score and Wald's statistics in particular. We study Bartlett adjustability and third-order power in a possibly non-iid setting and provide explicit formulae. Since the relevant Bartlett identities may not hold while working with a quasi-likelihood, our results can differ from those based on the usual likelihood. The prospects regarding posterior Bartlett adjustability have been briefly indicated.     

Confidence intervals for variance component ratios in unbalanced linear mixed models

Methods for constructing confidence intervals for variance component ratios in general unbalanced mixed models are developed. The methods are based on inverting the distribution of the signed root of the log-likelihood ratio statistic constructed from either the restricted maximum likelihood or the full likelihood. As this distribution is intractable, the inversion is rather based on using a saddlepoint approximation to its distribution. Apart from Wald's exact method, the resulting intervals are unrivalled in terms of achieving accuracy in overall coverage, underage, and overage. Issues related to the proper “reference set” with which to judge the coverage as well as issues connected to variance ratios being nonnegative with lower bound 0 are addressed. Applications include an unbalanced nested design and an unbalanced crossed design.     

Hypothesis Testing for Various Familial Dependence Structures

This work compares various hypothesis testing procedures in the case of familial clustered data. Specifically, we use likelihood ratio and Wald's tests for maximum likelihood estimators, and Wald-type tests for moment and quasi-least squares estimators. Using simulations, we estimate significance levels for various hypotheses concerning the one-parent auto-regressive and two-parent equi-correlated dependence structures. We show that the likelihood ratio test performs best for certain simple hypotheses in the one-parent case, whereas the Wald-type test for the quasi-least squares procedure is optimal in the more complex two-parent case.     

Chi–square tests for comparing vectors of proportions for several cluster samples

Test statistics are developed for comparing vectors of proportions obtained from several independent two–stage cluster samples. It is assumed that clusters are selected with probability proportional to size for each sample. Wald's general method of constructing quadratic forms is used to obtain a large sample chi–square test. More easily evaluted chi–square tests are derived from the Dirichlet–multinnomial model. Corresponding goodness–of–fit test for the Dirichlet–multinomial model are also derived.