Likelihood ratio tests in linear mixed models with one variance component

Summary.  We consider the problem of testing null hypotheses that include restrictions on the variance component in a linear mixed model with one variance component and we derive the finite sample and asymptotic distribution of the likelihood ratio test and the restricted likelihood ratio test. The spectral representations of the likelihood ratio test and the restricted likelihood ratio test statistics are used as the basis of efficient simulation algorithms of their null distributions. The large sample χ ² mixture approximations using the usual asymptotic theory for a null hypothesis on the boundary of the parameter space have been shown to be poor in simulation studies. Our asymptotic calculations explain these empirical results. The theory of Self and Liang applies only to linear mixed models for which the data vector can be partitioned into a large number of independent and identically distributed subvectors. One-way analysis of variance and penalized splines models illustrate the results.     

Approximate F-tests of multiple degree of freedom hypotheses in generalized least squares analyses of unbalanced split-plot experiments

Approximate t-tests of single degree of freedom hypotheses in generalized least squares analyses (GLS) of mixed linear models using restricted maximum likelihood (REML) estimates of variance components have been previously developed by Giesbrecht and Burns (GB), and by Jeske and Harville (JH), using method of moment approximations for the degrees of freedom (df) for the tstatistics. This paper proposes approximate Fstatistics for tests of multiple df hypotheses using one-moment and two-moment approximations which may be viewed as extensions of the GB and JH methods. The paper focuses specifically on tests of hypotheses concerning the main-plot treatment factor in split-plot experiments with missing data. Simulation results indicate usually satisfactory control of Type I error rates.     

Asymptotic likelihood inference for nonhomogeneous observations

This paper surveys asymptotic theory of maximum likelihood estimation for not identically distributed, possibly dependent observations. Main results on consistency, asymptotic normality and efficiency are stated within a unified framework. Limiting distributions of the likelihood ratio, Wald and score statistics for composite hypotheses are obtained under the same conditions by a generalization of existing theory. Modifications for maximum likelihood estimation under misspecification, containing the results for correctly specified models, are presented, and extensions to likelihood inference in the presence of nuisance parameters are indicated.     

Statistical Inference for High‐Dimensional Global Minimum Variance Portfolios

Many studies demonstrate that inference for the parameters arising in portfolio optimization often fails. The recent literature shows that this phenomenon is mainly due to a high‐dimensional asset universe. Typically, such a universe refers to the asymptotics that the sample size n + 1 and the sample dimension d both go to infinity while d ∕ n → c ∈ (0,1). In this paper, we analyze the estimators for the excess returns’ mean and variance, the weights and the Sharpe ratio of the global minimum variance portfolio under these asymptotics concerning consistency and asymptotic distribution. Problems for stating hypotheses in high dimension are also discussed. The applicability of the results is demonstrated by an empirical study. Copyright © 2014 John Wiley & Sons, Ltd.     

Wavelet Estimation of an Unknown Function Observed with Correlated Noise

Tests based on rank statistics are introduced to test for systematic changes in a sequence of independent observations. Proposed tests include a rank test analogous to the parametric likelihood ratio test and others analogous to parametric Bayes tests. The tests are usable with either one- or two-sided alternative hypotheses, and their asymptotic distributions are studied. The results of the general model are applied to two special cases, and their asymptotic distributions are also investigated. A Monte Carlo study verifies the applicability of asymptotic critical points in samples of moderate size, and other simulation studies compare power of the competing tests and their special-case versions. Finally, these tests are applied to a data set of traffic fatalities.     

Likelihood ratio tests for variance components in linear mixed models

Although the asymptotic distributions of the likelihood ratio for testing hypotheses of null variance components in linear mixed models derived by Stram and Lee [1994. Variance components testing in longitudinal mixed effects model. Biometrics 50, 1171–1177] are valid, their proof is based on the work of Self and Liang [1987. Asymptotic properties of maximum likelihood estimators and likelihood tests under nonstandard conditions. J. Amer. Statist. Assoc. 82, 605–610] which requires identically distributed random variables, an assumption not always valid in longitudinal data problems. We use the less restrictive results of Vu and Zhou [1997. Generalization of likelihood ratio tests under nonstandard conditions. Ann. Statist. 25, 897–916] to prove that the proposed mixture of chi-squared distributions is the actual asymptotic distribution of such likelihood ratios used as test statistics for null variance components in models with one or two random effects. We also consider a limited simulation study to evaluate the appropriateness of the asymptotic distribution of such likelihood ratios in moderately sized samples.     

Block empirical likelihood for longitudinal partially linear regression models

The authors propose a block empirical likelihood procedure to accommodate the within‐group correlation in longitudinal partially linear regression models. This leads them to prove a nonparametric version of the Wilks theorem. In comparison with normal approximations, their method does not require a consistent estimator for the asymptotic covariance matrix, which makes it easier to conduct inference on the parametric component of the model. An application to a longitudinal study on fluctuations of progesterone level in a menstrual cycle is used to illustrate the procedure developed here.     

Estimation and prediction for spatial generalized linear mixed models using high order Laplace approximation

Estimation and prediction in generalized linear mixed models are often hampered by intractable high dimensional integrals. This paper provides a framework to solve this intractability, using asymptotic expansions when the number of random effects is large. To that end, we first derive a modified Laplace approximation when the number of random effects is increasing at a lower rate than the sample size. Second, we propose an approximate likelihood method based on the asymptotic expansion of the log-likelihood using the modified Laplace approximation which is maximized using a quasi-Newton algorithm. Finally, we define the second order plug-in predictive density based on a similar expansion to the plug-in predictive density and show that it is a normal density. Our simulations show that in comparison to other approximations, our method has better performance. Our methods are readily applied to non-Gaussian spatial data and as an example, the analysis of the rhizoctonia root rot data is presented.     

Johansen cointegration rank tests under local alternative hypotheses when related drift or linear trend is not dependent upon sample size in VARs

Abstract

This paper discusses Johansen’s likelihood ratio tests to determine the cointegration rank under local alternative hypotheses in the vector autoregressive models (VARs) in which drift or linear trend related to the hypotheses is not dependent upon the sample size, and evaluates related asymptotic properties. We show that the test statistics diverge at the rate of the sample size even under one of local alternative hypotheses, owing to the existence of such a deterministic term. This implies that under our situations, the tests are far more powerful than those under the conventional local alternative hypotheses.     

Asymptotic results for estimation and testing variances in regression models

Usually the variance of independent observations resulting from a linear or a nonlinear relationship is estimated by the Least-Squares residual estimator. In this paper its asymptotic properties are investigated. Further the asymptotic behaviour of tests for one-sided hypotheses on the variance is studied. The paper splits into two parts, the first one concerned with linear and the second one with nonlinear models.     

Laplace approximations for censored linear regression models

We consider approximate Bayesian inference about scalar parameters of linear regression models with possible censoring. A second-order expansion of their Laplace posterior is seen to have a simple and intuitive form for logconcave error densities with nondecreasing hazard functions. The accuracy of the approximations is assessed for normal and Gumbel errors when the number of regressors increases with sample size. Perturbations of the prior and the likelihood are seen to be easily accommodated within our framework. Links with the work of DiCiccio et al. (1990) and Viveros and Sprott (1987) extend the applicability of our results to conditional frequentist inference based on likelihood-ratio statistics.     

Rényi statistics for testing hypotheses in mixed linear regression models

Rényi divergences are used to propose some statistics for testing general hypotheses in mixed linear regression models. The asymptotic distribution of these tests statistics, of the Kullback–Leibler and of the likelihood ratio statistics are provided, assuming that the sample size and the number of levels of the random factors tend to infinity. A simulation study is carried out to analyze and compare the behavior of the proposed tests when the sample size and number of levels are small.     

On the role of minque in testing of hypotheses under hiked linear models

Testing of hypotheses under balanced ANOVA models is fairly simple and generally based on the usual ANOVA sums of squares. Difficulties may arise in special cases when these sums of squares do not form a complete sufficient statistic. There is a huge literature on this subject which was recently surveyed in Seifert's contribution to the book of Mumak (1904). But there are only a few results about unbalanced models. In such models the consideration of likelihood ratios leads to more complex sums of squares known from MINQUE theory.

Uniform optimality of testsusually reduces to local optimality. Here we prespnt a small review of methods proposed for testing of hypotheses in unbalanced models. where MINQUEI playb a major role. We discuss the use of iterated MINQUE for the construction of asymptotically optimal tests described in Humak (1984) and approximate tests based on locally uncorrelated linear combinations of MINQUE estimators by Seifert (1985), We show that the latter tests coincide with robust locally optimal invariant tests proposeci by Kariya and Sinha and Das and Sinha, if the number of variance components is two. Explicit expressions for corresponding tests are given for the unbalanced two-way cross classification random model, which covers some other models as special cases. A simulation study under lines the relevance of MINQUE for testing of hypotheses problems.     

Likelihood ratio procedures and tests of fit in parametric and semiparametric copula models with censored data

Copula models for multivariate lifetimes have become widely used in areas such as biomedicine, finance and insurance. This paper fills some gaps in existing methodology for copula parameters and model assessment. We consider procedures based on likelihood and pseudolikelihood ratio statistics and introduce semiparametric maximum likelihood estimation leading to semiparametric versions. For cases where standard asymptotic approximations do not hold, we propose an efficient simulation technique for obtaining p-values. We apply these methods to tests for a copula model, based on embedding it in a larger copula family. It is shown that the likelihood and pseudolikelihood ratio tests are consistent even when the expanded copula model is misspecified. Power comparisons with two other tests of fit indicate that model expansion provides a convenient, powerful and robust approach. The methods are illustrated on an application concerning the time to loss of vision in the two eyes of an individual.     

The equivalence between likelihood ratio test and F-test for testing variance component in a balanced one-way random effects model

In mixed linear models, it is frequently of interest to test hypotheses on the variance components. F-test and likelihood ratio test (LRT) are commonly used for such purposes. Current LRTs available in literature are based on limiting distribution theory. With the development of finite sample distribution theory, it becomes possible to derive the exact test for likelihood ratio statistic. In this paper, we consider the problem of testing null hypotheses on the variance component in a one-way balanced random effects model. We use the exact test for the likelihood ratio statistic and compare the performance of F-test and LRT. Simulations provide strong support of the equivalence between these two tests. Furthermore, we prove the equivalence between these two tests mathematically.     

Nonnull asymptotic distributions of the LR,Wald, score and gradient statistics in generalized linear models with dispersion covariates

The class of generalized linear models with dispersion covariates, which allows us to jointly model the mean and dispersion parameters, is a natural extension to the classical generalized linear models. In this paper, we derive the asymptotic expansions under a sequence of Pitman alternatives (up to order n ^?1/2) for the nonnull distribution functions of the likelihood ratio, Wald, Rao score and gradient statistics in this class of models. The asymptotic distributions of these statistics are obtained for testing a subset of regression parameters and for testing a subset of dispersion parameters. Based on these nonnull asymptotic expansions, the power of all four tests, which are equivalent to first order, are compared. Furthermore, we consider Monte Carlo simulations in order to compare the finite-sample performance of these tests in this class of models. We present two empirical applications to two real data sets for illustrative purposes.     

Powerful Parametric Tests Based on Sum‐Functions of Spacings

Assume that we have a sequence of n independent and identically distributed random variables with a continuous distribution function F, which is specified up to a few unknown parameters. In this paper, tests based on sum‐functions of sample spacings are proposed, and large sample theory of the tests are presented under simple null hypotheses as well as under close alternatives. Tests, which are optimal within this class, are constructed, and it is noted that these tests have properties that closely parallel those of the likelihood ratio test in regular parametric models. Some examples are given, which show that the proposed tests work also in situations where the likelihood ratio test breaks down. Extensions to more general hypotheses are discussed.     

Approximate Small-Sample Tests of Fixed Effects in Nonlinear Mixed Models

Nonlinear mixed effect models have been studied extensively over several decades, particularly in pharmacokinetic and pharmacodynamic applications. Here, we focus on investigating the performance of commonly applied tests of linear hypotheses about the fixed effect parameters under different approximations to the likelihood function and to the estimated covariance matrix of the estimators. Included are the first-order approximation (FIRO), first-order conditional approximation (FOCE), and Gaussian quadrature approximation (AGQ) estimation methods. There is no straightforward way to mimic the approximations and adjustments taken in linear mixed models, such as the Kackar–Harville–Jeske–Kenward–Roger approach. By simulations, we illustrate the accuracy of p-values for the tests considered here. The observed results indicate that FOCE and AGQ estimation methods outperform FIRO. The test with an adjustment coefficient that takes into consideration the number of sampling units and the number of fixed effect parameters (Gallant-type) seems to perform closest to desirable even for small-sample sizes.     

Nonstationary panel data analysis: an overview of some recent developments

This paper overviews some recent developments in panel data asymptotics, concentrating on the nonstationary panel case and gives a new result for models with individual effects. Underlying recent theory are asymptotics for multi-indexed processes in which both indexes may pass to infinity. We review some of the new limit theory that has been developed, show how it can be applied and give a new interpretation of individual effects in nonstationary panel data. Fundamental to the interpretation of much of the asymptotics is the concept of a panel regression coefficient which measures the long run average relation across a section of the panel. This concept is analogous to the statistical interpretation of the coefficient in a classical regression relation. A variety of nonstationary panel data models are discussed and the paper reviews the asymptotic properties of estimators in these various models. Some recent developments in panel unit root tests and stationary dynamic panel regression models are also reviewed.     

Nonstationary panel data analysis: an overview of some recent developments

This paper overviews some recent developments in panel data asymptotics, concentrating on the nonstationary panel case and gives a new result for models with individual effects. Underlying recent theory are asymptotics for multi-indexed processes in which both indexes may pass to infinity. We review some of the new limit theory that has been developed, show how it can be applied and give a new interpretation of individual effects in nonstationary panel data. Fundamental to the interpretation of much of the asymptotics is the concept of a panel regression coefficient which measures the long run average relation across a section of the panel. This concept is analogous to the statistical interpretation of the coefficient in a classical regression relation. A variety of nonstationary panel data models are discussed and the paper reviews the asymptotic properties of estimators in these various models. Some recent developments in panel unit root tests and stationary dynamic panel regression models are also reviewed.