Likelihood Ratio Tests for Fixed Model Terms using Residual Maximum Likelihood

Likelihood ratio tests for fixed model terms are proposed for the analysis of linear mixed models when using residual maximum likelihood estimation. Bartlett-type adjustments, using an approximate decomposition of the data, are developed for the test statistics. A simulation study is used to compare properties of the test statistics proposed, with or without adjustment, with a Wald test. A proposed test statistic constructed by dropping fixed terms from the full fixed model is shown to give a better approximation to the asymptotic χ²-distribution than the Wald test for small data sets. Bartlett adjustment is shown to improve the χ²-approximation for the proposed tests substantially.     

Confidence Intervals for the Current Status Model

We discuss a new way of constructing pointwise confidence intervals for the distribution function in the current status model. The confidence intervals are based on the smoothed maximum likelihood estimator, using local smooth functional theory and normal limit distributions. Bootstrap methods for constructing these intervals are considered. Other methods to construct confidence intervals, using the non‐standard limit distribution of the (restricted) maximum likelihood estimator, are compared with our approach via simulations and real data applications.     

Empirical Likelihood Confidence Intervals for Response Mean with Data Missing at Random

Abstract.  A kernel regression imputation method for missing response data is developed. A class of bias-corrected empirical log-likelihood ratios for the response mean is defined. It is shown that any member of our class of ratios is asymptotically chi-squared, and the corresponding empirical likelihood confidence interval for the response mean is constructed. Our ratios share some of the desired features of the existing methods: they are self-scale invariant and no plug-in estimators for the adjustment factor and asymptotic variance are needed; when estimating the non-parametric function in the model, undersmoothing to ensure root- n consistency of the estimator for the parameter is avoided. Since the range of bandwidths contains the optimal bandwidth for estimating the regression function, the existing data-driven algorithm is valid for selecting an optimal bandwidth. We also study the normal approximation-based method. A simulation study is undertaken to compare the empirical likelihood with the normal approximation method in terms of coverage accuracies and average lengths of confidence intervals.     

Profile Likelihood Based Confidence Intervals for Common Intraclass Correlation Coefficient

In this article, we propose an approach for estimating the confidence interval of the common intraclass correlation coefficient based on the profile likelihood. Comparisons are made with a procedure using the concept of generalized pivots. The method presented is less computationally demanding than the method using generalized pivots. The approach also provides better coverage, and shorter lengths of confidence intervals for the case when the value of the common intraclass correlation coefficient is low. The lengths of confidence intervals given by both methods are quite comparable for high but less realistic values of the common intraclass correlation coefficient.     

Maximum Likelihood Estimation for Stochastic Differential Equations with Random Effects

Abstract. We consider N independent stochastic processes (X _i (t), t ∈ [0,T _i ]), i=1,…, N, defined by a stochastic differential equation with drift term depending on a random variable φ _i . The distribution of the random effect φ _i depends on unknown parameters which are to be estimated from the continuous observation of the processes X_i. We give the expression of the exact likelihood. When the drift term depends linearly on the random effect φ _i and φ _i has Gaussian distribution, an explicit formula for the likelihood is obtained. We prove that the maximum likelihood estimator is consistent and asymptotically Gaussian, when T _i =T for all i and N tends to infinity. We discuss the case of discrete observations. Estimators are computed on simulated data for several models and show good performances even when the length time interval of observations is not very large.     

Likelihood Ratio Type Two‐Sample Tests for Current Status Data

Abstract. We introduce fully non‐parametric two‐sample tests for testing the null hypothesis that the samples come from the same distribution if the values are only indirectly given via current status censoring. The tests are based on the likelihood ratio principle and allow the observation distributions to be different for the two samples, in contrast with earlier proposals for this situation. A bootstrap method is given for determining critical values and asymptotic theory is developed. A simulation study, using Weibull distributions, is presented to compare the power behaviour of the tests with the power of other non‐parametric tests in this situation.     

Confidence intervals and tests on the variance ratio in random models with two variance components

The LM test is modified to test any value of the ratio of two variance components in a mixed effects linear model with two variance components. The test is exact, so it can be used to construct exact confidence intervals on this ratio.Exact Neyman-Pearson (NP) tests on the variance ratio are described.Their powers provide attainable upper bounds on powers of tests on the variance ratio.Efficiencies of LM tests, which include ANOVA tests, and NP tests are compared for unbalanced, random, one-way ANOVA models.Confidence intervals corresponding to LM tests and NP tests are described.     

Generalized Likelihood Ratio Tests and Uniformly Most Powerful Tests

For testing a one-sided hypothesis in a one-parameter family of distributions, it is shown that the generalized likelihood ratio (GLR) test coincides with the uniformly most powerful (UMP) test, assuming certain monotonicity properties for the likelihood function. In particular, the equivalence of GLR tests and UMP tests holds for one-parameter exponential families. In addition, the relationship between GLR and UMPU (UMP unbiased) tests is considered when testing two-sided hypotheses.     

Empirical Likelihood Confidence Intervals for Distribution Functions under Negatively Associated Samples

In this article, we discuss the construction of the confidence intervals for distribution functions under negatively associated samples. It is shown that the blockwise empirical likelihood (EL) ratio statistic for a distribution function is asymptotically χ²-type distributed. The result is used to obtain an EL-based confidence interval for the distribution function.     

On the Asymptotic Distribution of the Likelihood Ratio Statistic

Some results on the estimation of a symmetric density function are given. For the case when the point of symmetry, θ, is known it is shown that a symmetrized kernel estimator is, as measured by MISE, approximately as good as a non-symmetrized one based on twice as many observations. This result remains ’true if the estimated density is a normal one and θ is estimated by the sample mean. Some Monte Carlo results for several densities and sample sizes are given for the case when θ is estimated by the sample median.     

A Sparse Implementation of the Average Information Algorithm for Factor Analytic and Reduced Rank Variance Models

Factor analytic variance models have been widely considered for the analysis of multivariate data particularly in the psychometrics area. Recently Smith, Cullis & Thompson (2001) have considered their use in the analysis of multi‐environment data arising from plant improvement programs. For these data, the size of the problem and the complexity of the variance models chosen to account for spatial heterogeneity within trials implies that standard algorithms for fitting factor analytic models can be computationally expensive. This paper presents a sparse implementation of the average information algorithm (Gilmour, Thompson & Cullis, 1995) for fitting factor analytic and reduced rank variance models.     

Variable Selection in Linear Mixed Models Using an Extended Class of Penalties

There is an emerging need to advance linear mixed model technology to include variable selection methods that can simultaneously choose and estimate important effects from a potentially large number of covariates. However, the complex nature of variable selection has made it difficult for it to be incorporated into mixed models. In this paper we extend the well known class of penalties and show that they can be integrated succinctly into a linear mixed model setting. Under mild conditions, the estimator obtained from this mixed model penalised likelihood is shown to be consistent and asymptotically normally distributed. A simulation study reveals that the extended family of penalties achieves varying degrees of estimator shrinkage depending on the value of one of its parameters. The simulation study also shows there is a link between the number of false positives detected and the number of true coefficients when using the same penalty. This new mixed model variable selection (MMVS) technology was applied to a complex wheat quality data set to determine significant quantitative trait loci (QTL).     

Box-Cox变换下联合均值与方差模型的极大似然估计

在提出Box-Cox变换下联合均值与方差模型的基础上,研究了该模型参数的估计问题.同时利用截面极大似然估计方法对变换参数λ进行估计,并对均值模型和方差模型的参数进行极大似然估计.通过随机模拟和实例研究,结果表明该模型和方法是有效和可行的.     

Confidence Intervals for Nonparametric Regression Functions with Missing Data

Suppose that we have a nonparametric regression model Y = m(X) + ε with X ∈ R^p, where X is a random design variable and is observed completely, and Y is the response variable and some Y-values are missing at random. Based on the “complete” data sets for Y after nonaprametric regression imputation and inverse probability weighted imputation, two estimators of the regression function m(x₀) for fixed x₀ ∈ R^p are proposed. Asymptotic normality of two estimators is established, which is used to construct normal approximation-based confidence intervals for m(x₀). We also construct an empirical likelihood (EL) statistic for m(x₀) with limiting distribution of χ²₁, which is used to construct an EL confidence interval for m(x₀).     

A Population Approach to Analysis of Variance Models

Several authors have contributed to what can now be considered a rather complete theory for analysis of variance in cases with orthogonal factors. By using this theory on an assumed basic reference population, the orthogonality concept gives a natural definition of independence between factors in the population. By looking upon the treated units in designed experiments as a formal sample from a future population about which we want to make inference, a natural parametrization of expectations and variances connected to such experiments arises. This approach seems to throw light upon several controversial questions in the theory of mixed models. Also, it gives a framework for discussing the choice of conditioning in models     

Wallet Game: Probability,Likelihood, and Extended Likelihood

We propose a likelihood explanation to the two-person wallet game, a probability-related paradox, where an obviously fair game may appear favorable to both players. Yet a small variation of the game, without changing its fairness, turns it to seem unfavorable. The extended likelihood concept seems logically necessary if we want to allow the sense of uncertainty associated with a realized but still unobserved random outcome, while at the same time avoid potential probability-related paradoxes.     

Comparing Equal-Tail Probability and Unbiased Confidence Intervals for the Intraclass Correlation Coefficient

The conventional confidence interval for the intraclass correlation coefficient assumes equal-tail probabilities. In general, the equal-tail probability interval is biased and other interval procedures should be considered. Unbiased confidence intervals for the intraclass correlation coefficient are readily available. The equal-tail probability and unbiased intervals have exact coverage as they are constructed using the pivotal quantity method. In this article, confidence intervals for the intraclass correlation coefficient are built using balanced and unbalanced one-way random effects models. The expected length of confidence intervals serves as a tool to compare the two procedures. The unbiased confidence interval outperforms the equal-tail probability interval if the intraclass correlation coefficient is small and the equal-tail probability interval outperforms the unbiased interval if the intraclass correlation coefficient is large.     

Small Sample Confidence Intervals for the Odds Ratio

Abstract

Numerous methods—based on exact and asymptotic distributions—can be used to obtain confidence intervals for the odds ratio in 2 × 2 tables. We examine ten methods for generating these intervals based on coverage probability, closeness of coverage probability to target, and length of confidence intervals. Based on these criteria, Cornfield’s method, without the continuity correction, performed the best of the methods examined here. A drawback to use of this method is the significant possibility that the attained coverage probability will not meet the nominal confidence level. Use of a mid-P value greatly improves methods based on the “exact” distribution. When combined with the Wilson rule for selection of a rejection set, the resulting method is a procedure that performed very well. Crow’s method, with use of a mid-P, performed well, although it was only a slight improvement over the Wilson mid-P method. Its cumbersome calculations preclude its general acceptance. Woolf's (logit) method—with the Haldane–Anscombe correction— performed well, especially with regard to length of confidence intervals, and is recommended based on ease of computation.     

Likelihood Ratio Tests for High‐Dimensional Normal Distributions

In their recent work, Jiang and Yang studied six classical Likelihood Ratio Test statistics under high‐dimensional setting. Assuming that a random sample of size n is observed from a p‐dimensional normal population, they derive the central limit theorems (CLTs) when p and n are proportional to each other, which are different from the classical chi‐square limits as n goes to infinity, while p remains fixed. In this paper, by developing a new tool, we prove that the mentioned six CLTs hold in a more applicable setting: p goes to infinity, and p can be very close to n. This is an almost sufficient and necessary condition for the CLTs. Simulations of histograms, comparisons on sizes and powers with those in the classical chi‐square approximations and discussions are presented afterwards.     

Simple and Exact Empirical Likelihood Ratio Tests for Normality Based on Moment Relations

The empirical likelihood (EL) technique is a powerful nonparametric method with wide theoretical and practical applications. In this article, we use the EL methodology in order to develop simple and efficient goodness-of-fit tests for normality based on the dependence between moments that characterizes normal distributions. The new empirical likelihood ratio (ELR) tests are exact and are shown to be very powerful decision rules based on small to moderate sample sizes. Asymptotic results related to the Type I error rates of the proposed tests are presented. We present a broad Monte Carlo comparison between different tests for normality, confirming the preference of the proposed method from a power perspective. A real data example is provided.