Analysis of the linear correlation coefficient using pseudo-likelihoods

Summary The problem of the inferential analysis of the linear correlation coefficient of normal bivariate populations is tackled, both from the likelihood and Bayesian viewpoints. In particular it is shown how, using pseudo-likelihood (marginal likelihood function and profile likelihood), hypotheses such asH ₀:ϱ=ϱ₀ andH ₀:ϱ_x=ϱ_y can be verified without prohibitive computation effort. The results of marginal and profile likelihood are compared and it is shown that these two methods are virtually equivalent even for small sample sizes. Furthermore, in suitable conditions, the posterior distribution of the coefficient ϱ can be readily obtained, using the exact form or different approximate formulations of the marginal or profile likelihood. Lastly some possible prior distributions of ϱ are illustrated and some explanatory examples are presented.     

Structural inference of the parameters of the heteroscedastic simultaneous equation model

The structural approach of inference for the parameters of a simultaneous equation model with heteroscedastic error variance is investigated in this paper. The joint and the marginal structural distributions for the coefficients of the exogenous variables and the scale parameters of the error variables, and the marginal likelihood function of the coefficients of the endogenous variables have been derived. The estimates are directly obtainable from the structural distribution and the marginal likelihood function of the parameters. The marginal distribution of a subset of coefficients of exogenous variables provides the basis for making inference for a particular subset of parameter of interest.     

On marginal likelihood inference for the intra-class correlation coefficient

A p-component set of responses have been constructed by a location-scale transformation to a p-component set of error variables, the covariance matrix of the set of error variables being of intra-class covariance structure:all variances being unity, and covariance being equal [IML0001]. A sample of size n has been described as a conditional structural model, conditional on the value of the intra-class correlation coefficient ρ. The conditional technique of structural inference provides the marginal likelihood function of ρ based on the standardized residuals. For the normal case, the marginal likelihood function of ρ is seen to be dependent on the standardized residuals through the sample intra-class correlation coefficient. By the likelihood modulation technique, the nonnull distribution of the sample intra-class correlation coefficient has also been obtained.     

Approximate multivariate conditional inference using the adjusted profile likelihood

The author proposes saddlepoint approximation methods that are adapted to multivariate conditional inference in canonical exponential familles. Several approaches to approximating conditional discrete distributions involve dividing an approximation to the full joint mass function, summed over tail regions of interest, by an approximate marginal density. The author first approximates this conditional likelihood by the adjusted profile likelihood, and then applies a multivariate saddlepoint approximation. He also presents formulas to aid in performing simultaneously the profiling and maximizing steps.     

A modified likelihood ratio test for the mean direction in the von mises distribution

The likelihood ratio test (LRT) for the mean direction in the von Mises distribution is modified for possessing a common asymptotic distribution both for large sample size and for large concentration parameter. The test statistic of the modified LRT is compared with the F distribution but not with the chi-square distribution usually employed, Good performances of the modified LRT are shown by analytical studies and Monte Carlo simulation studies, A notable advantage of the test is that it takes part in the unified likelihood inference procedures including both the marginal MLE and the marginal LRT for the concentration parameter.     

Bias Reduction of Likelihood Estimators in Semiparametric Frailty Models

Abstract. Frailty models with a non‐parametric baseline hazard are widely used for the analysis of survival data. However, their maximum likelihood estimators can be substantially biased in finite samples, because the number of nuisance parameters associated with the baseline hazard increases with the sample size. The penalized partial likelihood based on a first‐order Laplace approximation still has non‐negligible bias. However, the second‐order Laplace approximation to a modified marginal likelihood for a bias reduction is infeasible because of the presence of too many complicated terms. In this article, we find adequate modifications of these likelihood‐based methods by using the hierarchical likelihood.     

Circular functional relationships

This paper develops techniques for fitting a circular functional relationship. The model is formulated assuming the centre of the circle is known and taken to be the origin. This incurs some loss of generality, but considerably simplifies the analysis. Methods of estimating the parameters of the relationship, assuming that the co-ordinates have uncorrelated errors with equal variance, are developed and compared by way of simulations. Consistent estimators are obtained from unbiased estimating equations and by maximising the marginal likelihood. Approximate estimators are obtained by approximating the estimating equations and by maximising a modified profile likelihood function. The ideas and methodology are then applied to the relationship with the more realistic assumption of an unknown centre, with an example highlighting the differences between estimation techniques.     

General partially linear varying-coefficient transformation model with right censored data

In this paper, a unified maximum marginal likelihood estimation procedure is proposed for the analysis of right censored data using general partially linear varying-coefficient transformation models (GPLVCTM), which are flexible enough to include many survival models as its special cases. Unknown functional coefficients in the models are approximated by cubic B-spline polynomial. We estimate B-spline coefficients and regression parameters by maximizing marginal likelihood function. One advantage of this procedure is that it is free of both baseline and censoring distribution. Through simulation studies and a real data application (VA data from the Veteran's Administration Lung Cancer Study Clinical Trial), we illustrate that the proposed estimation procedure is accurate, stable and practical.     

Likelihood-Based Inference for the Shape Parameter of a Two Parameter Weibull Distribution

Based on a Type 2 censored sample, we use the likelihood-based approach to draw likelihood inference on the shape parameter gamma of a two-parameter Weibull distribution. In particular, we derive the profile, conditional and marginal likelihoods of gamma. Numerical results along with some concluding remarks regarding the use of likelihood-based methods for inference are provided.     

Pairwise- and marginal-likelihood estimation for the mixed Rasch model with binary data

A marginal–pairwise-likelihood estimation approach is examined in the mixed Rasch model with the binary response and logit link. This method belonging to the broad class of composite likelihood provides estimators with desirable asymptotic properties such as consistency and asymptotic normality. We study the performance of the proposed methodology when the random effect distribution is misspecified. A simulation study was conducted to compare this approach with the maximum marginal likelihood. The different results are also illustrated with an analysis of the real data set from a quality-of-life study.     

A Composite Likelihood Approach to Multivariate Survival Data

This paper is about the statistical analysis of multivariate survival data. We discuss the additive and multiplicative frailty models which have been the most popular models for multivariate survival data. As an alternative to the additive and multiplicative frailty models, we propose basing inference on a composite likelihood function that only requires modelling of the marginal distribution of pairs of failure times. Each marginal distribution of a pair of failure times is here assumed to follow a shared frailty model. The method is illustrated with a real-life example.     

Objective Bayesian analysis for a spatial model with nugget effects

The focus of this paper is objective priors for spatially correlated data with nugget effects. In addition to the Jeffreys priors and commonly used reference priors, two types of “exact” reference priors are derived based on improper marginal likelihoods. An “equivalence” theorem is developed in the sense that the expectation of any function of the score functions of the marginal likelihood function can be taken under marginal likelihoods. Interestingly, these two types of reference priors are identical.     

Composite Marginal Likelihoods to the Normal Bradley-Terry Model

Inference in generalized linear mixed models with crossed random effects is often made cumbersome by the high-dimensional intractable integrals involved in the marginal likelihood. This article presents two inferential approaches based on the marginal composite likelihood for the normal Bradley-Terry model. The two approaches are illustrated by a simulation study to evaluate their performance. Thereafter, the asymptotic variances of the estimated variance component are compared.     

Testtesting for the equality of scale parameters of k(> 2) exponential populations based on complete and type ii censored samples

This paper is concerned with testing the equality of scale parameters of K(> 2) two-parameter exponential distributions in presence of unspecified location parameters based on complete and type II censored samples. We develop a marginal likelihood ratio statistic, a quadratic statistic (Qu) (Nelson, 1982) based on maximum marginal likelihood estimates of the scale parameters under the null and the alternative hypotheses, a C(a) statistic (CPL) (Neyman, 1959) based on the profile likelihood estimate of the scale parameter under the null hypothesis and an extremal scale parameter ratio statistic (ESP) (McCool, 1979). We show that the marginal likelihood ratio statistic is equivalent to the modified Bartlett test statistic. We use Bartlett's small sample correction to the marginal likelihood ratio statistic and call it the modified marginal likelihood ratio statistic (MLB). We then compare the four statistics, MLBi Qut CPL and ESP in terms of size and power by using Monte Carlo simulation experiments. For the variety of sample sizes and censoring combinations and nominal levels considered the statistic MLB holds nominal level most accurately and based on empirically calculated critical values, this statistic performs best or as good as others in most situations. Two examples are given.     

Composite Likelihood Estimation for Multivariate Probit Latent Traits Models

Inference in generalized linear mixed models with multivariate random effects is often made cumbersome by the high-dimensional intractable integrals involved in the marginal likelihood. This article presents an inferential methodology based on the marginal composite likelihood approach for the probit latent traits models. This method belonging to the broad class of pseudo-likelihood involves marginal pairs probabilities of the responses which has analytical expression. The different results are illustrated with a simulation study and with an analysis of real data from health related quality of life.     

Composite conditional likelihood for sparse clustered data

Summary.  Sparse clustered data arise in finely stratified genetic and epidemiologic studies and pose at least two challenges to inference. First, it is difficult to model and interpret the full joint probability of dependent discrete data, which limits the utility of full likelihood methods. Second, standard methods for clustered data, such as pairwise likelihood and the generalized estimating function approach, are unsuitable when the data are sparse owing to the presence of many nuisance parameters. We present a composite conditional likelihood for use with sparse clustered data that provides valid inferences about covariate effects on both the marginal response probabilities and the intracluster pairwise association. Our primary focus is on sparse clustered binary data, in which case the method proposed utilizes doubly discordant quadruplets drawn from each stratum to conduct inference about the intracluster pairwise odds ratios.     

Full likelihood inference in the Cox model with LTRC data when covariates are discrete

For the regression parameter β in the Cox model, there have been several estimates based on different types of approximated likelihood. For right-censored data, Ren and Zhou [Full likelihood inferences in the Cox model: an empirical approach. Ann Inst Statist Math. 2011;63:1005–1018] derive the full likelihood function for (β, F₀), where F₀ is the baseline distribution function in the Cox model. In this article, we extend their results to left-truncated and right-censored data with discrete covariates. Using the empirical likelihood parameterization, we obtain the full-profile likelihood function for β when covariates are discrete. Simulation results indicate that the maximum likelihood estimator outperforms Cox's partial likelihood estimator in finite samples.     

Pointwise and functional approximations in Monte Carlo maximum likelihood estimation

We consider the use of Monte Carlo methods to obtain maximum likelihood estimates for random effects models and distinguish between the pointwise and functional approaches. We explore the relationship between the two approaches and compare them with the EM algorithm. The functional approach is more ambitious but the approximation is local in nature which we demonstrate graphically using two simple examples. A remedy is to obtain successively better approximations of the relative likelihood function near the true maximum likelihood estimate. To save computing time, we use only one Newton iteration to approximate the maximiser of each Monte Carlo likelihood and show that this is equivalent to the pointwise approach. The procedure is applied to fit a latent process model to a set of polio incidence data. The paper ends by a comparison between the marginal likelihood and the recently proposed hierarchical likelihood which avoids integration altogether.     

A SEMIPARAMETRIC MIXTURE MODEL FOR THE ANALYSIS OF COMPETING RISKS DATA

This paper deals with the regression analysis of failure time data when there are censoring and multiple types of failures. We propose a semiparametric generalization of a parametric mixture model of Larson & Dinse (1985), for which the marginal probabilities of the various failure types are logistic functions of the covariates. Given the type of failure, the conditional distribution of the time to failure follows a proportional hazards model. A marginal like lihood approach to estimating regression parameters is suggested, whereby the baseline hazard functions are eliminated as nuisance parameters. The Monte Carlo method is used to approximate the marginal likelihood; the resulting function is maximized easily using existing software. Some guidelines for choosing the number of Monte Carlo replications are given. Fixing the regression parameters at their estimated values, the full likelihood is maximized via an EM algorithm to estimate the baseline survivor functions. The methods suggested are illustrated using the Stanford heart transplant data.     

On a criticism of the profile likelihood function

The profile likelihood function is often criticized for giving strange or unintuitive results. In the cases discussed here these are due to the use of density functions that have singularities. These singularities are naturally inherited by the profile likelihood function. It is therefore apparently important to be reminded that likelihood functions are proportional to probability functions, and so cannot have singularities. When this issue is addressed, then the profile likelihood poses no problems of this sort. This is of particular importance since the profile likelihood is a commonly used method for dealing with separate estimation of parameters.