Improved likelihood inference in beta regression

We consider the issue of performing accurate small-sample likelihood-based inference in beta regression models, which are useful for modelling continuous proportions that are affected by independent variables. We derive small-sample adjustments to the likelihood ratio statistic in this class of models. The adjusted statistics can be easily implemented from standard statistical software. We present Monte Carlo simulations showing that inference based on the adjusted statistics we propose is much more reliable than that based on the usual likelihood ratio statistic. A real data example is presented.     

Joint Estimation of Intersecting Context Tree Models

We study a problem of model selection for data produced by two different context tree sources. Motivated by linguistic questions, we consider the case where the probabilistic context trees corresponding to the two sources are finite and share many of their contexts. In order to understand the differences between the two sources, it is important to identify which contexts and which transition probabilities are specific to each source. We consider a class of probabilistic context tree models with three types of contexts: those which appear in one, the other, or both sources. We use a BIC penalized maximum likelihood procedure that jointly estimates the two sources. We propose a new algorithm which efficiently computes the estimated context trees. We prove that the procedure is strongly consistent. We also present a simulation study showing the practical advantage of our procedure over a procedure that works separately on each data set.     

Cressie–Read Power-Divergence Statistics for Non-Gaussian Vector Stationary Processes

Abstract.  For a class of vector-valued non-Gaussian stationary processes, we develop the Cressie–Read power-divergence (CR) statistic approach which has been proposed for the i.i.d. case. The CR statistic includes empirical likelihood as a special case. Therefore, by adopting this CR statistic approach, the theory of estimation and testing based on empirical likelihood is greatly extended. We use an extended Whittle likelihood as score function and derive the asymptotic distribution of the CR statistic. We apply this result to estimation of autocorrelation and the AR coefficient, and get narrower confidence intervals than those obtained by existing methods. We also consider the power properties of the test based on asymptotic theory. Under a sequence of contiguous local alternatives, we derive the asymptotic distribution of the CR statistic. The problem of testing autocorrelation is discussed and we introduce some interesting properties of the local power.     

Non parametric hazard estimation with dependent censoring using penalized likelihood and an assumed copula

This article introduces a novel non parametric penalized likelihood hazard estimation when the censoring time is dependent on the failure time for each subject under observation. More specifically, we model this dependence using a copula, and the method of maximum penalized likelihood (MPL) is adopted to estimate the hazard function. We do not consider covariates in this article. The non negatively constrained MPL hazard estimation is obtained using a multiplicative iterative algorithm. The consistency results and the asymptotic properties of the proposed hazard estimator are derived. The simulation studies show that our MPL estimator under dependent censoring with an assumed copula model provides a better accuracy than the MPL estimator under independent censoring if the sign of dependence is correctly specified in the copula function. The proposed method is applied to a real dataset, with a sensitivity analysis performed over various values of correlation between failure and censoring times.     

Testing for two states in a hidden Markov model

The authors consider hidden Markov models (HMMs) whose latent process has m ≥ 2 states and whose state‐dependent distributions arise from a general one‐parameter family. They propose a test of the hypothesis m = 2. Their procedure is an extension to HMMs of the modified likelihood ratio statistic proposed by Chen, Chen & Kalbfleisch (2004) for testing two states in a finite mixture. The authors determine the asymptotic distribution of their test under the hypothesis m = 2 and investigate its finite‐sample properties in a simulation study. Their test is based on inference for the marginal mixture distribution of the HMM. In order to illustrate the additional difficulties due to the dependence structure of the HMM, they show how to test general regular hypotheses on the marginal mixture of HMMs via a quasi‐modified likelihood ratio. They also discuss two applications.     

A package of four edited books on structural equations modeling

We consider two analytical and a bootstrap bias correction scheme existing in the literature for maximum likelihood estimators (MLEs) in the special case of a particular biparametric exponential family, the estimators being obtained from i.i.d. samples. We assess the performances of the estimators through numerical simulations for three particular cases of the family explored here. We observe that the two analytical proposals display very similar behavior for these distributions and that all proposed estimators are effective in reducing bias and mean square error of the MLEs.     

Statistical Inference and Applications of Mixture of Varying Coefficient Models

In this paper, we consider a new mixture of varying coefficient models, in which each mixture component follows a varying coefficient model and the mixing proportions and dispersion parameters are also allowed to be unknown smooth functions. We systematically study the identifiability, estimation and inference for the new mixture model. The proposed new mixture model is rather general, encompassing many mixture models as its special cases such as mixtures of linear regression models, mixtures of generalized linear models, mixtures of partially linear models and mixtures of generalized additive models, some of which are new mixture models by themselves and have not been investigated before. The new mixture of varying coefficient model is shown to be identifiable under mild conditions. We develop a local likelihood procedure and a modified expectation–maximization algorithm for the estimation of the unknown non‐parametric functions. Asymptotic normality is established for the proposed estimator. A generalized likelihood ratio test is further developed for testing whether some of the unknown functions are constants. We derive the asymptotic distribution of the proposed generalized likelihood ratio test statistics and prove that the Wilks phenomenon holds. The proposed methodology is illustrated by Monte Carlo simulations and an analysis of a CO₂‐GDP data set.     

Weighting Method for a Linear Mixed Model

Maximum likelihood is a widely used estimation method in statistics. This method is model dependent and as such is criticized as being non robust. In this article, we consider using weighted likelihood method to make robust inferences for linear mixed models where weights are determined at both the subject level and the observation level. This approach is appropriate for problems where maximum likelihood is the basic fitting technique, but a subset of data points is discrepant with the model. It allows us to reduce the impact of outliers without complicating the basic linear mixed model with normally distributed random effects and errors. The weighted likelihood estimators are shown to be robust and asymptotically normal. Our simulation study demonstrates that the weighted estimates are much better than the unweighted ones when a subset of data points is far away from the rest. Its application to the analysis of deglutition apnea duration in normal swallows shows that the differences between the weighted and unweighted estimates are due to large amount of outliers in the data set.     

Statistical evidence in contingency tables analysis

The likelihood ratio is used for measuring the strength of statistical evidence. The probability of observing strong misleading evidence along with that of observing weak evidence evaluate the performance of this measure. When the corresponding likelihood function is expressed in terms of a parametric statistical model that fails, the likelihood ratio retains its evidential value if the likelihood function is robust [Royall, R., Tsou, T.S., 2003. Interpreting statistical evidence by using imperfect models: robust adjusted likelihood functions. J. Roy. Statist. Soc. Ser. B 65, 391–404]. In this paper, we extend the theory of Royall and Tsou [2003. Interpreting statistical evidence by using imperfect models: robust adjusted likelihood functions. J. Roy. Statist. Soc., Ser. B 65, 391–404] to the case when the assumed working model is a characteristic model for two-way contingency tables (the model of independence, association and correlation models). We observe that association and correlation models are not equivalent in terms of statistical evidence. The association models are bounded by the maximum of the bump function while the correlation models are not.     

Pointwise and functional approximations in Monte Carlo maximum likelihood estimation

We consider the use of Monte Carlo methods to obtain maximum likelihood estimates for random effects models and distinguish between the pointwise and functional approaches. We explore the relationship between the two approaches and compare them with the EM algorithm. The functional approach is more ambitious but the approximation is local in nature which we demonstrate graphically using two simple examples. A remedy is to obtain successively better approximations of the relative likelihood function near the true maximum likelihood estimate. To save computing time, we use only one Newton iteration to approximate the maximiser of each Monte Carlo likelihood and show that this is equivalent to the pointwise approach. The procedure is applied to fit a latent process model to a set of polio incidence data. The paper ends by a comparison between the marginal likelihood and the recently proposed hierarchical likelihood which avoids integration altogether.     

The Exponentiated G Poisson Model

We study a new family of distributions defined by the minimum of the Poisson random number of independent identically distributed random variables having a general exponentiated G distribution. Some mathematical properties of the new family including ordinary and incomplete moments, quantile and generating functions, mean deviations, order statistics and their moments, reliability, and Shannon entropy are derived. Maximum likelihood estimation of the model parameters is investigated. Two special models of the new family are discussed. We perform an application to a real data set to show the potentiality of the proposed family.     

Parameter estimation in semi-linear models using a maximal invariant likelihood function

In this paper, we consider the problem of estimation of semi-linear regression models. Using invariance arguments, Bhowmik and King [2007. Maximal invariant likelihood based testing of semi-linear models. Statist. Papers 48, 357–383] derived the probability density function of the maximal invariant statistic for the non-linear component of these models. Using this density function as a likelihood function allows us to estimate these models in a two-step process. First the non-linear component parameters are estimated by maximising the maximal invariant likelihood function. Then the non-linear component, with the parameter values replaced by estimates, is treated as a regressor and ordinary least squares is used to estimate the remaining parameters. We report the results of a simulation study conducted to compare the accuracy of this approach with full maximum likelihood and maximum profile-marginal likelihood estimation. We find maximising the maximal invariant likelihood function typically results in less biased and lower variance estimates than those from full maximum likelihood.     

Robust empirical likelihood for linear models under median constraints

In this paper, we consider the application of the empirical likelihood for

linear models under median constraints in view of robustness. For two simple median constraints, it is shown that conditions to ensure the consistency of the empirical likelihood confidence regions can be surprisingly relaxed compared with the normal approach under L norm. However, the coverage accuracy of the empirical likelihood confidence regions based on simple median constrains cannot be improved because of the discontinuity of the constraints. Therefore, a smoothed version of median constraint is proposed and a general theory is established to ensure its validity.     

Maximum likelihood estimator in a multi-phase random regression model

We consider a random regression model with several-fold change-points. The results for one change-point are generalized. The maximum likelihood estimator of the parameters is shown to be consistent, and the asymptotic distribution for the estimators of the coefficients is shown to be Gaussian. The estimators of the change-points converge, with n ^?1 rate, to the vector whose components are the left end points of the maximizing interval with respect to each change-point. The likelihood process is asymptotically equivalent to the sum of independent compound Poisson processes.     

Robust Inference in Generalized Linear Models

Robust inference on the parameters in generalized linear models is performed using the weighted likelihood method. Two cases are considered: a case with replicated observations and a case with a single observation of the dependent variable for each combination of the explanatory variables. The first case is common in the design of experiments, while the second case arises in observational studies. Theoretical and computational results on real datasets are presented and compared with other existing techniques.     

Semiparametric estimation of moment condition models with weakly dependent data

This paper develops the asymptotic theory for the estimation of smooth semiparametric generalized estimating equations models with weakly dependent data. The paper proposes new estimation methods based on smoothed two-step versions of the generalised method of moments and generalised empirical likelihood methods. An important aspect of the paper is that it allows the first-step estimation to have an effect on the asymptotic variances of the second-step estimators and explicitly characterises this effect for the empirically relevant case of the so-called generated regressors. The results of the paper are illustrated with a partially linear model that has not been previously considered in the literature. The proofs of the results utilise a new uniform strong law of large numbers and a new central limit theorem for U-statistics with varying kernels that are of independent interest.     

Likelihood ratio tests for testing for multiple contaminants in the shocks and labelled slippage models

In the literature related to the study of lifelengths of experimental units, little attention has been paid to the models where shocks to the units generate outliers. In the present article, we consider a situation where n experimental units under investigation receive shocks at several time points. The parameter values of the lifelength distribution may change due to each shock, resulting in the generation of outliers. We derive the likelihood ratio test statistic to investigate if the shocks have significantly altered the parameter values. We also derive a likelihood ratio test under the labelled slippage alternative with multiple contaminations. Monte Carlo studies have been carried out to investigate the power of the proposed test statistics.     

Asymptotic properties of LS and QML estimators for a class of nonlinear GARCH processes

We consider estimation of a class of power-transformed threshold GARCH models. When the power of the transformation is known, the asymptotic properties of the quasi-maximum likelihood estimator (QMLE) are established under mild conditions. Two sequences of least-squares estimators are also considered in the pure ARCH case, and it is shown that they can be asymptotically more accurate than the QMLE for certain power transformations. In the case where the power of the transformation has to be estimated, the asymptotic properties of the QMLE are proven under the assumption that the noise has a density. The finite-sample properties of the proposed estimators are studied by simulation.     

Modified slashed-Rayleigh distribution

A new family of slash distributions, the modified slashed-Rayleigh distribution, is proposed and studied. This family is an extension of the ordinary Rayleigh distribution, being more flexible in terms of distributional kurtosis. It arises as a quotient of two independent random variables, one being a Rayleigh distribution in the numerator and the other a power of the exponential distribution in denominator. We present properties of the proposed family. In addition, we carry out estimation of the model parameters by moment and maximum likelihood methods. Finally, we conduct a small-scale simulation study to evaluate the performance of the maximum likelihood estimators and apply the results to a real data set, revealing its good performance.     

Marginal regression models with a time to event outcome and discrete multiple source predictors

Information from multiple informants is frequently used to assess psychopathology. We consider marginal regression models with multiple informants as discrete predictors and a time to event outcome. We fit these models to data from the Stirling County Study; specifically, the models predict mortality from self report of psychiatric disorders and also predict mortality from physician report of psychiatric disorders. Previously, Horton et al. found little relationship between self and physician reports of psychopathology, but that the relationship of self report of psychopathology with mortality was similar to that of physician report of psychopathology with mortality. Generalized estimating equations (GEE) have been used to fit marginal models with multiple informant covariates; here we develop a maximum likelihood (ML) approach and show how it relates to the GEE approach. In a simple setting using a saturated model, the ML approach can be constructed to provide estimates that match those found using GEE. We extend the ML technique to consider multiple informant predictors with missingness and compare the method to using inverse probability weighted (IPW) GEE. Our simulation study illustrates that IPW GEE loses little efficiency compared with ML in the presence of monotone missingness. Our example data has non-monotone missingness; in this case, ML offers a modest decrease in variance compared with IPW GEE, particularly for estimating covariates in the marginal models. In more general settings, e.g., categorical predictors and piecewise exponential models, the likelihood parameters from the ML technique do not have the same interpretation as the GEE. Thus, the GEE is recommended to fit marginal models for its flexibility, ease of interpretation and comparable efficiency to ML in the presence of missing data.