Estimation Under the Lehmann Regression Model with Interval-Censored Data

We consider the estimation problem under the Lehmann model with interval-censored data, but focus on the computational issues. There are two methods for computing the semi-parametric maximum likelihood estimator (SMLE) under the Lehmann model (or called Cox model): the Newton-Raphson (NR) method and the profile likelihood (PL) method. We show that they often do not get close to the SMLE. We propose several approach to overcome the computational difficulty and apply our method to a breast cancer research data set.     

Piecewise proportional hazards models with interval-censored data

We consider the piecewise proportional hazards (PWPH) model with interval-censored (IC) relapse times under the distribution-free set-up. The partial likelihood approach is not applicable for IC data, and the generalized likelihood approach has not been studied in the literature. It turns out that under the PWPH model with IC data, the semi-parametric MLE (SMLE) of the covariate effect under the standard generalized likelihood may not be unique and may not be consistent. In fact, the parameter under the PWPH model with IC data is not identifiable unless the identifiability assumption is imposed. We propose a modification to the likelihood function so that its SMLE is unique. Under the identifiability assumption, our simulation study suggests that the SMLE is consistent. We apply the method to our cancer relapse time data and conclude that the bone marrow micrometastasis does not have a significant prognostic factor.     

Semi-parametric modelling and likelihood estimation with estimating equations

This paper proposes a semi-parametric modelling and estimating method for analysing censored survival data. The proposed method uses the empirical likelihood function to describe the information in data, and formulates estimating equations to incorporate knowledge of the underlying distribution and regression structure. The method is more flexible than the traditional methods such as the parametric maximum likelihood estimation (MLE), Cox's (1972) proportional hazards model, accelerated life test model, quasi-likelihood (Wedderburn, 1974) and generalized estimating equations (Liang & Zeger, 1986). This paper shows the existence and uniqueness of the proposed semi-parametric maximum likelihood estimates (SMLE) with estimating equations. The method is validated with known cases studied in the literature. Several finite sample simulation and large sample efficiency studies indicate that when the sample size is larger than 100 the SMLE is compatible with the parametric MLE; and in all case studies, the SMLE is about 15% better than the parametric MLE with a mis-specified underlying distribution.     

Piecewise Cox models with right-censored data

We study a general class of piecewise Cox models. We discuss the computation of the semi-parametric maximum likelihood estimates (SMLE) of the parameters, with right-censored data, and a simplified algorithm for the maximum partial likelihood estimates (MPLE). Our simulation study suggests that the relative efficiency of the PMLE of the parameter to the SMLE ranges from 96% to 99.9%, but the relative efficiency of the existing estimators of the baseline survival function to the SMLE ranges from 3% to 24%. Thus, the SMLE is much better than the existing estimators.     

ASYMPTOTIC DISTRIBUTIONS OF SEMIPARAMETRIC MAXIMUM LIKELIHOOD ESTIMATORS WITH ESTIMATING EQUATIONS FOR GROUP-CENSORED DATA

Semiparametric maximum likelihood estimation with estimating equations (SMLE) is more flexible than traditional methods; it has fewer restrictions on distributions and regression models. The required information about distribution and regression structures is incorporated in estimating equations of the SMLE to improve the estimation quality of non‐parametric methods. The likelihood of SMLE for censored data involves complicated implicit functions without closed‐form expressions, and the first derivatives of the log‐profile‐likelihood cannot be expressed as summations of independent and identically distributed random variables; it is challenging to derive asymptotic properties of the SMLE for censored data. For group‐censored data, the paper shows that all the implicit functions are well defined and obtains the asymptotic distributions of the SMLE for model parameters and lifetime distributions. With several examples the paper compares the SMLE, the regular non‐parametric likelihood estimation method and the parametric MLEs in terms of their asymptotic efficiencies, and illustrates application of SMLE. Various asymptotic distributions of the likelihood ratio statistics are derived for testing the adequacy of estimating equations and a partial set of parameters equal to some known values.     

On the UMVU estimator for the generalized variance of the multinomial family

Abstract

The generalized variance is an important statistical indicator which appears in a number of statistical topics. It is a successful measure for multivariate data concentration. In this article, we established, in a closed form, the bias of the generalized variance maximum likelihood estimator of the Multinomial family. We also derived, with a complete proof, the uniformly minimum variance unbiased estimator (UMVU) for the generalized variance of this family. These results rely on explicit calculations, the completeness of the exponential family and the Lehmann–Scheffé theorem.     

Conditional maximum likelihood estimation in negative binomial INGARCH processes with known number of successes when the true parameter is at the boundary of the parameter space

The paper establishes the asymptotic distribution of the conditional maximum likelihood estimator for integer-valued generalized autoregressive conditional heteroskedastic (INGARCH) processes of conditional negative binomial distributions, with the number of successes in the definition of the negative binomial distribution being assumed to be known, when the true parameter is at the boundary of the parameter space. Based on the result, coefficient nullity tests are developed for model simplification. The proposed tests are investigated through a simulation study.     

Penalized likelihood approach for the four-parameter kappa distribution

The four-parameter kappa distribution (K4D) is a generalized form of some commonly used distributions such as generalized logistic, generalized Pareto, generalized Gumbel, and generalized extreme value (GEV) distributions. Owing to its flexibility, the K4D is widely applied in modeling in several fields such as hydrology and climatic change. For the estimation of the four parameters, the maximum likelihood approach and the method of L-moments are usually employed. The L-moment estimator (LME) method works well for some parameter spaces, with up to a moderate sample size, but it is sometimes not feasible in terms of computing the appropriate estimates. Meanwhile, using the maximum likelihood estimator (MLE) with small sample sizes shows substantially poor performance in terms of a large variance of the estimator. We therefore propose a maximum penalized likelihood estimation (MPLE) of K4D by adjusting the existing penalty functions that restrict the parameter space. Eighteen combinations of penalties for two shape parameters are considered and compared. The MPLE retains modeling flexibility and large sample optimality while also improving on small sample properties. The properties of the proposed estimator are verified through a Monte Carlo simulation, and an application case is demonstrated taking Thailand’s annual maximum temperature data.     

Full likelihood inference in the Cox model with LTRC data when covariates are discrete

For the regression parameter β in the Cox model, there have been several estimates based on different types of approximated likelihood. For right-censored data, Ren and Zhou [Full likelihood inferences in the Cox model: an empirical approach. Ann Inst Statist Math. 2011;63:1005–1018] derive the full likelihood function for (β, F₀), where F₀ is the baseline distribution function in the Cox model. In this article, we extend their results to left-truncated and right-censored data with discrete covariates. Using the empirical likelihood parameterization, we obtain the full-profile likelihood function for β when covariates are discrete. Simulation results indicate that the maximum likelihood estimator outperforms Cox's partial likelihood estimator in finite samples.     

Constrained inference for generalized linear models with incomplete covariate data

Missing data are common in many experiments, including surveys, clinical trials, epidemiological studies, and environmental studies. Unconstrained likelihood inferences for generalized linear models (GLMs) with nonignorable missing covariates have been studied extensively in the literature. However, parameter orderings or constraints may occur naturally in practice, and thus the efficiency of a statistical method may be improved by incorporating parameter constraints into the likelihood function. In this paper, we consider constrained inference for analysing GLMs with nonignorable missing covariates under linear inequality constraints on the model parameters. Specifically, constrained maximum likelihood (ML) estimation is based on the gradient projection expectation maximization approach. Further, we investigate the asymptotic null distribution of the constrained likelihood ratio test (LRT). Simulations study the empirical properties of the constrained ML estimators and LRTs, which demonstrate improved precision of these constrained techniques. An application to contaminant levels in an environmental study is also presented.     

Maximum Likelihood Estimation of the Log-Binomial Model

Maximum likelihood estimation of prevalence ratios using the log-binomial model is problematic when the estimates are on the boundary of the parameter space. When the model is correct, maximum likelihood is often the method of choice. The authors provide a theorem, formulas, and methodology for obtaining maximum likelihood estimators of the log-binomial model and their estimated standard errors when the solution is on the boundary of the parameter space. Examples are given to illustrate the method.     

Estimation of the SURE model

The paper presents the essentials of the SURE model and the estimation of its parameters β and ω. Two alternative compact representations of the model are being used. The parameter β is estimated by least squares (LS), generalized least squares (GLS) and maximum likelihood (ML) (under normality). For ω two estimators are being considered, viz an LS-related estimator and a maximum likelihood estimator (under normality). Attention is being given to the study of asymptotic properties of all estimators examined. It turns out that the LS-related and ML estimators of ω follow the same asymptotic (normal) distribution. Efficiency comparisons for the various estimators of β conclude the paper.     

Maximum likelihood estimators in finite mixture models with censored data

The consistency of estimators in finite mixture models has been discussed under the topology of the quotient space obtained by collapsing the true parameter set into a single point. In this paper, we extend the results of Cheng and Liu (2001) to give conditions under which the maximum likelihood estimator (MLE) is strongly consistent in such a sense in finite mixture models with censored data. We also show that the fitted model tends to the true model under a weak condition as the sample size tends to infinity.     

Exact likelihood inference for two exponential populations based on a joint generalized Type-I hybrid censored sample

Following the work of Chen and Bhattacharyya [Exact confidence bounds for an exponential parameter under hybrid censoring. Comm Statist Theory Methods. 1988;17:1857–1870], several results have been developed regarding the exact likelihood inference of exponential parameters based on different forms of censored samples. In this paper, the conditional maximum likelihood estimators (MLEs) of two exponential mean parameters are derived under joint generalized Type-I hybrid censoring on the two samples. The moment generating functions (MGFs) and the exact densities of the conditional MLEs are obtained, using which exact confidence intervals are then developed for the model parameters. We also derive the means, variances, and mean squared errors of these estimates. An efficient computational method is developed based on the joint MGF. Finally, an example is presented to illustrate the methods of inference developed here.     

Properties of estimators for the gamma distribution

Accurate moments of maximum likelihood and moment estimators for the scale and shape parameters of a two parameter gamma density are given, the former being tabulated over a segment of the parameter space. In addition, joint acceptance regions are given for a particular case. The three parameter model is also considered and comments made on second order asymptotics for the maximum likelihood estimators     

Inadmissibility results of the mle for the multinomial problem when the parameter space is restricted or truncated

In binomial or multinomial problems when the parameter space is restricted or truncated to a subset of the natural parameter space, the maximum likelihood estimator (MLE) may be inadmissible under squared error loss. A quite general condition for the inadmissibility of MLEs in such cases can be established using the stepwise Bayes technique and the complete class theorem of Brown.     

Estimation with the generalized exponential distribution based on record values and inter-record times

The maximum likelihood and Bayesian approaches have been considered for the two-parameter generalized exponential distribution based on record values with the number of trials following the record values (inter-record times). The maximum likelihood estimates are obtained under the inverse sampling and the random sampling schemes. It is shown that the maximum likelihood estimator of the shape parameter converges in mean square to the true value when the scale parameter is known. The Bayes estimates of the parameters have been developed by using Lindley's approximation and the Markov Chain Monte Carlo methods due to the lack of explicit forms under the squared error and the linear-exponential loss functions. The confidence intervals for the parameters are constructed based on asymptotic and Bayesian methods. The Bayes and the maximum likelihood estimators are compared in terms of the estimated risk by the Monte Carlo simulations. The comparison of the estimators based on the record values and the record values with their corresponding inter-record times are performed by using Monte Carlo simulations.     

Missing data mechanisms and their implications on the analysis of categorical data

We review some issues related to the implications of different missing data mechanisms on statistical inference for contingency tables and consider simulation studies to compare the results obtained under such models to those where the units with missing data are disregarded. We confirm that although, in general, analyses under the correct missing at random and missing completely at random models are more efficient even for small sample sizes, there are exceptions where they may not improve the results obtained by ignoring the partially classified data. We show that under the missing not at random (MNAR) model, estimates on the boundary of the parameter space as well as lack of identifiability of the parameters of saturated models may be associated with undesirable asymptotic properties of maximum likelihood estimators and likelihood ratio tests; even in standard cases the bias of the estimators may be low only for very large samples. We also show that the probability of a boundary solution obtained under the correct MNAR model may be large even for large samples and that, consequently, we may not always conclude that a MNAR model is misspecified because the estimate is on the boundary of the parameter space.     

SHRINKAGE, PRETEST AND ABSOLUTE PENALTY ESTIMATORS IN PARTIALLY LINEAR MODELS

We consider a partially linear model in which the vector of coefficients β in the linear part can be partitioned as ( β ₁, β ₂) , where β ₁ is the coefficient vector for main effects (e.g. treatment effect, genetic effects) and β ₂ is a vector for ‘nuisance’ effects (e.g. age, laboratory). In this situation, inference about β ₁ may benefit from moving the least squares estimate for the full model in the direction of the least squares estimate without the nuisance variables (Steinian shrinkage), or from dropping the nuisance variables if there is evidence that they do not provide useful information (pretesting). We investigate the asymptotic properties of Stein‐type and pretest semiparametric estimators under quadratic loss and show that, under general conditions, a Stein‐type semiparametric estimator improves on the full model conventional semiparametric least squares estimator. The relative performance of the estimators is examined using asymptotic analysis of quadratic risk functions and it is found that the Stein‐type estimator outperforms the full model estimator uniformly. By contrast, the pretest estimator dominates the least squares estimator only in a small part of the parameter space, which is consistent with the theory. We also consider an absolute penalty‐type estimator for partially linear models and give a Monte Carlo simulation comparison of shrinkage, pretest and the absolute penalty‐type estimators. The comparison shows that the shrinkage method performs better than the absolute penalty‐type estimation method when the dimension of the β ₂ parameter space is large.