A class of local likelihood methods and near-parametric asymptotics

The local maximum likelihood estimate θ^ _t of a parameter in a statistical model f ( x , θ) is defined by maximizing a weighted version of the likelihood function which gives more weight to observations in the neighbourhood of t . The paper studies the sense in which f ( t , θ^ _t ) is closer to the true distribution g ( t ) than the usual estimate f ( t , θ^) is. Asymptotic results are presented for the case in which the model misspecification becomes vanishingly small as the sample size tends to ∞. In this setting, the relative entropy risk of the local method is better than that of maximum likelihood. The form of optimum weights for the local likelihood is obtained and illustrated for the normal distribution.     

Estimation of Hazard, Density and Survivor Functions for Randomly Censored Data

Maximum likelihood estimation and goodness-of-fit techniques are used within a competing risks framework to obtain maximum likelihood estimates of hazard, density, and survivor functions for randomly right-censored variables. Goodness-of- fit techniques are used to fit distributions to the crude lifetimes, which are used to obtain an estimate of the hazard function, which, in turn, is used to construct the survivor and density functions of the net lifetime of the variable of interest. If only one of the crude lifetimes can be adequately characterized by a parametric model, then semi-parametric estimates may be obtained using a maximum likelihood estimate of one crude lifetime and the empirical distribution function of the other. Simulation studies show that the survivor function estimates from crude lifetimes compare favourably with those given by the product-limit estimator when crude lifetimes are chosen correctly. Other advantages are discussed.     

Structural properties and estimation in m|EK| 1 queue

In this paper we study the distribution of the number of customers served in a busy period in the framework of modified power series distribution introduced by Gupta (197U) and obtain the moments and probability generating function of this distribution. We also study the maximum likelihood estimation of the parameter θand the variance and the asymptotic bias of the MLE are also obtained. The minimum variance unbiased estimate of θ^ris investigated and an estimate of the probabilities is given.     

Likelihood methods in randomized trials with noncompliance and subsequent nonresponse

This article considers likelihood methods for estimating the causal effect of treatment assignment for a two-armed randomized trial assuming all-or-none treatment noncompliance and allowing for subsequent nonresponse. We first derive the observed data likelihood function as a closed form expression of the parameter given the observed data where both response and compliance state are treated as variables with missing values. Then we describe an iterative procedure which maximizes the observed data likelihood function directly to compute a maximum likelihood estimator (MLE) of the causal effect of treatment assignment. Closed form expressions at each iterative step are provided. Finally we compare the MLE with an alternative estimator where the probability distribution of the compliance state is estimated independent of the response and its missingness mechanism. Our work indicates that direct maximum likelihood inference is straightforward for this problem. Extensive simulation studies are provided to examine the finite sample performance of the proposed methods.     

Bayesian likelihood methods for estimating the end point of a distribution

Summary.  We consider maximum likelihood methods for estimating the end point of a distribution. The likelihood function is modified by a prior distribution that is imposed on the location parameter. The prior is explicit and meaningful, and has a general form that adapts itself to different settings. Results on convergence rates and limiting distributions are given. In particular, it is shown that the limiting distribution is non-normal in non-regular cases. Parametric bootstrap techniques are suggested for quantifying the accuracy of the estimator. We illustrate performance by applying the method to multiparameter Weibull and gamma distributions.     

Estimation of the scale parameter of the Rayleigh distribution with multiply type–II censored sample

Based on a multiply type-II censored sample, the maximum likelihood estimator (MLE) and Bayes estimator for the scale parameter and the reliability function of the Rayleigh distribution are derived. However, since the MLE does not exist an explicit form, an approximate MLE which is the maximizer of an approximate likelihood function will be given. The comparisons among estimators are investigated through Monte Carlo simulations. An illustrative example with the real data concerning the 23 ball bearing in the life test is presented.     

Exact inference for exponential distribution with multiply Type-I censored data

In this paper, we focus on exact inference for exponential distribution under multiple Type-I censoring, which is a general form of Type-I censoring and represents that the units are terminated at different times. The maximum likelihood estimate of mean parameter is calculated. Further, the distribution of maximum likelihood estimate is derived and it yields an exact lower confidence limit for the mean parameter. Based on a simulation study, we conclude that the exact limit outperforms the bootstrap limit in terms of the coverage probability and average limit. Finally, a real dataset is analyzed for illustration.     

Product limit estimates: a generalized maximum likelihood study

The generalized maximum likelihood estimate (GMLE) assumptions are studied for four product-limit estimates (PLE): Censoring PLE (Kaplan-Meier estimate), truncation PLE, censoring-truncation PLE, and the degenerated PLE - the empirical distribution function. This paper shows that all the PLE's are also the GMLE's even if they are derived from partial likelihoods by natural parameterization techniques. However, a counter example is given to show that Kiefer Wolfowitz's assumption (1956) for consistency of GMLE can hardly be satisfied for un-dominated case.     

A fast algorithm for univariate log‐concave density estimation

A new fast algorithm for computing the nonparametric maximum likelihood estimate of a univariate log‐concave density is proposed and studied. It is an extension of the constrained Newton method for nonparametric mixture estimation. In each iteration, the newly extended algorithm includes, if necessary, new knots that are located via a special directional derivative function. The algorithm renews the changes of slope at all knots via a quadratically convergent method and removes the knots at which the changes of slope become zero. Theoretically, the characterisation of the nonparametric maximum likelihood estimate is studied and the algorithm is guaranteed to converge to the unique maximum likelihood estimate. Numerical studies show that it outperforms other algorithms that are available in the literature. Applications to some real‐world financial data are also given.     

Analysis of covariance under inverse Gaussian model

This paper considers the problem of analysis of covariance (ANCOVA) under the assumption of inverse Gaussian distribution for response variable. We develop the essential methodology for estimating the model parameters via maximum likelihood method. The general form of the maximum likelihood estimator is obtained in color closed form. Adjusted treatment effects and adjusted covariate effects are given, too. We also provide the asymptotic distribution of the proposed estimators. A simulation study and a real world application are also performed to illustrate and evaluate the proposed methodology.     

Approximate bayes estimation of reliability of two parameter inverse gaussian distribution

This paper extends the result of Padgett (1981) and gives a Bayes estimate of the reliability function of two-parameter inverse Gaussian distribution using Jeffreys' non-informative joint prior and a squared error loss fun ction . A numerical example is given. Based on a Monte Carlo simulation, Bayes estimator of reliability is compared with its maximum likelihood counterpart.     

Estimating the parameters of mixture models with modal estimators

This paper extends some of the work presented in Redner and Walker [I9841 on the maximum likelihood estimate of parameters in a mixture model to a Bayesian modal estimate. The problem of determining the mode of the joint posterior distribution is discussed. Necessary conditions are given for a choice of parameters to be the mode and a numerical scheme based on the EM algorithm is presented. Some theoretical remarks on the resulting iterative scheme and simulation results are also given.     

Asymptotic properties of the MAMSE adaptive likelihood weights

The weighted likelihood is a generalization of the likelihood designed to borrow strength from similar populations while making minimal assumptions. If the weights are properly chosen, the maximum weighted likelihood estimate may perform better than the maximum likelihood estimate (MLE). In a previous article, the minimum averaged mean squared error (MAMSE) weights are proposed and simulations show that they allow to outperform the MLE in many cases. In this paper, we study the asymptotic properties of the MAMSE weights. In particular, we prove that the MAMSE-weighted mixture of empirical distribution functions converges uniformly to the target distribution and that the maximum weighted likelihood estimate is strongly consistent. A short simulation illustrates the use of bootstrap in this context.     

On the estimation of the intraclass correlation

The problem of estimating the intraclass correlation when the sampling design is unbalanced is discussed. The method of moments is used to derive an approximation to the distribution of the estimate of the intraclass correlation obtained by the variance components approach. The maximum likelihood estimator is also presented, along with a simple procedure due to Richard (1961), for numerically maximizing a likelihood function of several parameters. Finally, the issue of optimal study design is considered for both balanced and unbalanced situations. For given power we determine the number of sets required to detect different values of the intraclass correlation.     

Bayesian estimation of the dispersion matrix of a multivariate normal distribution

The estimation of the dispersion matrix of a multivariate normal distribution with zero mean on the basis of a random sample is discussed from a Bayesian view. An inverted-Wishart distribu- tion for the dispersion is taken, with its defining matrix of intraclass form. Some consistency properties are described. The posterior distribution is found and its mode investigated as a possible estimate in preference to that of maximum likelihood     

Pairwise likelihood estimation for multivariate mixed Poisson models generated by Gamma intensities

Estimating the parameters of multivariate mixed Poisson models is an important problem in image processing applications, especially for active imaging or astronomy. The classical maximum likelihood approach cannot be used for these models since the corresponding masses cannot be expressed in a simple closed form. This paper studies a maximum pairwise likelihood approach to estimate the parameters of multivariate mixed Poisson models when the mixing distribution is a multivariate Gamma distribution. The consistency and asymptotic normality of this estimator are derived. Simulations conducted on synthetic data illustrate these results and show that the proposed estimator outperforms classical estimators based on the method of moments. An application to change detection in low-flux images is also investigated.     

Correction for bias in maximum likelihood estimators of in a right–censored normal distribution

It is assumed that the logs of the time to failure in a life test follow a normal distribution. If the test is terminated after r of a sample of n items fail, the test is said to be censored. If the sample size is small and censoring severe, the usual maximum likelihood estimator of a is downwardly biased. Monte Carlo techniques and regression analysis were used to develop an empirical correction factor. Applying the correction factor to the maximum likelihood estimator yields an unbiased estimate of σ.     

Properties of maximum likelihood estimates of the ratio of parameters in ordinal response regression models

The properties of a method of estimating the ratio of parameters for ordered categorical response regression models are discussed. If the link function relating the response variable to the linear combination of covariates is unknown then it is only possible to estimate the ratio of regression parameters. This ratio of parameters has a substitutability or relative importance interpretation.

The maximum likelihood estimate of the ratio of parameters, assuming a logistic function (McCullagh, 1980), is found to have very small bias for a wide variety of true link functions. Further it is shown using Monte Carlo simulations that this maximum likelihood estimate, has good coverage properties, even if the link function is incorrectly specified. It is demonstrated that combining adjacent categories to make the response binary can result in an analysis which is appreciably less efficient. The size of the efficiency loss on, among other factors, the marginal distribution in the ordered categories     

Adaptive likelihood estimator of conditional variance function

Modelling volatility in the form of conditional variance function has been a popular method mainly due to its application in financial risk management. Among others, we distinguish the parametric GARCH models and the nonparametric local polynomial approximation using weighted least squares or gaussian likelihood function. We introduce an alternative likelihood estimate of conditional variance and we show that substitution of the error density with its estimate yields similar asymptotic properties, that is, the proposed estimate is adaptive to the error distribution. Theoretical comparison with existing estimates reveals substantial gains in efficiency, especially if error distribution has fatter tails than Gaussian distribution. Simulated data confirm the theoretical findings while an empirical example demonstrates the gains of the proposed estimate.     

Maximum likelihood computation for fitting semiparametric mixture models

Three general algorithms that use different strategies are proposed for computing the maximum likelihood estimate of a semiparametric mixture model. They seek to maximize the likelihood function by, respectively, alternating the parameters, profiling the likelihood and modifying the support set. All three algorithms make a direct use of the recently proposed fast and stable constrained Newton method for computing the nonparametric maximum likelihood of a mixing distribution and employ additionally an optimization algorithm for unconstrained problems. The performance of the algorithms is numerically investigated and compared for solving the Neyman-Scott problem, overcoming overdispersion in logistic regression models and fitting two-level mixed effects logistic regression models. Satisfactory results have been obtained.