Towards a unified definition of maximum likelihood

A unified definition of maximum likelihood (ml) is given. It is based on a pairwise comparison of probability measures near the observed data point. This definition does not suffer from the usual inadequacies of earlier definitions, i.e., it does not depend on the choice of a density version in the dominated case. The definition covers the undominated case as well, i.e., it provides a consistent approach to nonparametric ml problems, which heretofore have been solved on a more less ad hoc basis. It is shown that the new ml definition is a true extension of the classical ml approach, as it is practiced in the dominated case. Hence the classical methodology can simply be subsumed. Parametric and nonparametric examples are discussed.     

Bias-reduced maximum likelihood estimation of the zero-inflated Poisson distribution

Using the techniques developed by Subrahmaniam and Ching’anda (1978), we study the robustness to nonnormality of the linear discriminant functions. It is seen that the LDF procedure is quite robust against the likelihood ratio rule. The latter yields in all cases much smaller overall error rates; however, the disparity between the error rates of the LDF and LR procedures is not large enough to warrant the recommendation to use the more complicated LR procedure.     

Product limit estimates: a generalized maximum likelihood study

The generalized maximum likelihood estimate (GMLE) assumptions are studied for four product-limit estimates (PLE): Censoring PLE (Kaplan-Meier estimate), truncation PLE, censoring-truncation PLE, and the degenerated PLE - the empirical distribution function. This paper shows that all the PLE's are also the GMLE's even if they are derived from partial likelihoods by natural parameterization techniques. However, a counter example is given to show that Kiefer Wolfowitz's assumption (1956) for consistency of GMLE can hardly be satisfied for un-dominated case.     

Extreme value index estimator using maximum likelihood and moment estimation

ABSTRACT

When a distribution function is in the max domain of attraction of an extreme value distribution, its tail can be well approximated by a generalized Pareto distribution. Based on this fact we use a moment estimation idea to propose an adapted maximum likelihood estimator for the extreme value index, which can be understood as a combination of the maximum likelihood estimation and moment estimation. Under certain regularity conditions, we derive the asymptotic normality of the new estimator and investigate its finite sample behavior by comparing with several classical or competitive estimators. A simulation study shows that the new estimator is competitive with other estimators in view of average bias, average MSE, and coefficient of variance of the new device for the optimal selection of the threshold.     

Skewness of maximum likelihood estimators in dispersion models

We introduce the dispersion models with a regression structure to extend the generalized linear models, the exponential family nonlinear models (Cordeiro and Paula, 1989) and the proper dispersion models (Jørgensen, 1997a). We provide a matrix expression for the skewness of the maximum likelihood estimators of the regression parameters in dispersion models. The formula is suitable for computer implementation and can be applied for several important submodels discussed in the literature. Expressions for the skewness of the maximum likelihood estimators of the precision and dispersion parameters are also derived. In particular, our results extend previous formulas obtained by Cordeiro and Cordeiro (2001) and Cavalcanti et al. (2009). A simulation study is performed to show the practice importance of our results.     

On the consistency of the maximum spacing method

The main result of this paper is a consistency theorem for the maximum spacing method, a general method of estimating parameters in continuous univariate distributions, introduced by Cheng and Amin (J. Roy. Statist. Soc. Ser. A 45 (1983) 394–403) and independently by Ranneby (Scand. J. Statist. 11 (1984) 93–112). This main result generalizes a theorem of Ranneby (Scand. J. Statist. 11 (1984) 93–112). Also, some examples are given, which shows that this estimation method works also in cases where the maximum likelihood method breaks down.     

The sliced inverse regression algorithm as a maximum likelihood procedure

It is shown that the sliced inverse regression procedure proposed by Li corresponds to the maximum likelihood estimate where the observations in each slice are samples of multivariate normal distributions with means in an affine manifold.     

Local maximum likelihood estimation and inference

Local maximum likelihood estimation is a nonparametric counterpart of the widely used parametric maximum likelihood technique. It extends the scope of the parametric maximum likelihood method to a much wider class of parametric spaces. Associated with this nonparametric estimation scheme is the issue of bandwidth selection and bias and variance assessment. This paper provides a unified approach to selecting a bandwidth and constructing confidence intervals in local maximum likelihood estimation. The approach is then applied to least squares nonparametric regression and to nonparametric logistic regression. Our experiences in these two settings show that the general idea outlined here is powerful and encouraging.     

A note on bias reduction of maximum likelihood estimates for the scalar skew t distribution

The skew t distribution is a flexible parametric family to fit data, because it includes parameters that let us regulate skewness and kurtosis. A problem with this distribution is that, for moderate sample sizes, the maximum likelihood estimator of the shape parameter is infinite with positive probability. In order to try to solve this problem, Sartori (2006) has proposed using a modified score function as an estimating equation for the shape parameter. In this note we prove that the resulting modified maximum likelihood estimator is always finite, considering the degrees of freedom as known and greater than or equal to 2.     

Pseudo maximum likelihood estimation for the dirichlet-multinomial distribution

Pseudo maximum likelihood estimation (PML) for the Dirich-let-multinomial distribution is proposed and examined in this pa-per. The procedure is compared to that based on moments (MM) for its asymptotic relative efficiency (ARE) relative to the maximum likelihood estimate (ML). It is found that PML, requiring much less computational effort than ML and possessing considerably higher ARE than MM, constitutes a good compromise between ML and MM. PML is also found to have very high ARE when an estimate for the scale parameter in the Dirichlet-multinomial distribution is all that is needed.     

The maximum likelihood estimators in the growth curve model with serial covariance structure

The maximum likelihood estimators of unknown parameters in the growth curve model with serial covariance structure under some conditions are derived in the paper.     

Modern likelihood inference for the maximum/minimum of a bivariate normal vector

ABSTRACT

We consider the use of modern likelihood asymptotics in the construction of confidence intervals for the parameter which determines the skewness of the distribution of the maximum/minimum of an exchangeable bivariate normal random vector. Simulation studies were conducted to investigate the accuracy of the proposed methods and to compare them to available alternatives. Accuracy is evaluated in terms of both coverage probability and expected length of the interval. We furthermore illustrate the suitability of our proposals by means of two data sets, consisting of, respectively, measurements taken on the brains of 10 mono-zygotic twins and measurements of mineral content of bones in the dominant and non-dominant arms for 25 elderly women.     

More on the four-parameter kappa distribution

The generalized extreme-value has been the distribution of choice for modeling available maxima (or minima) data since theory has shown it to be the limiting form of the distribution of extremes. However, fits to finite samples are not always adequate. Hosking (1994) and Parida (1999) suggest the four-parameter Kappa distribution as an alternative. Hosking (1994) developed an L-moment procedure for estimation. Some compromises must be made in practice however, as seen in Parida (1999). L-moment estimators of the four-parameter Kappa distribution are not always computable nor feasible. A simulation study in this paper quantifies the extent of each problem. Maximum likelihood is investigated as an alternative method of estimation and a simulation study compares the performance of both methods of estimation. Finally, further benefits of maximum likelihood are shown when wind speeds From the Tropical Pacific are examined and the weekly maxima for 10 buoys in the area are analyzed.     

Particle methods for maximum likelihood estimation in latent variable models

Standard methods for maximum likelihood parameter estimation in latent variable models rely on the Expectation-Maximization algorithm and its Monte Carlo variants. Our approach is different and motivated by similar considerations to simulated annealing; that is we build a sequence of artificial distributions whose support concentrates itself on the set of maximum likelihood estimates. We sample from these distributions using a sequential Monte Carlo approach. We demonstrate state-of-the-art performance for several applications of the proposed approach.     

Computing maximum likelihood estimates from type II doubly censored exponential data

It is well-known that, under Type II double censoring, the maximum likelihood (ML) estimators of the location and scale parameters, θ and δ, of a twoparameter exponential distribution are linear functions of the order statistics. In contrast, when θ is known, theML estimator of δ does not admit a closed form expression. It is shown, however, that theML estimator of the scale parameter exists and is unique. Moreover, it has good large-sample properties. In addition, sharp lower and upper bounds for this estimator are provided, which can serve as starting points for iterative interpolation methods such as regula falsi. Explicit expressions for the expected Fisher information and Cramér-Rao lower bound are also derived. In the Bayesian context, assuming an inverted gamma prior on δ, the uniqueness, boundedness and asymptotics of the highest posterior density estimator of δ can be deduced in a similar way. Finally, an illustrative example is included.     

Approximate maximum likelihood predictors of future failure times of shifted exponential distributions under multiple type II censoring

Suppose we consider a general multiple type II censored sample (some middle observations being censored) from a shifted exponential distribution. The maximum likelihood prediction method does not admit explicit solutions. We introduce a simple approximation to one of prediction likelihood equations and derive approximate predictors of missing failure times. We compute their mean square prediction errors by simulation and compare them with the best linear predictors. Further, we present two real examples to illustrate this method of prediction.AMS Subject Classification (2000): 62G30, 62M20, 62F99     

Asymptotic variances of maximum likelihood estimator for the correlation coefficient from a BVN distribution with one variable subject to censoring

This paper deals with the problem of estimating the Pearson correlation coefficient when one variable is subject to left or right censoring. In parallel to the classical results on the Pearson correlation coefficient, we derive a workable formula, through tedious computation and intensive simplification, of the asymptotic variances of the maximum likelihood estimators in two cases: (1) known means and variances and (2) unknown means and variances. We illustrate the usefulness of the asymptotic results in experimental designs.     

Nonparametric (smoothed) likelihood and integral equations

We show that there is an intimate connection between the theory of nonparametric (smoothed) maximum likelihood estimators for certain inverse problems and integral equations. This is illustrated by estimators for interval censoring and deconvolution problems. We also discuss the asymptotic efficiency of the MLE for smooth functionals in these models.