Estimating the location of the cauchy distribution by numerical global optimization

The log-likelihood function (LLF) of the single (location) parameter Cauchy distribution can exhibit up to n relative maxima, where n is the sample size. To compute the maximum likelihood estimate of the location parameter, previously published methods have advocated scanning the LLF over a suf-ficiently large portion of the real line to locate the absolute maximum. This note shows that, given an easily derived upper bound on the second derivative of the negative LLF, Brent's univariate numerical global optimization method can be used to locate the absolute maximum among several relative maxima of the LLF without performing an exhaustive search over the real line.     

Pooled estimators for the shape parameter of the three parameter gamma distribution

The aim of the paper is to study the pooled estimator of the shape parameter of the three parameter gamma distribution when k independent samples are available. Sufficient conditions for the existence of the pooled estimator are given and the small as well as the large sample properties are studied. The harmonic mean of the k estimators of the independent samples is proposed in the place of the pooled estimator, in the case in which the latter does not exist.     

On improved estimation of a gamma shape parameter

This paper deals with improved estimation of a gamma shape parameter from a decision-theoretic point of view. First we study the second-order properties of three estimators – (i) the maximum-likelihood estimator (MLE), (ii) a bias corrected version of the MLE, and (iii) an improved version (in terms of mean squared error) of the MLE. It is shown that all the three estimators mentioned above are second-order inadmissible. Next, we obtain superior estimators which are second order better than the above three estimators. Simulation results are provided to study the relative risk improvement of each improved estimator over the MLE.     

Asymptotic properties of the maximum-likelihood estimator for a class of birth-and-death processes admitting a unique stationary distribution

The asymptotic properties of the maximum-likelihood estimator of the parameter vector for a class of birth-and-death processes admitting a unique stationary distribution are studied. Also, it is shown that identifiability of the parameter vector with respect to the likelihood implies that the Fisher information matrix is of full rank. Two special cases of biological interest are presented. One of these, the exponential birth-and-death process, is proposed as a more appropriate model of density dependence than the logistic process.     

Improved estimators for the location of double exponential distribution

In this paper, attention is focused on estimation of the location parameter in the double exponential case using a weighted linear combination of the sample median and pairs of order statistics, with symmetric distance to both sides from the sample median. Minimizing with respect to weights and distances we get smaller asymptotic variance in the second order. If the number of pairs is taken as infinite and the distances as null we attain the least asymptotic variance in this class of estimators. The Pitman estimator is also noted. Similarly improved estimators are scanned over their probability of concentration to investigate its bound. Numerical comparison of the estimators is shown.     

On second-order improved estimation of a gamma scale parameter

This paper concludes our comprehensive study on point estimation of model parameters of a gamma distribution from a second-order decision theoretic point of view. It should be noted that efficient estimation of gamma model parameters for samples ‘not large’ is a challenging task since the exact sampling distributions of the maximum likelihood estimators and its variants are not known. Estimation of a gamma scale parameter has received less attention from the earlier researchers compared to shape parameter estimation. What we have observed here is that improved estimation of the shape parameter does not necessarily lead to improved scale estimation if a natural moment condition (which is also the maximum likelihood restriction) is satisfied. Therefore, this work deals with the gamma scale parameter estimation as a separate new problem, not as a by-product of the shape parameter estimation, and studies several estimators in terms of second-order risk.     

Approximate MLE for the scale parameter of the generalized exponential distribution under random censoring

In this paper, we consider the maximum likelihood estimator (MLE) of the scale parameter of the generalized exponential (GE) distribution based on a random censoring model. We assume the censoring distribution also follows a GE distribution. Since the estimator does not provide an explicit solution, we propose a simple method of deriving an explicit estimator by approximating the likelihood function. In order to compare the performance of the estimators, Monte Carlo simulation is conducted. The results show that the MLE and the approximate MLE are almost identical in terms of bias and variance.     

The exact distribution and density functions of the stein-type estimator for normal variance

In this paper, we derive the exact distribution and density functions of the Stein-type estimator for the normal variance. It is shown by numerical evaluation that the density function of the Stein-type estimator is unimodal and concentrates around the mode more than that of the usual estimator.     

Improved maximum-likelihood estimation of the shape parameter in the Nakagami distribution

We develop and evaluate analytic and bootstrap bias-corrected maximum-likelihood estimators for the shape parameter in the Nakagami distribution. This distribution is widely used in a variety of disciplines, and the corresponding estimator of its scale parameter is trivially unbiased. We find that both ‘corrective’ and ‘preventive’ analytic approaches to eliminating the bias, to O(n ^?2), are equally, and extremely, effective and simple to implement. As a bonus, the sizeable reduction in bias comes with a small reduction in the mean-squared error. Overall, we prefer analytic bias corrections in the case of this estimator. This preference is based on the relative computational costs and the magnitudes of the bias reductions that can be achieved in each case. Our results are illustrated with two real-data applications, including the one which provides the first application of the Nakagami distribution to data for ocean wave heights.     

The exact confidence interval for the scale parameter and the mvue of the laplace distribution

The exact distribution of the sample median, and of the maximum likelihood estimator of the scale parameter of the Laplace distribution is derived. Tables of Teans, variances and the distribution functions of the corresponding dislributions are evaluacted. Exact ,solutions to the problem of confidence interval and hypothesrs testing for the scale paramrter are provided. The minimum variance unbiased estimator (MVUE) of the p.d.f. of the Laplace distribution when the location parameter is known is also given.     

On shrinkage estimation of the exponential location parameter

Under the assumption that the exponential distribution is a reasonable model for a given population, some shrinkage estimators for the location parameter based on type 1 and type II censored samples have been derived. It is shown that these estimators dominate maximum likelihood estimators (MLE's) asymptotically under the mean squared error (MSE) criterion. A Monte Carlo study shows a significant improvement of our estimators over MLE's in terms of MSE for small samples.     

Maximum likelihood parameter estimation in the three-parameter gamma distribution with the use of Mathematica

The number of solutions of the system of the log-likelihood equations for the three-parameter case is still an open problem. Several methods have been developed for finding the solutions. In this article we present a program in Mathematica that can find all the solutions of the system of equations. Furthermore, we examine the case where the global maximum appears at the boundary of the domain of the log-likelihood function and we prove that any consistent estimators appear at the interior with probability tending to one.     

Performance of nonparametric maximum likelihood estimator in a

When the probability of selecting an individual in a population is propor­tional to its lifelength, it is called length biased sampling. A nonparametric maximum likelihood estimator (NPMLE) of survival in a length biased sam­ple is given in Vardi (1982). In this study, we examine the performance of Vardi's NPMLE in estimating the true survival curve when observations are from a length biased sample. We also compute estimators based on a linear combination (LCE) of empirical distribution function (EDF) estimators and weighted estimators. In our simulations, we consider observations from a mix­ture of two different distributions, one from F and the other from G which is a length biased distribution of F. Through a series of simulations with vari­ous proportions of length biasing in a sample, we show that the NPMLE and the LCE closely approximate the true survival curve. Throughout the sur­vival curve, the EDF estimators overestimate the survival. We also consider a case where the observations are from three different weighted distributions, Again, both the NPMLE and the LCE closely approximate the true distribu­tion, indicating that the length biasedness is properly adjusted for. Finally, an efficiency study shows that Vardi's estimators are more efficient than the EDF estimators in the lower percentiles of the survival curves.     

Efficiency of an adaptive estimator of a log-zero-poisson parameter

An estimator, λ is proposed for the parameter λ of the log-zero-Poisson distribution. While it is not a consistent estimator of λ in the usual statistical sense, it is shown to be quite close to the maximum likelihood estimates for many of the 35 sets of data on which it is tried. Since obtaining maximum likelihood estimates is extremely difficult for this and other contagious distributions, this estimate will act at least as an initial estimate in solving the likelihood equations iteratively. A lesson learned from this experience is that in the area of contagious distributions, variability is so large that attention should be focused directly on the mean squared error and not on consistency or unbiasedness, whether for small samples or for the asymptotic case. Sample sizes for some of the data considered in the paper are in hundreds. The fact that the estimator which is not a consistent estimator of λ is closer to the maximum likeli-hood estimator than the consistent moment estimator shows that the variability is large enough to not permit consistency to materialize even for such large sample sizes usually available in actual practice.     

Asymptotic variances of maximum likelihood estimator for the correlation coefficient from a BVN distribution with one variable subject to censoring

This paper deals with the problem of estimating the Pearson correlation coefficient when one variable is subject to left or right censoring. In parallel to the classical results on the Pearson correlation coefficient, we derive a workable formula, through tedious computation and intensive simplification, of the asymptotic variances of the maximum likelihood estimators in two cases: (1) known means and variances and (2) unknown means and variances. We illustrate the usefulness of the asymptotic results in experimental designs.     

On the minimaxiy of the maximum likelihood estimator in a multivariate problem

This study looks at the minimaxity of the maximum likelihood estimator (m.1.e), of the mean of a p-normal population, that has been given by Dahel, Giri and Lepage (1985). This estimator is computed on the basis of three independent samples: the first one is drawn from the whole vector of dimension p and the two others are based on the first p₁ and the last p₂ components respectively, such as p₁ +p₂=p.     

Inference of R=P[X<Y] for generalized logistic distribution

This paper deals with the estimation of R=P[X<Y] when X and Y come from two independent generalized logistic distributions with different parameters. The maximum-likelihood estimator (MLE) and its asymptotic distribution are proposed. The asymptotic distribution is used to construct an asymptotic confidence interval of R. Assuming that the common scale parameter is known, the MLE, uniformly minimum variance unbiased estimator, Bayes estimation and confidence interval of R are obtained. The MLE of R, asymptotic distribution of R in the general case, is also discussed. Monte Carlo simulations are performed to compare the different proposed methods. Analysis of a real data set has also been presented for illustrative purposes.