On second-order improved estimation of a gamma scale parameter

This paper concludes our comprehensive study on point estimation of model parameters of a gamma distribution from a second-order decision theoretic point of view. It should be noted that efficient estimation of gamma model parameters for samples ‘not large’ is a challenging task since the exact sampling distributions of the maximum likelihood estimators and its variants are not known. Estimation of a gamma scale parameter has received less attention from the earlier researchers compared to shape parameter estimation. What we have observed here is that improved estimation of the shape parameter does not necessarily lead to improved scale estimation if a natural moment condition (which is also the maximum likelihood restriction) is satisfied. Therefore, this work deals with the gamma scale parameter estimation as a separate new problem, not as a by-product of the shape parameter estimation, and studies several estimators in terms of second-order risk.     

On second-order admissibilities of the estimators of gamma shape vector

Simultaneous estimation problem of gamma shape vector is considered.First, it is shown that the maximum likelihood estimator (MLE), the bias corrected MLE, and the conditional MLE of shape vector are second-order inadmissible. Second, these estimators are improved up to the second order. Finally, we identify whether these improved estimators are second-order admissible or not. Simulation studies are also given.     

Exact confidence intervals for the shape parameter of the gamma distribution

In this paper exact confidence intervals (CIs) for the shape parameter of the gamma distribution are constructed using the method of Bølviken and Skovlund [Confidence intervals from Monte Carlo tests. J Amer Statist Assoc. 1996;91:1071–1078]. The CIs which are based on the maximum likelihood estimator or the moment estimator are compared to bootstrap CIs via a simulation study.     

Pooled estimators for the shape parameter of the three parameter gamma distribution

The aim of the paper is to study the pooled estimator of the shape parameter of the three parameter gamma distribution when k independent samples are available. Sufficient conditions for the existence of the pooled estimator are given and the small as well as the large sample properties are studied. The harmonic mean of the k estimators of the independent samples is proposed in the place of the pooled estimator, in the case in which the latter does not exist.     

Generalized gamma parameter estimation and moment evaluation

The generalized gamma distribution includes the exponential distribution, the gamma distribution, and the Weibull distribution as special cases. It also includes the log-normal distribution in the limit as one of its parameters goes to infinity. Prentice (1974) developed an estimation method that is effective even when the underlying distribution is nearly log-normal. He reparameterized the density function so that it achieved the limiting case in a smooth fashion relative to the new parameters. He also gave formulas for the second partial derivatives of the log-density function to be used in the nearly log-normal case. His formulas included infinite summations, and he did not estimate the error in approximating these summations.

We derive approximations for the log-density function and moments of the generalized gamma distribution that are smooth in the nearly log-normal case and involve only finite summations. Absolute error bounds for these approximations are included. The approximation for the first moment is applied to the problem of estimating the parameters of a generalized gamma distribution under the constraint that the distribution have mean one. This enables the development of a correspondence between the parameters in a mean one generalized gamma distribution and certain parameters in acoustic scattering theory.     

Interval estimation of the negative binomial dispersion parameter

Inference concerning the negative binomial dispersion parameter, denoted by c, is important in many biological and biomedical investigations. Properties of the maximum-likelihood estimator of c and its bias-corrected version have been studied extensively, mainly, in terms of bias and efficiency [W.W. Piegorsch, Maximum likelihood estimation for the negative binomial dispersion parameter, Biometrics 46 (1990), pp. 863–867; S.J. Clark and J.N. Perry, Estimation of the negative binomial parameter κ by maximum quasi-likelihood, Biometrics 45 (1989), pp. 309–316; K.K. Saha and S.R. Paul, Bias corrected maximum likelihood estimator of the negative binomial dispersion parameter, Biometrics 61 (2005), pp. 179–185]. However, not much work has been done on the construction of confidence intervals (C.I.s) for c. The purpose of this paper is to study the behaviour of some C.I. procedures for c. We study, by simulations, three Wald type C.I. procedures based on the asymptotic distribution of the method of moments estimate (mme), the maximum-likelihood estimate (mle) and the bias-corrected mle (bcmle) [K.K. Saha and S.R. Paul, Bias corrected maximum likelihood estimator of the negative binomial dispersion parameter, Biometrics 61 (2005), pp. 179–185] of c. All three methods show serious under-coverage. We further study parametric bootstrap procedures based on these estimates of c, which significantly improve the coverage probabilities. The bootstrap C.I.s based on the mle (Boot-MLE method) and the bcmle (Boot-BCM method) have coverages that are significantly better (empirical coverage close to the nominal coverage) than the corresponding bootstrap C.I. based on the mme, especially for small sample size and highly over-dispersed data. However, simulation results on lengths of the C.I.s show evidence that all three bootstrap procedures have larger average coverage lengths. Therefore, for practical data analysis, the bootstrap C.I. Boot-MLE or Boot-BCM should be used, although Boot-MLE method seems to be preferable over the Boot-BCM method in terms of both coverage and length. Furthermore, Boot-MLE needs less computation than Boot-BCM.     

On the maximum-likelihood estimator for the location parameter of a cauchy distribution

In the literature of point estimation, the Cauchy distribution with location parameter is often cited as an example for the failure of maximum-likelihood method and hence the failure of the likelihood principle in general. Contrary to the above notion, we prove that even in this case the likelihood equation has multiple roots and that the maximum-likelihood estimator (the global maximum) remains as an asymptotically optimal estimator in the Bahadur sense.     

Bias reduction in the estimation of a shape second-order parameter of a heavy-tailed model

In extreme value theory, the shape second-order parameter is a quite relevant parameter related to the speed of convergence of maximum values, linearly normalized, towards its limit law. The adequate estimation of this parameter is vital for improving the estimation of the extreme value index, the primary parameter in statistics of extremes. In this article, we consider a recent class of semi-parametric estimators of the shape second-order parameter for heavy right-tailed models. These estimators, based on the largest order statistics, depend on a real tuning parameter, which makes them highly flexible and possibly unbiased for several underlying models. In this article, we are interested in the adaptive choice of such tuning parameter and the number of top order statistics used in the estimation procedure. The performance of the methodology for the adaptive choice of parameters is evaluated through a Monte Carlo simulation study.     

Admissible estimation in an one parameter nonregular family of absolutely continuous distributions

Consider the problem of estimating under entropy loss an arbitrarily positive, strictly increasing or decreasing parametric function based on a sample of size n in an one parameter noregular family of absolutly continuous distributions with both endpoints of the support depending on a single parameter. We first provide sufficient conditions for the admissibility of generalized Bayes estimator with respect to some specific priors and then treat several examples which illustrate the admissibility of best invariant estimators is some location or scale parameter problems.     

Admissible estimation in an one parameter nonregular family of absolutely continuous distributions

Consider the problem of estimating under squared error loss an arbitrarily positive, strictly increasing or decreasing parametric function based on a sample of size n in an one parameter nonregular family of absolutly continuous distributions with both endpoints of the support depending on a single parameter. We first provide sufficient conditions for the admissibility of generalized Bayes estimators with respect to some specific priors and then treat several examples which illustrate the admissibility of best invariant estimators in some location or scale parameter problems.     

On the efficiency of a testimator for the weibull shape parameter

In estimating the shape parameter of a two-parameter Weibull distribution from a failure-censored sample, a recently popular procedure is to employ a testimator which is a shrinkage estimator based on a preliminary hypothesis test for a guessed value of the parameter. Such an adaptive testimator is a linear compound of the guessed value and a statistic. A new compounding coefficient is numerically shown to yield higher efficiency in many situations compared to some of the existing ones.     

Minimax estimation of a lower-bounded scale parameter of a gamma distribution for scale-invariant squared-error loss

Let X have a gamma distribution with known shape parameter θr;aL and unknown scale parameter θ. Suppose it is known that θ ≥ a for some known a > 0. An admissible minimax estimator for scale-invariant squared-error loss is presented. This estimator is the pointwise limit of a sequence of Bayes estimators. Further, the class of truncated linear estimators C = {θ_ρ|θ_ρ(x) = max(a, ρ), ρ > 0} is studied. It is shown that each θ_ρ is inadmissible and that exactly one of them is minimax. Finally, it is shown that Katz's [Ann. Math. Statist., 32, 136–142 (1961)] estimator of θ is not minimax for our loss function. Some further properties of and comparisons among these estimators are also presented.     

On parameter estimation in Bernoulli trials with dependence

A simple estimator is proposed for the dependence parameter for the Klotz model of Bernoulli trials with Markov dependence and it is compared with the ratio estimator given by Price and the approximate maximum likelihood estimator given by Klotz. The proposed estimator is shown to have considerably smaller bias than the other two estimators with comparable mean squared errors, and has all the large sample optimal properties that the other two estimators have.     

Multi - sample test of equal gamma distribution scale parameters in presence of unknown common shape parameter

Shiue and Bain proposed an approximate F statistic for testing equality of two gamma distribution scale parameters in presence of a common and unknown shape parameter. By generalizing Shiue and Bain's statistic we develop a new statistic for testing equality of L >= 2 gamma distribution scale parameters. We derive the distribution of the new statistic ESP for L = 2 and equal sample size situation. For other situations distribution of ESP is not known and test based on the ESP statistic has to be performed by using simulated critical values. We also derive a C(α) statistic CML and develop a likelihood ratio statistic, LR, two modified likelihood ratio statistics M and MLB and a quadratic statistic Q. The distribution of each of the statistics CML, LR, M, MLB and Q is asymptotically chi-square with L - 1 degrees of freedom. We then conducted a monte-carlo simulation study to compare the perfor- mance of the statistics ESP, LR, M, MLB, CML and Q in terms of size and power. The statistics LR, M, MLB and Q are in general liberal and do not show power advantage over other statistics. The statistic CML, based on its asymptotic chi-square distribution, in general, holds nominal level well. It is most powerful or nearly most powerful in most situations and is simple to use. Hence, we recommend the statistic CML for use in general. For better power the statistic ESP, based on its empirical distribution, is recommended for the special situation for which there is evidence in the data that λ₁ < … < λ_L and n₁ < … < n_L, where λ₁ …, λ_L are the scale parameters and n₁,…, n_L are the sample sizes.     

Tests and confidence intervals for the shape parameter of a gamma distribution

Inference based on the Central Limit Theorem has only first order accuracy. We give tests and confidence intervals (CIs) of second orderaccuracy for the shape parameter ρ of a gamma distribution for both the unscaled and scaled cases.

Tests and CIs based on moment and cumulant estimates are considered as well as those based on the maximum likelihood estimate (MLE).

For the unscaled case the MLE is the moment estimate of order zero; the most efficient moment estimate of integral order is the sample mean, having asymptotic relative efficiency (ARE) .61 when ρ= 1.

For the scaled case the most efficient moment estimate is a functionof the mean and variance. Its ARE is .39 when ρ = 1.

Our motivation for constructing these tests of ρ = 1 and CIs forρ is to provide a simple and convenient method for testing whether a distribution is exponential in situations such as rainfall models where such an assumption is commonly made.     

Sequential estimation of a location parameter from delayed observations

The problem of sequentially estimating a location parameter is considered in the special case when the data arrive at random times. Certain classes of sequential estimation procedures are derived under a location invariant loss function and with the observation cost determined by a function of the moment of stopping and the number of observations up to this moment.     

Comparison of estimation methods for the finite population mean in simple random sampling: symmetric super-populations

In this paper, a new estimator combined estimator (CE) is proposed for estimating the finite population mean ¯ Y _N in simple random sampling assuming a long-tailed symmetric super-population model. The efficiency and robustness properties of the CE is compared with the widely used and well-known estimators of the finite population mean ¯ Y _N by Monte Carlo simulation. The parameter estimators considered in this study are the classical least squares estimator, trimmed mean, winsorized mean, trimmed L-mean, modified maximum-likelihood estimator, Huber estimator (W24) and the non-parametric Hodges–Lehmann estimator. The mean square error criteria are used to compare the performance of the estimators. We show that the CE is overall more efficient than the other estimators. The CE is also shown to be more robust for estimating the finite population mean ¯ Y _N , since it is insensitive to outliers and to misspecification of the distribution. We give a real life example.