On second-order improved estimation of a gamma scale parameter

This paper concludes our comprehensive study on point estimation of model parameters of a gamma distribution from a second-order decision theoretic point of view. It should be noted that efficient estimation of gamma model parameters for samples ‘not large’ is a challenging task since the exact sampling distributions of the maximum likelihood estimators and its variants are not known. Estimation of a gamma scale parameter has received less attention from the earlier researchers compared to shape parameter estimation. What we have observed here is that improved estimation of the shape parameter does not necessarily lead to improved scale estimation if a natural moment condition (which is also the maximum likelihood restriction) is satisfied. Therefore, this work deals with the gamma scale parameter estimation as a separate new problem, not as a by-product of the shape parameter estimation, and studies several estimators in terms of second-order risk.     

On improved estimation of a gamma shape parameter

This paper deals with improved estimation of a gamma shape parameter from a decision-theoretic point of view. First we study the second-order properties of three estimators – (i) the maximum-likelihood estimator (MLE), (ii) a bias corrected version of the MLE, and (iii) an improved version (in terms of mean squared error) of the MLE. It is shown that all the three estimators mentioned above are second-order inadmissible. Next, we obtain superior estimators which are second order better than the above three estimators. Simulation results are provided to study the relative risk improvement of each improved estimator over the MLE.     

Pooled estimators for the shape parameter of the three parameter gamma distribution

The aim of the paper is to study the pooled estimator of the shape parameter of the three parameter gamma distribution when k independent samples are available. Sufficient conditions for the existence of the pooled estimator are given and the small as well as the large sample properties are studied. The harmonic mean of the k estimators of the independent samples is proposed in the place of the pooled estimator, in the case in which the latter does not exist.     

Some simple estimators for the two-parameter gamma distribution

ABSTRACT

In this paper, we propose two new simple estimation methods for the two-parameter gamma distribution. The first one is a modified version of the method of moments, whereas the second one makes use of some key properties of the distribution. We then derive the asymptotic distributions of these estimators. Also, bias-reduction methods are suggested to reduce the bias of these estimators. The performance of the estimators are evaluated through a Monte Carlo simulation study. The probability coverages of confidence intervals are also discussed. Finally, two examples are used to illustrate the proposed methods.     

Efficient closed-form maximum a posteriori estimators for the gamma distribution

We proposed a new class of maximum a posteriori estimators for the parameters of the Gamma distribution. These estimators have simple closed-form expressions and can be rewritten as a bias-corrected maximum likelihood estimators presented by Ye and Chen [Closed-form estimators for the gamma distribution derived from likelihood equations. Am Statist. 2017;71(2):177–181]. A simulation study was carried out to compare different estimation procedures. Numerical results revels that our new estimation scheme outperforms the existing closed-form estimators and produces extremely efficient estimates for both parameters, even for small sample sizes.     

On Second Order Admissibilities in Two-Parameter Logistic Regression Model

In two-parameter family of distribution, conditions for a modified maximum likelihood estimator to be second-order admissible are given. Applying these results to two-parameter logistic regression model, it is shown that the maximum likelihood estimator is always second-order inadmissible and the Rao-Blackwellized minimum logit chi-squared estimator is second-order admissible if and only if the number of the doses is greater than or equal to 6.     

A note on comparison and improvement of estimators based on likelihood

The problem of estimation of a parameter of interest in the presence of a nuisance parameter, which is either location or scale, is considered. Three estimators are taken into account: usual maximum likelihood (ML) estimator, maximum integrated likelihood estimator and the bias-corrected ML estimator. General results on comparison of these estimators w.r.t. the second-order risk based on the mean-squared error are obtained. Possible improvements of basic estimators via the notion of admissibility and methodology given in Ghosh and Sinha [A necessary and sufficient condition for second order admissibility with applications to Berkson's bioassay problem. Ann Stat. 1981;9(6):1334–1338] are considered. In the recent paper by Tanaka et al. [On improved estimation of a gamma shape parameter. Statistics. 2014; doi:10.1080/02331888.2014.915842], this problem was considered for estimating the shape parameter of gamma distribution. Here, we perform more accurate comparison of estimators for this case as well as for some other cases.     

The maximum likelihood estimators of the parameters of the gamma distribution are always positively biased

Several authors have conjectured, on the basis of their numerical work, that the maximum likelihood estimators of the shape and scale parameters of the Gamma distribution are positively biased. It is proved that their conjecture is always true.     

Exact confidence intervals for the shape parameter of the gamma distribution

In this paper exact confidence intervals (CIs) for the shape parameter of the gamma distribution are constructed using the method of Bølviken and Skovlund [Confidence intervals from Monte Carlo tests. J Amer Statist Assoc. 1996;91:1071–1078]. The CIs which are based on the maximum likelihood estimator or the moment estimator are compared to bootstrap CIs via a simulation study.     

On the performance of some new Liu parameters for the gamma regression model

The maximum likelihood (ML) method is used to estimate the unknown Gamma regression (GR) coefficients. In the presence of multicollinearity, the variance of the ML method becomes overstated and the inference based on the ML method may not be trustworthy. To combat multicollinearity, the Liu estimator has been used. In this estimator, estimation of the Liu parameter d is an important problem. A few estimation methods are available in the literature for estimating such a parameter. This study has considered some of these methods and also proposed some new methods for estimation of the d. The Monte Carlo simulation study has been conducted to assess the performance of the proposed methods where the mean squared error (MSE) is considered as a performance criterion. Based on the Monte Carlo simulation and application results, it is shown that the Liu estimator is always superior to the ML and recommendation about which best Liu parameter should be used in the Liu estimator for the GR model is given.     

Inadmissibility results of the mle for the multinomial problem when the parameter space is restricted or truncated

In binomial or multinomial problems when the parameter space is restricted or truncated to a subset of the natural parameter space, the maximum likelihood estimator (MLE) may be inadmissible under squared error loss. A quite general condition for the inadmissibility of MLEs in such cases can be established using the stepwise Bayes technique and the complete class theorem of Brown.     

Estimation of the parameters of a truncated gamma distribution

This paper deals with the estimation of the parameters of a truncated gamma distribution over (0,τ), where τ is assumed to be a real number. We obtain a necessary and sufficient condition for the existence of the maximum likelihood estimator(MLE). The probability of nonexistence of MLE is observed to be positive. A simulation study indicates that the modified maximum likelihood estimator and the mixed estimator, which exist with probability one,are to be preferred over MLE. The bias, the mean square error, and the probability of nearness form a basis of our simulation study.     

Estimation of parameters of the gamma distribution in the presence of outliers

The maximum likelihood estimators and moment estimators are derived for samples from the Gamma distribution in the presence of outliers. These estimators are compared empirically when all the three parameters are unknown and when one of the three parameters is known; their bias and mean square error (MSE) are investigated with the help of numerical technique.     

On bias reduction estimators of skew-normal and skew-t distributions

A particular concerns of researchers in statistical inference is bias in parameters estimation. Maximum likelihood estimators are often biased and for small sample size, the first order bias of them can be large and so it may influence the efficiency of the estimator. There are different methods for reduction of this bias. In this paper, we proposed a modified maximum likelihood estimator for the shape parameter of two popular skew distributions, namely skew-normal and skew-t, by offering a new method. We show that this estimator has lower asymptotic bias than the maximum likelihood estimator and is more efficient than those based on the existing methods.     

On the Simultaneous Estimation of Scale Parameters

This note is an extension of Das Gupta's results (1986) on the estimation of multiparameter gamma distribution. Consider p (p ? 2) independent positive random variables with possibly different scale-parameter densities. For the estimation of the powers of the scale parameters it is shown that the “best multiple estimator” is inadmissible with respect to a large class of weighted quadratic loss functions.     

A comparison of various estimators of the mean of an inverse gaussian distribution

In this paper we consider the Inverse Gaussian distribution whose variance is proportional to the mean. Assuming that the data are available from IGD(,μ,c,μ ²), and also from its length biased version, simulation studies are presented to compare the MVUE and MLE in terms of their variances and mean square errors from both kinds of data. Some tables and graphs are provided to analyze the comparisons. Finally, some recommendations and conclusions are given when one or both kinds of data are available.     

Properties of estimators for the gamma distribution

Accurate moments of maximum likelihood and moment estimators for the scale and shape parameters of a two parameter gamma density are given, the former being tabulated over a segment of the parameter space. In addition, joint acceptance regions are given for a particular case. The three parameter model is also considered and comments made on second order asymptotics for the maximum likelihood estimators     

On geometry of the set of admissible invariant quadratic estimators in balanced two variance components model

Two variance components model for which each invariant quadratic admissible estimator of a linear function of variance components (under quadratic loss function) is a linear combination of two quadratic forms,Z ₁,Z ₂, say, is considered. A setD={(d ₁,d ₂)′:d ₁ Z ₁+d ₂ Z ₂ is admissible} is described by giving formulae on the boundary ofD. Different forms of the setD are presented on figures.     

On the Restricted Liu Estimator in the Logistic Regression Model

The logistic regression model is used when the response variables are dichotomous. In the presence of multicollinearity, the variance of the maximum likelihood estimator (MLE) becomes inflated. The Liu estimator for the linear regression model is proposed by Liu to remedy this problem. Urgan and Tez and Mansson et al. examined the Liu estimator (LE) for the logistic regression model. We introduced the restricted Liu estimator (RLE) for the logistic regression model. Moreover, a Monte Carlo simulation study is conducted for comparing the performances of the MLE, restricted maximum likelihood estimator (RMLE), LE, and RLE for the logistic regression model.