Comparison of estimation methods for the Weibull distribution

Weibull distributions have received wide ranging applications in many areas including reliability, hydrology and communication systems. Many estimation methods have been proposed for Weibull distributions. But there has not been a comprehensive comparison of these estimation methods. Most studies have focused on comparing the maximum likelihood estimation (MLE) with one of the other approaches. In this paper, we first propose an L-moment estimator for the Weibull distribution. Then, a comprehensive comparison is made of the following methods: the method of maximum likelihood estimation (MLE), the method of logarithmic moments, the percentile method, the method of moments and the method of L-moments.     

Two-sided generalized Topp and Leone (TS-GTL) distributions

Over 50 years ago, in a 1955 issue of JASA, a paper on a bounded continuous distribution by Topp and Leone [C.W. Topp and F.C. Leone, A family of J-shaped frequency functions, J. Am. Stat. Assoc. 50(269) (1955), pp. 209–219] appeared (the subject was dormant for over 40 years but recently the family was resurrected). Here, we shall investigate the so-called Two-Sided Generalized Topp and Leone (TS-GTL) distributions. This family of distributions is constructed by extending the Generalized Two-Sided Power (GTSP) family to a new two-sided framework of distributions, where the first (second) branch arises from the distribution of the largest (smallest) order statistic. The TS-GTL distribution is generated from this framework by sampling from a slope (reflected slope) distribution for the first (second) branch. The resulting five-parameter TS-GTL family of distributions turns out to be flexible, encompassing the uniform, triangular, GTSP and two-sided slope distributions into a single family. In addition, the probability density functions may have bimodal shapes or admitting shapes with a jump discontinuity at the ‘threshold’ parameter. We will discuss some properties of the TS-GTL family and describe a maximum likelihood estimation (MLE) procedure. A numerical example of the MLE procedure is provided by means of a bimodal Galaxy M87 data set concerning V–I color indices of 80 globular clusters. A comparison with a Gaussian mixture fit is presented.     

On maximum likelihood estimation of the long-memory parameter in fractional Gaussian noise

Approximate normality and unbiasedness of the maximum likelihood estimate (MLE) of the long-memory parameter H of a fractional Brownian motion hold reasonably well for sample sizes as small as 20 if the mean and scale parameter are known. We show in a Monte Carlo study that if the latter two parameters are unknown the bias and variance of the MLE of H both increase substantially. We also show that the bias can be reduced by using a parametric bootstrap procedure. In very large samples, maximum likelihood estimation becomes problematic because of the large dimension of the covariance matrix that must be inverted. To overcome this difficulty, we propose a maximum likelihood method based upon first differences of the data. These first differences form a short-memory process. We split the data into a number of contiguous blocks consisting of a relatively small number of observations. Computation of the likelihood function in a block then presents no computational problem. We form a pseudo-likelihood function consisting of the product of the likelihood functions in each of the blocks and provide a formula for the standard error of the resulting estimator of H. This formula is shown in a Monte Carlo study to provide a good approximation to the true standard error. The computation time required to obtain the estimate and its standard error from large data sets is an order of magnitude less than that required to obtain the widely used Whittle estimator. Application of the methodology is illustrated on two data sets.     

Gompertz-power series distributions

ABSTRACT

In this article, we introduce the Gompertz power series (GPS) class of distributions which is obtained by compounding Gompertz and power series distributions. This distribution contains several lifetime models such as Gompertz-geometric (GG), Gompertz-Poisson (GP), Gompertz-binomial (GB), and Gompertz-logarithmic (GL) distributions as special cases. Sub-models of the GPS distribution are studied in details. The hazard rate function of the GPS distribution can be increasing, decreasing, and bathtub-shaped. We obtain several properties of the GPS distribution such as its probability density function, and failure rate function, Shannon entropy, mean residual life function, quantiles, and moments. The maximum likelihood estimation procedure via a EM-algorithm is presented, and simulation studies are performed for evaluation of this estimation for complete data, and the MLE of parameters for censored data. At the end, a real example is given.     

New perspective on the benefits of the gene–environment independence in case–control studies

We study the benefit of exploiting the gene–environment independence (GEI) assumption for inferring the joint effect of genotype and environmental exposure on disease risk in a case–control study. By transforming the problem into a constrained maximum likelihood estimation problem we derive the asymptotic distribution of the maximum likelihood estimator (MLE) under the GEI assumption (MLE‐GEI) in a closed form. Our approach uncovers a transparent explanation of the efficiency gained by exploiting the GEI assumption in more general settings, thus bridging an important gap in the existing literature. Moreover, we propose an easy‐to‐implement numerical algorithm for estimating the model parameters in practice. Finally, we conduct simulation studies to compare the proposed method with the traditional prospective logistic regression method and the case‐only estimator. The Canadian Journal of Statistics 47: 473–486; 2019 © 2019 Statistical Society of Canada     

Exact distribution of the MLEs of the parameters and of the quantiles of two-parameter exponential distribution under hybrid censoring

Epstein [Truncated life tests in the exponential case, Ann. Math. Statist. 25 (1954), pp. 555–564] introduced a hybrid censoring scheme (called Type-I hybrid censoring) and Chen and Bhattacharyya [Exact confidence bounds for an exponential parameter under hybrid censoring, Comm. Statist. Theory Methods 17 (1988), pp. 1857–1870] derived the exact distribution of the maximum-likelihood estimator (MLE) of the mean of a scaled exponential distribution based on a Type-I hybrid censored sample. Childs et al. [Exact likelihood inference based on Type-I and Type-II hybrid censored samples from the exponential distribution, Ann. Inst. Statist. Math. 55 (2003), pp. 319–330] provided an alternate simpler expression for this distribution, and also developed analogous results for another hybrid censoring scheme (called Type-II hybrid censoring). The purpose of this paper is to derive the exact bivariate distribution of the MLE of the parameter vector of a two-parameter exponential model based on hybrid censored samples. The marginal distributions are derived and exact confidence bounds for the parameters are obtained. The results are also used to derive the exact distribution of the MLE of the pth quantile, as well as the corresponding confidence bounds. These exact confidence intervals are then compared with parametric bootstrap confidence intervals in terms of coverage probabilities. Finally, we present some numerical examples to illustrate the methods of inference developed here.     

Bayesian analysis of mixture modelling using the multivariate t distribution

A finite mixture model using the multivariate t distribution has been shown as a robust extension of normal mixtures. In this paper, we present a Bayesian approach for inference about parameters of t-mixture models. The specifications of prior distributions are weakly informative to avoid causing nonintegrable posterior distributions. We present two efficient EM-type algorithms for computing the joint posterior mode with the observed data and an incomplete future vector as the sample. Markov chain Monte Carlo sampling schemes are also developed to obtain the target posterior distribution of parameters. The advantages of Bayesian approach over the maximum likelihood method are demonstrated via a set of real data.     

On second-order admissibilities of the estimators of gamma shape vector

Simultaneous estimation problem of gamma shape vector is considered.First, it is shown that the maximum likelihood estimator (MLE), the bias corrected MLE, and the conditional MLE of shape vector are second-order inadmissible. Second, these estimators are improved up to the second order. Finally, we identify whether these improved estimators are second-order admissible or not. Simulation studies are also given.     

Parameter estimation of three-parameter Weibull distribution based on progressively Type-II censored samples

In this paper, the estimation of parameters for a three-parameter Weibull distribution based on progressively Type-II right censored sample is studied. Different estimation procedures for complete sample are generalized to the case with progressively censored data. These methods include the maximum likelihood estimators (MLEs), corrected MLEs, weighted MLEs, maximum product spacing estimators and least squares estimators. We also proposed the use of a censored estimation method with one-step bias-correction to obtain reliable initial estimates for iterative procedures. These methods are compared via a Monte Carlo simulation study in terms of their biases, root mean squared errors and their rates of obtaining reliable estimates. Recommendations are made from the simulation results and a numerical example is presented to illustrate all of the methods of inference developed here.     

Estimates for mean and dispersion effects in unreplicated factorial designs

One important goal of experimentation in quality improvement is to minimize the variability of a product or process around a target mean value. Factors which affect variances as well as factors that affect the mean can be identified using the analysis of mean and dispersion. Box and Meyer (1986b) proposed a method of model identification and maximum likelihood estimation for mean and dispersion effects from unreplicated designs. In this article, we address two problems associated with MLE’s. First, asymptotic variance of MLE's for dispersion effects which can be used to judge the significance of factors can be misleading. A possible explanation is provided; simulation results also indicate that the asymptotic, variance underestimates.     

Reliability estimation in a multicomponent stress–strength model under generalized half-normal distribution based on progressive type-II censoring

In this paper, based on progressively Type-II censored samples, the problem of estimation of multicomponent stress–strength reliability under generalized half-normal (GHN) distribution is considered. The reliability of a k-component stress-strength system is estimated when both stress and strength variates are assumed to have a GHN distribution with various cases of same and different shape and scale parameters. Different methods such as the maximum likelihood estimates (MLEs) and Bayes estimation are discussed. The expectation maximization algorithm and approximate maximum likelihood methods are proposed to compute the MLE of reliability. The Lindley's approximation method, as well as Metropolis–Hastings algorithm, are applied to compute Bayes estimates. The performance of the proposed procedures is also demonstrated via a Monte Carlo simulation study and an illustrative example.     

Estimation of the parameters in a truncated normal distribution

This paper deals with the estimation of the parameters of doubly truncated and singly truncated normal distributions when truncation points are known. We derive, for these families, a necessary and sufficient condition for the maximum likelihood estimator(MLE) to be finite. Furthermore, the probability of the MLE being infinite is positive. A simulation study for single truncation is carried out to compare the modified maximum likelihood estimator, and the mixed estimator.     

Estimation of system reliability for exponential distributions based on L ranked set sampling

Abstract

In the case where strength and stress both follow exponential distributions, this paper considers the maximum likelihood estimator (MLE) of the system reliability based on L ranked set sampling (LRSS). The proposed MLE is shown to have existence, uniqueness and asymptotic normality, and its asymptotic variance is obtained by the Fisher information matrix of LRSS. The values of asymptotic relative efficiencies show that the proposed MLE is always more efficient than the MLE using simple random sampling (SRS). However, the MLE using LRSS cannot be written in closed form. Therefore, the modified MLE is proposed using the technique replaced some terms in the maximum likelihood equations by their expectations. The newly modified MLE using LRSS is shown to be superior to the MLE using SRS. Finally, the proposed method is applied to a real data set on metastatic renal carcinoma study.     

Unimodality of the pareto distribution likelihood function for multicensored samples and implications for estimation

This paper discusses maximum likelihood parameter estimation in the Pareto distribution for multicensored samples. In particu-

lar, the modality of the associated conditional log-likelihood function is investigated in order to resolve questions concerninc

the existence and uniqurneas of the lnarimum likelihood estimates.For the cases with one parameter known, the maximum likelihood

estimates of the remaining unknown parameters are shown to exist and to be unique. When both parameters are unknown, the maximum likelihood estimates may or may not exist and be unique. That is, their existence and uniqueness would seem to depend solely upon the information inherent in the sample data. In viav of the possible nonexistence and/or non-uniqueness of the maximum likelihood estimates when both parameters are unknown, alternatives to standard iterative numerical methods are explored.     

On some aspects of a general class of Yule distribution and its applications

Abstract

A wide class of Yule distribution is introduced here as a generalization of the extended Yule distribution of Martinez-Rodríguez et al. and the generalized Yule distribution of Mishra and investigate some of its properties. Various methods of estimation are employed for estimating the parameters of the distribution and generalized likelihood ratio test procedures are suggested for testing the significance of the parameters of the distribution. All these procedures are illustrated with the help of real data sets.     

A comparison of estimation procedures for the parameters of the star model

A simulation experiment compares the accuracy and precision of three alternate estimation techniques for the parameters of the STARMA model. Maximum likelihood estimation, in most ways the "best" estimation procedure, involves a large amount of computational effort so that two approximate techniques, exact least squares and conditional maximum likelihood, are often proposed for series of moderate lengths. This simulation experiment compares the accuracy of these three estimation procedures for simulated series of various lengths, and discusses the appropriateness of the three procedures as a function of the length of the observed series.     

BL-GARCH models with elliptical distributed innovations

In this work, we discuss the class of bilinear GARCH (BL-GARCH) models that are capable of capturing simultaneously two key properties of non-linear time series: volatility clustering and leverage effects. It has often been observed that the marginal distributions of such time series have heavy tails; thus we examine the BL-GARCH model in a general setting under some non-normal distributions. We investigate some probabilistic properties of this model and we conduct a Monte Carlo experiment to evaluate the small-sample performance of the maximum likelihood estimation (MLE) methodology for various models. Finally, within-sample estimation properties were studied using S&P 500 daily returns, when the features of interest manifest as volatility clustering and leverage effects. The main results suggest that the Student-t BL-GARCH seems highly appropriate to describe the S&P 500 daily returns.     

Linear approximate ML estimation in scaled Type I generalized logistic distribution based on Type-II censored samples

The scaled (two-parameter) Type I generalized logistic distribution (GLD) is considered with the known shape parameter. The ML method does not yield an explicit estimator for the scale parameter even in complete samples. In this article, we therefore construct a new linear estimator for scale parameter, based on complete and doubly Type-II censored samples, by making linear approximations to the intractable terms of the likelihood equation using least-squares (LS) method, a new approach of linearization. We call this as linear approximate maximum likelihood estimator (LAMLE). We also construct LAMLE based on Taylor series method of linear approximation and found that this estimator is slightly biased than that based on the LS method. A Monte Carlo simulation is used to investigate the performance of LAMLE and found that it is almost as efficient as MLE, though biased than MLE. We also compare unbiased LAMLE with BLUE based on the exact variances of the estimators and interestingly this new unbiased LAMLE is found just as efficient as the BLUE in both complete and Type-II censored samples. Since MLE is known as asymptotically unbiased, in large samples we compare unbiased LAMLE with MLE and found that this estimator is almost as efficient as MLE. We have also discussed interval estimation of the scale parameter from complete and Type-II censored samples. Finally, we present some numerical examples to illustrate the construction of the new estimators developed here.     

Statistical inference for start-up demonstration tests with rejection of units upon observing d failures

In this paper, we consider the statistical inference for the success probability in the case of start-up demonstration tests in which rejection of units is possible when a pre-fixed number of failures is observed before the required number of consecutive successes are achieved for acceptance of the unit. Since the expected value of the stopping time is not a monotone function of the unknown parameter, the method of moments is not useful in this situation. Therefore, we discuss two estimation methods for the success probability: (1) the maximum likelihood estimation (MLE) via the expectation-maximization (EM) algorithm and (2) Bayesian estimation with a beta prior. We examine the small-sample properties of the MLE and Bayesian estimator. Finally, we present an example to illustrate the method of inference discussed here.     

A frequency domain comparison of estimation methods for gaussian fields

This paper demonstrates that well-known parameter estimation methods for Gaussian fields place different emphasis on the high and low frequency components of the data. As a consequence, the relative importance of the frequencies under the objective of the analysis should be taken into account when selecting an estimation method, in addition to other considerations such as statistical and computational efficiency. The paper also shows that when noise is added to the Gaussian field, maximum pseudolikelihood automatically sets the smoothing parameter of the model equal to one. A simulation study then indicates that generalised cross-validation is more robust than maximum likelihood un-

der model misspecification in smoothing and image restoration problems. This has implications for Bayesian procedures since these use the same weightings of the frequencies as the likelihood.