Maximum likelihood vs. maximum goodness of fit estimation of the three-parameter Weibull distribution

The use of statistics based on the empirical distribution function is analysed for estimation of the scale, shape, and location parameters of the three-parameter Weibull distribution. The resulting maximum goodness of fit (MGF) estimators are compared with their maximum likelihood counterparts. In addition to the Kolmogorov–Smirnov, Cramer–von Mises, and Anderson–Darling statistics, some related empirical distribution function statistics using different weight functions are considered. The results show that the MGF estimators of the scale and shape parameters are usually more efficient than the maximum likelihood estimators when the shape parameter is smaller than 2, particularly if the sample size is large.     

The skew generalized t distribution as the scale mixture of a skew exponential power distribution and its applications in robust estimation

In this paper, we consider the family of skew generalized t (SGT) distributions originally introduced by Theodossiou [P. Theodossiou, Financial data and the skewed generalized t distribution, Manage. Sci. Part 1 44 (12) ( 1998), pp. 1650–1661] as a skew extension of the generalized t (GT) distribution. The SGT distribution family warrants special attention, because it encompasses distributions having both heavy tails and skewness, and many of the widely used distributions such as Student's t, normal, Hansen's skew t, exponential power, and skew exponential power (SEP) distributions are included as limiting or special cases in the SGT family. We show that the SGT distribution can be obtained as the scale mixture of the SEP and generalized gamma distributions. We investigate several properties of the SGT distribution and consider the maximum likelihood estimation of the location, scale, and skewness parameters under the assumption that the shape parameters are known. We show that if the shape parameters are estimated along with the location, scale, and skewness parameters, the influence function for the maximum likelihood estimators becomes unbounded. We obtain the necessary conditions to ensure the uniqueness of the maximum likelihood estimators for the location, scale, and skewness parameters, with known shape parameters. We provide a simple iterative re-weighting algorithm to compute the maximum likelihood estimates for the location, scale, and skewness parameters and show that this simple algorithm can be identified as an EM-type algorithm. We finally present two applications of the SGT distributions in robust estimation.     

On second-order improved estimation of a gamma scale parameter

This paper concludes our comprehensive study on point estimation of model parameters of a gamma distribution from a second-order decision theoretic point of view. It should be noted that efficient estimation of gamma model parameters for samples ‘not large’ is a challenging task since the exact sampling distributions of the maximum likelihood estimators and its variants are not known. Estimation of a gamma scale parameter has received less attention from the earlier researchers compared to shape parameter estimation. What we have observed here is that improved estimation of the shape parameter does not necessarily lead to improved scale estimation if a natural moment condition (which is also the maximum likelihood restriction) is satisfied. Therefore, this work deals with the gamma scale parameter estimation as a separate new problem, not as a by-product of the shape parameter estimation, and studies several estimators in terms of second-order risk.     

Estimation for the Parameters of Generalized Half-normal Distribution Based on Progressive Type-I Interval Censoring

Based on progressively Type-I interval censored sample, the problem of estimating unknown parameters of a two parameter generalized half-normal(GHN) distribution is considered. Different methods of estimation are discussed. They include the maximum likelihood estimation, midpoint approximation method, approximate maximum likelihood estimation, method of moments, and estimation based on probability plot. Several Bayesian estimates with respect to different symmetric and asymmetric loss functions such as squared error, LINEX, and general entropy is calculated. The Lindley’s approximation method is applied to determine Bayesian estimates. Monte Carlo simulations are performed to compare the performances of the different methods. Finally, analysis is also carried out for a real dataset.     

On the estimates of the parameters of the first order autoregressive process

Two methods of estimation for the parameters of an AR(1) process which are based on a non-linear least-squares approach are presented. On the basis of some simulation results they are compared with two maximum likelihood estimates and their relative merits are discussed.     

Estimation of Pr(Y < X) for the two-parameter generalized exponential records

This article considers the maximum likelihood and Bayes estimation of the stress–strength reliability based on two-parameter generalized exponential records. Here, we extend the results of Baklizi [Computational Statistics and Data Analysis 52 (2008), 3468–3473] to explain a wide variety of real datasets. We also consider the estimation of R when the same shape parameter is known. The results for exponential distribution can be obtained as a special case with different scale parameters.     

Inference for Log-Gamma Distribution Based on Progressively Type-II Censored Data

We discuss the maximum likelihood estimates (MLEs) of the parameters of the log-gamma distribution based on progressively Type-II censored samples. We use the profile likelihood approach to tackle the problem of the estimation of the shape parameter κ. We derive approximate maximum likelihood estimators of the parameters μ and σ and use them as initial values in the determination of the MLEs through the Newton–Raphson method. Next, we discuss the EM algorithm and propose a modified EM algorithm for the determination of the MLEs. A simulation study is conducted to evaluate the bias and mean square error of these estimators and examine their behavior as the progressive censoring scheme and the shape parameter vary. We also discuss the interval estimation of the parameters μ and σ and show that the intervals based on the asymptotic normality of MLEs have very poor probability coverages for small values of m. Finally, we present two examples to illustrate all the methods of inference discussed in this paper.     

Estimation of reliability in multicomponent stress–strength based on two parameter exponentiated Weibull Distribution

In this research article, we estimate the multicomponent stress–strength reliability of a system when strength and stress variates are drawn from an exponentiated Weibull distribution with different shape parameters α?and?β, and common shape and scale parameters γ and λ, respectively. We estimate the parameters by using maximum likelihood estimation (MLE) and hence the estimate of reliability obtained applying the MLE method of estimation when samples are drawn from stress and strength distributions. The small sample comparison of the reliability estimates is made through Monte Carlo simulation.     

An EM type estimation procedure for the destructive exponentially weighted Poisson regression cure model under generalized gamma lifetime

In this paper, we assume the number of competing causes to follow an exponentially weighted Poisson distribution. By assuming the initial number of competing causes can undergo destruction and that the population of interest has a cure fraction, we develop the EM algorithm for the determination of the MLEs of the model parameters of such a general cure model. This model is more flexible than the promotion time cure model and also provides an interesting and realistic interpretation of the biological mechanism of the occurrence of an event of interest. Instead of assuming a particular parametric distribution for the lifetime, we assume the lifetime to belong to the wider class of generalized gamma distribution. This allows us to carry out a model discrimination to select a parsimonious lifetime distribution that provides the best fit to the data. Within the EM framework, a two-way profile likelihood approach is proposed to estimate the shape parameters. An extensive Monte Carlo simulation study is carried out to demonstrate the performance of the proposed estimation method. Model discrimination is carried out by means of the likelihood ratio test and information-based methods. Finally, a data on melanoma is analyzed for illustrative purpose.     

ASYMPTOTIC DISTRIBUTIONS OF SEMIPARAMETRIC MAXIMUM LIKELIHOOD ESTIMATORS WITH ESTIMATING EQUATIONS FOR GROUP-CENSORED DATA

Semiparametric maximum likelihood estimation with estimating equations (SMLE) is more flexible than traditional methods; it has fewer restrictions on distributions and regression models. The required information about distribution and regression structures is incorporated in estimating equations of the SMLE to improve the estimation quality of non‐parametric methods. The likelihood of SMLE for censored data involves complicated implicit functions without closed‐form expressions, and the first derivatives of the log‐profile‐likelihood cannot be expressed as summations of independent and identically distributed random variables; it is challenging to derive asymptotic properties of the SMLE for censored data. For group‐censored data, the paper shows that all the implicit functions are well defined and obtains the asymptotic distributions of the SMLE for model parameters and lifetime distributions. With several examples the paper compares the SMLE, the regular non‐parametric likelihood estimation method and the parametric MLEs in terms of their asymptotic efficiencies, and illustrates application of SMLE. Various asymptotic distributions of the likelihood ratio statistics are derived for testing the adequacy of estimating equations and a partial set of parameters equal to some known values.     

Estimation for the three-parameter inverse Gaussian distribution under progressive Type-II censoring

Inverse Gaussian distribution has been used widely as a model in analysing lifetime data. In this regard, estimation of parameters of two-parameter (IG2) and three-parameter inverse Gaussian (IG3) distributions based on complete and censored samples has been discussed in the literature. In this paper, we develop estimation methods based on progressively Type-II censored samples from IG3 distribution. In particular, we use the EM-algorithm, as well as some other numerical methods for determining the maximum-likelihood estimates (MLEs) of the parameters. The asymptotic variances and covariances of the MLEs from the EM-algorithm are derived by using the missing information principle. We also consider some simplified alternative estimators. The inferential methods developed are then illustrated with some numerical examples. We also discuss the interval estimation of the parameters based on the large-sample theory and examine the true coverage probabilities of these confidence intervals in case of small samples by means of Monte Carlo simulations.     

Estimation and prediction for an inverted exponentiated Rayleigh distribution under hybrid censoring

In this paper we consider estimation of unknown parameters of an inverted exponentiated Rayleigh distribution when it is known that data are hybrid Type I censored. The maximum likelihood and Bayes estimates are derived. In sequel interval estimates are also constructed. We further consider one- and two-sample prediction of future observations and also obtain prediction intervals. The performance of proposed methods of estimation and prediction is studied using simulations and an illustrative example is discussed in support of the suggested methods.     

Strong consistency of the regularized least-squares estimates of infinite autoregressive models

Our main interest is on-line parameter estimation of infinite AR models with exponentially decaying coefficients. The practical importance of the problem follows from the fact that the class of such models includes (but not limited to) all causal invertible ARMA(p,q$p,q$) models. On-line parameter estimation means that the length of the observed data sample is not known a priori and may indefinitely increase. Hence, the parameter estimates should be refined upon arrival of every new observation. So use of the maximum likelihood (ML) method is not feasible due to the high computational burden, and recursive estimation procedures are preferable.     

Empirical likelihood for nonlinear regression models with nonignorable missing responses

This article develops three empirical likelihood (EL) approaches to estimate parameters in nonlinear regression models in the presence of nonignorable missing responses. These are based on the inverse probability weighted (IPW) method, the augmented IPW (AIPW) method and the imputation technique. A logistic regression model is adopted to specify the propensity score. Maximum likelihood estimation is used to estimate parameters in the propensity score by combining the idea of importance sampling and imputing estimating equations. Under some regularity conditions, we obtain the asymptotic properties of the maximum EL estimators of these unknown parameters. Simulation studies are conducted to investigate the finite sample performance of our proposed estimation procedures. Empirical results provide evidence that the AIPW procedure exhibits better performance than the other two procedures. Data from a survey conducted in 2002 are used to illustrate the proposed estimation procedure. The Canadian Journal of Statistics 48: 386–416; 2020 © 2020 Statistical Society of Canada     

Inference for multivariate normal hierarchical models

This paper provides a new method and algorithm for making inferences about the parameters of a two-level multivariate normal hierarchical model. One has observed J p -dimensional vector outcomes, distributed at level 1 as multivariate normal with unknown mean vectors and with known covariance matrices. At level 2, the unknown mean vectors also have normal distributions, with common unknown covariance matrix A and with means depending on known covariates and on unknown regression coefficients. The algorithm samples independently from the marginal posterior distribution of A by using rejection procedures. Functions such as posterior means and covariances of the level 1 mean vectors and of the level 2 regression coefficient are estimated by averaging over posterior values calculated conditionally on each value of A drawn. This estimation accounts for the uncertainty in A , unlike standard restricted maximum likelihood empirical Bayes procedures. It is based on independent draws from the exact posterior distributions, unlike Gibbs sampling. The procedure is demonstrated for profiling hospitals based on patients' responses concerning p =2 types of problems (non-surgical and surgical). The frequency operating characteristics of the rule corresponding to a particular vague multivariate prior distribution are shown via simulation to achieve their nominal values in that setting.     

Bayesian Estimators for Small Area Models Shrinking Both Means and Variances

For small area estimation of area‐level data, the Fay–Herriot model is extensively used as a model‐based method. In the Fay–Herriot model, it is conventionally assumed that the sampling variances are known, whereas estimators of sampling variances are used in practice. Thus, the settings of knowing sampling variances are unrealistic, and several methods are proposed to overcome this problem. In this paper, we assume the situation where the direct estimators of the sampling variances are available as well as the sample means. Using this information, we propose a Bayesian yet objective method producing shrinkage estimation of both means and variances in the Fay–Herriot model. We consider the hierarchical structure for the sampling variances, and we set uniform prior on model parameters to keep objectivity of the proposed model. For validity of the posterior inference, we show under mild conditions that the posterior distribution is proper and has finite variances. We investigate the numerical performance through simulation and empirical studies.     

Empirical Uncertain Bayes Methods in Area‐level Models

Random effects model can account for the lack of fitting a regression model and increase precision of estimating area‐level means. However, in case that the synthetic mean provides accurate estimates, the prior distribution may inflate an estimation error. Thus, it is desirable to consider the uncertain prior distribution, which is expressed as the mixture of a one‐point distribution and a proper prior distribution. In this paper, we develop an empirical Bayes approach for estimating area‐level means, using the uncertain prior distribution in the context of a natural exponential family, which we call the empirical uncertain Bayes (EUB) method. The regression model considered in this paper includes the Poisson‐gamma and the binomial‐beta, and the normal‐normal (Fay–Herriot) model, which are typically used in small area estimation. We obtain the estimators of hyperparameters based on the marginal likelihood by using a well‐known expectation‐maximization algorithm and propose the EUB estimators of area means. For risk evaluation of the EUB estimator, we derive a second‐order unbiased estimator of a conditional mean squared error by using some techniques of numerical calculation. Through simulation studies and real data applications, we evaluate a performance of the EUB estimator and compare it with the usual empirical Bayes estimator.     

Efficient closed-form maximum a posteriori estimators for the gamma distribution

We proposed a new class of maximum a posteriori estimators for the parameters of the Gamma distribution. These estimators have simple closed-form expressions and can be rewritten as a bias-corrected maximum likelihood estimators presented by Ye and Chen [Closed-form estimators for the gamma distribution derived from likelihood equations. Am Statist. 2017;71(2):177–181]. A simulation study was carried out to compare different estimation procedures. Numerical results revels that our new estimation scheme outperforms the existing closed-form estimators and produces extremely efficient estimates for both parameters, even for small sample sizes.     

Inference for Burr XII distribution under Type I progressive hybrid censoring

We consider estimation of unknown parameters of a Burr XII distribution based on progressively Type I hybrid censored data. The maximum likelihood estimates are obtained using an expectation maximization algorithm. Asymptotic interval estimates are constructed from the Fisher information matrix. We obtain Bayes estimates under the squared error loss function using the Lindley method and Metropolis–Hastings algorithm. The predictive estimates of censored observations are obtained and the corresponding prediction intervals are also constructed. We compare the performance of the different methods using simulations. Two real datasets have been analyzed for illustrative purposes.     

Reliability estimation in a multicomponent stress–strength model under generalized half-normal distribution based on progressive type-II censoring

In this paper, based on progressively Type-II censored samples, the problem of estimation of multicomponent stress–strength reliability under generalized half-normal (GHN) distribution is considered. The reliability of a k-component stress-strength system is estimated when both stress and strength variates are assumed to have a GHN distribution with various cases of same and different shape and scale parameters. Different methods such as the maximum likelihood estimates (MLEs) and Bayes estimation are discussed. The expectation maximization algorithm and approximate maximum likelihood methods are proposed to compute the MLE of reliability. The Lindley's approximation method, as well as Metropolis–Hastings algorithm, are applied to compute Bayes estimates. The performance of the proposed procedures is also demonstrated via a Monte Carlo simulation study and an illustrative example.